Researchers at the Max Planck Institute for Intelligent Systems unveil new technology for motion and shape capture (MoSh) that helps animators jump the “Uncanny Valley” by turning a few moving dots into detailed body shapes that jiggle and deform like real humans.
Researchers at the Max Planck Institute for Intelligent Systems in Tübingen, Germany, announced today that their Motion and Shape Capture (MoSh) study, which appeared in the journal ACM Transactions on Graphics, will be presented at SIGGRAPH Asia (http://sa2014.siggraph.org/en/) in Shenzhen on December 6, 2014.
Devised by a team of researchers under the direction of Dr. Michael J. Black, Director of the Perceiving Systems department, MoSh is a method that allows animators to record the three-dimensional (3D) motion and shape of a real human and digitally “retarget” it to a new body shape. With MoSh, realistic virtual humans can populate games, the Internet, and virtual reality, while reducing animation costs for the special effects industry.
Current Motion Capture (mocap) technology uses dozens of high-speed cameras to capture 3D position and motion data from a few reflective markers attached to a person’s body and face. This marker data is then converted into a moving skeleton that controls a digital character, much like a puppeteer controls a puppet. Mocap is widely criticized because this can result in eerily lifeless animations. Consequently mocap serves as only a starting point for the time-consuming and expensive hand animation by experts who put life into the movements of animated characters..
MoSh changes this labor-intensive approach by using a sophisticated mathematical model of human shape and pose, which, is used to compute body shape and motion directly from the 3D marker positions. The MoSh approach lets mocap data be transferred to any new virtual shape automatically. For example, the researchers captured the motion of an elegant female salsa dancer and then changed the body shape to that of a giant ogre, making him look light on his feet. “We can take the motions of one body and simply transfer them to another body resulting in a realistic animation,” says Matthew Loper, the lead author of the study.
And, because MoSh does not rely on a skeletal approach to animation, the details of body shape – such as breathing, muscle flexing, fat jiggling – are retained from the mocap marker data. Current methods throw such important details away and rely on manual animation techniques to apply them after the fact.
“Everybody jiggles,” according to Black, adding: “we were surprised by how much information is present in so few markers. This means that existing motion capture data may contain a treasure trove of realistic performances that MoSh can bring to life.”
Naureen Mahmood, one of the co-authors of the study noted, “realistically rigging and animating a 3D body requires expertise. MoSh will let anyone use motion capture data to achieve results approaching professional animation quality.” This means that realistic digital humans may be coming to video games, training videos, and new virtual-reality headsets.
Opening up realistic human animation to new markets, Max Planck has licensed its technology to Body Labs (http://www.bodylabs.com), a technology company that transforms the human body into a digital platform from which goods and services can be designed, created, and sold. “MoSh has a host of applications,” says William O’Farrell, co-founder CEO of Body Labs. “The obvious application is enhancing the quality and reducing the cost of animations from mocap; but, we also see extensive uses in apparel. MoSh makes high-end effects accessible to the clothing industry and finally allows clothing designers and customers to easily visualize garments on realistic moving bodies.”
Loper, M.M., Mahmood, N. and Black, M.J., MoSh: Motion and Shape Capture from Sparse Markers, ACM Transactions on Graphics, (Proc. SIGGRAPH Asia), 33(6): 220:1-220:13, November 2014. doi: http://dx.doi.org/10.1145/2661229.2661273
Claudia Däfler | Max-Planck-Institut für Intelligente Systeme
Construction of practical quantum computers radically simplified
05.12.2016 | University of Sussex
UT professor develops algorithm to improve online mapping of disaster areas
29.11.2016 | University of Tennessee at Knoxville
In recent years, lasers with ultrashort pulses (USP) down to the femtosecond range have become established on an industrial scale. They could advance some applications with the much-lauded “cold ablation” – if that meant they would then achieve more throughput. A new generation of process engineering that will address this issue in particular will be discussed at the “4th UKP Workshop – Ultrafast Laser Technology” in April 2017.
Even back in the 1990s, scientists were comparing materials processing with nanosecond, picosecond and femtosesecond pulses. The result was surprising:...
Have you ever wondered how you see the world? Vision is about photons of light, which are packets of energy, interacting with the atoms or molecules in what...
A multi-institutional research collaboration has created a novel approach for fabricating three-dimensional micro-optics through the shape-defined formation of porous silicon (PSi), with broad impacts in integrated optoelectronics, imaging, and photovoltaics.
Working with colleagues at Stanford and The Dow Chemical Company, researchers at the University of Illinois at Urbana-Champaign fabricated 3-D birefringent...
In experiments with magnetic atoms conducted at extremely low temperatures, scientists have demonstrated a unique phase of matter: The atoms form a new type of quantum liquid or quantum droplet state. These so called quantum droplets may preserve their form in absence of external confinement because of quantum effects. The joint team of experimental physicists from Innsbruck and theoretical physicists from Hannover report on their findings in the journal Physical Review X.
“Our Quantum droplets are in the gas phase but they still drop like a rock,” explains experimental physicist Francesca Ferlaino when talking about the...
The Max Planck Institute for Physics (MPP) is opening up a new research field. A workshop from November 21 - 22, 2016 will mark the start of activities for an innovative axion experiment. Axions are still only purely hypothetical particles. Their detection could solve two fundamental problems in particle physics: What dark matter consists of and why it has not yet been possible to directly observe a CP violation for the strong interaction.
The “MADMAX” project is the MPP’s commitment to axion research. Axions are so far only a theoretical prediction and are difficult to detect: on the one hand,...
16.11.2016 | Event News
01.11.2016 | Event News
14.10.2016 | Event News
08.12.2016 | Life Sciences
08.12.2016 | Physics and Astronomy
08.12.2016 | Materials Sciences