Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

4D Movies Capture every Jiggle, Creating Realistic Digital Avatars (w /video)

11.08.2015

Researchers at the Max Planck Institute for Intelligent Systems unveil the world’s first high-resolution 4D body scanner and software to model detailed soft-tissue motion.

“Everybody jiggles” according to Dr. Michael Black, Director at the Max Planck Institute for Intelligent Systems (MPI-IS) in Tübingen, Germany. “We may not like it, but how we jiggle says a lot about who we are. Our soft tissue (otherwise known as fat and muscle) deforms, wobbles, waves, and bounces as we move.


Dyna allows soft-tissue retargeting. Left: the dynamics are transferred from a heavy male to an „ogre“, Right: the dynamics of a heavy female to a thin „office worker“.

Perceiving Systems Department

These motions may provide clues about our risk for cardiovascular disease and diabetes. They also make us look real. Digital characters either lack natural soft-tissue motion or require time-consuming animation to make them believable”. Now researchers at MPI-IS have captured people and how people jiggle in exacting detail and have created realistic 3D avatars that bring natural body motions to digital characters.

To put jiggling under a microscope, the researchers needed a new type of scanner to capture 3D body shape as it is deforming. Most body scanners capture the static shape of the body. The new MPI-IS scanner is actually made of 66 cameras and special projectors that shine a speckled pattern on a subject’s body.

The system uses stereo, something like what human’s do to see depth but, in this case, with 66 eyes. Dr. Javier Romero, a research scientist at MPI-IS, says "the system captures high-speed '4D movies' of 3D body shape, where the 4th dimension is time".

The system captures 3D body shapes with about 150,000 3D points 60 times a second. According to Romero, this level of detail "shows ripples and waves propagating through soft tissue,” i.e. jiggle. The system is the world’s first full-body 4D scanner and was custom built by 3dMD Systems (http://www.3dmd.com), a leader in medical grade scanning systems.

"To analyze the data", Black says "it must first be put into correspondence.” The researchers take an average 3D body shape and deform it to match every frame in the 4D movie. The process, called 4Cap, tracks points on the body across time enabling their motion to be analyzed. Romero says that "this is similar to motion capture, or 'mocap' ”, commonly used in the animation industry except that mocap systems typically track around 50 points on the body using special markers while 4Cap tracks 15,000 points without any markers.

With this data, Dr. Gerard Pons-Moll, a post doctoral researcher at MPI-IS has created Dyna, a method to make highly-realistic 3D avatars that move and jiggle like real people. Soft-tissue motions are critical to creating believable characters that look alive. “If it doesn’t jiggle it’s not human,” says Pons-Moll. Applying machine learning algorithms, the team measured the statistics of soft tissue motion and how these motions vary from person to person. Depending on the body-mass index (BMI) of the avatar, their soft tissue will move differently.

“Because Dyna is a mathematic model, we can apply it to fantasy characters as well,” says Pons-Moll. Dyna can take the jiggle of a heavy-set person and transfer it to a thin person or an ogre, troll, or other cartoon character. Previous animation methods required complex physics simulations. Dyna simplifies this and is efficient to use in animating characters for movies or games. Animators can even edit the motions to exaggerate effects or change how a body deforms.

Dyna is not just for games but might one day be used in your doctor’s office. “How your fat jiggles provides information about where it is located and whether it is dangerous,” says Black. By tracking, modeling, and analyzing body fat in motion, Black sees the opportunity to non-invasively get an idea of what is under our skin. One day determining your risk for heart disease or diabetes might involve jumping around in front of a camera.

The work is being presented this week at ACM SIGGRAPH in Los Angeles. SIGGRAPH is the leading conference for research in computer graphics.

Weitere Informationen:

http://ps.is.tuebingen.mpg.de
http://dyna.is.tue.mpg.de
https://www.youtube.com/watch?v=mWthea2K8-Q
https://www.youtube.com/watch?v=AjZ24UbwvLU (supplemental material)

Claudia Däfler | Max-Planck-Institut für Intelligente Systeme

More articles from Information Technology:

nachricht Next stop Morocco: EU partners test innovative space robotics technologies in the Sahara desert
09.11.2018 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI

nachricht A burst of ”synchronous” light
08.11.2018 | Empa - Eidgenössische Materialprüfungs- und Forschungsanstalt

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: A Chip with Blood Vessels

Biochips have been developed at TU Wien (Vienna), on which tissue can be produced and examined. This allows supplying the tissue with different substances in a very controlled way.

Cultivating human cells in the Petri dish is not a big challenge today. Producing artificial tissue, however, permeated by fine blood vessels, is a much more...

Im Focus: A Leap Into Quantum Technology

Faster and secure data communication: This is the goal of a new joint project involving physicists from the University of Würzburg. The German Federal Ministry of Education and Research funds the project with 14.8 million euro.

In our digital world data security and secure communication are becoming more and more important. Quantum communication is a promising approach to achieve...

Im Focus: Research icebreaker Polarstern begins the Antarctic season

What does it look like below the ice shelf of the calved massive iceberg A68?

On Saturday, 10 November 2018, the research icebreaker Polarstern will leave its homeport of Bremerhaven, bound for Cape Town, South Africa.

Im Focus: Penn engineers develop ultrathin, ultralight 'nanocardboard'

When choosing materials to make something, trade-offs need to be made between a host of properties, such as thickness, stiffness and weight. Depending on the application in question, finding just the right balance is the difference between success and failure

Now, a team of Penn Engineers has demonstrated a new material they call "nanocardboard," an ultrathin equivalent of corrugated paper cardboard. A square...

Im Focus: Coping with errors in the quantum age

Physicists at ETH Zurich demonstrate how errors that occur during the manipulation of quantum system can be monitored and corrected on the fly

The field of quantum computation has seen tremendous progress in recent years. Bit by bit, quantum devices start to challenge conventional computers, at least...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

“3rd Conference on Laser Polishing – LaP 2018” Attracts International Experts and Users

09.11.2018 | Event News

On the brain’s ability to find the right direction

06.11.2018 | Event News

European Space Talks: Weltraumschrott – eine Gefahr für die Gesellschaft?

23.10.2018 | Event News

 
Latest News

Epoxy compound gets a graphene bump

14.11.2018 | Materials Sciences

Microgel powder fights infection and helps wounds heal

14.11.2018 | Health and Medicine

How algae and carbon fibers could sustainably reduce the athmospheric carbon dioxide concentration

14.11.2018 | Life Sciences

VideoLinks
Science & Research
Overview of more VideoLinks >>>