Body Talk: A New Crowdshaping Technology Uses Words to Create Accurate 3D Body Models

Body Talk on YouTube

Researchers from the Max Planck Institute for Intelligent Systems and the University of Texas at Dallas, revealed new crowdshaping technology at SIGGRAPH 2016 that creates accurate 3D body models from 2D photos using crowdsourced linguistic descriptions of body shape.

The Body Talk system takes a single photo and produces 3D body shapes that look like the person and are accurate enough to size clothing. It does this using the help of 15 volunteers who rate the body shape in the photo using 30 words or fewer. The researchers believe this technology has applications in online shopping, gaming, virtual reality and healthcare.

“High-end scanners and their lower-cost alternatives have yet to become ubiquitous in consumer technology,” said Dr. Michael J. Black, Director of the Perceiving Systems Department at the Max Planck Institute for Intelligent Systems. “Capturing 3D body shape remains a challenge, and our goal is to make it easy and fun. Our research shows that people have a shared understanding of body shape that is expressed in our use of language”.

Body Talk on YouTube: https://www.youtube.com/watch?v=x6F22RFO9HU&feature=youtu.be

The system uses machine learning to discover this relationship between our verbal descriptions of bodies and their actual 3D shape. “Language provides rich descriptions of body features related to gender, physical strength, attractiveness, and health“ said Dr. Alice J. O’Toole, Professor in the School of Behavioral and Brain Sciences at the University of Texas at Dallas.

`What is surprising is that language captures 3D shape so accurately and that the collective judgment of the “crowd” can be used to create realistic avatars. This process of crowdshaping opens up a practical way to scan bodies without a scanner” said Dr. Stephan Streuber, the lead author of the study. In the paper, Body Talk: Crowdshaping Realistic 3D Avatars with Words, the researchers found that realistic 3D bodies could be created using as few as ten words.

They demonstrated a “3D paparazzi” application that takes a single photo of a celebrity, has it rated by 15 people, and then creates a 3D avatar of the celebrity that can be animated. They further showed that they can extract measurements from the crowdshaped bodies with an accuracy sufficient for many clothing sizing applications. They even create 3D avatars of characters from books using just the written description.

“When scanning technology is unavailable or inapplicable, Body Talk can be used to visualize mental representations of human body shape,” said Dr. Black. “This system can be used in many areas of science and medicine, for example in studies of body perception disorders, obesity, or cross-cultural attitudes about body shape.”

Full paper: Streuber, S., Quiros-Ramirez, M., Hill, M., Hahn, C., Zuffi, S., O’Toole, A., Black, M. J. “Body Talk: Crowdshaping Realistic 3D Avatars with Words,” ACM Transactions on Graphics (Proc. SIGGRAPH), 35(4):54:1-54:14, July 2016

Weitere Informationen:

Body Talk System: http://bodytalk.is.tue.mpg.de
Press Material: http://bodytalk.is.tue.mpg.de/press
Perceiving Systems at MPI-IS: https://ps.is.tuebingen.mpg.de
Contact: https://is.tuebingen.mpg.de/contact (Claudia Daefler)

Media Contact

Claudia Däfler Max-Planck-Institut für Intelligente Systeme

All latest news from the category: Interdisciplinary Research

News and developments from the field of interdisciplinary research.

Among other topics, you can find stimulating reports and articles related to microsystems, emotions research, futures research and stratospheric research.

Back to home

Comments (0)

Write a comment

Newest articles

Results for control of pollutants in water

Brazilian scientists tested a simple and sustainable method for monitoring and degrading a mixture of polycyclic aromatic hydrocarbons, compounds present in fossil fuels and industrial waste. An article published in the journal Catalysis…

A tandem approach for better solar cells

Perovskite-based solar cells were first proved in 2009 to have excellent light-absorbing properties of methylammonium lead bromide and methylammonium lead iodide, collectively referred to as lead halide perovskites or, more…

The behavior of ant queens is shaped by their social environment

Specialization of ant queens as mere egg-layers is reversible / Queen behavioral specialization is initiated and maintained by the presence of workers. The queens in colonies of social insects, such…

Partners & Sponsors