Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Body Talk: A New Crowdshaping Technology Uses Words to Create Accurate 3D Body Models

27.07.2016

New alternatives to 3D body scanning

Researchers from the Max Planck Institute for Intelligent Systems and the University of Texas at Dallas, revealed new crowdshaping technology at SIGGRAPH 2016 that creates accurate 3D body models from 2D photos using crowdsourced linguistic descriptions of body shape.


Body Talk on YouTube

The Body Talk system takes a single photo and produces 3D body shapes that look like the person and are accurate enough to size clothing. It does this using the help of 15 volunteers who rate the body shape in the photo using 30 words or fewer. The researchers believe this technology has applications in online shopping, gaming, virtual reality and healthcare.

“High-end scanners and their lower-cost alternatives have yet to become ubiquitous in consumer technology,” said Dr. Michael J. Black, Director of the Perceiving Systems Department at the Max Planck Institute for Intelligent Systems. “Capturing 3D body shape remains a challenge, and our goal is to make it easy and fun. Our research shows that people have a shared understanding of body shape that is expressed in our use of language”.

Body Talk on YouTube: https://www.youtube.com/watch?v=x6F22RFO9HU&feature=youtu.be

The system uses machine learning to discover this relationship between our verbal descriptions of bodies and their actual 3D shape. ``Language provides rich descriptions of body features related to gender, physical strength, attractiveness, and health“ said Dr. Alice J. O’Toole, Professor in the School of Behavioral and Brain Sciences at the University of Texas at Dallas.

`What is surprising is that language captures 3D shape so accurately and that the collective judgment of the “crowd” can be used to create realistic avatars. This process of crowdshaping opens up a practical way to scan bodies without a scanner” said Dr. Stephan Streuber, the lead author of the study. In the paper, Body Talk: Crowdshaping Realistic 3D Avatars with Words, the researchers found that realistic 3D bodies could be created using as few as ten words.

They demonstrated a “3D paparazzi” application that takes a single photo of a celebrity, has it rated by 15 people, and then creates a 3D avatar of the celebrity that can be animated. They further showed that they can extract measurements from the crowdshaped bodies with an accuracy sufficient for many clothing sizing applications. They even create 3D avatars of characters from books using just the written description.

“When scanning technology is unavailable or inapplicable, Body Talk can be used to visualize mental representations of human body shape,” said Dr. Black. “This system can be used in many areas of science and medicine, for example in studies of body perception disorders, obesity, or cross-cultural attitudes about body shape.”

Full paper: Streuber, S., Quiros-Ramirez, M., Hill, M., Hahn, C., Zuffi, S., O’Toole, A., Black, M. J. “Body Talk: Crowdshaping Realistic 3D Avatars with Words,” ACM Transactions on Graphics (Proc. SIGGRAPH), 35(4):54:1-54:14, July 2016

Weitere Informationen:

Body Talk System: http://bodytalk.is.tue.mpg.de
Press Material: http://bodytalk.is.tue.mpg.de/press
Perceiving Systems at MPI-IS: https://ps.is.tuebingen.mpg.de
Contact: https://is.tuebingen.mpg.de/contact (Claudia Daefler)

Claudia Däfler | Max-Planck-Institut für Intelligente Systeme

More articles from Interdisciplinary Research:

nachricht Stanford researchers create a wireless, battery-free, biodegradable blood flow sensor
09.01.2019 | Stanford University

nachricht Description of rotating molecules made easy
21.12.2018 | Institute of Science and Technology Austria

All articles from Interdisciplinary Research >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Ten-year anniversary of the Neumayer Station III

The scientific and political community alike stress the importance of German Antarctic research

Joint Press Release from the BMBF and AWI

The Antarctic is a frigid continent south of the Antarctic Circle, where researchers are the only inhabitants. Despite the hostile conditions, here the Alfred...

Im Focus: Ultra ultrasound to transform new tech

World first experiments on sensor that may revolutionise everything from medical devices to unmanned vehicles

The new sensor - capable of detecting vibrations of living cells - may revolutionise everything from medical devices to unmanned vehicles.

Im Focus: Flying Optical Cats for Quantum Communication

Dead and alive at the same time? Researchers at the Max Planck Institute of Quantum Optics have implemented Erwin Schrödinger’s paradoxical gedanken experiment employing an entangled atom-light state.

In 1935 Erwin Schrödinger formulated a thought experiment designed to capture the paradoxical nature of quantum physics. The crucial element of this gedanken...

Im Focus: Nanocellulose for novel implants: Ears from the 3D-printer

Cellulose obtained from wood has amazing material properties. Empa researchers are now equipping the biodegradable material with additional functionalities to produce implants for cartilage diseases using 3D printing.

It all starts with an ear. Empa researcher Michael Hausmann removes the object shaped like a human ear from the 3D printer and explains:

Im Focus: Elucidating the Atomic Mechanism of Superlubricity

The phenomenon of so-called superlubricity is known, but so far the explanation at the atomic level has been missing: for example, how does extremely low friction occur in bearings? Researchers from the Fraunhofer Institutes IWM and IWS jointly deciphered a universal mechanism of superlubricity for certain diamond-like carbon layers in combination with organic lubricants. Based on this knowledge, it is now possible to formulate design rules for supra lubricating layer-lubricant combinations. The results are presented in an article in Nature Communications, volume 10.

One of the most important prerequisites for sustainable and environmentally friendly mobility is minimizing friction. Research and industry have been dedicated...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

Our digital society in 2040

16.01.2019 | Event News

11th International Symposium: “Advanced Battery Power – Kraftwerk Batterie” Aachen, 3-4 April 2019

14.01.2019 | Event News

ICTM Conference 2019: Digitization emerges as an engineering trend for turbomachinery construction

12.12.2018 | Event News

 
Latest News

Additive manufacturing reflects fundamental metallurgical principles to create materials

18.01.2019 | Materials Sciences

How molecules teeter in a laser field

18.01.2019 | Life Sciences

The cytoskeleton of neurons has been found to be involved in Alzheimer's disease

18.01.2019 | Health and Medicine

VideoLinks
Science & Research
Overview of more VideoLinks >>>