Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Body Talk: A New Crowdshaping Technology Uses Words to Create Accurate 3D Body Models

27.07.2016

New alternatives to 3D body scanning

Researchers from the Max Planck Institute for Intelligent Systems and the University of Texas at Dallas, revealed new crowdshaping technology at SIGGRAPH 2016 that creates accurate 3D body models from 2D photos using crowdsourced linguistic descriptions of body shape.


Body Talk on YouTube

The Body Talk system takes a single photo and produces 3D body shapes that look like the person and are accurate enough to size clothing. It does this using the help of 15 volunteers who rate the body shape in the photo using 30 words or fewer. The researchers believe this technology has applications in online shopping, gaming, virtual reality and healthcare.

“High-end scanners and their lower-cost alternatives have yet to become ubiquitous in consumer technology,” said Dr. Michael J. Black, Director of the Perceiving Systems Department at the Max Planck Institute for Intelligent Systems. “Capturing 3D body shape remains a challenge, and our goal is to make it easy and fun. Our research shows that people have a shared understanding of body shape that is expressed in our use of language”.

Body Talk on YouTube: https://www.youtube.com/watch?v=x6F22RFO9HU&feature=youtu.be

The system uses machine learning to discover this relationship between our verbal descriptions of bodies and their actual 3D shape. ``Language provides rich descriptions of body features related to gender, physical strength, attractiveness, and health“ said Dr. Alice J. O’Toole, Professor in the School of Behavioral and Brain Sciences at the University of Texas at Dallas.

`What is surprising is that language captures 3D shape so accurately and that the collective judgment of the “crowd” can be used to create realistic avatars. This process of crowdshaping opens up a practical way to scan bodies without a scanner” said Dr. Stephan Streuber, the lead author of the study. In the paper, Body Talk: Crowdshaping Realistic 3D Avatars with Words, the researchers found that realistic 3D bodies could be created using as few as ten words.

They demonstrated a “3D paparazzi” application that takes a single photo of a celebrity, has it rated by 15 people, and then creates a 3D avatar of the celebrity that can be animated. They further showed that they can extract measurements from the crowdshaped bodies with an accuracy sufficient for many clothing sizing applications. They even create 3D avatars of characters from books using just the written description.

“When scanning technology is unavailable or inapplicable, Body Talk can be used to visualize mental representations of human body shape,” said Dr. Black. “This system can be used in many areas of science and medicine, for example in studies of body perception disorders, obesity, or cross-cultural attitudes about body shape.”

Full paper: Streuber, S., Quiros-Ramirez, M., Hill, M., Hahn, C., Zuffi, S., O’Toole, A., Black, M. J. “Body Talk: Crowdshaping Realistic 3D Avatars with Words,” ACM Transactions on Graphics (Proc. SIGGRAPH), 35(4):54:1-54:14, July 2016

Weitere Informationen:

Body Talk System: http://bodytalk.is.tue.mpg.de
Press Material: http://bodytalk.is.tue.mpg.de/press
Perceiving Systems at MPI-IS: https://ps.is.tuebingen.mpg.de
Contact: https://is.tuebingen.mpg.de/contact (Claudia Daefler)

Claudia Däfler | Max-Planck-Institut für Intelligente Systeme

More articles from Interdisciplinary Research:

nachricht The Internet of Things: TU Graz researchers increase the dependability of smart systems
18.02.2019 | Technische Universität Graz

nachricht Stanford researchers create a wireless, battery-free, biodegradable blood flow sensor
09.01.2019 | Stanford University

All articles from Interdisciplinary Research >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Stellar cartography

The Potsdam Echelle Polarimetric and Spectroscopic Instrument (PEPSI) at the Large Binocular Telescope (LBT) in Arizona released its first image of the surface magnetic field of another star. In a paper in the European journal Astronomy & Astrophysics, the PEPSI team presents a Zeeman- Doppler-Image of the surface of the magnetically active star II Pegasi.

A special technique allows astronomers to resolve the surfaces of faraway stars. Those are otherwise only seen as point sources, even in the largest telescopes...

Im Focus: Heading towards a tsunami of light

Researchers at Chalmers University of Technology and the University of Gothenburg, Sweden, have proposed a way to create a completely new source of radiation. Ultra-intense light pulses consist of the motion of a single wave and can be described as a tsunami of light. The strong wave can be used to study interactions between matter and light in a unique way. Their research is now published in the scientific journal Physical Review Letters.

"This source of radiation lets us look at reality through a new angle - it is like twisting a mirror and discovering something completely different," says...

Im Focus: Revealing the secret of the vacuum for the first time

New research group at the University of Jena combines theory and experiment to demonstrate for the first time certain physical processes in a quantum vacuum

For most people, a vacuum is an empty space. Quantum physics, on the other hand, assumes that even in this lowest-energy state, particles and antiparticles...

Im Focus: Sussex scientists one step closer to a clock that could replace GPS and Galileo

Physicists in the EPic Lab at University of Sussex make crucial development in global race to develop a portable atomic clock

Scientists in the Emergent Photonics Lab (EPic Lab) at the University of Sussex have made a breakthrough to a crucial element of an atomic clock - devices...

Im Focus: Sensing shakes

A new way to sense earthquakes could help improve early warning systems

Every year earthquakes worldwide claim hundreds or even thousands of lives. Forewarning allows people to head for safety and a matter of seconds could spell...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

International Modelica Conference with 330 visitors from 21 countries at OTH Regensburg

11.03.2019 | Event News

Selection Completed: 580 Young Scientists from 88 Countries at the Lindau Nobel Laureate Meeting

01.03.2019 | Event News

LightMAT 2019 – 3rd International Conference on Light Materials – Science and Technology

28.02.2019 | Event News

 
Latest News

Levitating objects with light

19.03.2019 | Physics and Astronomy

New technique for in-cell distance determination

19.03.2019 | Life Sciences

Stellar cartography

19.03.2019 | Physics and Astronomy

VideoLinks
Science & Research
Overview of more VideoLinks >>>