Scientists at the Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute, HHI have developed a method by which the realistic image of a person can be transmitted into a virtual world. The 3D Human Body Reconstruction Technology captures real persons with multiple cameras at the same time and creates naturally moving dynamic 3D models. At this year’s trade fairs IFA in Berlin (Hall 11.1, Booth 3) and IBC in Amsterdam (Hall 8, Booth B80) Fraunhofer HHI will show this new technology.
Fraunhofer HHI researchers have developed a camera system that films people with a perfect three-dimensional impression. The core of this system is a stereo camera: Just as people do it with their two eyes, the camera records the person with two lenses.
This stereoscopic vision results in distances being estimated well, because both eyes look at an object from a slightly different angle. The result is a three-dimensional impression. Recording a person in detail from all directions takes more than one camera.
Fraunhofer HHI is currently using more than 20 stereo cameras to map a human. Each camera only captures a part of the person. The challenge is to merge the individual camera images together so that a realistic overall picture is produced.
The system includes more than just the camera technology. The researchers have developed algorithms that can quickly extract depth information from the stereoscopic camera images. This is necessary in order to calculate the 3D form of a captured person.
The computer calculates a virtual model of the human, which is then transferred into the virtual scene. The cameras perceive the surface shape with many details. In this way even small wrinkles, e.g. on the clothes of the person, can be shown. The model has a natural and realistic appearance.
Showing every gesture
The fusing of the 3D information from the various camera images takes a few seconds. The illusion is perfect, though. The system transmits the three-dimensional dynamic model of a person rapidly into virtual reality. A person can move freely in a dedicated capture area.
The virtual image portrays every gesture and movement realistically. The goal is that in the future a realistic image copy of a human is able to directly interact with the virtual world – for example, to let it grab virtual objects.
In the future, the new camera system is planned to be used for other application fields too. For example, the researchers work on a virtual video conferencing system. It could be used for infotainment applications as well.
Instead of a passive, frontal viewing experience, a television viewer could be directly involved in a movie scene via VR glasses. The viewer would not only see a three-dimensional image of the scene on the television, furthermore he could virtually walk around inside it, and, for example be a part of the adventures of his science fiction heroes.
Anne Rommel | Fraunhofer-Institut für Nachrichtentechnik Heinrich-Hertz-Institut
COMPAMED 2016 connected medical devices and people
23.11.2016 | IVAM Fachverband für Mikrotechnik
Successfully transferring Industrie 4.0 into reality
21.11.2016 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI
A multi-institutional research collaboration has created a novel approach for fabricating three-dimensional micro-optics through the shape-defined formation of porous silicon (PSi), with broad impacts in integrated optoelectronics, imaging, and photovoltaics.
Working with colleagues at Stanford and The Dow Chemical Company, researchers at the University of Illinois at Urbana-Champaign fabricated 3-D birefringent...
In experiments with magnetic atoms conducted at extremely low temperatures, scientists have demonstrated a unique phase of matter: The atoms form a new type of quantum liquid or quantum droplet state. These so called quantum droplets may preserve their form in absence of external confinement because of quantum effects. The joint team of experimental physicists from Innsbruck and theoretical physicists from Hannover report on their findings in the journal Physical Review X.
“Our Quantum droplets are in the gas phase but they still drop like a rock,” explains experimental physicist Francesca Ferlaino when talking about the...
The Max Planck Institute for Physics (MPP) is opening up a new research field. A workshop from November 21 - 22, 2016 will mark the start of activities for an innovative axion experiment. Axions are still only purely hypothetical particles. Their detection could solve two fundamental problems in particle physics: What dark matter consists of and why it has not yet been possible to directly observe a CP violation for the strong interaction.
The “MADMAX” project is the MPP’s commitment to axion research. Axions are so far only a theoretical prediction and are difficult to detect: on the one hand,...
Broadband rotational spectroscopy unravels structural reshaping of isolated molecules in the gas phase to accommodate water
In two recent publications in the Journal of Chemical Physics and in the Journal of Physical Chemistry Letters, researchers around Melanie Schnell from the Max...
The efficiency of power electronic systems is not solely dependent on electrical efficiency but also on weight, for example, in mobile systems. When the weight of relevant components and devices in airplanes, for instance, is reduced, fuel savings can be achieved and correspondingly greenhouse gas emissions decreased. New materials and components based on gallium nitride (GaN) can help to reduce weight and increase the efficiency. With these new materials, power electronic switches can be operated at higher switching frequency, resulting in higher power density and lower material costs.
Researchers at the Fraunhofer Institute for Solar Energy Systems ISE together with partners have investigated how these materials can be used to make power...
16.11.2016 | Event News
01.11.2016 | Event News
14.10.2016 | Event News
02.12.2016 | Medical Engineering
02.12.2016 | Agricultural and Forestry Science
02.12.2016 | Physics and Astronomy