Scientists at the Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute, HHI have developed a method by which the realistic image of a person can be transmitted into a virtual world. The 3D Human Body Reconstruction Technology captures real persons with multiple cameras at the same time and creates naturally moving dynamic 3D models. At this year’s trade fairs IFA in Berlin (Hall 11.1, Booth 3) and IBC in Amsterdam (Hall 8, Booth B80) Fraunhofer HHI will show this new technology.
Fraunhofer HHI researchers have developed a camera system that films people with a perfect three-dimensional impression. The core of this system is a stereo camera: Just as people do it with their two eyes, the camera records the person with two lenses.
This stereoscopic vision results in distances being estimated well, because both eyes look at an object from a slightly different angle. The result is a three-dimensional impression. Recording a person in detail from all directions takes more than one camera.
Fraunhofer HHI is currently using more than 20 stereo cameras to map a human. Each camera only captures a part of the person. The challenge is to merge the individual camera images together so that a realistic overall picture is produced.
The system includes more than just the camera technology. The researchers have developed algorithms that can quickly extract depth information from the stereoscopic camera images. This is necessary in order to calculate the 3D form of a captured person.
The computer calculates a virtual model of the human, which is then transferred into the virtual scene. The cameras perceive the surface shape with many details. In this way even small wrinkles, e.g. on the clothes of the person, can be shown. The model has a natural and realistic appearance.
Showing every gesture
The fusing of the 3D information from the various camera images takes a few seconds. The illusion is perfect, though. The system transmits the three-dimensional dynamic model of a person rapidly into virtual reality. A person can move freely in a dedicated capture area.
The virtual image portrays every gesture and movement realistically. The goal is that in the future a realistic image copy of a human is able to directly interact with the virtual world – for example, to let it grab virtual objects.
In the future, the new camera system is planned to be used for other application fields too. For example, the researchers work on a virtual video conferencing system. It could be used for infotainment applications as well.
Instead of a passive, frontal viewing experience, a television viewer could be directly involved in a movie scene via VR glasses. The viewer would not only see a three-dimensional image of the scene on the television, furthermore he could virtually walk around inside it, and, for example be a part of the adventures of his science fiction heroes.
Anne Rommel | Fraunhofer-Institut für Nachrichtentechnik Heinrich-Hertz-Institut
New Process Technology Unlocks Boost in Laser Productivity
18.05.2017 | Fraunhofer-Institut für Lasertechnik ILT
OLED microdisplays as high-precision optical fingerprint sensors
09.05.2017 | Fraunhofer-Institut für Organische Elektronik, Elektronenstrahl- und Plasmatechnik FEP
Staphylococcus aureus is a feared pathogen (MRSA, multi-resistant S. aureus) due to frequent resistances against many antibiotics, especially in hospital infections. Researchers at the Paul-Ehrlich-Institut have identified immunological processes that prevent a successful immune response directed against the pathogenic agent. The delivery of bacterial proteins with RNA adjuvant or messenger RNA (mRNA) into immune cells allows the re-direction of the immune response towards an active defense against S. aureus. This could be of significant importance for the development of an effective vaccine. PLOS Pathogens has published these research results online on 25 May 2017.
Staphylococcus aureus (S. aureus) is a bacterium that colonizes by far more than half of the skin and the mucosa of adults, usually without causing infections....
Physicists from the University of Würzburg are capable of generating identical looking single light particles at the push of a button. Two new studies now demonstrate the potential this method holds.
The quantum computer has fuelled the imagination of scientists for decades: It is based on fundamentally different phenomena than a conventional computer....
An international team of physicists has monitored the scattering behaviour of electrons in a non-conducting material in real-time. Their insights could be beneficial for radiotherapy.
We can refer to electrons in non-conducting materials as ‘sluggish’. Typically, they remain fixed in a location, deep inside an atomic composite. It is hence...
Two-dimensional magnetic structures are regarded as a promising material for new types of data storage, since the magnetic properties of individual molecular building blocks can be investigated and modified. For the first time, researchers have now produced a wafer-thin ferrimagnet, in which molecules with different magnetic centers arrange themselves on a gold surface to form a checkerboard pattern. Scientists at the Swiss Nanoscience Institute at the University of Basel and the Paul Scherrer Institute published their findings in the journal Nature Communications.
Ferrimagnets are composed of two centers which are magnetized at different strengths and point in opposing directions. Two-dimensional, quasi-flat ferrimagnets...
An Australian-Chinese research team has created the world's thinnest hologram, paving the way towards the integration of 3D holography into everyday...
24.05.2017 | Event News
23.05.2017 | Event News
22.05.2017 | Event News
26.05.2017 | Life Sciences
26.05.2017 | Life Sciences
26.05.2017 | Physics and Astronomy