Scientists at the Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute, HHI have developed a method by which the realistic image of a person can be transmitted into a virtual world. The 3D Human Body Reconstruction Technology captures real persons with multiple cameras at the same time and creates naturally moving dynamic 3D models. At this year’s trade fairs IFA in Berlin (Hall 11.1, Booth 3) and IBC in Amsterdam (Hall 8, Booth B80) Fraunhofer HHI will show this new technology.
Fraunhofer HHI researchers have developed a camera system that films people with a perfect three-dimensional impression. The core of this system is a stereo camera: Just as people do it with their two eyes, the camera records the person with two lenses.
This stereoscopic vision results in distances being estimated well, because both eyes look at an object from a slightly different angle. The result is a three-dimensional impression. Recording a person in detail from all directions takes more than one camera.
Fraunhofer HHI is currently using more than 20 stereo cameras to map a human. Each camera only captures a part of the person. The challenge is to merge the individual camera images together so that a realistic overall picture is produced.
The system includes more than just the camera technology. The researchers have developed algorithms that can quickly extract depth information from the stereoscopic camera images. This is necessary in order to calculate the 3D form of a captured person.
The computer calculates a virtual model of the human, which is then transferred into the virtual scene. The cameras perceive the surface shape with many details. In this way even small wrinkles, e.g. on the clothes of the person, can be shown. The model has a natural and realistic appearance.
Showing every gesture
The fusing of the 3D information from the various camera images takes a few seconds. The illusion is perfect, though. The system transmits the three-dimensional dynamic model of a person rapidly into virtual reality. A person can move freely in a dedicated capture area.
The virtual image portrays every gesture and movement realistically. The goal is that in the future a realistic image copy of a human is able to directly interact with the virtual world – for example, to let it grab virtual objects.
In the future, the new camera system is planned to be used for other application fields too. For example, the researchers work on a virtual video conferencing system. It could be used for infotainment applications as well.
Instead of a passive, frontal viewing experience, a television viewer could be directly involved in a movie scene via VR glasses. The viewer would not only see a three-dimensional image of the scene on the television, furthermore he could virtually walk around inside it, and, for example be a part of the adventures of his science fiction heroes.
Anne Rommel | Fraunhofer-Institut für Nachrichtentechnik Heinrich-Hertz-Institut
Creating living spaces for people: The »Fraunhofer CityLaboratory« at BAU 2017
14.10.2016 | Fraunhofer-Gesellschaft
Reducing Weight through Laser-assisted Material Processing in Automobile Construction
13.10.2016 | Fraunhofer-Institut für Lasertechnik ILT
Researchers from the Institute for Quantum Computing (IQC) at the University of Waterloo led the development of a new extensible wiring technique capable of controlling superconducting quantum bits, representing a significant step towards to the realization of a scalable quantum computer.
"The quantum socket is a wiring method that uses three-dimensional wires based on spring-loaded pins to address individual qubits," said Jeremy Béjanin, a PhD...
In a paper in Scientific Reports, a research team at Worcester Polytechnic Institute describes a novel light-activated phenomenon that could become the basis for applications as diverse as microscopic robotic grippers and more efficient solar cells.
A research team at Worcester Polytechnic Institute (WPI) has developed a revolutionary, light-activated semiconductor nanocomposite material that can be used...
By forcefully embedding two silicon atoms in a diamond matrix, Sandia researchers have demonstrated for the first time on a single chip all the components needed to create a quantum bridge to link quantum computers together.
"People have already built small quantum computers," says Sandia researcher Ryan Camacho. "Maybe the first useful one won't be a single giant quantum computer...
COMPAMED has become the leading international marketplace for suppliers of medical manufacturing. The trade fair, which takes place every November and is co-located to MEDICA in Dusseldorf, has been steadily growing over the past years and shows that medical technology remains a rapidly growing market.
In 2016, the joint pavilion by the IVAM Microtechnology Network, the Product Market “High-tech for Medical Devices”, will be located in Hall 8a again and will...
'Ferroelectric' materials can switch between different states of electrical polarization in response to an external electric field. This flexibility means they show promise for many applications, for example in electronic devices and computer memory. Current ferroelectric materials are highly valued for their thermal and chemical stability and rapid electro-mechanical responses, but creating a material that is scalable down to the tiny sizes needed for technologies like silicon-based semiconductors (Si-based CMOS) has proven challenging.
Now, Hiroshi Funakubo and co-workers at the Tokyo Institute of Technology, in collaboration with researchers across Japan, have conducted experiments to...
14.10.2016 | Event News
14.10.2016 | Event News
12.10.2016 | Event News
21.10.2016 | Health and Medicine
21.10.2016 | Information Technology
21.10.2016 | Materials Sciences