Fraunhofer HHI has put into operation, after several years of development, a volumetric video studio. Since that time, three professional commissioned productions have already been carried out in this studio. The studio, serves primarily as an experimental laboratory with the purpose to further develop the basic technology of “3D Human Body Reconstruction (3D HBR)” – an innovative procedure that enables a realistic authentic 3D image of moving persons in virtual worlds. The commercial use of the developed technology is therefore to be taken over, in the short term, by VoluCap GmbH (Volumetric Capture Studio Babelsberg GmbH) in Potsdam-Babelsberg.
The necessity to relocate the commercial production to a company is due in particular to the rapid market development of Virtual Reality (VR) and Augmented Reality (AR) and the high demand for volumetric video content resulting from this. The company formation enables the Fraunhofer HHI, as an institute for scientific research, to focus more intensively on the technical and scientific advancement of the HBR basic technology.
VoluCap GmbH was founded by the shareholders ARRI Cine Technik GmbH & Co. KG, Fraunhofer-Gesellschaft, Interlake System GmbH, Studio Babelsberg AG and UFA GmbH. The studio there will be put into operation as the first commercial volumetric video studio on the European continent in mid-2018.
As early as November 2017, the first professional commissioned production was carried out in the studio of Fraunhofer HHI. It is part of the VR experience “Ein ganzes Leben” (A Whole Life), which premiered at the Deutsche Kinemathek, the film and television museum in Berlin, with the special exhibition “Die Ufa - Geschichte einer Marke” (Ufa - History of a Brand). Additional productions from the volumetric video studio at Fraunhofer HHI will be presented to the public in several talks and presentations at this year’s Berlinale.
3D Human Body Reconstruction
The 3D Human Body Reconstruction technology captures real persons with multiple cameras at the same time and creates naturally moving dynamic 3D models, which can be observed from arbitrary viewpoints in the virtual scene.
The HBR capture system consists of 16 stereo cameras that create 3D information from all different viewpoints around the person, similar to how humans perceive with their two eyes. This information is fused and transformed to a consistent, natural and dynamic 3D representation of the person.
Post-processing modules adapt the data structures and formats and allow direct integration in standardized post-production workflows for VR and AR applications. In contrast to classical animation of virtual characters, facial expressions as well as moving clothes are captured from video information and reconstructed at high geometrical detail and texture quality.
This means that the maximum of naturalness of the visual impression is achieved and thus, the artificiality of avatars can be avoided. The complete workflow is fully automatic. Due to the standardized output format, further post-processing of the dynamic 3D model is possible.
Beyond the processing of dynamic 3D models, a novel integrated multi-camera and lighting system for full 360-degree acquisition of persons has been developed. The system enables a controlled, freely configurable and diffuse illumination of the persons, which allows both a subsequent synthetic illumination of the dynamic 3D-models in VR worlds (re-lighting), as well as a targeted dynamic scenic illumination with special lighting moods (campfire, blue light, etc.).
Anne Rommel | Fraunhofer-Institut für Nachrichtentechnik, Heinrich-Hertz-Institut, HHI
New Foldable Drone Flies through Narrow Holes in Rescue Missions
12.12.2018 | Universität Zürich
NIST's antenna evaluation method could help boost 5G network capacity and cut costs
11.12.2018 | National Institute of Standards and Technology (NIST)
Researchers from the University of Basel have reported a new method that allows the physical state of just a few atoms or molecules within a network to be controlled. It is based on the spontaneous self-organization of molecules into extensive networks with pores about one nanometer in size. In the journal ‘small’, the physicists reported on their investigations, which could be of particular importance for the development of new storage devices.
Around the world, researchers are attempting to shrink data storage devices to achieve as large a storage capacity in as small a space as possible. In almost...
The more objects we make "smart," from watches to entire buildings, the greater the need for these devices to store and retrieve massive amounts of data quickly without consuming too much power.
Millions of new memory cells could be part of a computer chip and provide that speed and energy savings, thanks to the discovery of a previously unobserved...
What if, instead of turning up the thermostat, you could warm up with high-tech, flexible patches sewn into your clothes - while significantly reducing your...
A widely used diabetes medication combined with an antihypertensive drug specifically inhibits tumor growth – this was discovered by researchers from the University of Basel’s Biozentrum two years ago. In a follow-up study, recently published in “Cell Reports”, the scientists report that this drug cocktail induces cancer cell death by switching off their energy supply.
The widely used anti-diabetes drug metformin not only reduces blood sugar but also has an anti-cancer effect. However, the metformin dose commonly used in the...
A research team from the University of Zurich has developed a new drone that can retract its propeller arms in flight and make itself small to fit through narrow gaps and holes. This is particularly useful when searching for victims of natural disasters.
Inspecting a damaged building after an earthquake or during a fire is exactly the kind of job that human rescuers would like drones to do for them. A flying...
12.12.2018 | Event News
10.12.2018 | Event News
06.12.2018 | Event News
17.12.2018 | Studies and Analyses
17.12.2018 | Life Sciences
17.12.2018 | Power and Electrical Engineering