Forum for Science, Industry and Business

Fraunhofer HHI put into operation first volumetric video studio on the European continent

The necessity to relocate the commercial production to a company is due in particular to the rapid market development of Virtual Reality (VR) and Augmented Reality (AR) and the high demand for volumetric video content resulting from this. The company formation enables the Fraunhofer HHI, as an institute for scientific research, to focus more intensively on the technical and scientific advancement of the HBR basic technology.

Fraunhofer HHI put into operation first volumetric video studio on the European continent

© Fraunhofer HHI

VoluCap GmbH was founded by the shareholders ARRI Cine Technik GmbH & Co. KG, Fraunhofer-Gesellschaft, Interlake System GmbH, Studio Babelsberg AG and UFA GmbH. The studio there will be put into operation as the first commercial volumetric video studio on the European continent in mid-2018.

As early as November 2017, the first professional commissioned production was carried out in the studio of Fraunhofer HHI. It is part of the VR experience “Ein ganzes Leben” (A Whole Life), which premiered at the Deutsche Kinemathek, the film and television museum in Berlin, with the special exhibition “Die Ufa - Geschichte einer Marke” (Ufa - History of a Brand). Additional productions from the volumetric video studio at Fraunhofer HHI will be presented to the public in several talks and presentations at this year’s Berlinale.

3D Human Body Reconstruction

The 3D Human Body Reconstruction technology captures real persons with multiple cameras at the same time and creates naturally moving dynamic 3D models, which can be observed from arbitrary viewpoints in the virtual scene.

The HBR capture system consists of 16 stereo cameras that create 3D information from all different viewpoints around the person, similar to how humans perceive with their two eyes. This information is fused and transformed to a consistent, natural and dynamic 3D representation of the person.

Post-processing modules adapt the data structures and formats and allow direct integration in standardized post-production workflows for VR and AR applications. In contrast to classical animation of virtual characters, facial expressions as well as moving clothes are captured from video information and reconstructed at high geometrical detail and texture quality.

This means that the maximum of naturalness of the visual impression is achieved and thus, the artificiality of avatars can be avoided. The complete workflow is fully automatic. Due to the standardized output format, further post-processing of the dynamic 3D model is possible.

Beyond the processing of dynamic 3D models, a novel integrated multi-camera and lighting system for full 360-degree acquisition of persons has been developed. The system enables a controlled, freely configurable and diffuse illumination of the persons, which allows both a subsequent synthetic illumination of the dynamic 3D-models in VR worlds (re-lighting), as well as a targeted dynamic scenic illumination with special lighting moods (campfire, blue light, etc.).

Weitere Informationen:

https://www.hhi.fraunhofer.de/en/press-media/press-releases.html

Anne Rommel | Fraunhofer-Institut für Nachrichtentechnik, Heinrich-Hertz-Institut, HHI

Im Focus: The hidden structure of the periodic system

The well-known representation of chemical elements is just one example of how objects can be arranged and classified

The periodic table of elements that most chemistry books depict is only one special case. This tabular overview of the chemical elements, which goes back to...

Im Focus: MPSD team discovers light-induced ferroelectricity in strontium titanate

Light can be used not only to measure materials’ properties, but also to change them. Especially interesting are those cases in which the function of a material can be modified, such as its ability to conduct electricity or to store information in its magnetic state. A team led by Andrea Cavalleri from the Max Planck Institute for the Structure and Dynamics of Matter in Hamburg used terahertz frequency light pulses to transform a non-ferroelectric material into a ferroelectric one.

Ferroelectricity is a state in which the constituent lattice “looks” in one specific direction, forming a macroscopic electrical polarisation. The ability to...

Im Focus: Determining the Earth’s gravity field more accurately than ever before

Researchers at TU Graz calculate the most accurate gravity field determination of the Earth using 1.16 billion satellite measurements. This yields valuable knowledge for climate research.

The Earth’s gravity fluctuates from place to place. Geodesists use this phenomenon to observe geodynamic and climatological processes. Using...

Im Focus: Tube anemone has the largest animal mitochondrial genome ever sequenced

Discovery by Brazilian and US researchers could change the classification of two species, which appear more akin to jellyfish than was thought.

The tube anemone Isarachnanthus nocturnus is only 15 cm long but has the largest mitochondrial genome of any animal sequenced to date, with 80,923 base pairs....

Im Focus: Tiny light box opens new doors into the nanoworld

Researchers at Chalmers University of Technology, Sweden, have discovered a completely new way of capturing, amplifying and linking light to matter at the nanolevel. Using a tiny box, built from stacked atomically thin material, they have succeeded in creating a type of feedback loop in which light and matter become one. The discovery, which was recently published in Nature Nanotechnology, opens up new possibilities in the world of nanophotonics.

Photonics is concerned with various means of using light. Fibre-optic communication is an example of photonics, as is the technology behind photodetectors and...