Forum for Science, Industry and Business

Fraunhofer HHI put into operation first volumetric video studio on the European continent

The necessity to relocate the commercial production to a company is due in particular to the rapid market development of Virtual Reality (VR) and Augmented Reality (AR) and the high demand for volumetric video content resulting from this. The company formation enables the Fraunhofer HHI, as an institute for scientific research, to focus more intensively on the technical and scientific advancement of the HBR basic technology.

Fraunhofer HHI put into operation first volumetric video studio on the European continent

© Fraunhofer HHI

VoluCap GmbH was founded by the shareholders ARRI Cine Technik GmbH & Co. KG, Fraunhofer-Gesellschaft, Interlake System GmbH, Studio Babelsberg AG and UFA GmbH. The studio there will be put into operation as the first commercial volumetric video studio on the European continent in mid-2018.

As early as November 2017, the first professional commissioned production was carried out in the studio of Fraunhofer HHI. It is part of the VR experience “Ein ganzes Leben” (A Whole Life), which premiered at the Deutsche Kinemathek, the film and television museum in Berlin, with the special exhibition “Die Ufa - Geschichte einer Marke” (Ufa - History of a Brand). Additional productions from the volumetric video studio at Fraunhofer HHI will be presented to the public in several talks and presentations at this year’s Berlinale.

3D Human Body Reconstruction

The 3D Human Body Reconstruction technology captures real persons with multiple cameras at the same time and creates naturally moving dynamic 3D models, which can be observed from arbitrary viewpoints in the virtual scene.

The HBR capture system consists of 16 stereo cameras that create 3D information from all different viewpoints around the person, similar to how humans perceive with their two eyes. This information is fused and transformed to a consistent, natural and dynamic 3D representation of the person.

Post-processing modules adapt the data structures and formats and allow direct integration in standardized post-production workflows for VR and AR applications. In contrast to classical animation of virtual characters, facial expressions as well as moving clothes are captured from video information and reconstructed at high geometrical detail and texture quality.

This means that the maximum of naturalness of the visual impression is achieved and thus, the artificiality of avatars can be avoided. The complete workflow is fully automatic. Due to the standardized output format, further post-processing of the dynamic 3D model is possible.

Beyond the processing of dynamic 3D models, a novel integrated multi-camera and lighting system for full 360-degree acquisition of persons has been developed. The system enables a controlled, freely configurable and diffuse illumination of the persons, which allows both a subsequent synthetic illumination of the dynamic 3D-models in VR worlds (re-lighting), as well as a targeted dynamic scenic illumination with special lighting moods (campfire, blue light, etc.).

Weitere Informationen:

https://www.hhi.fraunhofer.de/en/press-media/press-releases.html

Anne Rommel | Fraunhofer-Institut für Nachrichtentechnik, Heinrich-Hertz-Institut, HHI

Im Focus: Color effects from transparent 3D-printed nanostructures

New design tool automatically creates nanostructure 3D-print templates for user-given colors
Scientists present work at prestigious SIGGRAPH conference

Most of the objects we see are colored by pigments, but using pigments has disadvantages: such colors can fade, industrial pigments are often toxic, and...

Im Focus: Unraveling the nature of 'whistlers' from space in the lab

A new study sheds light on how ultralow frequency radio waves and plasmas interact

Scientists at the University of California, Los Angeles present new research on a curious cosmic phenomenon known as "whistlers" -- very low frequency packets...

Im Focus: New interactive machine learning tool makes car designs more aerodynamic

Scientists develop first tool to use machine learning methods to compute flow around interactively designable 3D objects. Tool will be presented at this year’s prestigious SIGGRAPH conference.

When engineers or designers want to test the aerodynamic properties of the newly designed shape of a car, airplane, or other object, they would normally model...

Im Focus: Robots as 'pump attendants': TU Graz develops robot-controlled rapid charging system for e-vehicles

Researchers from TU Graz and their industry partners have unveiled a world first: the prototype of a robot-controlled, high-speed combined charging system (CCS) for electric vehicles that enables series charging of cars in various parking positions.

Global demand for electric vehicles is forecast to rise sharply: by 2025, the number of new vehicle registrations is expected to reach 25 million per year....

Im Focus: The “TRiC” to folding actin

Proteins must be folded correctly to fulfill their molecular functions in cells. Molecular assistants called chaperones help proteins exploit their inbuilt folding potential and reach the correct three-dimensional structure. Researchers at the Max Planck Institute of Biochemistry (MPIB) have demonstrated that actin, the most abundant protein in higher developed cells, does not have the inbuilt potential to fold and instead requires special assistance to fold into its active state. The chaperone TRiC uses a previously undescribed mechanism to perform actin folding. The study was recently published in the journal Cell.

Actin is the most abundant protein in highly developed cells and has diverse functions in processes like cell stabilization, cell division and muscle...