High-resolution content is required to foster a sense of immersion in VR video applications, but the large amount of data poses a challenge to established transport means and the limits of video decoders. Lightweight merging of HEVC Tiles allows to easily adapt the 360 degree video data stream to the current VR user viewport without transcoding to significantly reduce the required data rates. At this year’s trade fair IBC in Amsterdam the Fraunhofer HHI will show this technology (Hall 8, Booth B80).
High-resolution in user Field of View (FoV) is required to foster a sense of immersion in VR video applications such as multiple times UHD resolution to cover full 360 degree surroundings. This large amount of data poses a major challenge to the whole chain of current state video streaming.
Tile Based HEVC Video for VR
© Fraunhofer HHI
The bandwidth required for streaming of such content over the public Internet cannot be provided for most of users. Likewise, video decoders are typically not capable of decoding such high-resolution video, especially with constrained resources such as those of a mobile device.
A new approach for bitrate adaptively in Virtual Reality video applications is required. An inferior approach is to provide a stream per user or FoV orientation, which does not scale well and requires many separate encodings. A superior solution is facilitation of HEVC Tiles.
After encoding, this approach allows emphasis of the current user FoV within the 360 degree video through better quality or higher resolution on-the-fly. This is done in a lightweight fashion without transcoding by Fraunhofer HHI’s technique for aggregation of tiles of different quality or resolution into a single common bitstream.
Fraunhofer HHI’s underlying technique for Compressed Domain Tile Aggregation allows aggregating separate HEVC encoded videos into a single common HEVC bitstream through lightweight rewriting of header information. Using this technique, a suitable bitstream for each user can be easily generated on the fly without heavy processing on the server or client side.
This allows a more efficient bandwidth usage as video content outside the users current FoV can be transmitted with low quality or small resolution. Therefore, this technique enables a better decoder utilization such as 16K VR video quality using a 4K decoder.
Given Fraunhofer HHI’s lightweight technique for Compressed Domain Tile Aggregation, usage of a single video decoder on the end device is enabled.
Furthermore, complete and market ready streaming solutions can be implemented based on the well-established MPEG standards family such as MPEG File Format and MPEG DASH which are fully compatible to the Compressed Domain Tile Aggregation technique.
Anne Rommel | Fraunhofer-Institut für Nachrichtentechnik Heinrich-Hertz-Institut
Information integration and artificial intelligence for better diagnosis and therapy decisions
24.05.2017 | Fraunhofer MEVIS - Institut für Bildgestützte Medizin
World's thinnest hologram paves path to new 3-D world
18.05.2017 | RMIT University
Staphylococcus aureus is a feared pathogen (MRSA, multi-resistant S. aureus) due to frequent resistances against many antibiotics, especially in hospital infections. Researchers at the Paul-Ehrlich-Institut have identified immunological processes that prevent a successful immune response directed against the pathogenic agent. The delivery of bacterial proteins with RNA adjuvant or messenger RNA (mRNA) into immune cells allows the re-direction of the immune response towards an active defense against S. aureus. This could be of significant importance for the development of an effective vaccine. PLOS Pathogens has published these research results online on 25 May 2017.
Staphylococcus aureus (S. aureus) is a bacterium that colonizes by far more than half of the skin and the mucosa of adults, usually without causing infections....
Physicists from the University of Würzburg are capable of generating identical looking single light particles at the push of a button. Two new studies now demonstrate the potential this method holds.
The quantum computer has fuelled the imagination of scientists for decades: It is based on fundamentally different phenomena than a conventional computer....
An international team of physicists has monitored the scattering behaviour of electrons in a non-conducting material in real-time. Their insights could be beneficial for radiotherapy.
We can refer to electrons in non-conducting materials as ‘sluggish’. Typically, they remain fixed in a location, deep inside an atomic composite. It is hence...
Two-dimensional magnetic structures are regarded as a promising material for new types of data storage, since the magnetic properties of individual molecular building blocks can be investigated and modified. For the first time, researchers have now produced a wafer-thin ferrimagnet, in which molecules with different magnetic centers arrange themselves on a gold surface to form a checkerboard pattern. Scientists at the Swiss Nanoscience Institute at the University of Basel and the Paul Scherrer Institute published their findings in the journal Nature Communications.
Ferrimagnets are composed of two centers which are magnetized at different strengths and point in opposing directions. Two-dimensional, quasi-flat ferrimagnets...
An Australian-Chinese research team has created the world's thinnest hologram, paving the way towards the integration of 3D holography into everyday...
24.05.2017 | Event News
23.05.2017 | Event News
22.05.2017 | Event News
26.05.2017 | Life Sciences
26.05.2017 | Life Sciences
26.05.2017 | Physics and Astronomy