High-resolution content is required to foster a sense of immersion in VR video applications, but the large amount of data poses a challenge to established transport means and the limits of video decoders. Lightweight merging of HEVC Tiles allows to easily adapt the 360 degree video data stream to the current VR user viewport without transcoding to significantly reduce the required data rates. At this year’s trade fair IBC in Amsterdam the Fraunhofer HHI will show this technology (Hall 8, Booth B80).
High-resolution in user Field of View (FoV) is required to foster a sense of immersion in VR video applications such as multiple times UHD resolution to cover full 360 degree surroundings. This large amount of data poses a major challenge to the whole chain of current state video streaming.
Tile Based HEVC Video for VR
© Fraunhofer HHI
The bandwidth required for streaming of such content over the public Internet cannot be provided for most of users. Likewise, video decoders are typically not capable of decoding such high-resolution video, especially with constrained resources such as those of a mobile device.
A new approach for bitrate adaptively in Virtual Reality video applications is required. An inferior approach is to provide a stream per user or FoV orientation, which does not scale well and requires many separate encodings. A superior solution is facilitation of HEVC Tiles.
After encoding, this approach allows emphasis of the current user FoV within the 360 degree video through better quality or higher resolution on-the-fly. This is done in a lightweight fashion without transcoding by Fraunhofer HHI’s technique for aggregation of tiles of different quality or resolution into a single common bitstream.
Fraunhofer HHI’s underlying technique for Compressed Domain Tile Aggregation allows aggregating separate HEVC encoded videos into a single common HEVC bitstream through lightweight rewriting of header information. Using this technique, a suitable bitstream for each user can be easily generated on the fly without heavy processing on the server or client side.
This allows a more efficient bandwidth usage as video content outside the users current FoV can be transmitted with low quality or small resolution. Therefore, this technique enables a better decoder utilization such as 16K VR video quality using a 4K decoder.
Given Fraunhofer HHI’s lightweight technique for Compressed Domain Tile Aggregation, usage of a single video decoder on the end device is enabled.
Furthermore, complete and market ready streaming solutions can be implemented based on the well-established MPEG standards family such as MPEG File Format and MPEG DASH which are fully compatible to the Compressed Domain Tile Aggregation technique.
Anne Rommel | Fraunhofer-Institut für Nachrichtentechnik Heinrich-Hertz-Institut
Putting food-safety detection in the hands of consumers
15.11.2018 | Massachusetts Institute of Technology
Next stop Morocco: EU partners test innovative space robotics technologies in the Sahara desert
09.11.2018 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI
Researchers at the University of New Hampshire have captured a difficult-to-view singular event involving "magnetic reconnection"--the process by which sparse particles and energy around Earth collide producing a quick but mighty explosion--in the Earth's magnetotail, the magnetic environment that trails behind the planet.
Magnetic reconnection has remained a bit of a mystery to scientists. They know it exists and have documented the effects that the energy explosions can...
Biochips have been developed at TU Wien (Vienna), on which tissue can be produced and examined. This allows supplying the tissue with different substances in a very controlled way.
Cultivating human cells in the Petri dish is not a big challenge today. Producing artificial tissue, however, permeated by fine blood vessels, is a much more...
Faster and secure data communication: This is the goal of a new joint project involving physicists from the University of Würzburg. The German Federal Ministry of Education and Research funds the project with 14.8 million euro.
In our digital world data security and secure communication are becoming more and more important. Quantum communication is a promising approach to achieve...
On Saturday, 10 November 2018, the research icebreaker Polarstern will leave its homeport of Bremerhaven, bound for Cape Town, South Africa.
When choosing materials to make something, trade-offs need to be made between a host of properties, such as thickness, stiffness and weight. Depending on the application in question, finding just the right balance is the difference between success and failure
Now, a team of Penn Engineers has demonstrated a new material they call "nanocardboard," an ultrathin equivalent of corrugated paper cardboard. A square...
09.11.2018 | Event News
06.11.2018 | Event News
23.10.2018 | Event News
16.11.2018 | Health and Medicine
16.11.2018 | Life Sciences
16.11.2018 | Life Sciences