With modern transmission technology, so much more is possible than has made it into our private living rooms so far. Multi-View Video Streaming for instance lets users move into a recorded scene and view it from different perspectives.
Possible applications range from consumer electronics, computer games and virtual worlds to realistic video conferences and autonomous driving. Until now, there was no overall functioning system for this technology. Now computer scientists from Saarland University will be presenting their solution at this year’s Cebit computer fair.
Thanks to advancements in camera technology, a single scene can be captured from different perspectives with several cameras at once. This opens up entirely new fields of application, especially for home electronics: “Say you are watching a detective story, and you can hear the suspect talking in the room next door, off-screen. Then you could use this new technology to simply switch perspectives and look around the corner,” says Tobias Lange, PhD student at the Saarland University.
Together with Thorsten Herfet, Chair of the Telecommunications Lab at Saarland University, Tobias Lange is researching multi-view video streaming at the Intel Visual Computing Institute. The individual components of this technology already work by themselves, but so far there has been no complete integrated system. This is what the two Saarland computer scientists and their colleagues are trying to change. The potential applications for multi-view video streaming are abundant.
Multi-view video streams could not only revolutionize the entertainment industry, but also the workplace, with true-to-life video conferencing, for instance. “This technology might even be useful if several autonomous cars are driving in convoy. Or how else would the car at the rear be able to access images from the car in front?,” asks Lange.
Presently there are still some challenges that have to be addressed in order to fully implement this vision. The greatest difficulty: Network technology has not developed as rapidly as recording technology has. Not only do the videos need to be recorded with several cameras, they also have to be encoded into a set of data packets and stored in a transmission buffer on the video server.
From there, they will find their way over the Internet to viewers’ computers. There the data needs to be unpacked in time and played back in such a way that viewers can switch their perspective without encountering any image errors. “The data rate is ludicrous. Even now we need such a high bandwidth that most contemporary Internet connections would be overloaded,” Lange explains. The calculations themselves are also highly complex.
The Saarbrücken researchers are tackling this challenge by improving the entire production process step by step. For streaming, they use special computational methods to minimize the delay until it is so small as to be nearly unobservable. And for encoding and decoding the data in an acceptable time span, they rely on a distributed approach. Each camera has a mini-computer of its own attached to it.
The researchers have also developed a new method for computing the images that can be viewed from different perspectives almost in real-time. With these incremental improvements, they have created a comprehensive working system. “Only a few solutions exist,” says Lange. Hence, he is unsure whether that is sufficient to make the technology marketable.
“Maybe our research partner Intel will take over. They will be looking at our results in their entirety,” says Lange. The researchers are now presenting their completed system at the Cebit computer fair from March 20 to 24 in Hannover (Hall 6, Stand E28).
Press photos are available here: www.uni-saarland.de/pressefotos
Saarland Informatics Campus C6 3
Phone: +49 (0)681 302- 70852
Competence Center Computer Science Saarland
Saarland Informatics Campus E1 7
Phone: +49 681 302-70741
Friederike Meyer zu Tittingdorf | Universität des Saarlandes
Medica 2018: Mobile motion feedback to help patients reduce relieving postures when walking
07.11.2018 | Technische Universität Kaiserslautern
Medica 2018: Control with your feet - computer game to help prevent thrombosis
05.11.2018 | Technische Universität Kaiserslautern
Biochips have been developed at TU Wien (Vienna), on which tissue can be produced and examined. This allows supplying the tissue with different substances in a very controlled way.
Cultivating human cells in the Petri dish is not a big challenge today. Producing artificial tissue, however, permeated by fine blood vessels, is a much more...
Faster and secure data communication: This is the goal of a new joint project involving physicists from the University of Würzburg. The German Federal Ministry of Education and Research funds the project with 14.8 million euro.
In our digital world data security and secure communication are becoming more and more important. Quantum communication is a promising approach to achieve...
On Saturday, 10 November 2018, the research icebreaker Polarstern will leave its homeport of Bremerhaven, bound for Cape Town, South Africa.
When choosing materials to make something, trade-offs need to be made between a host of properties, such as thickness, stiffness and weight. Depending on the application in question, finding just the right balance is the difference between success and failure
Now, a team of Penn Engineers has demonstrated a new material they call "nanocardboard," an ultrathin equivalent of corrugated paper cardboard. A square...
Physicists at ETH Zurich demonstrate how errors that occur during the manipulation of quantum system can be monitored and corrected on the fly
The field of quantum computation has seen tremendous progress in recent years. Bit by bit, quantum devices start to challenge conventional computers, at least...
09.11.2018 | Event News
06.11.2018 | Event News
23.10.2018 | Event News
15.11.2018 | Earth Sciences
15.11.2018 | Physics and Astronomy
15.11.2018 | Physics and Astronomy