New Streaming Technology Will Change Computer Gaming

Dieter Schmalstieg has been professor at the Institute for Machine Vision and Presentation since 2004. He is one of the most successful inventors at Graz University of Technology. © Schmalstieg

Streaming services, such as Netflix or Amazon Prime, are widely used. But the next wave of digital media is imminent: cloud gaming. This technology is similar to video-on-demand services.

A computer game is run on a server in the cloud. The players access the server via an internet connection and receive an audio/video stream on their personal device.

Players no longer have to own a powerful gaming device; instead, they just need a fast internet connection, capable of streaming large amounts of data from the cloud with low latency.

Cloud computing has the potential to elevate VR games to the next level. However, the bandwidth requirements are still challenging. A fluid VR display requires up to 10x more computational performance to generate enough pixels and enough frames per second.

Traditional video transmission is easily pushed beyond its limits. Dieter Schmalstieg, head of the Institute of Computer Graphics and Vision, and his team have developed a novel method unlocking a breakthrough potential for untethered VR experiences.

Drastic latency improvements

Their method, called “shading atlas streaming”, can deliver compelling VR experiences with significantly fewer bits per second transmitted over the network. Schmalstieg explains, “We are not streaming videos, but geometrically encoded data, which is decoded on the VR headset and converted into an image.”

Latency – the temporal delay caused by signal transmission, storage or processing of data packets – is compensated for by the system. “It is physically impossible to remove all latency. But our encoding allows correct images to be predicted for a small temporal window into the future. As a result, physical latency is compensated for, and the user does not perceive any delays,” says Schmalstieg. Only a few pixel errors from mispredictions remain – too few to be perceived by the users.

Efficient use of existing hardware

In practice, it is important to be able to integrate the new technology into existing infrastructure. For this purpose, the researchers use conventional MPEG video compression to encode and transmit the data. MPEG decoding capabilities already exist in VR headsets. Therefore, Shading Atlas Streaming can be used without investing in new hardware.

Shading Atlas Streaming is generally applicable to all areas involving 3D data and VR headsets. The researchers are working with US chip manufacturer Qualcomm on commercial exploitation of their research results.

Further Information:
Dieter Schmalstieg is a pioneering researcher in the area of Augmented Reality and Virtual Reality. In 2017, he received the Nikola Tesla Medal as the most successful inventor at Graz University of Technology. In 2019, he received the Research Award of the Federal State of Styria.

Dieter SCHMALSTIEG
Univ.-Prof. Dipl.-Ing. Dr.techn.
Institute of Computer Graphics and Vision
Graz University of Technology
Inffeldgasse 16/II
8010 Graz
schmalstieg@tugraz.at

https://www.youtube.com/watch?v=ZW8MOwpOwI8 (Video on Shading Atlas Streaming)

https://www.tugraz.at/institute/icg/research/team-steinberger/research-projects/… (More info on the Project)

https://www.tugraz.at/institutes/icg/home/ (Website Institute of Computer Graphics and Vision)

https://www.tugraz.at/en/tu-graz/services/news-stories/planet-research/singlevie… (Interview with D. Schmalstieg)

Media Contact

Mag. Christoph Pelzl, MSc Technische Universität Graz

Alle Nachrichten aus der Kategorie: Information Technology

Here you can find a summary of innovations in the fields of information and data processing and up-to-date developments on IT equipment and hardware.

This area covers topics such as IT services, IT architectures, IT management and telecommunications.

Zurück zur Startseite

Kommentare (0)

Schreib Kommentar

Neueste Beiträge

Argonne targets lithium-rich materials as key to more sustainable cost-effective batteries

Next-generation batteries using lithium-rich materials could be more sustainable and cost-effective, according to a team of researchers with the U.S. Department of Energy’s (DOE) Argonne National Laboratory. The pivotal discovery,…

Why disordered light-harvesting systems produce ordered outcomes

Scientists typically prefer to work with ordered systems. However, a diverse team of physicists and biophysicists from the University of Groningen found that individual light-harvesting nanotubes with disordered molecular structures…

RadarGlass – from vehicle headlight to radar transceiver

As a result of modern Advanced Driver Assistance Systems, the use of radar technology has become indispensable for the automotive sector. With the installation of a large and growing number…

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close