Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Engineering graduate student narrows gap between high-resolution video and virtual reality

06.02.2009
With their immersive 3D capabilities, virtual-reality environments (VEs) provide the kind of intense visual experience that two-dimensional digital televisions could never to live up to. But digital TVs outperform VEs in one important way: They can play high-resolution video in real-time without a hitch, while VEs have trouble rendering the data-heavy video clips at a constant frame rate.

University of California at San Diego grad student Han Suk Kim is trying to narrow that performance gap so that VEs can one day be used for high-resolution video conferencing, video surveillance or even in virtual movie theaters. Kim, a computer science and engineering Ph.D. student at the Jacobs School of Engineering, has developed an efficient “mipmap” algorithm that "shrinks" high-resolution video content so that it can be played interactively in VEs. He has also created several optimization solutions for sustaining a stable video playback frame rate, even when the video is projected onto non-rectangular VE screens.

Kim will showcase his work during the student poster session at the Jacobs School of Engineering's Research Expo on Thursday, Feb. 19. Kim's research will be one of 240 grad student projects presented at Research Expo. For a sneak peak of some of Research Expo’s hottest student posters click here. Research Expo also includes technical breakout sessions by Jacobs School faculty, as well as a luncheon featuring keynote speaker Christopher Scolese, NASA’s acting administrator.

According to Jürgen Schulze – Kim's advisor and a project scientist at the UC San Diego division of the California Institute for Telecommunications and Information Technology (Calit2) – the algorithm that Kim has developed will make it possible to display super high-resolution 4K video in Calit2’s virtual auditorium.

"This ability does not only add more realism to architectural models, but it also allows us to use the super high resolution environments to their capability, for instance, in Calit2’s virtual reality StarCAVE, which can display 34 million pixels,” Schulze said. “Another feature of Kim’s algorithm is that dozens of video streams can be displayed concurrently, in different places of the virtual environment, with a much smaller impact on overall rendering performance than previously possible.”

Kim derived his algorithm from a technique called "mipmapping," which is widely used by computer graphics experts to design computer games, flight simulations and other 3D imaging systems. The term itself is indicative of its approach – the letters "MIP" are short for the Latin phrase multum in parvo, which means "much in a small space." By using mipmap to reduce the level of detail (LOD) and downscale the size of high-resolution media datasets (like Calit2's 4K video of a tornado simulation, which numbers almost 45 gigabytes in volume), Kim was able to stream the video in real-time at 25 frames per second. By adding various optimizations to allow for constant frame and rendering rates, Kim was able to rotate, zoom in and otherwise manipulate the video playback screen to make the experience fully interactive.

"In interactive computer graphic applications, each frame takes a different time to render, depending on many different factors, such as the amount of data to be loaded, the size of the rendered screen and cache effect in various places of a computer system," Kim explained. "One of the ideas behind my work is to apply the mipmap approach for multiple frames of video data. The algorithm I developed automatically calculates the correct LOD mipmap scaling depending on the distance away from the eye and the area of each tile shown on screen. We then use the processed data for playback. So I'm not really editing the video. I'm only touching it in terms of resolution.”

Although mipmap is an efficient method for coping with large datasets, there has to be a good playback system to support it, Kim said.

"Our approach reduces the memory required to display high-resolution images, depending on distance and visual perspective,” he said. “If the area is big and close to the viewer's face, the video is streamed at a high-resolution; if it’s small and far away from the viewer's face, it's streamed at a low-resolution.

“Another issue is how to read a lot of data efficiently,” Kim added. “If I want to render a particular frame in the VE, the data has to already be in the system and I have to read it from memory and copy it again to the graphics processor. For the VE, we used pre-fetching to read the data in advance, and to speed up the reading process we used synchronous input-output. If I want to play the video with audio, it has to be synchronized with the sounds, so it has to be played at the correct speed. This means I have to measure the speed of playing, and if it’s too slow, I have to jump a couple of frames."

Kim's research has implications for another important field of research: Biomedicine. UC San Diego’s National Center for Microscopy and Imaging Research (NCMIR) has enlisted Kim to help visualize large datasets culled from brain cells – research that might ultimately play a part in the digital "Whole Brain Catalog” envisioned by UC San Diego’s Mark Ellisman, a professor of neuroscience and bioengineering.

"Visualizing cellular datasets and maximizing high-resolution video playback share similar problems," Kim said. "If you have 10 gigs of data but only 2 gigs of memory, how do you achieve that? NCMIR has a lot of datasets that are usually made up of very high-resolution microscope images, and all the optimization solutions that we used in video playback can also be applied to the rendering system of light microscope and electron microscope data. The next step would be something called ‘transfer function design,’ which adds color to the 3D datasets so scientists can compare them.”

Kim will also publish his preliminary research results as a poster at this year’s Institute of Electrical and Electronics Engineer’s (IEEE) Virtual Reality conference in Lafayette, La. March 14-18.

Andrea Siedsma | EurekAlert!
Further information:
http://www.ucsd.edu

More articles from Communications Media:

nachricht The plastic brain: Better connectivity of brain regions with training
02.07.2018 | Leibniz-Institut für Wissensmedien

nachricht Arguments, Emotions, and News distribution in social media - Leibniz-WissenschaftsCampus Tübingen
04.05.2018 | Leibniz-Institut für Wissensmedien

All articles from Communications Media >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: New interactive machine learning tool makes car designs more aerodynamic

Scientists develop first tool to use machine learning methods to compute flow around interactively designable 3D objects. Tool will be presented at this year’s prestigious SIGGRAPH conference.

When engineers or designers want to test the aerodynamic properties of the newly designed shape of a car, airplane, or other object, they would normally model...

Im Focus: Robots as 'pump attendants': TU Graz develops robot-controlled rapid charging system for e-vehicles

Researchers from TU Graz and their industry partners have unveiled a world first: the prototype of a robot-controlled, high-speed combined charging system (CCS) for electric vehicles that enables series charging of cars in various parking positions.

Global demand for electric vehicles is forecast to rise sharply: by 2025, the number of new vehicle registrations is expected to reach 25 million per year....

Im Focus: The “TRiC” to folding actin

Proteins must be folded correctly to fulfill their molecular functions in cells. Molecular assistants called chaperones help proteins exploit their inbuilt folding potential and reach the correct three-dimensional structure. Researchers at the Max Planck Institute of Biochemistry (MPIB) have demonstrated that actin, the most abundant protein in higher developed cells, does not have the inbuilt potential to fold and instead requires special assistance to fold into its active state. The chaperone TRiC uses a previously undescribed mechanism to perform actin folding. The study was recently published in the journal Cell.

Actin is the most abundant protein in highly developed cells and has diverse functions in processes like cell stabilization, cell division and muscle...

Im Focus: Lining up surprising behaviors of superconductor with one of the world's strongest magnets

Scientists have discovered that the electrical resistance of a copper-oxide compound depends on the magnetic field in a very unusual way -- a finding that could help direct the search for materials that can perfectly conduct electricity at room temperatur

What happens when really powerful magnets--capable of producing magnetic fields nearly two million times stronger than Earth's--are applied to materials that...

Im Focus: World record: Fastest 3-D tomographic images at BESSY II

The quality of materials often depends on the manufacturing process. In casting and welding, for example, the rate at which melts solidify and the resulting microstructure of the alloy is important. With metallic foams as well, it depends on exactly how the foaming process takes place. To understand these processes fully requires fast sensing capability. The fastest 3D tomographic images to date have now been achieved at the BESSY II X-ray source operated by the Helmholtz-Zentrum Berlin.

Dr. Francisco Garcia-Moreno and his team have designed a turntable that rotates ultra-stably about its axis at a constant rotational speed. This really depends...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

Within reach of the Universe

08.08.2018 | Event News

A journey through the history of microscopy – new exhibition opens at the MDC

27.07.2018 | Event News

2018 Work Research Conference

25.07.2018 | Event News

 
Latest News

Early opaque universe linked to galaxy scarcity

15.08.2018 | Physics and Astronomy

Molecular switch detects metals in the environment

15.08.2018 | Materials Sciences

Seeing on the Quick: New Insights into Active Vision in the Brain

15.08.2018 | Life Sciences

VideoLinks
Science & Research
Overview of more VideoLinks >>>