By cutting the computing cost for creating highly realistic imagery from scratch, the UCSD computer scientists are helping to pull cutting edge graphics techniques out of research labs and into movies and eventually video games and beyond. The findings are being presented this week at Europe’s premier computer graphics conference, Eurographics 2008 in Crete, Greece on April 17.
This new work is part of a shift in the computer graphics, film, animation and video game industries toward greater realism through the use of “ray tracing algorithms.” Much of the realism in ray tracing technologies comes from calculating how the light in computer generated images would behave if it were set loose in the real world and followed the laws of nature.
At the heart of the new UCSD advance are computationally slimmed “photon mapping” algorithms, which are a subset of the ray tracing algorithms. The computer scientists found a way to collect all of the pertinent lighting information in computer generated scenes at once, which made the new photon mapping approach more lightweight than conventional photon mapping. This technique is especially good for creating smoky, foggy or cloudy scenes and producing images that do not have much unwanted visual noise.
“We took an algorithm that is already great and made it more efficient,” said Wojciech Jarosz, the first author on the new Eurographics paper and a Ph.D. candidate from the Department of Computer Science and Engineering at UCSD’s Jacobs School of Engineering.This approach is an improvement upon the Academy Award winning photon mapping technique first developed by UCSD computer science professor Henrik Wann Jensen during his doctoral studies. Jensen is a co-author on this new Eurographics paper, along with UCSD computer science professor Matthias Zwicker.
Computational constraints, however, have limited the use of photon mapping and other ray tracing approaches in places where speed and lightweight computation are crucial – such as video games. These domains have embraced an approach called rasterization, which is faster, but unable to easily simulate advanced lighting effects.
The new photon mapping approach from UCSD, and related advances, are poised to increase the reach of ray tracing algorithms – perhaps even into the domain of 3-D animation software for the general public and video games. The Larrabee chip that Intel is working on is just one indication that ray tracing technologies may play an increasing important role in consumer oriented graphics of the future.
Computerized Fog Costs
Much of the richness in images created with photon mapping algorithms comes from precise accounting for the amount of light is in a scene and where that light is. Photon mapping algorithms provide a way to follow the light around the scene, as it bounces off various objects and lands on other objects. Photon mapping can also determine how light will interact with fog, smoke or other “participating media” that absorb, reflect and scatter some portion of the light – a task that has been traditionally quite computationally costly to perform because it requires sampling the light at many locations in order to make sure that nearly all the light is accounted for.
“Instead of computing the light at thousands of discrete points along the ray between the camera and the object, which is the conventional approach, we compute the lighting along the whole length of the ray all at once,” said Jarosz.
To Movies, Then Milk
This more efficient approach to photon mapping could be extended well beyond foggy and smoky scenes, because many materials, including skin, milk and plants, behave like fog or smoke, but on a more limited basis.
“Most natural materials behave like really dense fog because light penetrates them to a limited extent, so this work has a lot of potential future applications,” said Jensen, who published work in 2007 at SIGGRAPH on a graphics model capable of generating realistic milk images based on the fat and protein content. This research is pushing the field of computer graphics into the realms of diagnostic medicine, food safety and atmospheric science.
While photon mapping and other ray tracing algorithms that more closely mimic the natural world are making their way into movie special effects and animated films, Jarosz does not expect movies and video games to strictly follow the laws of nature.
“In live action movies, the lighting is incredibly controlled. If a character walks into a shadow, they will add light to the face even if you would never get that kind of light in a real shadow. The composition on the screen must tell the story and not distract the viewer. Realism doesn’t always matter. It’s the movies.”
Eurographics 2008 Paper: “The Beam Radiance Estimate for Volumetric Photon Mapping,” by Wojciech Jarosz, Matthias Zwicker and Henrik Wann Jensen at the Computer Science and Engineering Department, University of California, San Diego’s Jacobs School of Engineering.
Daniel Kane | EurekAlert!
Drones learn to navigate autonomously by imitating cars and bicycles
23.01.2018 | Universität Zürich
Cloud technology: Dynamic certificates make cloud service providers more secure
15.01.2018 | Technische Universität München
Physicists have developed a technique based on optical microscopy that can be used to create images of atoms on the nanoscale. In particular, the new method allows the imaging of quantum dots in a semiconductor chip. Together with colleagues from the University of Bochum, scientists from the University of Basel’s Department of Physics and the Swiss Nanoscience Institute reported the findings in the journal Nature Photonics.
Microscopes allow us to see structures that are otherwise invisible to the human eye. However, conventional optical microscopes cannot be used to image...
On the way to an intelligent laboratory, physicists from Innsbruck and Vienna present an artificial agent that autonomously designs quantum experiments. In initial experiments, the system has independently (re)discovered experimental techniques that are nowadays standard in modern quantum optical laboratories. This shows how machines could play a more creative role in research in the future.
We carry smartphones in our pockets, the streets are dotted with semi-autonomous cars, but in the research laboratory experiments are still being designed by...
What enables electrons to be transferred swiftly, for example during photosynthesis? An interdisciplinary team of researchers has worked out the details of how...
For the first time, scientists have precisely measured the effective electrical charge of a single molecule in solution. This fundamental insight of an SNSF Professor could also pave the way for future medical diagnostics.
Electrical charge is one of the key properties that allows molecules to interact. Life itself depends on this phenomenon: many biological processes involve...
At the JEC World Composite Show in Paris in March 2018, the Fraunhofer Institute for Laser Technology ILT will be focusing on the latest trends and innovations in laser machining of composites. Among other things, researchers at the booth shared with the Aachen Center for Integrative Lightweight Production (AZL) will demonstrate how lasers can be used for joining, structuring, cutting and drilling composite materials.
No other industry has attracted as much public attention to composite materials as the automotive industry, which along with the aerospace industry is a driver...
08.01.2018 | Event News
11.12.2017 | Event News
08.12.2017 | Event News
23.01.2018 | Life Sciences
23.01.2018 | Earth Sciences
23.01.2018 | Physics and Astronomy