By cutting the computing cost for creating highly realistic imagery from scratch, the UCSD computer scientists are helping to pull cutting edge graphics techniques out of research labs and into movies and eventually video games and beyond. The findings are being presented this week at Europe’s premier computer graphics conference, Eurographics 2008 in Crete, Greece on April 17.
This new work is part of a shift in the computer graphics, film, animation and video game industries toward greater realism through the use of “ray tracing algorithms.” Much of the realism in ray tracing technologies comes from calculating how the light in computer generated images would behave if it were set loose in the real world and followed the laws of nature.
At the heart of the new UCSD advance are computationally slimmed “photon mapping” algorithms, which are a subset of the ray tracing algorithms. The computer scientists found a way to collect all of the pertinent lighting information in computer generated scenes at once, which made the new photon mapping approach more lightweight than conventional photon mapping. This technique is especially good for creating smoky, foggy or cloudy scenes and producing images that do not have much unwanted visual noise.
“We took an algorithm that is already great and made it more efficient,” said Wojciech Jarosz, the first author on the new Eurographics paper and a Ph.D. candidate from the Department of Computer Science and Engineering at UCSD’s Jacobs School of Engineering.This approach is an improvement upon the Academy Award winning photon mapping technique first developed by UCSD computer science professor Henrik Wann Jensen during his doctoral studies. Jensen is a co-author on this new Eurographics paper, along with UCSD computer science professor Matthias Zwicker.
Computational constraints, however, have limited the use of photon mapping and other ray tracing approaches in places where speed and lightweight computation are crucial – such as video games. These domains have embraced an approach called rasterization, which is faster, but unable to easily simulate advanced lighting effects.
The new photon mapping approach from UCSD, and related advances, are poised to increase the reach of ray tracing algorithms – perhaps even into the domain of 3-D animation software for the general public and video games. The Larrabee chip that Intel is working on is just one indication that ray tracing technologies may play an increasing important role in consumer oriented graphics of the future.
Computerized Fog Costs
Much of the richness in images created with photon mapping algorithms comes from precise accounting for the amount of light is in a scene and where that light is. Photon mapping algorithms provide a way to follow the light around the scene, as it bounces off various objects and lands on other objects. Photon mapping can also determine how light will interact with fog, smoke or other “participating media” that absorb, reflect and scatter some portion of the light – a task that has been traditionally quite computationally costly to perform because it requires sampling the light at many locations in order to make sure that nearly all the light is accounted for.
“Instead of computing the light at thousands of discrete points along the ray between the camera and the object, which is the conventional approach, we compute the lighting along the whole length of the ray all at once,” said Jarosz.
To Movies, Then Milk
This more efficient approach to photon mapping could be extended well beyond foggy and smoky scenes, because many materials, including skin, milk and plants, behave like fog or smoke, but on a more limited basis.
“Most natural materials behave like really dense fog because light penetrates them to a limited extent, so this work has a lot of potential future applications,” said Jensen, who published work in 2007 at SIGGRAPH on a graphics model capable of generating realistic milk images based on the fat and protein content. This research is pushing the field of computer graphics into the realms of diagnostic medicine, food safety and atmospheric science.
While photon mapping and other ray tracing algorithms that more closely mimic the natural world are making their way into movie special effects and animated films, Jarosz does not expect movies and video games to strictly follow the laws of nature.
“In live action movies, the lighting is incredibly controlled. If a character walks into a shadow, they will add light to the face even if you would never get that kind of light in a real shadow. The composition on the screen must tell the story and not distract the viewer. Realism doesn’t always matter. It’s the movies.”
Eurographics 2008 Paper: “The Beam Radiance Estimate for Volumetric Photon Mapping,” by Wojciech Jarosz, Matthias Zwicker and Henrik Wann Jensen at the Computer Science and Engineering Department, University of California, San Diego’s Jacobs School of Engineering.
Daniel Kane | EurekAlert!
Ultra-precise chip-scale sensor detects unprecedentedly small changes at the nanoscale
18.01.2017 | The Hebrew University of Jerusalem
Data analysis optimizes cyber-physical systems in telecommunications and building automation
18.01.2017 | Fraunhofer-Institut für Algorithmen und Wissenschaftliches Rechnen SCAI
An important step towards a completely new experimental access to quantum physics has been made at University of Konstanz. The team of scientists headed by...
Yersiniae cause severe intestinal infections. Studies using Yersinia pseudotuberculosis as a model organism aim to elucidate the infection mechanisms of these...
Researchers from the University of Hamburg in Germany, in collaboration with colleagues from the University of Aarhus in Denmark, have synthesized a new superconducting material by growing a few layers of an antiferromagnetic transition-metal chalcogenide on a bismuth-based topological insulator, both being non-superconducting materials.
While superconductivity and magnetism are generally believed to be mutually exclusive, surprisingly, in this new material, superconducting correlations...
Laser-driving of semimetals allows creating novel quasiparticle states within condensed matter systems and switching between different states on ultrafast time scales
Studying properties of fundamental particles in condensed matter systems is a promising approach to quantum field theory. Quasiparticles offer the opportunity...
Among the general public, solar thermal energy is currently associated with dark blue, rectangular collectors on building roofs. Technologies are needed for aesthetically high quality architecture which offer the architect more room for manoeuvre when it comes to low- and plus-energy buildings. With the “ArKol” project, researchers at Fraunhofer ISE together with partners are currently developing two façade collectors for solar thermal energy generation, which permit a high degree of design flexibility: a strip collector for opaque façade sections and a solar thermal blind for transparent sections. The current state of the two developments will be presented at the BAU 2017 trade fair.
As part of the “ArKol – development of architecturally highly integrated façade collectors with heat pipes” project, Fraunhofer ISE together with its partners...
19.01.2017 | Event News
10.01.2017 | Event News
09.01.2017 | Event News
20.01.2017 | Awards Funding
20.01.2017 | Materials Sciences
20.01.2017 | Life Sciences