Those are some of the sounds that have been missing from computer graphic simulations of water and other fluids, according to researchers in Cornell’s Department of Computer Science, who have come up with new algorithms to simulate such sounds to go with the images.
The work by Doug James, associate professor of computer science, and graduate student Changxi Zheng will be reported at the 2009 ACM SIGGRAPH conference Aug. 3-7 in New Orleans, an international conference on computer graphics and interactive techniques. It is the first step in a broader research program on sound synthesis supported by a $1.2 million grant from the Human Centered Computing Program of the National Science Foundation (NSF) to James, assistant professor Kavita Bala and associate professor Steve Marschner.
In computer-animated movies, sound can be added after the fact from recordings or by Foley artists. But as virtual worlds grow increasingly interactive, the researchers point out, sounds will need to be generated automatically to fit events that can’t be predicted in advance. Recordings can be cued in, but can be repetitive and not always well matched to what’s happening.
“We have no way to efficiently compute the sounds of water splashing, paper crumpling, hands clapping, wind in trees or a wine glass dropped onto the floor,” the researchers said in their research proposal.
Along with fluid sounds, the research also will simulate sounds made by objects in contact, like a bin of Legos; the noisy vibrations of thin shells, like trash cans or cymbals; and the sounds of brittle fracture, like breaking glass and the clattering of the resulting debris.
All the simulations will be based on the physics of the objects being simulated in computer graphics, calculating how those objects would vibrate if they actually existed, and how those vibrations would produce acoustic waves in the air. Physics-based simulations also can be used in design, just as visual simulation is now, James said. “You can tell what it’s going to sound like before you build it,” he explained, noting that a lot of effort often goes into making things quieter.
In their SIGGRAPH paper, Zheng and James report that most of the sounds of water are created by tiny air bubbles that form as water pours and splashes. Moving water traps air bubbles on the scale of a millimeter or so. Surface tension contracts the bubbles, compressing the air inside until it pushes back and expands the bubble. The repeated expansion and contraction over milliseconds generates vibrations in the water that eventually make its surface vibrate, acting like a loudspeaker to create sound waves in the air.
The simulation method developed by the Cornell researchers starts with the geometry of the scene, figures out where the bubbles would be and how they’re moving, computes the expected vibrations and finally the sounds they would produce. The simulation is done on a highly parallel computer, with each processor computing the effects of multiple bubbles. The researchers have fine-tuned the results by comparing their simulations with real water sounds.
Demonstration videos of simulations of falling, pouring, splashing and babbling water are available at http://www.cs.cornell.edu/projects/HarmonicFluids.
The current methods still require hours of offline computing time, and work best on compact sound sources, the researchers noted, but they said further development should make possible the real-time performance needed for interactive virtual environments and deal with larger sound sources such as swimming pools or perhaps even Niagara Falls. They also plan to approach the more complex collections of bubbles in foam or plumes.
The research reported in the SIGGRAPH paper was supported in part by an NSF Faculty Early Career Award to James, and by the Alfred P. Sloan Foundation, Pixar, Intel and Autodesk.
Fighting myocardial infarction with nanoparticle tandems
04.12.2017 | Rheinische Friedrich-Wilhelms-Universität Bonn
Virtual Reality for Bacteria
01.12.2017 | Institute of Science and Technology Austria
On the way to an intelligent laboratory, physicists from Innsbruck and Vienna present an artificial agent that autonomously designs quantum experiments. In initial experiments, the system has independently (re)discovered experimental techniques that are nowadays standard in modern quantum optical laboratories. This shows how machines could play a more creative role in research in the future.
We carry smartphones in our pockets, the streets are dotted with semi-autonomous cars, but in the research laboratory experiments are still being designed by...
What enables electrons to be transferred swiftly, for example during photosynthesis? An interdisciplinary team of researchers has worked out the details of how...
For the first time, scientists have precisely measured the effective electrical charge of a single molecule in solution. This fundamental insight of an SNSF Professor could also pave the way for future medical diagnostics.
Electrical charge is one of the key properties that allows molecules to interact. Life itself depends on this phenomenon: many biological processes involve...
At the JEC World Composite Show in Paris in March 2018, the Fraunhofer Institute for Laser Technology ILT will be focusing on the latest trends and innovations in laser machining of composites. Among other things, researchers at the booth shared with the Aachen Center for Integrative Lightweight Production (AZL) will demonstrate how lasers can be used for joining, structuring, cutting and drilling composite materials.
No other industry has attracted as much public attention to composite materials as the automotive industry, which along with the aerospace industry is a driver...
Scientists at Tokyo Institute of Technology (Tokyo Tech) and Tohoku University have developed high-quality GFO epitaxial films and systematically investigated their ferroelectric and ferromagnetic properties. They also demonstrated the room-temperature magnetocapacitance effects of these GFO thin films.
Multiferroic materials show magnetically driven ferroelectricity. They are attracting increasing attention because of their fascinating properties such as...
08.01.2018 | Event News
11.12.2017 | Event News
08.12.2017 | Event News
19.01.2018 | Materials Sciences
19.01.2018 | Health and Medicine
19.01.2018 | Physics and Astronomy