In a recent issue of the Proceedings of the National Academy of Sciences, Marcelo Magnasco, professor and head of the Mathematical Physics Laboratory at Rockefeller University, has published a paper that may prove to be a sound-analysis breakthrough, featuring a mathematical method or “algorithm” that’s far more nuanced at transforming sound into a visual representation than current methods. “This outperforms everything in the market as a general method of sound analysis,” Magnasco says. In fact, he notes, it may be the same type of method the brain actually uses.
Monotone. In this image, created by a computer that reassigned a sound’s rate and frequency values using Magnasco’s new algorithm, a single-frequency tone can be seen as it cuts through a background of white noise. The bright blue spots indicate the areas in this histogram where there was no sound at all.
Magnasco collaborated with Timothy Gardner, a former Rockefeller graduate student who is now a Burroughs Wellcome Fund fellow at MIT, to figure out how to get computers to process complex, rapidly changing sounds the same way the brain does. They struck upon a mathematical method that reassigned a sound’s rate and frequency data into a set of points that they could make into a histogram — a visual, two-dimensional map of how a sound’s individual frequencies move in time. When they tested their technique against other sound-analysis programs, they found that it gave them a much greater ability to tease out the sound they were interested in from the noise that surrounded it.
One fundamental observation enabled this vast improvement: They were able to visualize the areas in which there was no sound at all. The two researchers used white noise — hissing similar to what you might hear on an un-tuned FM radio — because it’s the most complex sound available, with exactly the same amount of energy at all frequency levels. When they plugged their algorithm into a computer, it reassigned each tone and plotted the data points on a graph in which the x-axis was time and the y-axis was frequency. The resulting histograms showed thin, froth-like images, each “bubble” encircling a blue spot. Each blue spot indicated a zero, or a moment during which there was no sound at a particular frequency. “There is a theorem,” Magnasco says, “that tells us that we can know what the sound was by knowing when there was no sound.” In other words, their pictures were being determined not by where there was volume, but where there was silence.
“If you want to show that your analysis is a valid signal estimation method, you have to understand what a sound looks like when it’s embedded in noise,” Magnasco says. So he added a constant tone beneath the white noise. That tone appeared in their histograms as a thin yellow band, bubble edges converging in a horizontal line that cut straight through the center of the froth. This, he says, proves that their algorithm is a viable method of analysis, and one that may be related to how the mammalian brain parses sound.
“The applications are immense, and can be used in most fields of science and technology,” Magnasco says. And those applications aren’t limited to sound, either. It can be used for any kind of data in which a series of time points are juxtaposed with discrete frequencies that are important to pick up. Radar and sonar both depend on this kind of time-frequency analysis, as does speech-recognition software. Medical tests such as electroencephalograms (EEGs), which measure multiple, discrete brainwaves use it, too. Geologists use time-frequency data to determine the composition of the ground under a surveyor’s feet, and an angler’s fishfinder uses the method to determine the water’s depth and locate schools of fish. But current methods are far from exact, so the algorithm has plenty of potential opportunities. “If we were able to do extremely high-resolution time-frequency analysis, we’d get unbelievable amounts of information from technologies like radar,” Magnasco says. “With radar now, for instance, you’d be able to tell there was a helicopter. With this algorithm, you’d be able to pick out each one of its blades.” With this algorithm, researchers could one day give computers the same acuity as human ears, and give cochlear implants the power of 8,000 hair cells.
Proceedings of the National Academy of Sciences 103(16): 6094-6099 (April 18, 2006)
Kristine Kelly | EurekAlert!
New study: How does Europe become a leading player for software and IT services?
03.04.2017 | Fraunhofer-Institut für System- und Innovationsforschung (ISI)
Reusable carbon nanotubes could be the water filter of the future, says RIT study
30.03.2017 | Rochester Institute of Technology
The world's highest gain high power laser amplifier - by many orders of magnitude - has been developed in research led at the University of Strathclyde.
The researchers demonstrated the feasibility of using plasma to amplify short laser pulses of picojoule-level energy up to 100 millijoules, which is a 'gain'...
Staphylococcus aureus is a feared pathogen (MRSA, multi-resistant S. aureus) due to frequent resistances against many antibiotics, especially in hospital infections. Researchers at the Paul-Ehrlich-Institut have identified immunological processes that prevent a successful immune response directed against the pathogenic agent. The delivery of bacterial proteins with RNA adjuvant or messenger RNA (mRNA) into immune cells allows the re-direction of the immune response towards an active defense against S. aureus. This could be of significant importance for the development of an effective vaccine. PLOS Pathogens has published these research results online on 25 May 2017.
Staphylococcus aureus (S. aureus) is a bacterium that colonizes by far more than half of the skin and the mucosa of adults, usually without causing infections....
Physicists from the University of Würzburg are capable of generating identical looking single light particles at the push of a button. Two new studies now demonstrate the potential this method holds.
The quantum computer has fuelled the imagination of scientists for decades: It is based on fundamentally different phenomena than a conventional computer....
An international team of physicists has monitored the scattering behaviour of electrons in a non-conducting material in real-time. Their insights could be beneficial for radiotherapy.
We can refer to electrons in non-conducting materials as ‘sluggish’. Typically, they remain fixed in a location, deep inside an atomic composite. It is hence...
Two-dimensional magnetic structures are regarded as a promising material for new types of data storage, since the magnetic properties of individual molecular building blocks can be investigated and modified. For the first time, researchers have now produced a wafer-thin ferrimagnet, in which molecules with different magnetic centers arrange themselves on a gold surface to form a checkerboard pattern. Scientists at the Swiss Nanoscience Institute at the University of Basel and the Paul Scherrer Institute published their findings in the journal Nature Communications.
Ferrimagnets are composed of two centers which are magnetized at different strengths and point in opposing directions. Two-dimensional, quasi-flat ferrimagnets...
24.05.2017 | Event News
23.05.2017 | Event News
22.05.2017 | Event News
29.05.2017 | Earth Sciences
29.05.2017 | Life Sciences
29.05.2017 | Physics and Astronomy