New framework discovered by Salk scientists could improve machine-learning methods or help to detect when novelty detection is impaired in the brain
It might seem like fruit flies would have nothing in common with computers, but new research from the Salk Institute reveals that the two identify novel information in similar ways. The work, which appeared in Proceedings of the National Academy of Sciences (PNAS) on December 3, 2018, not only sheds light on an important neurobiological problem--how organisms detect new odors--but could also improve algorithms for novelty detection in computer science.
This image of flies buzzing around glasses of wine illustrates how flies detect novel odors using a tactic similar to that of a computer using a computational tool called a Bloom filter. In the fly version, neurons called Kenyon cells in a region of the fly brain called the mushroom body (MBON-a'3) process olfactory information and broadcast a 'novelty alert' signal when a new odor is encountered.
Credit: Salk Institute
"When a fly smells an odor, the fly needs to quickly figure out if it has smelled the odor before, to determine if the odor is new and something it should pay attention to," says Saket Navlakha, an assistant professor in Salk's Integrative Biology Laboratory. "In computer science, this is an important task called novelty detection. Understanding how novelty detection strategies compare in both domains could give us valuable insights into both brain algorithms and computing." The researchers suggest that their new framework could be useful in detecting duplicates or anomalies in large, streaming data sets, such as patient databases or news stories.
In 2017, Navlakha discovered how fly brains identify similar odors. He found that applying the fly algorithm to computer "similarity searches" (such as ones that suggest products to buy that are similar to your past purchases) improved the search results.
The new PNAS study is based on another paper [Hattori et al.] that came out in 2017 in the journal Cell, describing how flies detect entirely new odors. When Navlakha read the study, he was struck by how the flies seemed to be using a tactic similar to a computational tool for novelty detection called a Bloom filter.
When a search engine such as Google crawls the Web, it needs to know whether a website it comes across has previously been indexed, so that it doesn't waste time indexing the same site again. The problem is there are trillions of websites on the Web, and storing all of them in memory is computationally expensive. In the 1970s, Howard Bloom at MIT devised a data structure that can store a large database of items compactly. Instead of storing each item in the database in its entirety, a Bloom filter stores a small "fingerprint" of each item using only a few bits of space per item. By checking whether the same fingerprint appears twice in the database, a system can quickly determine whether the item is a duplicate or something novel.
Fruit flies are well known to change their behavior in response to novel odors. A region in the fly brain, called the mushroom body, contains a collection of neurons that processes olfactory information. When a new odor is experienced, these neurons broadcast a "novelty alert" signal so the fly knows this odor is new and worth investigating. If the odor, however, does not have a strong impact, the next time the odor is experienced, the strength of the alert signal is reduced and the fly doesn't waste time investigating the odor. This is an important computation because the fly wants to pay attention to something only if it's worth it. The fly's mushroom-body novelty signal is generated using a fingerprint for odors akin to the Bloom filter's "data fingerprint."
"A fundamental challenge in machine learning is finding representations of data that are suitable for a wide range of tasks," says Sanjoy Dasgupta, a professor of computer science and engineering at UC San Diego and the new paper's first author. "The fly's olfactory system shows us one simple and ingenious way of doing this."
By analyzing--from a computer science perspective--the neural circuit, identified in the Cell paper, that generates this novelty signal, Navlakha and Dasgupta found that the fruit fly introduced a couple of new twists to the traditional Bloom filter, which their team elaborated and defined mathematically.
The first twist involves not just determining whether you've smelled the exact same odor before, but rather if you've smelled the odor, or something pretty similar to it. This is important in the brain because chances are that you'll never smell the exact same odor twice. The second twist involves determining how long ago you've smelled the odor. If it's been a long time, then the odor's novelty should be higher than if you've smelled the odor rather recently.
Based on the fruit fly's Bloom filter variant, the team created a new algorithmic framework to predict fruit flies' novelty responses. They tested their framework on research data collected as flies were presented pairs of odors in succession. The team's novelty predictions turned out to closely match the actual novelty response of the mushroom body neurons, which validated their framework's accuracy. Navlakha's team then tested the framework on several machine learning data sets and found that the fly's Bloom filter improved the accuracy of novelty detection compared to other types of novelty detection filters.
Navlakha adds, "What makes this work especially exciting to us is that it represents one of the first data structures discovered in the brain, along with a simple algorithm for how the brain may actually perform novelty detection."
The work was funded by the Pew Charitable Trusts, the Kavli Institute for Brain and Mind, and the NIDCD of the National Institutes of Health under award number 1R01DC017695.
Other authors included Timothy C. Sheehan of UC San Diego and Charles F. Stevens of Salk.
About the Salk Institute for Biological Studies:
Every cure has a starting point. The Salk Institute embodies Jonas Salk's mission to dare to make dreams into reality. Its internationally renowned and award-winning scientists explore the very foundations of life, seeking new understandings in neuroscience, genetics, immunology, plant biology and more. The Institute is an independent nonprofit organization and architectural landmark: small by choice, intimate by nature and fearless in the face of any challenge. Be it cancer or Alzheimer's, aging or diabetes, Salk is where cures begin. Learn more at: salk.edu.
Salk Communications | EurekAlert!
SRNL demonstrates electrochemical techniques for monitoring microbial growth
04.12.2018 | DOE/Savannah River National Laboratory
New technique to identify phloem cells aids in the fight against citrus greening
04.12.2018 | Botanical Society of America
Scientists have discovered the first synthetic material that becomes thicker - at the molecular level - as it is stretched.
Researchers led by Dr Devesh Mistry from the University of Leeds discovered a new non-porous material that has unique and inherent "auxetic" stretching...
Scientists from the Theory Department of the Max Planck Institute for the Structure and Dynamics of Matter (MPSD) at the Center for Free-Electron Laser Science (CFEL) in Hamburg have shown through theoretical calculations and computer simulations that the force between electrons and lattice distortions in an atomically thin two-dimensional superconductor can be controlled with virtual photons. This could aid the development of new superconductors for energy-saving devices and many other technical applications.
The vacuum is not empty. It may sound like magic to laypeople but it has occupied physicists since the birth of quantum mechanics.
Process engineers at Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU) have developed a method which allows the size and shape of nanoparticles in dispersions to be determined considerably quicker than ever before. Based on gold nanorods, they demonstrated how length and diameter distributions can be measured accurately in just one step instead of the complicated series of electron microscopic images which have been needed up until now. Nanoparticles from precious metals are used, for example, as catalysts and contrast agents for diagnosing cancer. The results have been published in the renowned journal Nature Communications (doi: 10.1038/s41467-018-07366-9).
Even in the Middle Ages, gold particles were used to create vibrant red and blue colours, for example to illustrate biblical scenes in stained glass windows....
The experiments conducted from July until November at the Wendelstein 7-X fusion device at the Max Planck Institute for Plasma Physics (IPP) in Greifswald have achieved higher values for the density and the energy content of the plasma and long discharge times of up to 100 seconds – record results for devices of the stellarator type. Meanwhile, the next round of the step-by-step upgrading of Wendelstein 7-X has begun. It is to equip the device for greater heating power and longer discharges. Wendelstein 7-X, the world’s largest fusion device of the stellarator type, is to investigate the suitability of this configuration for use in a power plant.
During the course of the step-by-step upgrading of Wendelstein 7-X, the plasma vessel was fitted with inner cladding since September of last year.
Advances in environmental technology: You don’t need complex filters and laser systems to destroy persistent pollutants in water. Chemists at Martin Luther University Halle-Wittenberg (MLU) have developed a new process that works using mere sunlight. The process is so simple that it can even be conducted outdoors under the most basic conditions. The chemists present their research in the journal “Chemistry - a European Journal”.
The chemists at MLU rely on electrons moving freely in water, so-called hydrated electrons, to degrade dissolved pollutants.
03.12.2018 | Event News
28.11.2018 | Event News
23.11.2018 | Event News
04.12.2018 | Life Sciences
04.12.2018 | Life Sciences
04.12.2018 | Materials Sciences