New framework discovered by Salk scientists could improve machine-learning methods or help to detect when novelty detection is impaired in the brain
It might seem like fruit flies would have nothing in common with computers, but new research from the Salk Institute reveals that the two identify novel information in similar ways. The work, which appeared in Proceedings of the National Academy of Sciences (PNAS) on December 3, 2018, not only sheds light on an important neurobiological problem--how organisms detect new odors--but could also improve algorithms for novelty detection in computer science.
This image of flies buzzing around glasses of wine illustrates how flies detect novel odors using a tactic similar to that of a computer using a computational tool called a Bloom filter. In the fly version, neurons called Kenyon cells in a region of the fly brain called the mushroom body (MBON-a'3) process olfactory information and broadcast a 'novelty alert' signal when a new odor is encountered.
Credit: Salk Institute
"When a fly smells an odor, the fly needs to quickly figure out if it has smelled the odor before, to determine if the odor is new and something it should pay attention to," says Saket Navlakha, an assistant professor in Salk's Integrative Biology Laboratory. "In computer science, this is an important task called novelty detection. Understanding how novelty detection strategies compare in both domains could give us valuable insights into both brain algorithms and computing." The researchers suggest that their new framework could be useful in detecting duplicates or anomalies in large, streaming data sets, such as patient databases or news stories.
In 2017, Navlakha discovered how fly brains identify similar odors. He found that applying the fly algorithm to computer "similarity searches" (such as ones that suggest products to buy that are similar to your past purchases) improved the search results.
The new PNAS study is based on another paper [Hattori et al.] that came out in 2017 in the journal Cell, describing how flies detect entirely new odors. When Navlakha read the study, he was struck by how the flies seemed to be using a tactic similar to a computational tool for novelty detection called a Bloom filter.
When a search engine such as Google crawls the Web, it needs to know whether a website it comes across has previously been indexed, so that it doesn't waste time indexing the same site again. The problem is there are trillions of websites on the Web, and storing all of them in memory is computationally expensive. In the 1970s, Howard Bloom at MIT devised a data structure that can store a large database of items compactly. Instead of storing each item in the database in its entirety, a Bloom filter stores a small "fingerprint" of each item using only a few bits of space per item. By checking whether the same fingerprint appears twice in the database, a system can quickly determine whether the item is a duplicate or something novel.
Fruit flies are well known to change their behavior in response to novel odors. A region in the fly brain, called the mushroom body, contains a collection of neurons that processes olfactory information. When a new odor is experienced, these neurons broadcast a "novelty alert" signal so the fly knows this odor is new and worth investigating. If the odor, however, does not have a strong impact, the next time the odor is experienced, the strength of the alert signal is reduced and the fly doesn't waste time investigating the odor. This is an important computation because the fly wants to pay attention to something only if it's worth it. The fly's mushroom-body novelty signal is generated using a fingerprint for odors akin to the Bloom filter's "data fingerprint."
"A fundamental challenge in machine learning is finding representations of data that are suitable for a wide range of tasks," says Sanjoy Dasgupta, a professor of computer science and engineering at UC San Diego and the new paper's first author. "The fly's olfactory system shows us one simple and ingenious way of doing this."
By analyzing--from a computer science perspective--the neural circuit, identified in the Cell paper, that generates this novelty signal, Navlakha and Dasgupta found that the fruit fly introduced a couple of new twists to the traditional Bloom filter, which their team elaborated and defined mathematically.
The first twist involves not just determining whether you've smelled the exact same odor before, but rather if you've smelled the odor, or something pretty similar to it. This is important in the brain because chances are that you'll never smell the exact same odor twice. The second twist involves determining how long ago you've smelled the odor. If it's been a long time, then the odor's novelty should be higher than if you've smelled the odor rather recently.
Based on the fruit fly's Bloom filter variant, the team created a new algorithmic framework to predict fruit flies' novelty responses. They tested their framework on research data collected as flies were presented pairs of odors in succession. The team's novelty predictions turned out to closely match the actual novelty response of the mushroom body neurons, which validated their framework's accuracy. Navlakha's team then tested the framework on several machine learning data sets and found that the fly's Bloom filter improved the accuracy of novelty detection compared to other types of novelty detection filters.
Navlakha adds, "What makes this work especially exciting to us is that it represents one of the first data structures discovered in the brain, along with a simple algorithm for how the brain may actually perform novelty detection."
The work was funded by the Pew Charitable Trusts, the Kavli Institute for Brain and Mind, and the NIDCD of the National Institutes of Health under award number 1R01DC017695.
Other authors included Timothy C. Sheehan of UC San Diego and Charles F. Stevens of Salk.
About the Salk Institute for Biological Studies:
Every cure has a starting point. The Salk Institute embodies Jonas Salk's mission to dare to make dreams into reality. Its internationally renowned and award-winning scientists explore the very foundations of life, seeking new understandings in neuroscience, genetics, immunology, plant biology and more. The Institute is an independent nonprofit organization and architectural landmark: small by choice, intimate by nature and fearless in the face of any challenge. Be it cancer or Alzheimer's, aging or diabetes, Salk is where cures begin. Learn more at: salk.edu.
Salk Communications | EurekAlert!
Polymers get caught up in love-hate chemistry of oil and water
28.02.2020 | DOE/Oak Ridge National Laboratory
How do zebrafish get their stripes? New data analysis tool could provide an answer
28.02.2020 | Brown University
Researchers at the University of Bayreuth have discovered an unusual material: When cooled down to two degrees Celsius, its crystal structure and electronic properties change abruptly and significantly. In this new state, the distances between iron atoms can be tailored with the help of light beams. This opens up intriguing possibilities for application in the field of information technology. The scientists have presented their discovery in the journal "Angewandte Chemie - International Edition". The new findings are the result of close cooperation with partnering facilities in Augsburg, Dresden, Hamburg, and Moscow.
The material is an unusual form of iron oxide with the formula Fe₅O₆. The researchers produced it at a pressure of 15 gigapascals in a high-pressure laboratory...
Study by Mainz physicists indicates that the next generation of neutrino experiments may well find the answer to one of the most pressing issues in neutrino physics
Among the most exciting challenges in modern physics is the identification of the neutrino mass ordering. Physicists from the Cluster of Excellence PRISMA+ at...
Fraunhofer researchers are investigating the potential of microimplants to stimulate nerve cells and treat chronic conditions like asthma, diabetes, or Parkinson’s disease. Find out what makes this form of treatment so appealing and which challenges the researchers still have to master.
A study by the Robert Koch Institute has found that one in four women will suffer from weak bladders at some point in their lives. Treatments of this condition...
The operational speed of semiconductors in various electronic and optoelectronic devices is limited to several gigahertz (a billion oscillations per second). This constrains the upper limit of the operational speed of computing. Now researchers from the Max Planck Institute for the Structure and Dynamics of Matter in Hamburg, Germany, and the Indian Institute of Technology in Bombay have explained how these processes can be sped up through the use of light waves and defected solid materials.
Light waves perform several hundred trillion oscillations per second. Hence, it is natural to envision employing light oscillations to drive the electronic...
Most natural and artificial surfaces are rough: metals and even glasses that appear smooth to the naked eye can look like jagged mountain ranges under the microscope. There is currently no uniform theory about the origin of this roughness despite it being observed on all scales, from the atomic to the tectonic. Scientists suspect that the rough surface is formed by irreversible plastic deformation that occurs in many processes of mechanical machining of components such as milling.
Prof. Dr. Lars Pastewka from the Simulation group at the Department of Microsystems Engineering at the University of Freiburg and his team have simulated such...
12.02.2020 | Event News
16.01.2020 | Event News
15.01.2020 | Event News
28.02.2020 | Materials Sciences
28.02.2020 | Life Sciences
28.02.2020 | Architecture and Construction