Energy constraints lead to novel ways of efficient, at-a-distance communication
When it fires, a neuron consumes significantly more energy than an equivalent computer operation. And yet, a network of coupled neurons can continuously learn, sense and perform complex tasks at energy levels that are currently unattainable for even state-of-the-art processors.
What does a neuron do to save energy that a contemporary computer processing unit doesn't?
Computer modelling by researchers at Washington University in St. Louis' McKelvey School of Engineering may provide an answer. Using simulated silicon "neurons," they found that energy constraints on a system, coupled with the intrinsic property neurons have to move to the lowest-energy configuration, leads to a dynamic, at-a-distance communication protocol that is both more robust and more energy-efficient than traditional computer processors.
The research, from the lab of Shantanu Chakrabartty, the Clifford W. Murphy Professor in the Preston M. Green Department of Systems & Electrical Engineering, was published last month in the journal Frontiers in Neuroscience.
It's a case of doing more with less.
Ahana Gangopadhyay, a doctoral student in Chakrabartty's lab and a lead author on the paper, has been investigating computer models to study the energy constraints on silicon neurons -- artificially created neurons, connected by wires, that show the same dynamics and behavior as the neurons in our brains.
Like biological neurons, their silicon counterparts also depend on specific electrical conditions to fire, or spike. These spikes are the basis of neuronal communication, zipping back and forth, carrying information from neuron to neuron.
The researchers first looked at the energy constraints on a single neuron. Then a pair. Then, they added more. "We found there's a way to couple them where you can use some of these energy constraints, themselves, to create a virtual communication channel," Chakrabartty said.
A group of neurons operates under a common energy constraint. So, when a single neuron spikes, it necessarily affects the available energy -- not just for the neurons it's directly connected to, but for all others operating under the same energy constraint.
Spiking neurons thus create perturbations in the system, allowing each neuron to "know" which others are spiking, which are responding, and so on. It's as if the neurons were all embedded in a rubber sheet; a single ripple, caused by a spike, would affect them all. And like all physical processes, systems of silicon neurons tend to self-optimize to their least-energetic states while also being affected by the other neurons in the network.
These constraints come together to form a kind of secondary communication network, where additional information can be communicated through the dynamic but synchronized topology of spikes. It's like the rubber sheet vibrating in a synchronized rhythm in response to multiple spikes.
This topology carries with it information that is communicated, not just to the neurons that are physically connected, but to all neurons under the same energy constraint, including ones that are not physically connected.
Under the pressure of these constraints, Chakrabartty said, "They learn to form a network on the fly."
This makes for much more efficient communication than traditional computer processors, which lose most of their energy in the process of linear communication, where neuron A must first send a signal through B in order to communicate with C.
Using these silicon neurons for computer processors gives the best efficiency-to-processing speed tradeoff, Chakrabartty said. It will allow hardware designers to create systems to take advantage of this secondary network, computing not just linearly, but with the ability to perform additional computing on this secondary network of spikes.
The immediate next steps, however, are to create a simulator that can emulate billions of neurons. Then researchers will begin the process of building a physical chip.
Brandie Jefferson | EurekAlert!
Cherned up to the maximum
10.07.2020 | Max-Planck-Institut für Chemische Physik fester Stoffe
Porous graphene ribbons doped with nitrogen for electronics and quantum computing
09.07.2020 | University of Basel
New insight into the spin behavior in an exotic state of matter puts us closer to next-generation spintronic devices
Aside from the deep understanding of the natural world that quantum physics theory offers, scientists worldwide are working tirelessly to bring forth a...
Kiel physics team observed extremely fast electronic changes in real time in a special material class
In physics, they are currently the subject of intensive research; in electronics, they could enable completely new functions. So-called topological materials...
Solar cells based on perovskite compounds could soon make electricity generation from sunlight even more efficient and cheaper. The laboratory efficiency of these perovskite solar cells already exceeds that of the well-known silicon solar cells. An international team led by Stefan Weber from the Max Planck Institute for Polymer Research (MPI-P) in Mainz has found microscopic structures in perovskite crystals that can guide the charge transport in the solar cell. Clever alignment of these "electron highways" could make perovskite solar cells even more powerful.
Solar cells convert sunlight into electricity. During this process, the electrons of the material inside the cell absorb the energy of the light....
Empa researchers have succeeded in applying aerogels to microelectronics: Aerogels based on cellulose nanofibers can effectively shield electromagnetic radiation over a wide frequency range – and they are unrivalled in terms of weight.
Electric motors and electronic devices generate electromagnetic fields that sometimes have to be shielded in order not to affect neighboring electronic...
A promising operating mode for the plasma of a future power plant has been developed at the ASDEX Upgrade fusion device at Max Planck Institute for Plasma...
07.07.2020 | Event News
02.07.2020 | Event News
19.05.2020 | Event News
10.07.2020 | Life Sciences
10.07.2020 | Materials Sciences
10.07.2020 | Life Sciences