Largest neuronal network simulation to date achieved using Japanese supercomputer

The simulation was made possible by the development of advanced novel data structures for the simulation software NEST. The relevance of the achievement for neuroscience lies in the fact that NEST is open-source software freely available to every scientist in the world.

Using NEST, the team, led by Markus Diesmann in collaboration with Abigail Morrison both now with the Institute of Neuroscience and Medicine at Jülich, succeeded in simulating a network consisting of 1.73 billion nerve cells connected by 10.4 trillion synapses. To realize this feat, the program recruited 82,944 processors of the K Computer. The process took 40 minutes, to complete the simulation of 1 second of neuronal network activity in real, biological, time.

Although the simulated network is huge, it only represents 1% of the neuronal network in the brain. The nerve cells were randomly connected and the simulation itself was not supposed to provide new insight into the brain – the purpose of the endeavor was to test the limits of the simulation technology developed in the project and the capabilities of K. In the process, the researchers gathered invaluable experience that will guide them in the construction of novel simulation software.

This achievement gives neuroscientists a glimpse of what will be possible in the future, with the next generation of computers, so called exa-scale computers.

“If peta-scale computers like the K Computer are capable of representing 1% of the network of a human brain today, then we know that simulating the whole brain at the level of the individual nerve cell and its synapses will be possible with exa-scale computers hopefully available within the next decade,” explains Diesmann.

Memory of 250.000 PCs

Simulating a large neuronal network and a process like learning requires large amounts of computing memory. Synapses, the structures at the interface between two neurons, are constantly modified by neuronal interaction and simulators need to allow for these modifications.

More important than the number of neurons in the simulated network is the fact that during the simulation each synapse between excitatory neurons was supplied with 24 bytes of memory. This enabled an accurate mathematical description of the network.

In total, the simulator coordinated the use of about 1 petabyte of main
memory, which corresponds to the aggregated memory of 250.000 PCs.
NEST
NEST is a widely used, general-purpose neuronal network simulation software available to the community as open source. The team ensured that their optimizations were of general character, independent of a particular hardware or neuroscientific problem. This will enable neuroscientists to use the software to investigate neuronal systems using normal laptops, computer clusters or, for the largest systems, supercomputers, and easily exchange their model descriptions.

A large, international project

Work on optimizing NEST for the K Computer started in 2009 while the supercomputer was still under construction. Shin Ishii, leader of the brain science projects on K at the time, explains that “Having access to the established supercomputers at Jülich, JUGENE and JUQUEEN, was essential, to prepare for K and cross-check results.”

Mitsuhisa Sato, of the RIKEN Advanced Institute for Computer Science, points out that “Many researchers at many different Japanese and European institutions have been involved in this project, but the dedication of Jun Igarashi now at OIST, Gen Masumoto now at the RIKEN Advanced Center for Computing and Communication, Susanne Kunkel and Moritz Helias now at Forschungszentrum Jülich was key to the success of the endeavor.”

Paving the way for future projects

Kenji Doya of OIST, currently leading a project aiming to understand the neural control of movement and the mechanism of Parkinson's disease, says “The new result paves the way for combined simulations of the brain and the musculoskeletal system using the K Computer. These results demonstrate that neuroscience can make full use of the existing peta-scale supercomputers.”

The achievement on K provides new technology for brain research in Japan and is encouraging news for the Human Brain Project (HBP) of the European Union, scheduled to start this October. The central supercomputer for this project will be based at Forschungszentrum Jülich.

The researchers in Japan and Germany are planning on continuing their successful collaboration in the upcoming era of exa-scale systems.

For more information please contact:

Prof. Markus Diesmann
Institute of Neuroscience and Medicine, Computational and Systems Neuroscience (INM-6), Forschungszentrum Jülich
Tel: +49 (0)2461 61-9301
Email: diesmann@fz-juelich.de
Juliette Savin
Global Relations Office
RIKEN
Tel: +81-(0)48-462-1225
Mobile phone: +81-(0)808895-2136
Email: pr@riken.jp
Kaoru Natori
Media Section Leader, Communication and PR Division, OIST
Tel: +81-(0)98-966-2389
Mobile phone : +81-(0)806497-2711
E-Mail: kaoru.natori@oist.jp
About RIKEN
RIKEN is Japan's largest research institute for basic and applied research. Over 2500 papers by RIKEN researchers are published every year in leading scientific and technical journals, covering a broad spectrum of disciplines including physics, chemistry, biology, medical science and engineering. RIKEN's research environment and strong emphasis on interdisciplinary collaboration and globalization has earned a reputation for scientific excellence worldwide.

Website: www.riken.jp/en/ Find us on Twitter at @riken_en

About the K Computer
The K Computer is Japan’s most powerful supercomputer developed in partnership with electronics firm Fujitsu. It boasts a computational power of 1016petaflops, or 10 billion operations per second. The supercomputer’s exceptional simulation precision and computational speed benefit research in a broad range of fields that use computational science, ranging from pharmaceutical science to nanoscience and disaster prevention.
About Forschungszentrum Jülich
Forschungszentrum Jülich pursues cutting-edge interdisciplinary research to address pressing issues of the present, most of all the future energy supply. With its competence in materials science and simulation and its expertise in physics, nanotechnology and information technology and also in the biosciences and brain research, Jülich is developing a basis for the key technologies of tomorrow. Forschungszentrum Jülich helps to solve the grand challenges facing society in the fields of energy and the environment, health and information technology. With a staff of almost 5,000, Jülich – a member of the Helmholtz Association – is one of the large interdisciplinary research centres in Europe.
About OIST
The Okinawa Institute of Science and Technology (OIST) is a new graduate university established in November 2011 with the aim to conduct internationally outstanding education and research in science and technology, and thus contribute to the self-sustaining development of Okinawa and promote the advancement of science and technology in Japan and throughout the world. The first graduate class commenced in September 2012 with 34 students from 18 countries and regions. Its education and research program is cross-disciplinary and aims to be at the leading edge. As of July 2013, 45 research units (with over 350 researchers, of whom approximately 150 are international) have been launched so far, with research in five major areas of neuroscience; molecular, cell, and developmental biology; mathematical and computational sciences, environmental and ecological sciences; and physics and chemistry.