But new work on Sandia National Laboratories’ Red Storm supercomputer — the 17th fastest in the world — is helping to make supercomputers more accessible, in effect removing them from the solitary confinement of their specialized operating systems.
Sandia researchers, working hand in hand with researchers from Northwestern University and the University of New Mexico, socialized 4,096 of Red Storm’s total 12,960 computer nodes into accepting a virtual external operating system — a leap of at least two orders of magnitude over previous such efforts.
“The goal is to create a more flexible environment for all users,” said Sandia researcher Kevin Pedretti, who led Sandia researchers in adapting and optimizing a Northwestern program called Palacios for the Red Storm environment. Sandia researchers directed the testing effort.
Built by Sandia as part of the National Nuclear Security Administration’s (NNSA) program to ensure the safety, security and effectiveness of the nation’s nuclear stockpile without testing, Red Storm’s advanced computational capabilities are also being utilized in unclassified modes to contribute to global efforts to combat climate change, evaluate dangers from possible asteroid strikes, and help solve other problems of national interest.
Peter Dinda, professor of electrical engineering and computer science at Northwestern’s McCormick School of Engineering, added, “If we can virtualize supercomputers without performance compromises we will make them easier to use and easier to manage, generally increasing the utility of these very large national infrastructure investments.” Dinda led the development of Palacios with his student Jack Lange.
Because of the complex nature of the classified work performed on Red Storm in the service of stockpile stewardship, its operating system is functionally restrictive compared with a general-purpose operating system.
Enter the technique called virtualization. A virtual machine in effect separates the hardware of a computer from its operating system.
“Our observation is that no single operating system will satisfy the needs of all potential users,” said Pedretti, “so we are attempting to leverage the virtualization hardware in modern processors to allow users to select the operating system best for them to use at run-time.”
This could permit one machine to simultaneously run multiple operating systems, with the possibility of migrating these systems from one computer to another. To achieve this trick on Red Storm, a receptor operating system called Kitten has been developed primarily at Sandia, while a virtual machine monitoring program called Palacios was developed at Northwestern. Operating through the filter of this programming translation, a program not native to Red Storm can run on nodes of the machine
The overlaid program was only 5 percent less effective than running Red Storm’s native, fixed programming. That figure, called overhead, represents the additional expense in time and efficiency of running the program in a virtualized environment.
“We believe the results show that the benefits of virtualization can be brought to even the largest computers in the world without performance compromises,” said Pedretti.
This would mean that researchers around the world should one day be able to run their own simulations on huge machines at remote sites without having to reconfigure their software to the machine’s specific hardware and software environment.
“Visualization technology provides a path for supporting a broader range of supercomputer applications, both for traditional scientific computing and for national security purposes,” says Pedretti.
The virtualization market in general is reported by industry magazines to be billions of dollars.
The work was funded for Sandia by its Laboratory Directed Research and Development program. Northwestern and UNM work was funded by the National Science Foundation.
Sandia National Laboratories is a multiprogram laboratory operated by Sandia Corporation, a wholly owned subsidiary of Lockheed Martin, for the U.S. Department of Energy’s National Nuclear Security Administration. With main facilities in Albuquerque, N.M., and Livermore, Calif., Sandia has major R&D responsibilities in national security, energy and environmental technologies, and economic competitiveness.
Neal Singer | Newswise Science News
Earthquake researchers finalists for supercomputing prize
19.11.2018 | University of Tokyo
Putting food-safety detection in the hands of consumers
15.11.2018 | Massachusetts Institute of Technology
Max Planck researchers revel the nano-structure of molecular trains and the reason for smooth transport in cellular antennas.
Moving around, sensing the extracellular environment, and signaling to other cells are important for a cell to function properly. Responsible for those tasks...
Researchers at the University of New Hampshire have captured a difficult-to-view singular event involving "magnetic reconnection"--the process by which sparse particles and energy around Earth collide producing a quick but mighty explosion--in the Earth's magnetotail, the magnetic environment that trails behind the planet.
Magnetic reconnection has remained a bit of a mystery to scientists. They know it exists and have documented the effects that the energy explosions can...
Biochips have been developed at TU Wien (Vienna), on which tissue can be produced and examined. This allows supplying the tissue with different substances in a very controlled way.
Cultivating human cells in the Petri dish is not a big challenge today. Producing artificial tissue, however, permeated by fine blood vessels, is a much more...
Faster and secure data communication: This is the goal of a new joint project involving physicists from the University of Würzburg. The German Federal Ministry of Education and Research funds the project with 14.8 million euro.
In our digital world data security and secure communication are becoming more and more important. Quantum communication is a promising approach to achieve...
On Saturday, 10 November 2018, the research icebreaker Polarstern will leave its homeport of Bremerhaven, bound for Cape Town, South Africa.
19.11.2018 | Event News
09.11.2018 | Event News
06.11.2018 | Event News
20.11.2018 | Life Sciences
20.11.2018 | Life Sciences
20.11.2018 | Physics and Astronomy