But new work on Sandia National Laboratories’ Red Storm supercomputer — the 17th fastest in the world — is helping to make supercomputers more accessible, in effect removing them from the solitary confinement of their specialized operating systems.
Sandia researchers, working hand in hand with researchers from Northwestern University and the University of New Mexico, socialized 4,096 of Red Storm’s total 12,960 computer nodes into accepting a virtual external operating system — a leap of at least two orders of magnitude over previous such efforts.
“The goal is to create a more flexible environment for all users,” said Sandia researcher Kevin Pedretti, who led Sandia researchers in adapting and optimizing a Northwestern program called Palacios for the Red Storm environment. Sandia researchers directed the testing effort.
Built by Sandia as part of the National Nuclear Security Administration’s (NNSA) program to ensure the safety, security and effectiveness of the nation’s nuclear stockpile without testing, Red Storm’s advanced computational capabilities are also being utilized in unclassified modes to contribute to global efforts to combat climate change, evaluate dangers from possible asteroid strikes, and help solve other problems of national interest.
Peter Dinda, professor of electrical engineering and computer science at Northwestern’s McCormick School of Engineering, added, “If we can virtualize supercomputers without performance compromises we will make them easier to use and easier to manage, generally increasing the utility of these very large national infrastructure investments.” Dinda led the development of Palacios with his student Jack Lange.
Because of the complex nature of the classified work performed on Red Storm in the service of stockpile stewardship, its operating system is functionally restrictive compared with a general-purpose operating system.
Enter the technique called virtualization. A virtual machine in effect separates the hardware of a computer from its operating system.
“Our observation is that no single operating system will satisfy the needs of all potential users,” said Pedretti, “so we are attempting to leverage the virtualization hardware in modern processors to allow users to select the operating system best for them to use at run-time.”
This could permit one machine to simultaneously run multiple operating systems, with the possibility of migrating these systems from one computer to another. To achieve this trick on Red Storm, a receptor operating system called Kitten has been developed primarily at Sandia, while a virtual machine monitoring program called Palacios was developed at Northwestern. Operating through the filter of this programming translation, a program not native to Red Storm can run on nodes of the machine
The overlaid program was only 5 percent less effective than running Red Storm’s native, fixed programming. That figure, called overhead, represents the additional expense in time and efficiency of running the program in a virtualized environment.
“We believe the results show that the benefits of virtualization can be brought to even the largest computers in the world without performance compromises,” said Pedretti.
This would mean that researchers around the world should one day be able to run their own simulations on huge machines at remote sites without having to reconfigure their software to the machine’s specific hardware and software environment.
“Visualization technology provides a path for supporting a broader range of supercomputer applications, both for traditional scientific computing and for national security purposes,” says Pedretti.
The virtualization market in general is reported by industry magazines to be billions of dollars.
The work was funded for Sandia by its Laboratory Directed Research and Development program. Northwestern and UNM work was funded by the National Science Foundation.
Sandia National Laboratories is a multiprogram laboratory operated by Sandia Corporation, a wholly owned subsidiary of Lockheed Martin, for the U.S. Department of Energy’s National Nuclear Security Administration. With main facilities in Albuquerque, N.M., and Livermore, Calif., Sandia has major R&D responsibilities in national security, energy and environmental technologies, and economic competitiveness.
Neal Singer | Newswise Science News
Switchable DNA mini-machines store information
26.06.2017 | Emory Health Sciences
Equipping form with function
23.06.2017 | Institute of Science and Technology Austria
An international team of scientists has proposed a new multi-disciplinary approach in which an array of new technologies will allow us to map biodiversity and the risks that wildlife is facing at the scale of whole landscapes. The findings are published in Nature Ecology and Evolution. This international research is led by the Kunming Institute of Zoology from China, University of East Anglia, University of Leicester and the Leibniz Institute for Zoo and Wildlife Research.
Using a combination of satellite and ground data, the team proposes that it is now possible to map biodiversity with an accuracy that has not been previously...
Heatwaves in the Arctic, longer periods of vegetation in Europe, severe floods in West Africa – starting in 2021, scientists want to explore the emissions of the greenhouse gas methane with the German-French satellite MERLIN. This is made possible by a new robust laser system of the Fraunhofer Institute for Laser Technology ILT in Aachen, which achieves unprecedented measurement accuracy.
Methane is primarily the result of the decomposition of organic matter. The gas has a 25 times greater warming potential than carbon dioxide, but is not as...
Hydrogen is regarded as the energy source of the future: It is produced with solar power and can be used to generate heat and electricity in fuel cells. Empa researchers have now succeeded in decoding the movement of hydrogen ions in crystals – a key step towards more efficient energy conversion in the hydrogen industry of tomorrow.
As charge carriers, electrons and ions play the leading role in electrochemical energy storage devices and converters such as batteries and fuel cells. Proton...
Scientists from the Excellence Cluster Universe at the Ludwig-Maximilians-Universität Munich have establised "Cosmowebportal", a unique data centre for cosmological simulations located at the Leibniz Supercomputing Centre (LRZ) of the Bavarian Academy of Sciences. The complete results of a series of large hydrodynamical cosmological simulations are available, with data volumes typically exceeding several hundred terabytes. Scientists worldwide can interactively explore these complex simulations via a web interface and directly access the results.
With current telescopes, scientists can observe our Universe’s galaxies and galaxy clusters and their distribution along an invisible cosmic web. From the...
Temperature measurements possible even on the smallest scale / Molecular ruby for use in material sciences, biology, and medicine
Chemists at Johannes Gutenberg University Mainz (JGU) in cooperation with researchers of the German Federal Institute for Materials Research and Testing (BAM)...
19.06.2017 | Event News
13.06.2017 | Event News
13.06.2017 | Event News
26.06.2017 | Life Sciences
26.06.2017 | Physics and Astronomy
26.06.2017 | Information Technology