But new work on Sandia National Laboratories’ Red Storm supercomputer — the 17th fastest in the world — is helping to make supercomputers more accessible, in effect removing them from the solitary confinement of their specialized operating systems.
Sandia researchers, working hand in hand with researchers from Northwestern University and the University of New Mexico, socialized 4,096 of Red Storm’s total 12,960 computer nodes into accepting a virtual external operating system — a leap of at least two orders of magnitude over previous such efforts.
“The goal is to create a more flexible environment for all users,” said Sandia researcher Kevin Pedretti, who led Sandia researchers in adapting and optimizing a Northwestern program called Palacios for the Red Storm environment. Sandia researchers directed the testing effort.
Built by Sandia as part of the National Nuclear Security Administration’s (NNSA) program to ensure the safety, security and effectiveness of the nation’s nuclear stockpile without testing, Red Storm’s advanced computational capabilities are also being utilized in unclassified modes to contribute to global efforts to combat climate change, evaluate dangers from possible asteroid strikes, and help solve other problems of national interest.
Peter Dinda, professor of electrical engineering and computer science at Northwestern’s McCormick School of Engineering, added, “If we can virtualize supercomputers without performance compromises we will make them easier to use and easier to manage, generally increasing the utility of these very large national infrastructure investments.” Dinda led the development of Palacios with his student Jack Lange.
Because of the complex nature of the classified work performed on Red Storm in the service of stockpile stewardship, its operating system is functionally restrictive compared with a general-purpose operating system.
Enter the technique called virtualization. A virtual machine in effect separates the hardware of a computer from its operating system.
“Our observation is that no single operating system will satisfy the needs of all potential users,” said Pedretti, “so we are attempting to leverage the virtualization hardware in modern processors to allow users to select the operating system best for them to use at run-time.”
This could permit one machine to simultaneously run multiple operating systems, with the possibility of migrating these systems from one computer to another. To achieve this trick on Red Storm, a receptor operating system called Kitten has been developed primarily at Sandia, while a virtual machine monitoring program called Palacios was developed at Northwestern. Operating through the filter of this programming translation, a program not native to Red Storm can run on nodes of the machine
The overlaid program was only 5 percent less effective than running Red Storm’s native, fixed programming. That figure, called overhead, represents the additional expense in time and efficiency of running the program in a virtualized environment.
“We believe the results show that the benefits of virtualization can be brought to even the largest computers in the world without performance compromises,” said Pedretti.
This would mean that researchers around the world should one day be able to run their own simulations on huge machines at remote sites without having to reconfigure their software to the machine’s specific hardware and software environment.
“Visualization technology provides a path for supporting a broader range of supercomputer applications, both for traditional scientific computing and for national security purposes,” says Pedretti.
The virtualization market in general is reported by industry magazines to be billions of dollars.
The work was funded for Sandia by its Laboratory Directed Research and Development program. Northwestern and UNM work was funded by the National Science Foundation.
Sandia National Laboratories is a multiprogram laboratory operated by Sandia Corporation, a wholly owned subsidiary of Lockheed Martin, for the U.S. Department of Energy’s National Nuclear Security Administration. With main facilities in Albuquerque, N.M., and Livermore, Calif., Sandia has major R&D responsibilities in national security, energy and environmental technologies, and economic competitiveness.
Neal Singer | Newswise Science News
Construction of practical quantum computers radically simplified
05.12.2016 | University of Sussex
UT professor develops algorithm to improve online mapping of disaster areas
29.11.2016 | University of Tennessee at Knoxville
In recent years, lasers with ultrashort pulses (USP) down to the femtosecond range have become established on an industrial scale. They could advance some applications with the much-lauded “cold ablation” – if that meant they would then achieve more throughput. A new generation of process engineering that will address this issue in particular will be discussed at the “4th UKP Workshop – Ultrafast Laser Technology” in April 2017.
Even back in the 1990s, scientists were comparing materials processing with nanosecond, picosecond and femtosesecond pulses. The result was surprising:...
Have you ever wondered how you see the world? Vision is about photons of light, which are packets of energy, interacting with the atoms or molecules in what...
A multi-institutional research collaboration has created a novel approach for fabricating three-dimensional micro-optics through the shape-defined formation of porous silicon (PSi), with broad impacts in integrated optoelectronics, imaging, and photovoltaics.
Working with colleagues at Stanford and The Dow Chemical Company, researchers at the University of Illinois at Urbana-Champaign fabricated 3-D birefringent...
In experiments with magnetic atoms conducted at extremely low temperatures, scientists have demonstrated a unique phase of matter: The atoms form a new type of quantum liquid or quantum droplet state. These so called quantum droplets may preserve their form in absence of external confinement because of quantum effects. The joint team of experimental physicists from Innsbruck and theoretical physicists from Hannover report on their findings in the journal Physical Review X.
“Our Quantum droplets are in the gas phase but they still drop like a rock,” explains experimental physicist Francesca Ferlaino when talking about the...
The Max Planck Institute for Physics (MPP) is opening up a new research field. A workshop from November 21 - 22, 2016 will mark the start of activities for an innovative axion experiment. Axions are still only purely hypothetical particles. Their detection could solve two fundamental problems in particle physics: What dark matter consists of and why it has not yet been possible to directly observe a CP violation for the strong interaction.
The “MADMAX” project is the MPP’s commitment to axion research. Axions are so far only a theoretical prediction and are difficult to detect: on the one hand,...
16.11.2016 | Event News
01.11.2016 | Event News
14.10.2016 | Event News
08.12.2016 | Power and Electrical Engineering
07.12.2016 | Health and Medicine
07.12.2016 | Life Sciences