The debugging tool is a significant milestone in LLNL's multi-year collaboration with the University of Wisconsin (UW), Madison and the University of New Mexico (UNM) to ensure supercomputers run more efficiently.
Playing a significant role in scaling up the Sequoia supercomputer, STAT, a 2011 R&D 100 Award winner, has helped both early access users and system integrators quickly isolate a wide range of errors, including particularly perplexing issues that only manifested at extremely large scales up to 1,179,648 compute cores. During the Sequoia scale-up, bugs in applications as well as defects in system software and hardware have manifested themselves as failures in applications. It is important to quickly diagnose errors so they can be reported to experts who can analyze them in detail and ultimately solve the problem.
"STAT has been indispensable in this capacity, helping the multi-disciplined integration team keep pace with the aggressive system scale-up schedule," said LLNL computer scientist Greg Lee.
"While testing a subsystem of Blue/Gene Q, my test program consistently failed only when scaled to 1,179,648 MPI processes. Although the test program was simple, the sheer scale at which this program ran made debugging efforts highly challenging. But when I applied STAT, it quickly revealed that one particular rank process was consistently stuck in a system call," said Dong Ahn, a computer scientist in Livermore Computing.
Based on this finding, a system expert took a close look at the compute core on which this rank process was running and discovered a hardware defect. "Replacing the component suddenly got the entire Sequoia system back to life," Ahn said. "Putting this exercise into perspective, this error was due to a defect in a tiny hardware unit, the decrementor, of a single hardware thread out of a total of 4.7 million hardware threads. I felt it was like finding a needle in a haystack over a coffee break."
Sequoia delivers 20 petaflops of peak power and was ranked No. 1 in June of this year's TOP500 list. It is currently ranked No. 2, behind Oak Ridge National Laboratory's Titan.
LLNL plans to use Sequoia's impressive computational capability to advance understanding of fundamental physics and engineering questions that arise in the National Nuclear Security Administration's (NNSA) program to ensure the safety, security and effectiveness of the United States' nuclear deterrent without testing. Sequoia also will support NNSA/DOE programs at LLNL that focus on nonproliferation, counterterrorism, energy, security, health and climate change.
As LLNL takes delivery of the Sequoia system and works to move it into production, computer scientists will migrate applications that have been running on earlier systems to this newer architecture. This is a period of intense activity for LLNL's application teams as they gain experience with the new hardware and software environment.
"Having a highly effective debugging tool that scales to the full system is vital to the installation and acceptance process for Sequoia. It is critical that our development teams have a comprehensive parallel debugging tool set as they iron out the inevitable issues that come up with running on a new system like Sequoia," said Kim Cupps, leader of the Livermore Computing Division at LLNL.
STAT is particularly important for LLNL because supercomputer simulations are essential in virtually every mission area of the Laboratory. The tool also has been used at other sites and proved to be effective on a wide range of supercomputer platforms, including Linux clusters and Cray systems.
The team is actively pursuing further optimization of STAT technologies and is exploring commercialization strategies. More information about STAT, including a link to the source code, is available on the Web.
Early science runs prepare Lawrence Livermore National Lab's Sequoia for national security missions
LLNL news release, Nov. 9, 2012
"Venturing into the heart of high-performance computing simulations"
Science & Technology Review, September 2012
Founded in 1952, Lawrence Livermore National Laboratory provides solutions to our nation's most important national security challenges through innovative science, engineering and technology. Lawrence Livermore National Laboratory is managed by Lawrence Livermore National Security, LLC for the U.S. Department of Energy's National Nuclear Security Administration.
Anne Stark | Source: EurekAlert!
Further information: www.llnl.gov
Further Reports about: Bug repellent > computer simulation > Laboratory > LLNL > MPI > national security > Nuclear > Nuclear Security Administration > Pervasive Computing > Security Administration > Security Forum > STAT
More articles from Information Technology:
Making memories: Practical quantum computing moves closer to reality
19.06.2013 | Dartmouth College
Titan Completes Acceptance Testing
12.06.2013 | Oak Ridge National Laboratory
- Biological fermentation process converts CO and CO2 into bioethanol and platform chemicals
- Process uses energy contained in steel plant off-gases
- Ten-year co-operation to develop and market integrated environmental solutions for the steel industry worldwide
Siemens Metals Technologies and LanzaTech have signed a ten-year co-operation agreement to develop and market integrated environmental solutions for the steel industry worldwide. The collaboration will utilize the ground-breaking fermentation technology developed by LanzaTech transforming carbon-rich off-gases generated by the steel industry into low carbon bioethanol and other platform chemicals. ...
Novel application of 3D printing could enable the development of miniaturized medical implants, compact electronics, tiny robots, and more
3D printing can now be used to print lithium-ion microbatteries the size of a grain of sand. The printed microbatteries could supply electricity to tiny devices in fields from medicine to communications, including many that have lingered on lab benches for lack of a battery small enough to fit the ...
... two engines aircraft project “Elektro E6”.
The countdown has been started for opening the gates again for the worldwide leading aviation and space event in Le Bourget, Paris from June 17th - 23rd, 2013.
EADCO & PC-Aero will present at the Paris Air Show in Hall H4 booth F-7 their new future aircraft and innovative project: ...
Siemens scientists have developed new kinds of ceramics in which they can embed transformers.
The new development allows power supply transformers to be reduced to one fifth of their current size so that the normally separate switched-mode power supply units of light-emitting diodes can be integrated into the module's heat sink.
The new technology was developed in cooperation with industrial and research partners who ...
Cheaper clean-energy technologies could be made possible thanks to a new discovery.
Led by Raymond Schaak, a professor of chemistry at Penn State University, research team members have found that an important chemical reaction that generates hydrogen from water is effectively triggered -- or catalyzed -- by a nanoparticle composed of nickel and phosphorus, two inexpensive elements that are abundant on Earth. ...
19.06.2013 | Life Sciences
19.06.2013 | Agricultural and Forestry Science
19.06.2013 | Studies and Analyses
14.06.2013 | Event News
13.06.2013 | Event News
10.06.2013 | Event News