(Press-News.org) Livermore, Calif. -- Lawrence Livermore National Laboratory (LLNL) researchers have used the Stack Trace Analysis Tool (STAT), a highly scalable, lightweight tool to debug a program running more than one million MPI processes on the IBM Blue Gene/Q (BGQ)-based Sequoia supercomputer.
The debugging tool is a significant milestone in LLNL's multi-year collaboration with the University of Wisconsin (UW), Madison and the University of New Mexico (UNM) to ensure supercomputers run more efficiently.
Playing a significant role in scaling up the Sequoia supercomputer, STAT, a 2011 R&D 100 Award winner, has helped both early access users and system integrators quickly isolate a wide range of errors, including particularly perplexing issues that only manifested at extremely large scales up to 1,179,648 compute cores. During the Sequoia scale-up, bugs in applications as well as defects in system software and hardware have manifested themselves as failures in applications. It is important to quickly diagnose errors so they can be reported to experts who can analyze them in detail and ultimately solve the problem.
"STAT has been indispensable in this capacity, helping the multi-disciplined integration team keep pace with the aggressive system scale-up schedule," said LLNL computer scientist Greg Lee.
"While testing a subsystem of Blue/Gene Q, my test program consistently failed only when scaled to 1,179,648 MPI processes. Although the test program was simple, the sheer scale at which this program ran made debugging efforts highly challenging. But when I applied STAT, it quickly revealed that one particular rank process was consistently stuck in a system call," said Dong Ahn, a computer scientist in Livermore Computing.
Based on this finding, a system expert took a close look at the compute core on which this rank process was running and discovered a hardware defect. "Replacing the component suddenly got the entire Sequoia system back to life," Ahn said. "Putting this exercise into perspective, this error was due to a defect in a tiny hardware unit, the decrementor, of a single hardware thread out of a total of 4.7 million hardware threads. I felt it was like finding a needle in a haystack over a coffee break."
Sequoia delivers 20 petaflops of peak power and was ranked No. 1 in June of this year's TOP500 list. It is currently ranked No. 2, behind Oak ridge National Laboratory's Titan.
LLNL plans to use Sequoia's impressive computational capability to advance understanding of fundamental physics and engineering questions that arise in the National Nuclear Security Administration's (NNSA) program to ensure the safety, security and effectiveness of the United States' nuclear deterrent without testing. Sequoia also will support NNSA/DOE programs at LLNL that focus on nonproliferation, counterterrorism, energy, security, health and climate change.
As LLNL takes delivery of the Sequoia system and works to move it into production, computer scientists will migrate applications that have been running on earlier systems to this newer architecture. This is a period of intense activity for LLNL's application teams as they gain experience with the new hardware and software environment.
"Having a highly effective debugging tool that scales to the full system is vital to the installation and acceptance process for Sequoia. It is critical that our development teams have a comprehensive parallel debugging tool set as they iron out the inevitable issues that come up with running on a new system like Sequoia," said Kim Cupps, leader of the Livermore Computing Division at LLNL.
STAT is particularly important for LLNL because supercomputer simulations are essential in virtually every mission area of the Laboratory. The tool also has been used at other sites and proved to be effective on a wide range of supercomputer platforms, including Linux clusters and Cray systems.
The team is actively pursuing further optimization of STAT technologies and is exploring commercialization strategies. More information about STAT, including a link to the source code, is available on the Web.
###
Founded in 1952, Lawrence Livermore National Laboratory provides solutions to our nation's most important national security challenges through innovative science, engineering and technology. Lawrence Livermore National Laboratory is managed by Lawrence Livermore National Security, LLC for the U.S. Department of Energy's National Nuclear Security Administration.
END
CHAMPAIGN, Ill. — Frontline employees will commit to improving their organization if they perceive a high degree of autonomy in their jobs and trust their leaders, says research from University of Illinois business professors.
According to a soon-to-be-published study by Gopesh Anand and Dilip Chhajed, professors of business administration at Illinois, a flexible work environment plays a significant role in increasing employee commitment to continuous improvement initiatives.
"Continuous improvement initiatives are typically bundled with employee empowerment techniques," ...
Heart failure is a relatively common complication in older women with breast cancer, but the risk is even higher in those patients treated with adjuvant trastuzumab (Herceptin©), Yale School of Medicine researchers report in the current issue of the Journal of the American College of Cardiology.
The researchers conducted this study because older women who are at higher risk of decreased heart function, were often excluded from randomized clinical trials of trastuzumab, which is used to treat breast tumors that over-express human epidermal growth factor receptor-2 (HER-2). ...
Your emotions can certainly impact your decisions, but you might be surprised by the extent to which your emotions affect your pocketbook. New research from psychological scientist Jennifer Lerner of the Harvard Kennedy School of Government and colleagues Yi Le and Elke U. Weber of Columbia University explores how impatience brought on by sadness can in turn produce substantial financial loss. The study is published in Psychological Science, a journal of the Association for Psychological Science.
Using data collected at the Harvard Decision Science Laboratory and the ...
Research out of the University of Cincinnati seeks to measure economic and political policy impacts that unions associated with criminal justice systems – such as police, correctional officers and dispatchers unions – have in their respective states.
That research, titled "Measuring the Effect of Public-Sector Unionization on Criminal Justice Public Policy" by UC criminal justice doctoral students Derek Cohen and Jay Kennedy, will be presented at the American Society of Criminology conference on Nov. 17.
It's a research effort that stems from and seeks to shed light ...
Richmond, Va. (November 13, 2012) – In laboratory experiments, scientists have eliminated metastasis, the spread of cancer from the original tumor to other parts of the body, in melanoma by inhibiting a protein known as melanoma differentiation associated gene-9 (mda-9)/syntenin. More than 1 million cases of skin cancer are diagnosed each year in the U.S., and melanoma is the deadliest form. With further research, the approach used by the scientists could lead to targeted therapies that stop metastasis in melanoma and potentially a broad range of additional cancers.
The ...
VIDEO:
On Nov. 13, 2012, a narrow corridor in the southern hemisphere experienced a total solar eclipse. The corridor lay mostly over the ocean but also cut across the northern tip...
Click here for more information.
On Nov. 13, 2012, a narrow corridor in the southern hemisphere experienced a total solar eclipse. The corridor lay mostly over the ocean but also cut across the northern tip of Australia where both professional and amateur astronomers gathered to watch.
During ...
The twenty-fifth tropical depression of the western North Pacific Ocean season formed today and is already affecting southern Vietnam. NASA's Aqua satellite passed over Tropical Depression 25W and captured a visible image of the storm that showed its northern quadrant raining over the country.
When NASA's Aqua satellite passed over newborn Tropical Depression 25W (TD25W) on Nov. 14 at 0638 UTC (1:38 a.m. EDT), the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument captured a visible image of the storm. At the time of the image, the strongest thunderstorms ...
Sometimes simplicity is best. Two Northwestern University researchers have discovered a remarkably easy way to make nanofluidic devices: using paper and scissors. And they can cut a device into any shape and size they want, adding to the method's versatility.
Nanofluidic devices are attractive because their thin channels can transport ions -- and with them a higher than normal electric current -- making the devices promising for use in batteries and new systems for water purification, harvesting energy and DNA sorting.
The "paper-and-scissors" method one day could ...
An international research team including scientists from the University of Toronto's Faculty of Medicine has discovered a link between a mutation in an immune system gene and Alzheimer's disease.
Using data from 25,000 people, researchers from the Faculty of Medicine and University College London's Institute of Neurology discovered that a rare genetic mutation in the TREM2 gene — which helps trigger immune system responses — is also associated with increased risk of Alzheimer's. The discovery supports an emerging theory about the role of the immune system in the disease. ...
Noting that active-duty servicewomen have higher rates of unintended pregnancy than the general population and lower reported contraception use, one researcher at Women & Infants Hospital is suggesting the answer might be a review of the health care offered to females in the military and veterans.
Vinita Goyal, MD, MPH, published the study "Unintended pregnancy and contraception among active-duty servicewomen and veterans" in a recent issue of the American Journal of Obstetrics & Gynecology. As part of her research, conducted in cooperation with the Veteran's Administration ...
