XSEDE Campus Champions, Stampede and Lonestar4 supercomputers of TACC help create 3-D images deep underground
A new work based on 3-D supercomputer simulations of earthquake data has found hidden rock structures deep under East Asia. Researchers from China, Canada, and the U.S. worked together to publish their results in March 2015 in the American Geophysical Union Journal of Geophysical Research, Solid Earth.
Three-dimensional high velocity structures beneath East Asia from 50 km to 1000 km depth viewed from the southeast. Surface topography with vertical exaggeration is superimposed for geographic references. Isosurfaces of high velocity anomalies in percent referenced to a one-dimensional earth model (STW105) at each depth are plotted from 1% to 4% with 1% interval. Three cut planes show shear wave velocity maps at 410 km, 660 km, and 1000 km depths. The highest elevations represent the Himalayas and the Tibetan Plateau.
Credit: Min Chen, Rice University
The scientists used seismic data from 227 East Asia earthquakes during 2007-2011, which they used to image depths to about 900 kilometers, or about 560 miles below ground.
Notable structures include a high velocity colossus beneath the Tibetan plateau, and a deep mantle upwelling beneath the Hangai Dome in Mongolia. The researchers say their line of work could potentially help find hidden hydrocarbon resources, and more broadly it could help explore the Earth under East Asia and the rest of the world.
"With the help of supercomputing, it becomes possible to render crystal-clear images of Earth's complex interior," principal investigator and lead author Min Chen said of the study. Chen is a postdoctoral research associate in the department of Earth Sciences at Rice University.
Chen and her colleagues ran simulations on the Stampede and Lonestar4 supercomputers of the Texas Advanced Computing Center through an allocation by XSEDE, the eXtreme Science and Engineering Discovery Environment funded by the National Science Foundation.
"We are combining different kinds of seismic waves to render a more coherent image of the Earth," Chen said. "This process has been helped by supercomputing power that is provided by XSEDE."
"What is really new here is that this is an application of what is sometimes referred to as full waveform inversion in exploration geophysics," study co-author Jeroen Tromp said. Tromp is a professor of Geosciences and Applied and Computational Mathematics, and the Blair Professor of Geology at Princeton University.
In essence the application combined seismic records from thousands of stations for each earthquake to produce scientifically accurate, high-res 3-D tomographic images of the subsurface beneath immense geological formations.
XSEDE provided more than just time on supercomputers for the science team. Through the Campus Champions program, researchers worked directly with Rice XSEDE champion Qiyou Jiang of Rice's Center for Research Computing and with former Rice staffer Roger Moye, who used Rice's DAVinCI supercomputer to help Chen with different issues she had with high performance computing." "They are the contacts I had with XSEDE," Chen said.
"These collaborations are really important," said Tromp of XSEDE. "They cannot be done without the help and advice of the computational science experts at these supercomputing centers. Without access to these computational resources, we would not be able to do this kind of work."
Like a thrown pebble generates ripples in a pond, earthquakes make waves that can travel thousands of miles through the Earth. A seismic wave slows down or speeds up a small percentage as it travels through changes in rock composition and temperature. The scientists mapped these wave speed changes to model the physical properties of rock hidden below ground.
Tromp explained that the goal for his team was to match the observed ground-shaking information at seismographic stations to fully numerical simulations run on supercomputers.
"In the computer, we set off these earthquakes," says Tromp. "The waves ripple across southeast Asia. We simulate what the ground motion should look like at these stations. Then we compare that to the actual observations.
The differences between our simulations and the observations are used to improve our models of the Earth's interior," Tromp said. "What's astonishing is how well those images correlate with what we know about the tectonics, in this case, of East Asia from surface observations."
The Tibetan Plateau, known as 'the roof of the world,' rises about three miles, or five kilometers above sea level. The details of how it formed remain hidden to scientists today.
The leading theory holds that the plateau formed and is maintained by the northward motion of the India plate, which forces the plateau to shorten horizontally and move upward simultaneously.
Scientists can't yet totally account for the speed of the movement of ground below the surface at the Tibetan Plateau or what happened to the Tethys Ocean that once separated the India and Eurasia plates. But a piece of the puzzle might have been found.
"We found that beneath the Tibetan plateau, the world's largest and highest plateau, there is a sub-vertical high velocity structure that extends down to the bottom of the mantle transition zone," Chen said.
The bottom of the transition zone goes to depths of 660 kilometers, she said. "Three-dimensional geometry of the high velocity structure depicts the lithosphere beneath the plateau, which gives clues of the fate of the subducted oceanic and the continental parts of the Indian plate under the Eurasian plate," Chen said.
The collision of plates at the Tibetan Plateau has caused devastating earthquakes, such as the recent 2015 Nepal earthquake at the southern edge of where the two plates meet. Scientists hope to use earthquakes to model the substructure and better understand the origins of these earthquakes.
To reach any kind of understanding, the scientists first grappled with some big data, 1.7 million frequency-dependent traveltime measurements from seismic waveforms. "We applied this very sophisticated imaging technique called adjoint tomography with a key component that is a numerical code package called SPECFEM3D_GLOBE," Chen said.
Specifically, they used SPECFEM3D GLOBE, open source software maintained by the UC Davis Computational Infrastructure for Geodynamics. "It uses parallel computing to simulate the very complex seismic waves through the Earth," Chen said.
Even with the tools in place, the study was still costly. "The cost is in the simulations of the wave propagation," says Tromp. "That takes hundreds of cores for tens of minutes at a time per earthquake.
As you can imagine, that's a very expensive proposition just for one iteration simulating all these 227 earthquakes." In all, the study used about eight million CPU hours on the Stampede and Lonestar4 supercomputers.
"The big computing power of supercomputers really helped a lot in terms of shortening the simulation time and in getting an image of the Earth within a reasonable timeframe," said Chen. "It's still very challenging. It took us two years to develop this current model beneath East Asia. Hopefully, in the future it's going to be even faster."
Three-D imaging inside the Earth can help society find new resources, said Tromp. The iterative inversion methods they used to model structures deep below are the same ones used in exploration seismology to look for hidden hydrocarbons.
"There's a wonderful synergy at the moment," Tromp said. "The kinds of things we're doing here with earthquakes to try and image the Earth's crust and upper mantle and what people are doing in exploration geophysics to try and image hydrocarbon reservoirs."
"In my point of view, it's the era of big seismic data," Chen said. She said their ultimate goal is to make everything about seismic imaging methods automatic and accessible by anyone to better understand the Earth.
It sounded something like a Google Earth for inside the Earth itself. "Right, exactly. Assisted by the supercomputing systems of XSEDE, you can have a tour inside the Earth and possibly make some new discoveries." Chen said.
The science team for this study included Min Chen and Fenglin Niu of Rice University; Qinya Liu of the University of Toronto; Jeroen Tromp of Princeton University; and Xiufen Zheng of the Institute of Geophysics, China Earthquake Administration, Beijing, China. The National Science Foundation (US) provided the study funding.
The DAVinCI supercomputer is administered by Rice's Ken Kennedy Institute for Information Technology and supported by the National Science Foundation. The researchers also thank Kiran Thyagaraja, Franco Bladilo, and Kim Andrews for their assistance with work on DAVinCI.
Jorge Salazar | EurekAlert!
Predicting unpredictability: Information theory offers new way to read ice cores
07.12.2016 | Santa Fe Institute
Sea ice hit record lows in November
07.12.2016 | University of Colorado at Boulder
In recent years, lasers with ultrashort pulses (USP) down to the femtosecond range have become established on an industrial scale. They could advance some applications with the much-lauded “cold ablation” – if that meant they would then achieve more throughput. A new generation of process engineering that will address this issue in particular will be discussed at the “4th UKP Workshop – Ultrafast Laser Technology” in April 2017.
Even back in the 1990s, scientists were comparing materials processing with nanosecond, picosecond and femtosesecond pulses. The result was surprising:...
Have you ever wondered how you see the world? Vision is about photons of light, which are packets of energy, interacting with the atoms or molecules in what...
A multi-institutional research collaboration has created a novel approach for fabricating three-dimensional micro-optics through the shape-defined formation of porous silicon (PSi), with broad impacts in integrated optoelectronics, imaging, and photovoltaics.
Working with colleagues at Stanford and The Dow Chemical Company, researchers at the University of Illinois at Urbana-Champaign fabricated 3-D birefringent...
In experiments with magnetic atoms conducted at extremely low temperatures, scientists have demonstrated a unique phase of matter: The atoms form a new type of quantum liquid or quantum droplet state. These so called quantum droplets may preserve their form in absence of external confinement because of quantum effects. The joint team of experimental physicists from Innsbruck and theoretical physicists from Hannover report on their findings in the journal Physical Review X.
“Our Quantum droplets are in the gas phase but they still drop like a rock,” explains experimental physicist Francesca Ferlaino when talking about the...
The Max Planck Institute for Physics (MPP) is opening up a new research field. A workshop from November 21 - 22, 2016 will mark the start of activities for an innovative axion experiment. Axions are still only purely hypothetical particles. Their detection could solve two fundamental problems in particle physics: What dark matter consists of and why it has not yet been possible to directly observe a CP violation for the strong interaction.
The “MADMAX” project is the MPP’s commitment to axion research. Axions are so far only a theoretical prediction and are difficult to detect: on the one hand,...
16.11.2016 | Event News
01.11.2016 | Event News
14.10.2016 | Event News
07.12.2016 | Health and Medicine
07.12.2016 | Life Sciences
07.12.2016 | Health and Medicine