A ‘conductor’ that ensures simultaneous processing tasks keep time could dramatically increase the efficiency of ‘cloud’ simulations.
In large-scale simulations that involve simultaneous computational tasks on distributed computers, the overall speed of the simulation is limited by the slowest link. By adaptively redistributing computational resources in real-time according to workload, a Singapore-based research team have shown how to overcome this ‘slowest link’ limitation.
This approach could dramatically improve the speed and efficiency of simulations conducted across many computers — also called ‘cloud’ simulations.
“The problem of workload imbalance is very common in large-scale simulations, which involve a group of parallel distributed computers or ‘components’ that need to synchronize with each other to ensure that all simulation events are executed in time stamp order,” explains research leader Zengxiang Li, from the A*STAR Institute of High Performance Computing.
Parallel computing simulations involve a large number of events that must occur in order. These events are assigned to multiple parallel computing ‘nodes’ for simultaneous computation. When an event is processed, new events may be generated and inserted into the event processing queue. It is wasteful to let expensive computational resources lie idle waiting for work, so parallel processing schemes often allow each node to process events sequentially without waiting for events from other nodes.
The problem is that if events from one node are late, the other nodes proceeding with their ‘optimistic’ execution of the next event will need to discard their extra work and rollback to where the late node left off. “The entire simulation execution is held back by the slowest components,” says Li, “while faster components risk wasting time and resources on overoptimistic execution and execution rollbacks.”
To improve the efficiency of such simulations, Li and his colleagues developed a resource-conducting scheme called Adaptive Resource Provisioning Mechanism in Virtual Execution Environments, or ArmVee. This scheme sits transparently as middleware in the simulation environment to monitor workloads and task completion speeds on each node in real-time. ArmVee then dynamically reallocates resources, such as memory and processing cycles, to speed up the slowest links.
“We use a self-adaptive auto-regressive-moving-average model — commonly used in control theory — to capture the relationship between simulation performance and resources,” says Li. “This allows ArmVee to predict the dynamically changing simulation workload and to align the execution speeds of simulation components proactively so that each advances in simulation time with comparable speed.”
Importantly, ArmVee can be used transparently in standard simulation architectures without any simulation recoding or interruption. This makes it ready for implementation in standard parallel and distributed simulations.
The A*STAR-affiliated researchers contributing to this research are from the Institute of High Performance Computing
 Li, Z., Cai, W., Turner, S. J., Li, X., Duong, T. N. B., Goh, R. S. M. Adaptive resource provisioning mechanism in VEEs for improving performance of HLA-based simulations. ACM Transactions on Modeling and Computer Simulation 26, 1 (2015).
Original article from Agency for Science, Technology and Research
A*STAR Research | Research SEA
Five developments for improved data exploitation
19.04.2017 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI
Smart Manual Workstations Deliver More Flexible Production
04.04.2017 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI
The nearby, giant radio galaxy M87 hosts a supermassive black hole (BH) and is well-known for its bright jet dominating the spectrum over ten orders of magnitude in frequency. Due to its proximity, jet prominence, and the large black hole mass, M87 is the best laboratory for investigating the formation, acceleration, and collimation of relativistic jets. A research team led by Silke Britzen from the Max Planck Institute for Radio Astronomy in Bonn, Germany, has found strong indication for turbulent processes connecting the accretion disk and the jet of that galaxy providing insights into the longstanding problem of the origin of astrophysical jets.
Supermassive black holes form some of the most enigmatic phenomena in astrophysics. Their enormous energy output is supposed to be generated by the...
The probability to find a certain number of photons inside a laser pulse usually corresponds to a classical distribution of independent events, the so-called...
Microprocessors based on atomically thin materials hold the promise of the evolution of traditional processors as well as new applications in the field of flexible electronics. Now, a TU Wien research team led by Thomas Müller has made a breakthrough in this field as part of an ongoing research project.
Two-dimensional materials, or 2D materials for short, are extremely versatile, although – or often more precisely because – they are made up of just one or a...
Two researchers at Heidelberg University have developed a model system that enables a better understanding of the processes in a quantum-physical experiment...
Glaciers might seem rather inhospitable environments. However, they are home to a diverse and vibrant microbial community. It’s becoming increasingly clear that they play a bigger role in the carbon cycle than previously thought.
A new study, now published in the journal Nature Geoscience, shows how microbial communities in melting glaciers contribute to the Earth’s carbon cycle, a...
20.04.2017 | Event News
18.04.2017 | Event News
03.04.2017 | Event News
21.04.2017 | Physics and Astronomy
21.04.2017 | Health and Medicine
21.04.2017 | Physics and Astronomy