The SIMDAT project has created a portfolio of tools and services that can finally bring the power of grid computing to industrial applications. Grids capture all the resources of connected computers, from storage to computation.
But up to now grids mostly languished in research labs, where they were used to provide massive processing power or to enable large-scale database management. SIMDAT developed essential business functions for grids, like industrial strength service-level agreements, management and security.
It will mean the advent of virtual organisations, a long-unfulfilled promise of information technology. Grids for business have huge applications in product development, both for data crunching and collaboration, and this was the focus of SIMDAT’s work in the automotive, pharmaceutical, aerospace and weather sectors.
But that is the just the beginning, and the ground broken by SIMDAT will prove a fertile field for grid technology over the next decade. Their work and solutions are relevant to other commercial areas and other industrial sectors. SIMDAT partners are already looking at the potential of adapting their work to new industrial sectors, like shipping and media production.
The commercialisation efforts are already well underway and began months before SIMDAT completed the EU-funded part of its work. Elements of SIMDAT’s wide-ranging research are already appearing in commercial applications.
Take data compression, for example, one small aspect of SIMDAT’s vast research and development programme. SIMDAT made three improvements related to data compression. Large data transfers – typical in grid applications – are now more efficient.
First, it boosted basic compression by a factor of 10, a huge achievement in itself. Second, it developed meta-models. By looking at a series of related datasets, computer scientists found that it was possible to ‘summarise’ their results in a meta-model, and this meta-model provided an accurate analysis of the whole dataset. So data could be exchanged as a meta-model and still be accurate.
The third improvement means it is now possible to make complex queries within summaries (such as why did the behaviour change, or what caused a fault?). By combining these achievements, SIMDAT developed state-of-the-art data compression for industrial grid deployments.
“Data compression technology we developed is now used by most of the automotive companies in Germany and is going to be used by 30 percent of the automobile companies worldwide – so it is already a mature product. And meta-modelling has become a standard technology inside BAE Systems for numerical optimisation,” explains Clemens-August Thole, Fraunhofer SCAI, SIMDAT project coordinator.
Weather without borders
One of SIMDAT’s most advanced commercialisation initiatives is VGISC (pronounced Vegis), the Virtual Global Information System Centre. “It is now deployed at 11 met centres worldwide and it is a prototype for a standard to be proposed by the World Meterological Organisation (WMO),” Thole states.
Weather does not recognise frontiers, and while national organisations can easily access weather data within their territory, analysing border regions is a lot more difficult.
Currently, meteorologists and climate researchers must use different tools for data from different national weather centres. VGISC overcomes that problem by leaving all the management, conversion and delivery of data to the SIMDAT portfolio. The SIMDAT solution also provides analysis tools.
SIMDAT is partnered with weather centres in the UK, Germany and France, but VGISC implements part of the WMO’s World Information System (WIS). “SIMDAT project is the first and only prototype for a WIS implementation. Ultimately, all the met centres worldwide would adapt this software,” explains Thole. “That’s the plan.”
Scientists will be able to access data from anywhere in the world through their web browser. This will be a huge achievement, involving petabytes of information in one of the most complex scientific fields, involving observations, simulations, analysis and prediction.
Setting the standards
SIMDAT is not only a commercial success, it is important in the world of standards, working with the Web Services Resource Framework (WSRF), the Open Grid Forum and W3C (World Wide Web Consortium), and has been active in Global Information Systems via its work with the WMO.
SIMDAT is a vast project. “You have some results already available as... commercial products (more are to come within the next two years), and then there are also some basic research results, which are more ideas, shown in some prototypes. [These] might turn into commercial solutions, but then again might not,” Thole notes.
The upshot, though, is that SIMDAT has already brought commercial solutions to industry, and helped to set the standards for the technology. The project’s impact will be felt for a long time.
The SIMDAT project received funding from the ICT strand of the Sixth Framework Programme for research.
This is the third and last part of a three-part series on SIMDAT.
Christian Nielsen | alfa
Snake-inspired robot uses kirigami to move
22.02.2018 | Harvard John A. Paulson School of Engineering and Applied Sciences
Camera technology in vehicles: Low-latency image data compression
22.02.2018 | Fraunhofer-Institut für Nachrichtentechnik, Heinrich-Hertz-Institut, HHI
A newly developed laser technology has enabled physicists in the Laboratory for Attosecond Physics (jointly run by LMU Munich and the Max Planck Institute of Quantum Optics) to generate attosecond bursts of high-energy photons of unprecedented intensity. This has made it possible to observe the interaction of multiple photons in a single such pulse with electrons in the inner orbital shell of an atom.
In order to observe the ultrafast electron motion in the inner shells of atoms with short light pulses, the pulses must not only be ultrashort, but very...
A group of researchers led by Andrea Cavalleri at the Max Planck Institute for Structure and Dynamics of Matter (MPSD) in Hamburg has demonstrated a new method enabling precise measurements of the interatomic forces that hold crystalline solids together. The paper Probing the Interatomic Potential of Solids by Strong-Field Nonlinear Phononics, published online in Nature, explains how a terahertz-frequency laser pulse can drive very large deformations of the crystal.
By measuring the highly unusual atomic trajectories under extreme electromagnetic transients, the MPSD group could reconstruct how rigid the atomic bonds are...
Quantum computers may one day solve algorithmic problems which even the biggest supercomputers today can’t manage. But how do you test a quantum computer to...
For the first time, a team of researchers at the Max-Planck Institute (MPI) for Polymer Research in Mainz, Germany, has succeeded in making an integrated circuit (IC) from just a monolayer of a semiconducting polymer via a bottom-up, self-assembly approach.
In the self-assembly process, the semiconducting polymer arranges itself into an ordered monolayer in a transistor. The transistors are binary switches used...
Breakthrough provides a new concept of the design of molecular motors, sensors and electricity generators at nanoscale
Researchers from the Institute of Organic Chemistry and Biochemistry of the CAS (IOCB Prague), Institute of Physics of the CAS (IP CAS) and Palacký University...
15.02.2018 | Event News
13.02.2018 | Event News
12.02.2018 | Event News
23.02.2018 | Physics and Astronomy
23.02.2018 | Health and Medicine
23.02.2018 | Physics and Astronomy