The SIMDAT project has created a portfolio of tools and services that can finally bring the power of grid computing to industrial applications. Grids capture all the resources of connected computers, from storage to computation.
But up to now grids mostly languished in research labs, where they were used to provide massive processing power or to enable large-scale database management. SIMDAT developed essential business functions for grids, like industrial strength service-level agreements, management and security.
It will mean the advent of virtual organisations, a long-unfulfilled promise of information technology. Grids for business have huge applications in product development, both for data crunching and collaboration, and this was the focus of SIMDAT’s work in the automotive, pharmaceutical, aerospace and weather sectors.
But that is the just the beginning, and the ground broken by SIMDAT will prove a fertile field for grid technology over the next decade. Their work and solutions are relevant to other commercial areas and other industrial sectors. SIMDAT partners are already looking at the potential of adapting their work to new industrial sectors, like shipping and media production.
The commercialisation efforts are already well underway and began months before SIMDAT completed the EU-funded part of its work. Elements of SIMDAT’s wide-ranging research are already appearing in commercial applications.
Take data compression, for example, one small aspect of SIMDAT’s vast research and development programme. SIMDAT made three improvements related to data compression. Large data transfers – typical in grid applications – are now more efficient.
First, it boosted basic compression by a factor of 10, a huge achievement in itself. Second, it developed meta-models. By looking at a series of related datasets, computer scientists found that it was possible to ‘summarise’ their results in a meta-model, and this meta-model provided an accurate analysis of the whole dataset. So data could be exchanged as a meta-model and still be accurate.
The third improvement means it is now possible to make complex queries within summaries (such as why did the behaviour change, or what caused a fault?). By combining these achievements, SIMDAT developed state-of-the-art data compression for industrial grid deployments.
“Data compression technology we developed is now used by most of the automotive companies in Germany and is going to be used by 30 percent of the automobile companies worldwide – so it is already a mature product. And meta-modelling has become a standard technology inside BAE Systems for numerical optimisation,” explains Clemens-August Thole, Fraunhofer SCAI, SIMDAT project coordinator.
Weather without borders
One of SIMDAT’s most advanced commercialisation initiatives is VGISC (pronounced Vegis), the Virtual Global Information System Centre. “It is now deployed at 11 met centres worldwide and it is a prototype for a standard to be proposed by the World Meterological Organisation (WMO),” Thole states.
Weather does not recognise frontiers, and while national organisations can easily access weather data within their territory, analysing border regions is a lot more difficult.
Currently, meteorologists and climate researchers must use different tools for data from different national weather centres. VGISC overcomes that problem by leaving all the management, conversion and delivery of data to the SIMDAT portfolio. The SIMDAT solution also provides analysis tools.
SIMDAT is partnered with weather centres in the UK, Germany and France, but VGISC implements part of the WMO’s World Information System (WIS). “SIMDAT project is the first and only prototype for a WIS implementation. Ultimately, all the met centres worldwide would adapt this software,” explains Thole. “That’s the plan.”
Scientists will be able to access data from anywhere in the world through their web browser. This will be a huge achievement, involving petabytes of information in one of the most complex scientific fields, involving observations, simulations, analysis and prediction.
Setting the standards
SIMDAT is not only a commercial success, it is important in the world of standards, working with the Web Services Resource Framework (WSRF), the Open Grid Forum and W3C (World Wide Web Consortium), and has been active in Global Information Systems via its work with the WMO.
SIMDAT is a vast project. “You have some results already available as... commercial products (more are to come within the next two years), and then there are also some basic research results, which are more ideas, shown in some prototypes. [These] might turn into commercial solutions, but then again might not,” Thole notes.
The upshot, though, is that SIMDAT has already brought commercial solutions to industry, and helped to set the standards for the technology. The project’s impact will be felt for a long time.
The SIMDAT project received funding from the ICT strand of the Sixth Framework Programme for research.
This is the third and last part of a three-part series on SIMDAT.
Christian Nielsen | alfa
Study suggests buried Internet infrastructure at risk as sea levels rise
18.07.2018 | University of Wisconsin-Madison
Microscopic trampoline may help create networks of quantum computers
17.07.2018 | University of Colorado at Boulder
For the first time ever, scientists have determined the cosmic origin of highest-energy neutrinos. A research group led by IceCube scientist Elisa Resconi, spokesperson of the Collaborative Research Center SFB1258 at the Technical University of Munich (TUM), provides an important piece of evidence that the particles detected by the IceCube neutrino telescope at the South Pole originate from a galaxy four billion light-years away from Earth.
To rule out other origins with certainty, the team led by neutrino physicist Elisa Resconi from the Technical University of Munich and multi-wavelength...
For the first time a team of researchers have discovered two different phases of magnetic skyrmions in a single material. Physicists of the Technical Universities of Munich and Dresden and the University of Cologne can now better study and understand the properties of these magnetic structures, which are important for both basic research and applications.
Whirlpools are an everyday experience in a bath tub: When the water is drained a circular vortex is formed. Typically, such whirls are rather stable. Similar...
Physicists working with Roland Wester at the University of Innsbruck have investigated if and how chemical reactions can be influenced by targeted vibrational excitation of the reactants. They were able to demonstrate that excitation with a laser beam does not affect the efficiency of a chemical exchange reaction and that the excited molecular group acts only as a spectator in the reaction.
A frequently used reaction in organic chemistry is nucleophilic substitution. It plays, for example, an important role in in the synthesis of new chemical...
Optical spectroscopy allows investigating the energy structure and dynamic properties of complex quantum systems. Researchers from the University of Würzburg present two new approaches of coherent two-dimensional spectroscopy.
"Put an excitation into the system and observe how it evolves." According to physicist Professor Tobias Brixner, this is the credo of optical spectroscopy....
Ultra-short, high-intensity X-ray flashes open the door to the foundations of chemical reactions. Free-electron lasers generate these kinds of pulses, but there is a catch: the pulses vary in duration and energy. An international research team has now presented a solution: Using a ring of 16 detectors and a circularly polarized laser beam, they can determine both factors with attosecond accuracy.
Free-electron lasers (FELs) generate extremely short and intense X-ray flashes. Researchers can use these flashes to resolve structures with diameters on the...
13.07.2018 | Event News
12.07.2018 | Event News
03.07.2018 | Event News
19.07.2018 | Materials Sciences
19.07.2018 | Earth Sciences
19.07.2018 | Life Sciences