In this age of Industry 4.0 and the “Internet of Things” direct machine-to-machine communication (M2M) is taking on an increasingly important role. The result, however, is that data streams within industry are increasing in volume at such an alarming rate that they are posing a growing challenge to data processing systems. The first open source software designed to deal with the realtime analysis of massive data streams in distributed systems – with the specific aim of closing this gap – has now been released as part of the EU “Flexible Event Processing for Big Data Architectures” (FERARI) project.
“FERARI is intended to provide a general sense of relief to data processing systems. The individual sensors of the associated machines ultimately decide for themselves if they want to communicate the information they collect and which other components within the system they consider it relevant to”, comments Dr. Michael Mock, project manager at the Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS.
“This means that the entire data stream is reduced to the bare essentials.” When combined with “Complex Event Processing” methods – i. e. the processing of complex interdependent events – it means that important correlations can now be found within multi-connected real-time data streams.
“During the development phase, in particular, we felt it was crucial to give users the option to familiarize themselves with the software as fast as possible”, emphasizes Mock. “For this and other reasons we decided to integrate the entire software configuration into a docker container.”
This means that users can get started immediately after the download without the need for any further installations. Supplementary video documentation shows how the initial applications can be developed with just a few steps and subsequently tested using the data sets supplied as examples. The idea behind the easy access is to advance the distribution of modern Big Data applications for science and economy as widely as possible.
A technological basis for the project was provided by partner IBM Haifa and their “IBM Proactive Technology Online (Proton)” tool which was specifically designed to process complex events.
“In order to be used in conjunction with FERARI, Proton needed to be equipped to process enormous data streams, therefore we decided to combine the software with the Storm Big Data system”, explains Dr. Fabiana Fournier, the IBM scientist responsible for the project. This allows “Proton on Storm” to run on several computers simultaneously which is an essential prerequisite to processing data volumes at the Big Data level.
In addition to the Fraunhofer IAIS and IBM Haifa Research Labs other contributors to the “FERARI” project include the Israel Institute of Technology (TECHNION), the Technical University of Crete, Croatian Telecom and the Croatian company Poslovna Inteligencija. The project receives a total of 36 months funding as part of EU's Seventh Framework Programme for Research (FP7).
Contact for more information
Head of PR at Fraunhofer IAIS
Phone +49 2241 14-2252
http://www.iais.fraunhofer.de/ferari-projekt.html Project Website Fraunhofer IAIS (german)
http://www.ferari-project.eu Website of FERARI project (english)
https://bitbucket.org/sbothe-iais/ferari Download Open Source Software
Katrin Berkler | Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS
Seeing the forest through the trees with a new LiDAR system
28.06.2017 | The Optical Society
Drones that drive
27.06.2017 | Massachusetts Institute of Technology, CSAIL
An international team of scientists has proposed a new multi-disciplinary approach in which an array of new technologies will allow us to map biodiversity and the risks that wildlife is facing at the scale of whole landscapes. The findings are published in Nature Ecology and Evolution. This international research is led by the Kunming Institute of Zoology from China, University of East Anglia, University of Leicester and the Leibniz Institute for Zoo and Wildlife Research.
Using a combination of satellite and ground data, the team proposes that it is now possible to map biodiversity with an accuracy that has not been previously...
Heatwaves in the Arctic, longer periods of vegetation in Europe, severe floods in West Africa – starting in 2021, scientists want to explore the emissions of the greenhouse gas methane with the German-French satellite MERLIN. This is made possible by a new robust laser system of the Fraunhofer Institute for Laser Technology ILT in Aachen, which achieves unprecedented measurement accuracy.
Methane is primarily the result of the decomposition of organic matter. The gas has a 25 times greater warming potential than carbon dioxide, but is not as...
Hydrogen is regarded as the energy source of the future: It is produced with solar power and can be used to generate heat and electricity in fuel cells. Empa researchers have now succeeded in decoding the movement of hydrogen ions in crystals – a key step towards more efficient energy conversion in the hydrogen industry of tomorrow.
As charge carriers, electrons and ions play the leading role in electrochemical energy storage devices and converters such as batteries and fuel cells. Proton...
Scientists from the Excellence Cluster Universe at the Ludwig-Maximilians-Universität Munich have establised "Cosmowebportal", a unique data centre for cosmological simulations located at the Leibniz Supercomputing Centre (LRZ) of the Bavarian Academy of Sciences. The complete results of a series of large hydrodynamical cosmological simulations are available, with data volumes typically exceeding several hundred terabytes. Scientists worldwide can interactively explore these complex simulations via a web interface and directly access the results.
With current telescopes, scientists can observe our Universe’s galaxies and galaxy clusters and their distribution along an invisible cosmic web. From the...
Temperature measurements possible even on the smallest scale / Molecular ruby for use in material sciences, biology, and medicine
Chemists at Johannes Gutenberg University Mainz (JGU) in cooperation with researchers of the German Federal Institute for Materials Research and Testing (BAM)...
19.06.2017 | Event News
13.06.2017 | Event News
13.06.2017 | Event News
28.06.2017 | Physics and Astronomy
28.06.2017 | Physics and Astronomy
28.06.2017 | Health and Medicine