In this age of Industry 4.0 and the “Internet of Things” direct machine-to-machine communication (M2M) is taking on an increasingly important role. The result, however, is that data streams within industry are increasing in volume at such an alarming rate that they are posing a growing challenge to data processing systems. The first open source software designed to deal with the realtime analysis of massive data streams in distributed systems – with the specific aim of closing this gap – has now been released as part of the EU “Flexible Event Processing for Big Data Architectures” (FERARI) project.
“FERARI is intended to provide a general sense of relief to data processing systems. The individual sensors of the associated machines ultimately decide for themselves if they want to communicate the information they collect and which other components within the system they consider it relevant to”, comments Dr. Michael Mock, project manager at the Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS.
“This means that the entire data stream is reduced to the bare essentials.” When combined with “Complex Event Processing” methods – i. e. the processing of complex interdependent events – it means that important correlations can now be found within multi-connected real-time data streams.
“During the development phase, in particular, we felt it was crucial to give users the option to familiarize themselves with the software as fast as possible”, emphasizes Mock. “For this and other reasons we decided to integrate the entire software configuration into a docker container.”
This means that users can get started immediately after the download without the need for any further installations. Supplementary video documentation shows how the initial applications can be developed with just a few steps and subsequently tested using the data sets supplied as examples. The idea behind the easy access is to advance the distribution of modern Big Data applications for science and economy as widely as possible.
A technological basis for the project was provided by partner IBM Haifa and their “IBM Proactive Technology Online (Proton)” tool which was specifically designed to process complex events.
“In order to be used in conjunction with FERARI, Proton needed to be equipped to process enormous data streams, therefore we decided to combine the software with the Storm Big Data system”, explains Dr. Fabiana Fournier, the IBM scientist responsible for the project. This allows “Proton on Storm” to run on several computers simultaneously which is an essential prerequisite to processing data volumes at the Big Data level.
In addition to the Fraunhofer IAIS and IBM Haifa Research Labs other contributors to the “FERARI” project include the Israel Institute of Technology (TECHNION), the Technical University of Crete, Croatian Telecom and the Croatian company Poslovna Inteligencija. The project receives a total of 36 months funding as part of EU's Seventh Framework Programme for Research (FP7).
Contact for more information
Head of PR at Fraunhofer IAIS
Phone +49 2241 14-2252
http://www.iais.fraunhofer.de/ferari-projekt.html Project Website Fraunhofer IAIS (german)
http://www.ferari-project.eu Website of FERARI project (english)
https://bitbucket.org/sbothe-iais/ferari Download Open Source Software
Katrin Berkler | Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS
Cutting edge research for the industries of tomorrow – DFKI and NICT expand cooperation
21.03.2017 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI
Molecular motor-powered biocomputers
20.03.2017 | Technische Universität Dresden
Astronomers from Bonn and Tautenburg in Thuringia (Germany) used the 100-m radio telescope at Effelsberg to observe several galaxy clusters. At the edges of these large accumulations of dark matter, stellar systems (galaxies), hot gas, and charged particles, they found magnetic fields that are exceptionally ordered over distances of many million light years. This makes them the most extended magnetic fields in the universe known so far.
The results will be published on March 22 in the journal „Astronomy & Astrophysics“.
Galaxy clusters are the largest gravitationally bound structures in the universe. With a typical extent of about 10 million light years, i.e. 100 times the...
Researchers at the Goethe University Frankfurt, together with partners from the University of Tübingen in Germany and Queen Mary University as well as Francis Crick Institute from London (UK) have developed a novel technology to decipher the secret ubiquitin code.
Ubiquitin is a small protein that can be linked to other cellular proteins, thereby controlling and modulating their functions. The attachment occurs in many...
In the eternal search for next generation high-efficiency solar cells and LEDs, scientists at Los Alamos National Laboratory and their partners are creating...
Silicon nanosheets are thin, two-dimensional layers with exceptional optoelectronic properties very similar to those of graphene. Albeit, the nanosheets are less stable. Now researchers at the Technical University of Munich (TUM) have, for the first time ever, produced a composite material combining silicon nanosheets and a polymer that is both UV-resistant and easy to process. This brings the scientists a significant step closer to industrial applications like flexible displays and photosensors.
Silicon nanosheets are thin, two-dimensional layers with exceptional optoelectronic properties very similar to those of graphene. Albeit, the nanosheets are...
Enzymes behave differently in a test tube compared with the molecular scrum of a living cell. Chemists from the University of Basel have now been able to simulate these confined natural conditions in artificial vesicles for the first time. As reported in the academic journal Small, the results are offering better insight into the development of nanoreactors and artificial organelles.
Enzymes behave differently in a test tube compared with the molecular scrum of a living cell. Chemists from the University of Basel have now been able to...
20.03.2017 | Event News
14.03.2017 | Event News
07.03.2017 | Event News
27.03.2017 | Earth Sciences
27.03.2017 | Life Sciences
27.03.2017 | Life Sciences