In this age of Industry 4.0 and the “Internet of Things” direct machine-to-machine communication (M2M) is taking on an increasingly important role. The result, however, is that data streams within industry are increasing in volume at such an alarming rate that they are posing a growing challenge to data processing systems. The first open source software designed to deal with the realtime analysis of massive data streams in distributed systems – with the specific aim of closing this gap – has now been released as part of the EU “Flexible Event Processing for Big Data Architectures” (FERARI) project.
“FERARI is intended to provide a general sense of relief to data processing systems. The individual sensors of the associated machines ultimately decide for themselves if they want to communicate the information they collect and which other components within the system they consider it relevant to”, comments Dr. Michael Mock, project manager at the Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS.
“This means that the entire data stream is reduced to the bare essentials.” When combined with “Complex Event Processing” methods – i. e. the processing of complex interdependent events – it means that important correlations can now be found within multi-connected real-time data streams.
“During the development phase, in particular, we felt it was crucial to give users the option to familiarize themselves with the software as fast as possible”, emphasizes Mock. “For this and other reasons we decided to integrate the entire software configuration into a docker container.”
This means that users can get started immediately after the download without the need for any further installations. Supplementary video documentation shows how the initial applications can be developed with just a few steps and subsequently tested using the data sets supplied as examples. The idea behind the easy access is to advance the distribution of modern Big Data applications for science and economy as widely as possible.
A technological basis for the project was provided by partner IBM Haifa and their “IBM Proactive Technology Online (Proton)” tool which was specifically designed to process complex events.
“In order to be used in conjunction with FERARI, Proton needed to be equipped to process enormous data streams, therefore we decided to combine the software with the Storm Big Data system”, explains Dr. Fabiana Fournier, the IBM scientist responsible for the project. This allows “Proton on Storm” to run on several computers simultaneously which is an essential prerequisite to processing data volumes at the Big Data level.
In addition to the Fraunhofer IAIS and IBM Haifa Research Labs other contributors to the “FERARI” project include the Israel Institute of Technology (TECHNION), the Technical University of Crete, Croatian Telecom and the Croatian company Poslovna Inteligencija. The project receives a total of 36 months funding as part of EU's Seventh Framework Programme for Research (FP7).
Contact for more information
Head of PR at Fraunhofer IAIS
Phone +49 2241 14-2252
http://www.iais.fraunhofer.de/ferari-projekt.html Project Website Fraunhofer IAIS (german)
http://www.ferari-project.eu Website of FERARI project (english)
https://bitbucket.org/sbothe-iais/ferari Download Open Source Software
Katrin Berkler | Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS
Construction of practical quantum computers radically simplified
05.12.2016 | University of Sussex
UT professor develops algorithm to improve online mapping of disaster areas
29.11.2016 | University of Tennessee at Knoxville
In recent years, lasers with ultrashort pulses (USP) down to the femtosecond range have become established on an industrial scale. They could advance some applications with the much-lauded “cold ablation” – if that meant they would then achieve more throughput. A new generation of process engineering that will address this issue in particular will be discussed at the “4th UKP Workshop – Ultrafast Laser Technology” in April 2017.
Even back in the 1990s, scientists were comparing materials processing with nanosecond, picosecond and femtosesecond pulses. The result was surprising:...
Have you ever wondered how you see the world? Vision is about photons of light, which are packets of energy, interacting with the atoms or molecules in what...
A multi-institutional research collaboration has created a novel approach for fabricating three-dimensional micro-optics through the shape-defined formation of porous silicon (PSi), with broad impacts in integrated optoelectronics, imaging, and photovoltaics.
Working with colleagues at Stanford and The Dow Chemical Company, researchers at the University of Illinois at Urbana-Champaign fabricated 3-D birefringent...
In experiments with magnetic atoms conducted at extremely low temperatures, scientists have demonstrated a unique phase of matter: The atoms form a new type of quantum liquid or quantum droplet state. These so called quantum droplets may preserve their form in absence of external confinement because of quantum effects. The joint team of experimental physicists from Innsbruck and theoretical physicists from Hannover report on their findings in the journal Physical Review X.
“Our Quantum droplets are in the gas phase but they still drop like a rock,” explains experimental physicist Francesca Ferlaino when talking about the...
The Max Planck Institute for Physics (MPP) is opening up a new research field. A workshop from November 21 - 22, 2016 will mark the start of activities for an innovative axion experiment. Axions are still only purely hypothetical particles. Their detection could solve two fundamental problems in particle physics: What dark matter consists of and why it has not yet been possible to directly observe a CP violation for the strong interaction.
The “MADMAX” project is the MPP’s commitment to axion research. Axions are so far only a theoretical prediction and are difficult to detect: on the one hand,...
16.11.2016 | Event News
01.11.2016 | Event News
14.10.2016 | Event News
06.12.2016 | Materials Sciences
06.12.2016 | Medical Engineering
06.12.2016 | Power and Electrical Engineering