In this age of Industry 4.0 and the “Internet of Things” direct machine-to-machine communication (M2M) is taking on an increasingly important role. The result, however, is that data streams within industry are increasing in volume at such an alarming rate that they are posing a growing challenge to data processing systems. The first open source software designed to deal with the realtime analysis of massive data streams in distributed systems – with the specific aim of closing this gap – has now been released as part of the EU “Flexible Event Processing for Big Data Architectures” (FERARI) project.
“FERARI is intended to provide a general sense of relief to data processing systems. The individual sensors of the associated machines ultimately decide for themselves if they want to communicate the information they collect and which other components within the system they consider it relevant to”, comments Dr. Michael Mock, project manager at the Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS.
“This means that the entire data stream is reduced to the bare essentials.” When combined with “Complex Event Processing” methods – i. e. the processing of complex interdependent events – it means that important correlations can now be found within multi-connected real-time data streams.
“During the development phase, in particular, we felt it was crucial to give users the option to familiarize themselves with the software as fast as possible”, emphasizes Mock. “For this and other reasons we decided to integrate the entire software configuration into a docker container.”
This means that users can get started immediately after the download without the need for any further installations. Supplementary video documentation shows how the initial applications can be developed with just a few steps and subsequently tested using the data sets supplied as examples. The idea behind the easy access is to advance the distribution of modern Big Data applications for science and economy as widely as possible.
A technological basis for the project was provided by partner IBM Haifa and their “IBM Proactive Technology Online (Proton)” tool which was specifically designed to process complex events.
“In order to be used in conjunction with FERARI, Proton needed to be equipped to process enormous data streams, therefore we decided to combine the software with the Storm Big Data system”, explains Dr. Fabiana Fournier, the IBM scientist responsible for the project. This allows “Proton on Storm” to run on several computers simultaneously which is an essential prerequisite to processing data volumes at the Big Data level.
In addition to the Fraunhofer IAIS and IBM Haifa Research Labs other contributors to the “FERARI” project include the Israel Institute of Technology (TECHNION), the Technical University of Crete, Croatian Telecom and the Croatian company Poslovna Inteligencija. The project receives a total of 36 months funding as part of EU's Seventh Framework Programme for Research (FP7).
Contact for more information
Head of PR at Fraunhofer IAIS
Phone +49 2241 14-2252
http://www.iais.fraunhofer.de/ferari-projekt.html Project Website Fraunhofer IAIS (german)
http://www.ferari-project.eu Website of FERARI project (english)
https://bitbucket.org/sbothe-iais/ferari Download Open Source Software
Katrin Berkler | Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS
Terahertz spectroscopy goes nano
20.10.2017 | Brown University
New software speeds origami structure designs
12.10.2017 | Georgia Institute of Technology
Salmonellae are dangerous pathogens that enter the body via contaminated food and can cause severe infections. But these bacteria are also known to target...
University of Maryland researchers contribute to historic detection of gravitational waves and light created by event
On August 17, 2017, at 12:41:04 UTC, scientists made the first direct observation of a merger between two neutron stars--the dense, collapsed cores that remain...
Seven new papers describe the first-ever detection of light from a gravitational wave source. The event, caused by two neutron stars colliding and merging together, was dubbed GW170817 because it sent ripples through space-time that reached Earth on 2017 August 17. Around the world, hundreds of excited astronomers mobilized quickly and were able to observe the event using numerous telescopes, providing a wealth of new data.
Previous detections of gravitational waves have all involved the merger of two black holes, a feat that won the 2017 Nobel Prize in Physics earlier this month....
Material defects in end products can quickly result in failures in many areas of industry, and have a massive impact on the safe use of their products. This is why, in the field of quality assurance, intelligent, nondestructive sensor systems play a key role. They allow testing components and parts in a rapid and cost-efficient manner without destroying the actual product or changing its surface. Experts from the Fraunhofer IZFP in Saarbrücken will be presenting two exhibits at the Blechexpo in Stuttgart from 7–10 November 2017 that allow fast, reliable, and automated characterization of materials and detection of defects (Hall 5, Booth 5306).
When quality testing uses time-consuming destructive test methods, it can result in enormous costs due to damaging or destroying the products. And given that...
Using a new cooling technique MPQ scientists succeed at observing collisions in a dense beam of cold and slow dipolar molecules.
How do chemical reactions proceed at extremely low temperatures? The answer requires the investigation of molecular samples that are cold, dense, and slow at...
23.10.2017 | Event News
17.10.2017 | Event News
10.10.2017 | Event News
23.10.2017 | Life Sciences
23.10.2017 | Physics and Astronomy
23.10.2017 | Health and Medicine