Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Mastering Big Data using smart sensor technology – First software release from EU “FERARI” project

20.08.2015

In this age of Industry 4.0 and the “Internet of Things” direct machine-to-machine communication (M2M) is taking on an increasingly important role. The result, however, is that data streams within industry are increasing in volume at such an alarming rate that they are posing a growing challenge to data processing systems. The first open source software designed to deal with the realtime analysis of massive data streams in distributed systems – with the specific aim of closing this gap – has now been released as part of the EU “Flexible Event Processing for Big Data Architectures” (FERARI) project.

“FERARI is intended to provide a general sense of relief to data processing systems. The individual sensors of the associated machines ultimately decide for themselves if they want to communicate the information they collect and which other components within the system they consider it relevant to”, comments Dr. Michael Mock, project manager at the Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS.

“This means that the entire data stream is reduced to the bare essentials.” When combined with “Complex Event Processing” methods – i. e. the processing of complex interdependent events – it means that important correlations can now be found within multi-connected real-time data streams.

“During the development phase, in particular, we felt it was crucial to give users the option to familiarize themselves with the software as fast as possible”, emphasizes Mock. “For this and other reasons we decided to integrate the entire software configuration into a docker container.”

This means that users can get started immediately after the download without the need for any further installations. Supplementary video documentation shows how the initial applications can be developed with just a few steps and subsequently tested using the data sets supplied as examples. The idea behind the easy access is to advance the distribution of modern Big Data applications for science and economy as widely as possible.

A technological basis for the project was provided by partner IBM Haifa and their “IBM Proactive Technology Online (Proton)” tool which was specifically designed to process complex events.

“In order to be used in conjunction with FERARI, Proton needed to be equipped to process enormous data streams, therefore we decided to combine the software with the Storm Big Data system”, explains Dr. Fabiana Fournier, the IBM scientist responsible for the project. This allows “Proton on Storm” to run on several computers simultaneously which is an essential prerequisite to processing data volumes at the Big Data level.

In addition to the Fraunhofer IAIS and IBM Haifa Research Labs other contributors to the “FERARI” project include the Israel Institute of Technology (TECHNION), the Technical University of Crete, Croatian Telecom and the Croatian company Poslovna Inteligencija. The project receives a total of 36 months funding as part of EU's Seventh Framework Programme for Research (FP7).

Contact for more information
Katrin Berkler
Head of PR at Fraunhofer IAIS
Phone +49 2241 14-2252
pr[at]iais.fraunhofer.de

Weitere Informationen:

http://www.iais.fraunhofer.de/ferari-projekt.html Project Website Fraunhofer IAIS (german)
http://www.ferari-project.eu Website of FERARI project (english)
https://bitbucket.org/sbothe-iais/ferari Download Open Source Software

Katrin Berkler | Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS

More articles from Information Technology:

nachricht First machine learning method capable of accurate extrapolation
13.07.2018 | Institute of Science and Technology Austria

nachricht A step closer to single-atom data storage
13.07.2018 | Ecole Polytechnique Fédérale de Lausanne

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: First evidence on the source of extragalactic particles

For the first time ever, scientists have determined the cosmic origin of highest-energy neutrinos. A research group led by IceCube scientist Elisa Resconi, spokesperson of the Collaborative Research Center SFB1258 at the Technical University of Munich (TUM), provides an important piece of evidence that the particles detected by the IceCube neutrino telescope at the South Pole originate from a galaxy four billion light-years away from Earth.

To rule out other origins with certainty, the team led by neutrino physicist Elisa Resconi from the Technical University of Munich and multi-wavelength...

Im Focus: Magnetic vortices: Two independent magnetic skyrmion phases discovered in a single material

For the first time a team of researchers have discovered two different phases of magnetic skyrmions in a single material. Physicists of the Technical Universities of Munich and Dresden and the University of Cologne can now better study and understand the properties of these magnetic structures, which are important for both basic research and applications.

Whirlpools are an everyday experience in a bath tub: When the water is drained a circular vortex is formed. Typically, such whirls are rather stable. Similar...

Im Focus: Breaking the bond: To take part or not?

Physicists working with Roland Wester at the University of Innsbruck have investigated if and how chemical reactions can be influenced by targeted vibrational excitation of the reactants. They were able to demonstrate that excitation with a laser beam does not affect the efficiency of a chemical exchange reaction and that the excited molecular group acts only as a spectator in the reaction.

A frequently used reaction in organic chemistry is nucleophilic substitution. It plays, for example, an important role in in the synthesis of new chemical...

Im Focus: New 2D Spectroscopy Methods

Optical spectroscopy allows investigating the energy structure and dynamic properties of complex quantum systems. Researchers from the University of Würzburg present two new approaches of coherent two-dimensional spectroscopy.

"Put an excitation into the system and observe how it evolves." According to physicist Professor Tobias Brixner, this is the credo of optical spectroscopy....

Im Focus: Chemical reactions in the light of ultrashort X-ray pulses from free-electron lasers

Ultra-short, high-intensity X-ray flashes open the door to the foundations of chemical reactions. Free-electron lasers generate these kinds of pulses, but there is a catch: the pulses vary in duration and energy. An international research team has now presented a solution: Using a ring of 16 detectors and a circularly polarized laser beam, they can determine both factors with attosecond accuracy.

Free-electron lasers (FELs) generate extremely short and intense X-ray flashes. Researchers can use these flashes to resolve structures with diameters on the...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

Leading experts in Diabetes, Metabolism and Biomedical Engineering discuss Precision Medicine

13.07.2018 | Event News

Conference on Laser Polishing – LaP: Fine Tuning for Surfaces

12.07.2018 | Event News

11th European Wood-based Panel Symposium 2018: Meeting point for the wood-based materials industry

03.07.2018 | Event News

 
Latest News

Subaru Telescope helps pinpoint origin of ultra-high energy neutrino

16.07.2018 | Physics and Astronomy

Barium ruthenate: A high-yield, easy-to-handle perovskite catalyst for the oxidation of sulfides

16.07.2018 | Life Sciences

New research calculates capacity of North American forests to sequester carbon

16.07.2018 | Earth Sciences

VideoLinks
Science & Research
Overview of more VideoLinks >>>