Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

DILIGENT Data Challenge on EGEE Infrastructure

06.12.2007
The success of DILIGENT’s recent data challenge on image feature extraction, executed on the EGEE infrastructure, has enabled one of the world's largest collections of multimedia metadata to be made publicly available for research purposes.

The DILIGENT team used the EGEE computing Grid to process 37 million images from the online Flickr database in just 16 weeks. This computation generated approximately 112 million text and image objects—nearly 5 TB of data—containing more than 150 million extracted features. This is equivalent to an average processing capacity of over 300,000 images per day.

This unique collection will be used by the SAPIR project to develop new large-scale content-based data retrieval and automatic data classification techniques that combine both text and image content, expanding the limits of conventional search engines, which can only search text associated to images and audio-visual content.

The computational load required to generate this massive data collection was outsourced to DILIGENT, and then delegated to the EGEE Pre-Production Service (PPS) Grid infrastructure via the gLite middleware. A total of 44,333 gLite jobs were successfully executed by the EGEE PPS infrastructure resource broker. Each job processed approximately 1000 images.

The data challenge lasted for 116 days, from 16 June to 9 October 2007, and was organized in three different phases. During the initial preparation phase experimental jobs were submitted to some EGEE PPS sites to test the feature extraction application and optimize the number of images to process per day.

The next two phases involved actual execution of the data challenge, exploiting ten EGEE PPS sites that contributed their computational resources: University of Athens, Scuola Normale Superiore, ISTI-CNR, LIP, ESA-ESRIN, CERN, CESGA, University of Macedonia, Ben Gurion University, and CYFRONET. Four of these sites are maintained by DILIGENT partners.

Sarah Purcell | alfa
Further information:
http://www.eu-egee.org/
http://www.sapir.eu/
http://www.diligentproject.org

More articles from Information Technology:

nachricht Defining the backbone of future mobile internet access
21.07.2017 | IHP - Leibniz-Institut für innovative Mikroelektronik

nachricht Researchers create new technique for manipulating polarization of terahertz radiation
20.07.2017 | Brown University

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Manipulating Electron Spins Without Loss of Information

Physicists have developed a new technique that uses electrical voltages to control the electron spin on a chip. The newly-developed method provides protection from spin decay, meaning that the contained information can be maintained and transmitted over comparatively large distances, as has been demonstrated by a team from the University of Basel’s Department of Physics and the Swiss Nanoscience Institute. The results have been published in Physical Review X.

For several years, researchers have been trying to use the spin of an electron to store and transmit information. The spin of each electron is always coupled...

Im Focus: The proton precisely weighted

What is the mass of a proton? Scientists from Germany and Japan successfully did an important step towards the most exact knowledge of this fundamental constant. By means of precision measurements on a single proton, they could improve the precision by a factor of three and also correct the existing value.

To determine the mass of a single proton still more accurate – a group of physicists led by Klaus Blaum and Sven Sturm of the Max Planck Institute for Nuclear...

Im Focus: On the way to a biological alternative

A bacterial enzyme enables reactions that open up alternatives to key industrial chemical processes

The research team of Prof. Dr. Oliver Einsle at the University of Freiburg's Institute of Biochemistry has long been exploring the functioning of nitrogenase....

Im Focus: The 1 trillion tonne iceberg

Larsen C Ice Shelf rift finally breaks through

A one trillion tonne iceberg - one of the biggest ever recorded -- has calved away from the Larsen C Ice Shelf in Antarctica, after a rift in the ice,...

Im Focus: Laser-cooled ions contribute to better understanding of friction

Physics supports biology: Researchers from PTB have developed a model system to investigate friction phenomena with atomic precision

Friction: what you want from car brakes, otherwise rather a nuisance. In any case, it is useful to know as precisely as possible how friction phenomena arise –...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

Closing the Sustainability Circle: Protection of Food with Biobased Materials

21.07.2017 | Event News

»We are bringing Additive Manufacturing to SMEs«

19.07.2017 | Event News

The technology with a feel for feelings

12.07.2017 | Event News

 
Latest News

NASA looks to solar eclipse to help understand Earth's energy system

21.07.2017 | Earth Sciences

Stanford researchers develop a new type of soft, growing robot

21.07.2017 | Power and Electrical Engineering

Vortex photons from electrons in circular motion

21.07.2017 | Physics and Astronomy

VideoLinks
B2B-VideoLinks
More VideoLinks >>>