Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Picture this - automatic image categorisation

02.05.2005


Creating, storing and transmitting visual images has become increasingly easy. Yet the same problem always arises – how to categorise or classify visual images automatically without using external metadata or image thumbnails? There now may be an answer.

Researchers in the IST project LAVA have developed a method of automatically categorising the content of digital images, providing an effective means of storing and retrieving digital image content without having to rely on additional metadata. The developed techniques should be of real value for document and content management, making it much easier for users to search for images as well as text.

An interdisciplinary approach



At the beginning of the project, the participants faced two major technological challenges: how to interpret and categorise efficiently large numbers of objects, scenes and events in real settings, and how to automatically acquire knowledge of categories for the convenient construction of further applications. To overcome them, they brought together two key groups of researchers.

“Our main idea was to bring together researchers from the machine-learning community with those from the computer-vision and cognitive science areas,” says LAVA’s Gabriela Csurka of Xerox Research Centre Europe (XRCE) in Grenoble.

“We began our approach by grouping together similar types of objects, such as bicycles or cars for example, and trying to find a way of categorising those that were common to a group,” says Csurka. “We applied machine-learning techniques to find the distinctions between images by focusing on sections of images that were similar – sections that were common to other images with the same content.” Researchers also needed to overcome the challenge of categorising image content despite views of objects from varying perspectives or from different distances.

A typical example of the challenges they faced was how to draw a distinction between an image of a car, and one of a stack of car tyres. Both picture types contain ‘patches’, or sections, of images that are the same. To overcome the problem, the team had to provide the system with the ability to examine key patches in other areas of the image. In this case, the software was programmed to check for other key content in the ‘car’ image, such as headlights or windows.

Real advance on earlier methods

At the close of the project at the end of April 2005, LAVA researchers have developed an integrated method of capturing visual images and identifying, automatically, the appropriate category for any captured objects or scenes, be they people, objects or simply landscapes. This confluence between machine-learning and vision interpretation has greatly enhanced the ability to build reliable vision-based detectors for everyday objects and events, they believe. Such systems can underpin novel applications of all kinds, including location identification and the description of meetings.

“We believe that we now have the state-of-the-art in image categorisation and event interpretation,” Csurka says. “Our system does not rely on the whole shape of an image, but on local patches or parts of the image with similar geometric properties. So it is more versatile – we can cope with much larger intra-class variations and still correctly interpret the image. It is a real advance on what went before.”

Underlining their achievement, the LAVA team, represented by the Gravir-INRIA laboratory and the University of Southampton, won 14 out of 18 competitions in detection, localisation and classification in the Visual Object Classes Challenge organised by the PASCAL network which emerged from LAVA’s work in recognition of the importance of the field and the maturity of the existing research. The challenge itself aimed to compile a standardised collection of object recognition databases and provide a common set of tools for accessing and managing database annotations.

According to Chris Dance, project coordinator and head of XRCE laboratory, the techniques developed in LAVA will certainly be taken forward. “We will be working with Xerox business groups to integrate this new system into Xerox’ document management offerings, making them pioneering products in this field and providing our customers with additional competitive advantage.”

Potentially the developed technologies could be used for browsing images within documents, archiving images and managing photo for consumers, and searching for images on the Web. But they could also be applied to video surveillance, human-computer interaction, medical imaging and robotics.

Tara Morris | alfa
Further information:
http://istresults.cordis.lu/

More articles from Information Technology:

nachricht Study suggests buried Internet infrastructure at risk as sea levels rise
18.07.2018 | University of Wisconsin-Madison

nachricht Microscopic trampoline may help create networks of quantum computers
17.07.2018 | University of Colorado at Boulder

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: First evidence on the source of extragalactic particles

For the first time ever, scientists have determined the cosmic origin of highest-energy neutrinos. A research group led by IceCube scientist Elisa Resconi, spokesperson of the Collaborative Research Center SFB1258 at the Technical University of Munich (TUM), provides an important piece of evidence that the particles detected by the IceCube neutrino telescope at the South Pole originate from a galaxy four billion light-years away from Earth.

To rule out other origins with certainty, the team led by neutrino physicist Elisa Resconi from the Technical University of Munich and multi-wavelength...

Im Focus: Magnetic vortices: Two independent magnetic skyrmion phases discovered in a single material

For the first time a team of researchers have discovered two different phases of magnetic skyrmions in a single material. Physicists of the Technical Universities of Munich and Dresden and the University of Cologne can now better study and understand the properties of these magnetic structures, which are important for both basic research and applications.

Whirlpools are an everyday experience in a bath tub: When the water is drained a circular vortex is formed. Typically, such whirls are rather stable. Similar...

Im Focus: Breaking the bond: To take part or not?

Physicists working with Roland Wester at the University of Innsbruck have investigated if and how chemical reactions can be influenced by targeted vibrational excitation of the reactants. They were able to demonstrate that excitation with a laser beam does not affect the efficiency of a chemical exchange reaction and that the excited molecular group acts only as a spectator in the reaction.

A frequently used reaction in organic chemistry is nucleophilic substitution. It plays, for example, an important role in in the synthesis of new chemical...

Im Focus: New 2D Spectroscopy Methods

Optical spectroscopy allows investigating the energy structure and dynamic properties of complex quantum systems. Researchers from the University of Würzburg present two new approaches of coherent two-dimensional spectroscopy.

"Put an excitation into the system and observe how it evolves." According to physicist Professor Tobias Brixner, this is the credo of optical spectroscopy....

Im Focus: Chemical reactions in the light of ultrashort X-ray pulses from free-electron lasers

Ultra-short, high-intensity X-ray flashes open the door to the foundations of chemical reactions. Free-electron lasers generate these kinds of pulses, but there is a catch: the pulses vary in duration and energy. An international research team has now presented a solution: Using a ring of 16 detectors and a circularly polarized laser beam, they can determine both factors with attosecond accuracy.

Free-electron lasers (FELs) generate extremely short and intense X-ray flashes. Researchers can use these flashes to resolve structures with diameters on the...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

Leading experts in Diabetes, Metabolism and Biomedical Engineering discuss Precision Medicine

13.07.2018 | Event News

Conference on Laser Polishing – LaP: Fine Tuning for Surfaces

12.07.2018 | Event News

11th European Wood-based Panel Symposium 2018: Meeting point for the wood-based materials industry

03.07.2018 | Event News

 
Latest News

Global study of world's beaches shows threat to protected areas

19.07.2018 | Earth Sciences

New creepy, crawly search and rescue robot developed at Ben-Gurion U

19.07.2018 | Power and Electrical Engineering

Metal too 'gummy' to cut? Draw on it with a Sharpie or glue stick, science says

19.07.2018 | Materials Sciences

VideoLinks
Science & Research
Overview of more VideoLinks >>>