Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Making video easier to search and find

19.04.2005


Imagine a computer system that can automatically search through videos of football matches and pull out all the shots on goal or all the fouls.



Creating the elements that make such a system possible is a key result from the IST BUSMAN project. The current generation of computer systems is excellent at searching for and manipulating text: as the spectacular success of Google has shown. However, computers are now routinely used to store and process more than just text - videos of football matches for example. Handling multimedia content such as video footage is far harder than text where particular words and phrases can be searched for.

The fast growth of such ‘unstructured’ digital content and the lack of efficient tools to handle it motivated several European research institutions and key industrial players in the multimedia field, including Motorola and BTexact Technologies, to set up the BUSMAN project. Coordinated by Professor Ebroul Izquierdo of the EE Multimedia and Vision Lab, at Queen Mary University of London, it finished in December 2004. In its final review the project was rated as among the very best research and development projects funded by the European Union’s Fifth Framework programme.


The BUSMAN partners created a content management system and series of tools, all based on the MPEG 7 standard, to enable search, retrieval and delivery of video content from both PCs and mobile devices. In all 28 important results were achieved from the project in crucial areas of advanced media processing.

Driven by user needs

Simon Waddington of Motorola Labs in the UK emphasises the lengths to which the project partners went to ensure that they started from user needs. “We started at the very beginning by talking to end-users to find out what they really wanted. The two applications we eventually chose to demonstrate the technology were football and tourism. So we talked to football fans and asked them what they remembered about specific matches. Then we talked to the content providers and tried to understand their work flow for processing content, and the tools they’d need.”

Rather than attempt to service the major broadcasting organisations, “BUSMAN is ideally suited for smaller content providers, who have limited resources for managing and annotating their content,” he says. “BUSMAN also allows the ordinary user equipped with a standard PC or mobile phone easy access to video content.”

Potential applications for the technology are multifold, he believes. The content can be sports matches, music videos, city guides, history simulations for architectural sites or even instruction videos on how to repair a piece of equipment. Whichever the application, BUSMAN’s ability to manage the content of large collections of videos and pick out specific video segments, makes it ideal for the purpose.

Variety of annotation and search methods

What is unique about the system, claims Waddington, is the variety of categorisation and search methods that can be used to label and find video content. “The content can be labelled and searched semantically using keywords or free text. But the user can also perform query-by-example, by providing a query image and searching for similar images in the database,” he says. The researchers developed a method called ‘relevance feedback’, which allows the user to provide feedback on the relevance of the retrieved images to their original search.

“Given a ninety-minute football match,” he says, “we developed a tool that could annotate the most interesting shots in the video. What you find is that, when a goal is scored, it is accompanied by rapid changes in camera shots and a rise in background noise from the spectators. Our tool can use this information to select highlights from the video, which saves the annotator much time and effort. It can even predict what is actually happening in a particular football sequence such as a foul.”

Take the case of a typical football supporter Mike. He spends Saturday afternoon watching his team Manchester United play Liverpool on TV. Manchester win 3-2 with a particularly good goal by Roy Keane through an overhead kick. That evening he goes out with friends, and a discussion about the day’s match ensues. Using the BUSMAN application, he enters the team names and the date of play on his mobile phone and chooses the ‘goal highlights’ video for Manchester. The group watches the build-up, the goal and the celebration for each of the goals. A dispute arises about a disallowed goal. A slow-motion video clip of the crucial moment for the goal is passed around amongst the group, enabling each person to decide whether the referee’s decision was the right one.

The BUSMAN system was also designed to help with the management of intellectual property rights, in the area of usage monitoring in particular. “The creator can insert labels into the video content that are almost imperceptible using advanced watermarking techniques developed during the project.” Waddington says. “We used a binary form of ‘Digital Item Identifier’. When the user views the video, the system can extract the Digital Item Identifier and thus provide a link to a rights management page. It’s a very good way of associating metadata with content.”

By way of example, Gita, creative director of a production company, wants to do a commercial that includes a tiger jumping into shallow water. The client is not going to fund a live video shoot, so she uses the BUSMAN system to search for existing video material and its likely cost. The query ‘tiger jumping into water’ returns several shots of tigers, some of which look promising. Full screen previews let her assess what the shots look like. While none are perfect, one is close. Gita selects this clip and asks the system to look for ‘similar’ shots. By repeated searches using the best current match, two candidate shots are finally selected.

Gita then enters a detailed description of the intended use, and instructs BUSMAN to search for the rights. Contact is established with the rights holders via email to discuss licensing and fees. After the contracts are signed, BUSMAN transfers master-quality copies to a download server, while download authorisation data is sent on a secure channel. Once the download is complete, notification that the shots have been downloaded is stored in the system and sent to the rights holders.

Raising interest among potential users

Waddington believes that thanks to the amount of user research and feedback that has taken place in the project, the resulting system could be put into use quite easily. Motorola demonstrated the system at the IBC exhibition in 2004, as well as at a number of other international exhibitions.

BUSMAN technology has now been integrated into the educational programmes of project partner Queen Mary University of London. The project results have also led the BUSMAN partners to make a series of recommendations on European standards, which will help make available knowledge on the advances made in the project to the wider IT community.

On the topic of commercial products however, the partners are playing their cards close to their chests. They are not saying at present if they have plans to turn the technology into any commercial products. However, as Waddington admits, “the first thing we have to do is to generate interest amongst our customers. And we have had some very positive feedback.”

In all, the BUSMAN project was an outstanding success, and as a result we can look forward to being able to routinely and easily search through archives of videos for particular events of interest just as we can already search for Web pages about a given topic.

Tara Morris | alfa
Further information:
http://istresults.cordis.lu/

More articles from Information Technology:

nachricht An AI that makes road maps from aerial images
18.04.2018 | Massachusetts Institute of Technology, CSAIL

nachricht Beyond the clouds: Networked clouds in a production setting
04.04.2018 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Gamma-ray flashes from plasma filaments

Novel highly efficient and brilliant gamma-ray source: Based on model calculations, physicists of the Max PIanck Institute for Nuclear Physics in Heidelberg propose a novel method for an efficient high-brilliance gamma-ray source. A giant collimated gamma-ray pulse is generated from the interaction of a dense ultra-relativistic electron beam with a thin solid conductor. Energetic gamma-rays are copiously produced as the electron beam splits into filaments while propagating across the conductor. The resulting gamma-ray energy and flux enable novel experiments in nuclear and fundamental physics.

The typical wavelength of light interacting with an object of the microcosm scales with the size of this object. For atoms, this ranges from visible light to...

Im Focus: Basel researchers succeed in cultivating cartilage from stem cells

Stable joint cartilage can be produced from adult stem cells originating from bone marrow. This is made possible by inducing specific molecular processes occurring during embryonic cartilage formation, as researchers from the University and University Hospital of Basel report in the scientific journal PNAS.

Certain mesenchymal stem/stromal cells from the bone marrow of adults are considered extremely promising for skeletal tissue regeneration. These adult stem...

Im Focus: Like a wedge in a hinge

Researchers lay groundwork to tailor drugs for new targets in cancer therapy

In the fight against cancer, scientists are developing new drugs to hit tumor cells at so far unused weak points. Such a “sore spot” is the protein complex...

Im Focus: The Future of Ultrafast Solid-State Physics

In an article that appears in the journal “Review of Modern Physics”, researchers at the Laboratory for Attosecond Physics (LAP) assess the current state of the field of ultrafast physics and consider its implications for future technologies.

Physicists can now control light in both time and space with hitherto unimagined precision. This is particularly true for the ability to generate ultrashort...

Im Focus: Stronger evidence for a weaker Atlantic overturning

The Atlantic overturning – one of Earth’s most important heat transport systems, pumping warm water northwards and cold water southwards – is weaker today than any time before in more than 1000 years. Sea surface temperature data analysis provides new evidence that this major ocean circulation has slowed down by roughly 15 percent since the middle of the 20th century, according to a study published in the highly renowned journal Nature by an international team of scientists. Human-made climate change is a prime suspect for these worrying observations.

“We detected a specific pattern of ocean cooling south of Greenland and unusual warming off the US coast – which is highly characteristic for a slowdown of the...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

Invitation to the upcoming "Current Topics in Bioinformatics: Big Data in Genomics and Medicine"

13.04.2018 | Event News

Unique scope of UV LED technologies and applications presented in Berlin: ICULTA-2018

12.04.2018 | Event News

IWOLIA: A conference bringing together German Industrie 4.0 and French Industrie du Futur

09.04.2018 | Event News

 
Latest News

Improved stability of plastic light-emitting diodes

19.04.2018 | Power and Electrical Engineering

Enduring cold temperatures alters fat cell epigenetics

19.04.2018 | Life Sciences

New capabilities at NSLS-II set to advance materials science

18.04.2018 | Materials Sciences

VideoLinks
Science & Research
Overview of more VideoLinks >>>