Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Attaining new goals in computer vision

25.03.2004


Football stadiums and museums may not have much in common, but for two IST projects, EVENTS and VISIRE, they are the perfect testing grounds for computer vision technologies that have the potential to change key areas of visual media forever.



Coordinated by Eptron in Spain, the groundbreaking initiatives have resulted in two state-of-the-art computer vision applications that far surpass anything currently available on the market. "EVENTS is an image interpolation system that creates multi-view presentations of television transmissions in near real-time," explains Tomás Rodríguez, the coordinator of both projects. "VISIRE is a 3D authoring tool that automates the construction of three-dimensional video images from two-dimensional footage."

Eptron is now considering commercialising the systems, amid what Rodríguez sees as a "strong market" for both.


EVENTS, however, may have the strongest market of all. The project partners designed it with football in mind to enhance the viewing experience of fans and cut broadcasters’ costs when covering matches. Instead of populating a soccer stadium with dozens of cameras as broadcasters have had to do until now to capture as many views as possible, EVENTS draws on footage from a minimal number of cameras and, through interpolating the images, creates virtual viewpoints.

Virtual viewpoints

"You can go anywhere you want in the stadium and view the match from there, without having to have a camera physically in place," Rodríguez notes. "You can replay a goal from any angle, or check to see whether a foul was really committed."

Interpolated images have evidently been used before, most notably in films such as ’Matrix,’ but whereas those took hours of manual processing, EVENTS achieves similar results in seconds through its advanced software platform and innovative computer-vision algorithms. This allows near real-time replays at a quality that approximates to normal camera footage, and without the need for costly equipment.

"Other systems, such as the one used to cover the US Superbowl, have had to employ upwards of 20 cameras or robotic cameras that move autonomously, or a combination of both. That’s extremely expensive," the coordinator notes. "With only a few cameras, say five or six, EVENTS can produce the same results at half or even a third of the cost of multi-camera and robotic camera systems."

These benefits were validated in trials last year at Real Madrid’s Bernabéu stadium in Spain and at Oxford United’s stadium in England that served to further enhance the system’s two core components, the Image Interpolation Engine and the Interpolated Video Player. EVENTS is not restricted to football, however, and the project partners see uses for it in other sports, as well as live television events, pop concerts or theatre. The technical progress made during the project may also have applications in video-compression or mobile services. "The market for such a system is good," Rodríguez explains. "And the possibilities for it are huge."

Similarly, VISIRE, which was tested over the same period, stands out as an important advance in computer vision, with a broad, albeit different, market potential.

Automating the design of 3D video

Also geared toward leisure, but with significant scientific uses, VISIRE is a software tool that automates the design process of 3D video images, removing much of the time and cost burden on multimedia specialists.

"There’s currently a great deal of interest in developing 3D image systems because until now the construction of photorealistic 3D footage has had to be done manually in a very long and time consuming process," Rodríguez notes. "What we have done is achieve the same quality largely automatically."

In effect, VISIRE cuts out the need for specialised skills to design 3D images allowing any multimedia professional to take footage with little more than a home-video camera and then convert it into three dimensions.

Tested at the Uffizi Gallery in Florence, Italy, and in the Spanish capital’s historic Casino Madrid, VISIRE was validated as a generic 3D authoring tool that can be used on a multitude of environments to create 3D images of any object.

"There’s currently a great deal of interest in developing 3D image systems because until now the construction of photorealistic 3D footage has had to be done manually in a very long and time consuming process," Rodríguez notes. "What we have done is achieve the same quality largely automatically."

In effect, VISIRE cuts out the need for specialised skills to design 3D images allowing any multimedia professional to take footage with little more than a home-video camera and then convert it into three dimensions.

Tested at the Uffizi Gallery in Florence, Italy, and in the Spanish capital’s historic Casino Madrid, VISIRE was validated as a generic 3D authoring tool that can be used on a multitude of environments to create 3D images of any object.

"We chose to pick historic sights and museums to test the system as they are good environments to see how well the application works, although it can be used in many locations and for many purposes," Rodríguez explains. Indeed, any structure or object, from the largest building to the smallest jewel, can be rendered in 3D by VISIRE, and, perhaps most interestingly, the system proves most useful when applied to the most complex images.

"Scenes with rich and highly textured architecture, such as stuccoed walls or sculptures, are excellent candidates for VISIRE because the processing of those types of images is most complicated," the coordinator notes. VISIRE automates up to 95 per cent of the 3D rendering process, reducing the production time for creating 3D images to a third of what it would take to do so entirely manually. "It is the most advanced automatic 3D design system yet created," Rodríguez says.

With plans in the works to launch VISIRE commercially, a whole new virtual world of 3D tours of historic monuments and other sites is being opened up, just as EVENTS promises to allow soccer fans to relive goals in ways they may never have previously thought possible.

Contact:
Tomás Rodríguez
Eptron
Calle Juan Vigon 3
E-28003 Madrid
Spain
Tel: +34-91-5360163
E-mail: tomasrod@eptron.es
Source: Based on information from EVENTS and VISIRE

Tara Morris | IST Results
Further information:
http://istresults.cordis.lu/index.cfm?section=news&tpl=article&BrowsingType=Features&ID=63180

More articles from Communications Media:

nachricht Tile Based DASH Streaming for Virtual Reality with HEVC from Fraunhofer HHI
03.01.2017 | Fraunhofer-Institut für Nachrichtentechnik Heinrich-Hertz-Institut

nachricht Product placement: Only brands placed very prominently benefit from 3D technology
07.07.2016 | Alpen-Adria-Universität Klagenfurt

All articles from Communications Media >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Quantum optical sensor for the first time tested in space – with a laser system from Berlin

For the first time ever, a cloud of ultra-cold atoms has been successfully created in space on board of a sounding rocket. The MAIUS mission demonstrates that quantum optical sensors can be operated even in harsh environments like space – a prerequi-site for finding answers to the most challenging questions of fundamental physics and an important innovation driver for everyday applications.

According to Albert Einstein's Equivalence Principle, all bodies are accelerated at the same rate by the Earth's gravity, regardless of their properties. This...

Im Focus: Traffic jam in empty space

New success for Konstanz physicists in studying the quantum vacuum

An important step towards a completely new experimental access to quantum physics has been made at University of Konstanz. The team of scientists headed by...

Im Focus: How gut bacteria can make us ill

HZI researchers decipher infection mechanisms of Yersinia and immune responses of the host

Yersiniae cause severe intestinal infections. Studies using Yersinia pseudotuberculosis as a model organism aim to elucidate the infection mechanisms of these...

Im Focus: Interfacial Superconductivity: Magnetic and superconducting order revealed simultaneously

Researchers from the University of Hamburg in Germany, in collaboration with colleagues from the University of Aarhus in Denmark, have synthesized a new superconducting material by growing a few layers of an antiferromagnetic transition-metal chalcogenide on a bismuth-based topological insulator, both being non-superconducting materials.

While superconductivity and magnetism are generally believed to be mutually exclusive, surprisingly, in this new material, superconducting correlations...

Im Focus: Studying fundamental particles in materials

Laser-driving of semimetals allows creating novel quasiparticle states within condensed matter systems and switching between different states on ultrafast time scales

Studying properties of fundamental particles in condensed matter systems is a promising approach to quantum field theory. Quasiparticles offer the opportunity...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

Sustainable Water use in Agriculture in Eastern Europe and Central Asia

19.01.2017 | Event News

12V, 48V, high-voltage – trends in E/E automotive architecture

10.01.2017 | Event News

2nd Conference on Non-Textual Information on 10 and 11 May 2017 in Hannover

09.01.2017 | Event News

 
Latest News

Tracking movement of immune cells identifies key first steps in inflammatory arthritis

23.01.2017 | Health and Medicine

Electrocatalysis can advance green transition

23.01.2017 | Physics and Astronomy

New technology for mass-production of complex molded composite components

23.01.2017 | Process Engineering

VideoLinks
B2B-VideoLinks
More VideoLinks >>>