Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Attaining new goals in computer vision

25.03.2004


Football stadiums and museums may not have much in common, but for two IST projects, EVENTS and VISIRE, they are the perfect testing grounds for computer vision technologies that have the potential to change key areas of visual media forever.



Coordinated by Eptron in Spain, the groundbreaking initiatives have resulted in two state-of-the-art computer vision applications that far surpass anything currently available on the market. "EVENTS is an image interpolation system that creates multi-view presentations of television transmissions in near real-time," explains Tomás Rodríguez, the coordinator of both projects. "VISIRE is a 3D authoring tool that automates the construction of three-dimensional video images from two-dimensional footage."

Eptron is now considering commercialising the systems, amid what Rodríguez sees as a "strong market" for both.


EVENTS, however, may have the strongest market of all. The project partners designed it with football in mind to enhance the viewing experience of fans and cut broadcasters’ costs when covering matches. Instead of populating a soccer stadium with dozens of cameras as broadcasters have had to do until now to capture as many views as possible, EVENTS draws on footage from a minimal number of cameras and, through interpolating the images, creates virtual viewpoints.

Virtual viewpoints

"You can go anywhere you want in the stadium and view the match from there, without having to have a camera physically in place," Rodríguez notes. "You can replay a goal from any angle, or check to see whether a foul was really committed."

Interpolated images have evidently been used before, most notably in films such as ’Matrix,’ but whereas those took hours of manual processing, EVENTS achieves similar results in seconds through its advanced software platform and innovative computer-vision algorithms. This allows near real-time replays at a quality that approximates to normal camera footage, and without the need for costly equipment.

"Other systems, such as the one used to cover the US Superbowl, have had to employ upwards of 20 cameras or robotic cameras that move autonomously, or a combination of both. That’s extremely expensive," the coordinator notes. "With only a few cameras, say five or six, EVENTS can produce the same results at half or even a third of the cost of multi-camera and robotic camera systems."

These benefits were validated in trials last year at Real Madrid’s Bernabéu stadium in Spain and at Oxford United’s stadium in England that served to further enhance the system’s two core components, the Image Interpolation Engine and the Interpolated Video Player. EVENTS is not restricted to football, however, and the project partners see uses for it in other sports, as well as live television events, pop concerts or theatre. The technical progress made during the project may also have applications in video-compression or mobile services. "The market for such a system is good," Rodríguez explains. "And the possibilities for it are huge."

Similarly, VISIRE, which was tested over the same period, stands out as an important advance in computer vision, with a broad, albeit different, market potential.

Automating the design of 3D video

Also geared toward leisure, but with significant scientific uses, VISIRE is a software tool that automates the design process of 3D video images, removing much of the time and cost burden on multimedia specialists.

"There’s currently a great deal of interest in developing 3D image systems because until now the construction of photorealistic 3D footage has had to be done manually in a very long and time consuming process," Rodríguez notes. "What we have done is achieve the same quality largely automatically."

In effect, VISIRE cuts out the need for specialised skills to design 3D images allowing any multimedia professional to take footage with little more than a home-video camera and then convert it into three dimensions.

Tested at the Uffizi Gallery in Florence, Italy, and in the Spanish capital’s historic Casino Madrid, VISIRE was validated as a generic 3D authoring tool that can be used on a multitude of environments to create 3D images of any object.

"There’s currently a great deal of interest in developing 3D image systems because until now the construction of photorealistic 3D footage has had to be done manually in a very long and time consuming process," Rodríguez notes. "What we have done is achieve the same quality largely automatically."

In effect, VISIRE cuts out the need for specialised skills to design 3D images allowing any multimedia professional to take footage with little more than a home-video camera and then convert it into three dimensions.

Tested at the Uffizi Gallery in Florence, Italy, and in the Spanish capital’s historic Casino Madrid, VISIRE was validated as a generic 3D authoring tool that can be used on a multitude of environments to create 3D images of any object.

"We chose to pick historic sights and museums to test the system as they are good environments to see how well the application works, although it can be used in many locations and for many purposes," Rodríguez explains. Indeed, any structure or object, from the largest building to the smallest jewel, can be rendered in 3D by VISIRE, and, perhaps most interestingly, the system proves most useful when applied to the most complex images.

"Scenes with rich and highly textured architecture, such as stuccoed walls or sculptures, are excellent candidates for VISIRE because the processing of those types of images is most complicated," the coordinator notes. VISIRE automates up to 95 per cent of the 3D rendering process, reducing the production time for creating 3D images to a third of what it would take to do so entirely manually. "It is the most advanced automatic 3D design system yet created," Rodríguez says.

With plans in the works to launch VISIRE commercially, a whole new virtual world of 3D tours of historic monuments and other sites is being opened up, just as EVENTS promises to allow soccer fans to relive goals in ways they may never have previously thought possible.

Contact:
Tomás Rodríguez
Eptron
Calle Juan Vigon 3
E-28003 Madrid
Spain
Tel: +34-91-5360163
E-mail: tomasrod@eptron.es
Source: Based on information from EVENTS and VISIRE

Tara Morris | IST Results
Further information:
http://istresults.cordis.lu/index.cfm?section=news&tpl=article&BrowsingType=Features&ID=63180

More articles from Communications Media:

nachricht New Technologies for A/V Analysis and Search
13.04.2017 | Fraunhofer-Institut für Digitale Medientechnologie IDMT

nachricht On patrol in social networks
25.01.2017 | Fraunhofer-Institut für Arbeitswirtschaft und Organisation IAO

All articles from Communications Media >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Making lightweight construction suitable for series production

More and more automobile companies are focusing on body parts made of carbon fiber reinforced plastics (CFRP). However, manufacturing and repair costs must be further reduced in order to make CFRP more economical in use. Together with the Volkswagen AG and five other partners in the project HolQueSt 3D, the Laser Zentrum Hannover e.V. (LZH) has developed laser processes for the automatic trimming, drilling and repair of three-dimensional components.

Automated manufacturing processes are the basis for ultimately establishing the series production of CFRP components. In the project HolQueSt 3D, the LZH has...

Im Focus: Wonder material? Novel nanotube structure strengthens thin films for flexible electronics

Reflecting the structure of composites found in nature and the ancient world, researchers at the University of Illinois at Urbana-Champaign have synthesized thin carbon nanotube (CNT) textiles that exhibit both high electrical conductivity and a level of toughness that is about fifty times higher than copper films, currently used in electronics.

"The structural robustness of thin metal films has significant importance for the reliable operation of smart skin and flexible electronics including...

Im Focus: Deep inside Galaxy M87

The nearby, giant radio galaxy M87 hosts a supermassive black hole (BH) and is well-known for its bright jet dominating the spectrum over ten orders of magnitude in frequency. Due to its proximity, jet prominence, and the large black hole mass, M87 is the best laboratory for investigating the formation, acceleration, and collimation of relativistic jets. A research team led by Silke Britzen from the Max Planck Institute for Radio Astronomy in Bonn, Germany, has found strong indication for turbulent processes connecting the accretion disk and the jet of that galaxy providing insights into the longstanding problem of the origin of astrophysical jets.

Supermassive black holes form some of the most enigmatic phenomena in astrophysics. Their enormous energy output is supposed to be generated by the...

Im Focus: A Quantum Low Pass for Photons

Physicists in Garching observe novel quantum effect that limits the number of emitted photons.

The probability to find a certain number of photons inside a laser pulse usually corresponds to a classical distribution of independent events, the so-called...

Im Focus: Microprocessors based on a layer of just three atoms

Microprocessors based on atomically thin materials hold the promise of the evolution of traditional processors as well as new applications in the field of flexible electronics. Now, a TU Wien research team led by Thomas Müller has made a breakthrough in this field as part of an ongoing research project.

Two-dimensional materials, or 2D materials for short, are extremely versatile, although – or often more precisely because – they are made up of just one or a...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

Fighting drug resistant tuberculosis – InfectoGnostics meets MYCO-NET² partners in Peru

28.04.2017 | Event News

Expert meeting “Health Business Connect” will connect international medical technology companies

20.04.2017 | Event News

Wenn der Computer das Gehirn austrickst

18.04.2017 | Event News

 
Latest News

Wireless power can drive tiny electronic devices in the GI tract

28.04.2017 | Medical Engineering

Ice cave in Transylvania yields window into region's past

28.04.2017 | Earth Sciences

Nose2Brain – Better Therapy for Multiple Sclerosis

28.04.2017 | Life Sciences

VideoLinks
B2B-VideoLinks
More VideoLinks >>>