Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Let software catch the game for you

01.07.2004


Software that can identify the significant events in live TV sports broadcasts will soon be able to compile programmes of highlights without any help from people.

The technology will save broadcasters millions in editing costs- and should eventually lead to new generations of video recorders that will let people customise their own sports highlights packages. But developing software that understands sport is no easy task.

Picking out the key events from a game- whether it be pool, rugby, baseball, soccer or basketball- is labour-intensive. As the footage streams into a TV station or outside-broadcast truck, a sports editor has to watch the action and keep notes on what happens and when. Only after that are the clips retrieved and put together to form a highlights package.



But as sports follow fixed rules, and take place in predictable locations, computers ought to be able to pick out the key pieces of play and string them together. "It is a situation that is ripe for automation," believes Andrew Kilner at Sony Broadcast in Basingstoke, UK, which makes TV broadcasting equipment.

Anil Kokaram and colleagues at Trinity College in Dublin, Ireland are among the teams trying to turn the idea into reality. They have decided to analyse table-based ball games like snooker and pool. These are sports that a computer should find relatively easy to handle as the action is slow, indoor lighting is fairly consistent and cameras mostly shoot from fixed positions.

The Trinity team’s PC-based software uses the edges of the table and the positions of the pockets to work out where the balls are on the table. The software has the rules of the game programmed in, so it can track the moving balls and work out what has happened. For example, if a ball approaches a pocket and then disappears from view, the program assumes it has been potted. By working out how to detect foul shots - when a player hits the wrong ball - the team hopes to find a way to create a compelling highlights package that includes a varied selection of the action.

Sports like American football and soccer will be much more of a challenge, because they involve a far greater number of moving objects (both teams of players plus the ball) on the field which cannot be tracked easily without massive computer power. Hampering this process, too, is the fact that the colour of the playing field is often patchy and can vary with the weather and lighting. So when the camera moves across the field, the software could mistake the different-coloured patches for extra players.

Carlo Colombo and colleagues at the University of Florence, Italy, are trying out another idea. They found that they can compile highlights from soccer footage without tracking the ball or the moving players. Instead, one of their tricks is to look at the position of the players in set pieces like corners, free kicks and penalties. Their software detects the position of the pitch markings in a shot to work out which area is in the frame (see Graphic). Then, by checking the positions the players adopt in relation to the markings, the software can decide whether a player is about to take a penalty, free kick or corner, and whether or not a goal is scored as a result. The Florence team has not yet worked out how to enable the computer to determine when a goal is scored in open play.

Ahmat Ekin, a computer scientist from the University of Rochester in New York, may be close to solving that problem. He has designed software that looks for a specific sequence of camera shots to work out whether a goal has been scored. For example, player close-ups often indicate a gap in play when something important has happened, and slow-motion footage is another useful cue. If Ekin’s software sees a sequence of player close-ups combined with shots of the crowd and pictures in slow motion that lasts between 30 and 120 seconds, it decides that a goal has been scored, and records the clip in the highlights. But it could also be possible that a controversial incident is being analysed, and Ekin aims to get round this by combining sound analysis with the pictures to give a more accurate result. For example, the software could hunt for the commentator’s extravagant shouts of "gooooaall!".

The electronics giant Sharp is now trialling a simple highlights package called Himpact with sports broadcasters. For soccer it simply searches for all replay footage, but in American football or baseball it captures all the "plays"- the action between the frequent pauses. In tests it has cut an hour of American football down to around 14 minutes, and an hour’s baseball to 10 minutes. Sharp is now seeking commercial partners to develop the technology for home video recorders. It hopes people will be able to choose a full highlights package or a customised one, in which they might choose to see only goals- or fouls, if the mood takes them.

The Japanese firm is also planning a heavyweight future for the technology: its next target market is sumo wrestling.

James Randerson | alfa
Further information:
http://www.newscientist.com

More articles from Communications Media:

nachricht New Technologies for A/V Analysis and Search
13.04.2017 | Fraunhofer-Institut für Digitale Medientechnologie IDMT

nachricht On patrol in social networks
25.01.2017 | Fraunhofer-Institut für Arbeitswirtschaft und Organisation IAO

All articles from Communications Media >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: The pyrenoid is a carbon-fixing liquid droplet

Plants and algae use the enzyme Rubisco to fix carbon dioxide, removing it from the atmosphere and converting it into biomass. Algae have figured out a way to increase the efficiency of carbon fixation. They gather most of their Rubisco into a ball-shaped microcompartment called the pyrenoid, which they flood with a high local concentration of carbon dioxide. A team of scientists at Princeton University, the Carnegie Institution for Science, Stanford University and the Max Plank Institute of Biochemistry have unravelled the mysteries of how the pyrenoid is assembled. These insights can help to engineer crops that remove more carbon dioxide from the atmosphere while producing more food.

A warming planet

Im Focus: Highly precise wiring in the Cerebral Cortex

Our brains house extremely complex neuronal circuits, whose detailed structures are still largely unknown. This is especially true for the so-called cerebral cortex of mammals, where among other things vision, thoughts or spatial orientation are being computed. Here the rules by which nerve cells are connected to each other are only partly understood. A team of scientists around Moritz Helmstaedter at the Frankfiurt Max Planck Institute for Brain Research and Helene Schmidt (Humboldt University in Berlin) have now discovered a surprisingly precise nerve cell connectivity pattern in the part of the cerebral cortex that is responsible for orienting the individual animal or human in space.

The researchers report online in Nature (Schmidt et al., 2017. Axonal synapse sorting in medial entorhinal cortex, DOI: 10.1038/nature24005) that synapses in...

Im Focus: Tiny lasers from a gallery of whispers

New technique promises tunable laser devices

Whispering gallery mode (WGM) resonators are used to make tiny micro-lasers, sensors, switches, routers and other devices. These tiny structures rely on a...

Im Focus: Ultrafast snapshots of relaxing electrons in solids

Using ultrafast flashes of laser and x-ray radiation, scientists at the Max Planck Institute of Quantum Optics (Garching, Germany) took snapshots of the briefest electron motion inside a solid material to date. The electron motion lasted only 750 billionths of the billionth of a second before it fainted, setting a new record of human capability to capture ultrafast processes inside solids!

When x-rays shine onto solid materials or large molecules, an electron is pushed away from its original place near the nucleus of the atom, leaving a hole...

Im Focus: Quantum Sensors Decipher Magnetic Ordering in a New Semiconducting Material

For the first time, physicists have successfully imaged spiral magnetic ordering in a multiferroic material. These materials are considered highly promising candidates for future data storage media. The researchers were able to prove their findings using unique quantum sensors that were developed at Basel University and that can analyze electromagnetic fields on the nanometer scale. The results – obtained by scientists from the University of Basel’s Department of Physics, the Swiss Nanoscience Institute, the University of Montpellier and several laboratories from University Paris-Saclay – were recently published in the journal Nature.

Multiferroics are materials that simultaneously react to electric and magnetic fields. These two properties are rarely found together, and their combined...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

“Lasers in Composites Symposium” in Aachen – from Science to Application

19.09.2017 | Event News

I-ESA 2018 – Call for Papers

12.09.2017 | Event News

EMBO at Basel Life, a new conference on current and emerging life science research

06.09.2017 | Event News

 
Latest News

Rainbow colors reveal cell history: Uncovering β-cell heterogeneity

22.09.2017 | Life Sciences

Penn first in world to treat patient with new radiation technology

22.09.2017 | Medical Engineering

Calculating quietness

22.09.2017 | Physics and Astronomy

VideoLinks
B2B-VideoLinks
More VideoLinks >>>