Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

A future vision for media

08.06.2012
A*STAR’s Snap2Tell image recognition technology is at the forefront of new media applications for mobile phone and iPad users.
New technologies to support the rapidly evolving world of media and communications are big business. Creating successful image recognition software is a key area of research, since multimedia relies heavily on the power of imagery and customers are demanding more information more rapidly.

Teaching computers to ‘see’ and recognize images accurately is difficult. The key is to train computers to recognize and group together images that have the same or similar numerical pixel data. The sheer amount and complexity of image data available means that advanced image recognition is still beyond current technologies.

An image recognition system called Snap2Tell, developed by Yiqun Li and co-workers at the A*STAR Institute for Infocomm Research is now being integrated into a new mobile phone app for Malaysian newspaper The Star as a new function called iSnap. This could have many potential applications for media use in future.

How Snap2Tell works

The initial objective of the Snap2Tell technology is to simplify the process of getting information on the move,” explains Li. “By capturing an image using the phone camera, relevant information on the topic at hand is displayed to the user immediately. Taking a picture is much easier than typing a sentence on the small key pad on the phone.”

The Snap2Tell software works by recognizing image information present in a pre-prepared database of Snap2Tell readable images. Snap2Tell matches the image to the database, and then accesses further information which has been pre-associated with that image.

Enhancing newspapers with iSnap

Snap2Tell is now being applied to mobile augmented reality applications, in the form of iSnap. iSnap is free to use for mobile phone and iPad users as soon they have downloaded the Star Mobile app. The user simply points the phone camera at an iSnap marked article or advert, and a set of icons will appear on top of the articles on the phone screen. The icons represent different additional information relevant to the article. When an icon is touched, iSnap will automatically take the reader to further information through a variety of multimedia, such as websites, social network forums, or video clips.

In The Star newspaper, certain articles and advertisements are now printed with an iSnap logo next to them. iSnap is different to QR codes, currently used widely in advertising print media such as billboard posters. Essentially barcode squares that phone users can scan, QR codes direct the user’s phone to a company’s product website. With iSnap, the code is not needed — the software recognizes images related to the product.

In addition, iSnap brings up a whole array of different multimedia information via icons on the touch-screen — not just one website. This means that the user has a choice of which media form they would like to view, rather than scrolling through websites to find a video, audio file, or written commentary, to give but a few examples. The user also has the choice to save their favorite information to their phone, should they wish.

Advantages and disadvantages

Media and advertising companies are delighted with the possibilities that the Snap2Tell technology brings. Paper advertisements can potentially come to life through mixed media — for example viewing the latest TV adverts or reading the specifications and reviews for the latest model of a car. News articles can be accompanied by film footage, interviews and associated story links and commentaries, and even billboard posters could carry the iSnap logo in future and lead the ‘snapper’ to film trailers or the latest news on a certain product.

Furthermore, a more targeted audience could also be reached in future, as Li explains: “The information can also be stored in the user's phone if the user is interested in the product being advertised. We have developed a mobile app called Snap2Remind for bringing up more information on printed advertisement pictures. The app also provides location-based reminders to alert users when they pass by the shops where the advertised products are being sold.”

For advertising and media companies, Snap2Tell opens up a wide range of possibilities in terms of consumers accessing further information without page or print limitations. Companies can also monitor the popularity of different articles and products by looking at the access rates for each individual item.

There are, however, some limitations of the technology as it currently stands. iSnap requires a phone with a touch-screen and access to the internet. In addition, media companies’ servers need to be big enough to host and produce multimedia on a large scale. They also need to develop a database of Snap2Tell readable images, by uploading each image as it is needed in printed form. This could eliminate some smaller local companies from participating.

Future plans for Snap2Tell technology

Li is quick to point out that, as in the West, newspapers may not last in Asia. However, she remains optimistic about the future of iSnap and Snap2Tell: “Even if there are no printed newspapers in the future, there may still be other paper media such as posters, signboards, paintings, drawings, CD covers, and book covers, for example.”

Snap2Tell image recognition is not limited to printed materials; it can be applied to physical objects or scenes as well — see Snap2Search for more details.

A*STAR researchers are now working to produce more complex versions of the Snap2Tell technology and expanding it into applications for 3D physical objects or scenes. Pointing the phone camera to a real building could bring up a similar touch-screen experience, providing the mobile users with information about the building and its location. This could mean that sight-seeing for tourists could take on a new twist, without the need for carrying guidebooks.

“We are planning to work on more complicated cases of augmented reality on mobile phones,” says Li. “The iSnap may not be just an overlay of icons on top of printed media. It may include 3D object rendering on top of physical objects or scenes in future.”

About the Institute for Infocomm Research

The A*STAR Institute for Infocomm Research (I²R) was established in 2002 with the mission of becoming a globally preferred source of innovations in interactive secured information, content and services. I²R conducts research and development in information technology, wireless and optical communications, interactive and digital media, signal processing and computing.
Associated links
http://www.research.a-star.edu.sg/feature-and-innovation/6516

ResearchSEA Account for A*STAR | Research asia research news
Further information:
http://www.a-star.edu.sg
http://www.researchsea.com

More articles from Communications Media:

nachricht Rapid increase in the volume of video transmissions: Work is in progress on a new intelligent video platform
23.06.2020 | Alpen-Adria-Universität Klagenfurt

nachricht More focus and comfort at telephone workstations
20.02.2020 | Fraunhofer-Institut für Digitale Medientechnologie IDMT

All articles from Communications Media >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Electrons in the fast lane

Solar cells based on perovskite compounds could soon make electricity generation from sunlight even more efficient and cheaper. The laboratory efficiency of these perovskite solar cells already exceeds that of the well-known silicon solar cells. An international team led by Stefan Weber from the Max Planck Institute for Polymer Research (MPI-P) in Mainz has found microscopic structures in perovskite crystals that can guide the charge transport in the solar cell. Clever alignment of these "electron highways" could make perovskite solar cells even more powerful.

Solar cells convert sunlight into electricity. During this process, the electrons of the material inside the cell absorb the energy of the light....

Im Focus: The lightest electromagnetic shielding material in the world

Empa researchers have succeeded in applying aerogels to microelectronics: Aerogels based on cellulose nanofibers can effectively shield electromagnetic radiation over a wide frequency range – and they are unrivalled in terms of weight.

Electric motors and electronic devices generate electromagnetic fields that sometimes have to be shielded in order not to affect neighboring electronic...

Im Focus: Gentle wall contact – the right scenario for a fusion power plant

Quasi-continuous power exhaust developed as a wall-friendly method on ASDEX Upgrade

A promising operating mode for the plasma of a future power plant has been developed at the ASDEX Upgrade fusion device at Max Planck Institute for Plasma...

Im Focus: ILA Goes Digital – Automation & Production Technology for Adaptable Aircraft Production

Live event – July 1, 2020 - 11:00 to 11:45 (CET)
"Automation in Aerospace Industry @ Fraunhofer IFAM"

The Fraunhofer Institute for Manufacturing Technology and Advanced Materials IFAM l Stade is presenting its forward-looking R&D portfolio for the first time at...

Im Focus: AI monitoring of laser welding processes - X-ray vision and eavesdropping ensure quality

With an X-ray experiment at the European Synchrotron ESRF in Grenoble (France), Empa researchers were able to demonstrate how well their real-time acoustic monitoring of laser weld seams works. With almost 90 percent reliability, they detected the formation of unwanted pores that impair the quality of weld seams. Thanks to a special evaluation method based on artificial intelligence (AI), the detection process is completed in just 70 milliseconds.

Laser welding is a process suitable for joining metals and thermoplastics. It has become particularly well established in highly automated production, for...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

International conference QuApps shows status quo of quantum technology

02.07.2020 | Event News

Dresden Nexus Conference 2020: Same Time, Virtual Format, Registration Opened

19.05.2020 | Event News

Aachen Machine Tool Colloquium AWK'21 will take place on June 10 and 11, 2021

07.04.2020 | Event News

 
Latest News

Rising water temperatures could endanger the mating of many fish species

03.07.2020 | Life Sciences

Risk of infection with COVID-19 from singing: First results of aerosol study with the Bavarian Radio Chorus

03.07.2020 | Studies and Analyses

Efficient, Economical and Aesthetic: Researchers Build Electrodes from Leaves

03.07.2020 | Power and Electrical Engineering

VideoLinks
Science & Research
Overview of more VideoLinks >>>