Computers that can read lips are already in development but this is the first time they have been 'taught' to recognise different languages. The discovery could have practical uses for deaf people, for law enforcement agencies, and in noisy environments.
Led by Stephen Cox and Jake Newman of UEA's School of Computing Sciences, the groundbreaking research will be presented at a major conference in Taiwan on Wednesday April 22.
The technology was developed by statistical modelling of the lip motions made by a group of 23 bilingual and trilingual speakers. The system was able to identify which language was spoken by an individual speaker with very high accuracy. These languages included English, French, German, Arabic, Mandarin, Cantonese, Italian, Polish and Russian.
"This is an exciting advance in automatic lip-reading technology and the first scientific confirmation of something we already intuitively suspected -¬ that when people speak different languages, they use different mouth shapes in different sequences," said Prof Cox.
"For example, we found frequent 'lip-rounding' among French speakers and more prominent tongue movements among Arabic speakers."
Funded by the EPSRC, the research is part of a wider UEA project on automatic lip-reading. The next step will be to make the system more robust to an individual's physiology and his or her way of speaking.
The IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2009 takes place at the Taipei International Convention Centre in Taipei, Taiwan from April 19-24. For more details, visit www.icassp09.com.
Simon Dunford | Source: EurekAlert!
Further information: www.uea.ac.uk
www.icassp09.com
Further Reports about: automatic lip-reading technology > bilingual and trilingual speakers > Computing Sciences > different languages > law enforcement agencies > Lip-reading computers > signal processing
More articles from Information Technology:
NIST Test Proves ‘The Eyes Have It’ for ID Verification
06.11.2009 | National Institute of Standards and Technology (NIST)
New Celestial Map Gives Directions for GPS
02.11.2009 | NASA/Goddard Space Flight Center
Airborne nitrogen shifts aquatic nutrient limitation in pristine lakes
06.11.2009 | Studies and Analyses
Genome sequence for the domestic horse to be unveiled
06.11.2009 | Life Sciences
06.11.2009 | Earth Sciences
Texas Tech University Hosts Major Textile Conference in India
06.11.2009 | Event News
Brief Highlights of the Fluid Dynamics Conference, Minneapolis
30.10.2009 | Event News
EUROSAFE Forum 2009 Brussels: "Safety Implications of an Increased Demand for Nuclear Energy"
29.10.2009 | Event News