Computers that can read lips are already in development but this is the first time they have been 'taught' to recognise different languages. The discovery could have practical uses for deaf people, for law enforcement agencies, and in noisy environments.
Led by Stephen Cox and Jake Newman of UEA's School of Computing Sciences, the groundbreaking research will be presented at a major conference in Taiwan on Wednesday April 22.
The technology was developed by statistical modelling of the lip motions made by a group of 23 bilingual and trilingual speakers. The system was able to identify which language was spoken by an individual speaker with very high accuracy. These languages included English, French, German, Arabic, Mandarin, Cantonese, Italian, Polish and Russian.
"This is an exciting advance in automatic lip-reading technology and the first scientific confirmation of something we already intuitively suspected -¬ that when people speak different languages, they use different mouth shapes in different sequences," said Prof Cox.
"For example, we found frequent 'lip-rounding' among French speakers and more prominent tongue movements among Arabic speakers."
Funded by the EPSRC, the research is part of a wider UEA project on automatic lip-reading. The next step will be to make the system more robust to an individual's physiology and his or her way of speaking.
The IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2009 takes place at the Taipei International Convention Centre in Taipei, Taiwan from April 19-24. For more details, visit www.icassp09.com.
TIB’s Visual Analytics Research Group to develop methods for person detection and visualisation
19.03.2018 | Technische Informationsbibliothek (TIB)
Green Light for Galaxy Europe
15.03.2018 | Albert-Ludwigs-Universität Freiburg im Breisgau
For the first time, an interdisciplinary team from the University of Basel has succeeded in integrating artificial organelles into the cells of live zebrafish embryos. This innovative approach using artificial organelles as cellular implants offers new potential in treating a range of diseases, as the authors report in an article published in Nature Communications.
In the cells of higher organisms, organelles such as the nucleus or mitochondria perform a range of complex functions necessary for life. In the networks of...
Animal photoreceptors capture light with photopigments. Researchers from the University of Göttingen have now discovered that these photopigments fulfill an...
On 15 March, the AWI research aeroplane Polar 5 will depart for Greenland. Concentrating on the furthest northeast region of the island, an international team...
The world’s second-largest ice shelf was the destination for a Polarstern expedition that ended in Punta Arenas, Chile on 14th March 2018. Oceanographers from...
At the 2018 ILA Berlin Air Show from April 25–29, the Fraunhofer Institute for Laser Technology ILT is showcasing extreme high-speed Laser Material Deposition (EHLA): A video documents how for metal components that are highly loaded, EHLA has already proved itself as an alternative to hard chrome plating, which is now allowed only under special conditions.
When the EU restricted the use of hexavalent chromium compounds to special applications requiring authorization, the move prompted a rethink in the surface...
19.03.2018 | Event News
16.03.2018 | Event News
13.03.2018 | Event News
19.03.2018 | Physics and Astronomy
19.03.2018 | Materials Sciences
19.03.2018 | Event News