Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

'Can You See Me Now?' Sign Language Over Cell Phones Comes to United States

25.08.2008
Researchers have developed software that for the first time enables deaf and hard-of-hearing Americans to use sign language over a mobile phone.

A group at the University of Washington has developed software that for the first time enables deaf and hard-of-hearing Americans to use sign language over a mobile phone. UW engineers got the phones working together this spring, and recently received a National Science Foundation grant for a 20-person field project that will begin next year in Seattle.

This is the first time two-way real-time video communication has been demonstrated over cell phones in the United States. Since posting a video of the working prototype on YouTube, deaf people around the country have been writing on a daily basis.

"A lot of people are excited about this," said principal investigator Eve Riskin, a UW professor of electrical engineering.

The video is posted at http://youtube.com/watch?v=FaE1PvJwI8E.
For mobile communication, deaf people now communicate by cell phone using text messages. "But the point is you want to be able to communicate in your native language," Riskin said. "For deaf people that's American Sign Language."

Video is much better than text-messaging because it's faster and it's better at conveying emotion, said Jessica DeWitt, a UW undergraduate in psychology who is deaf and is a collaborator on the MobileASL project. She says a large part of her communication is with facial expressions, which are transmitted over the video phones.

Low data transmission rates on U.S. cellular networks, combined with limited processing power on mobile devices, have so far prevented real-time video transmission with enough frames per second that it could be used to transmit sign language. Communication rates on United States cellular networks allow about one tenth of the data rates common in places such as Europe and Asia (sign language over cell phones is already possible in Sweden and Japan).

Even as faster networks are becoming more common in the United States, there is still a need for phones that would operate on the slower systems.

"The faster networks are not available everywhere," said doctoral student Anna Cavender. "They also cost more. We don't think it's fair for someone who's deaf to have to pay more for his or her cell phone than someone who's hearing."

The team tried different ways to get comprehensible sign language on low-resolution video. They discovered that the most important part of the image to transmit in high resolution is around the face. This is not surprising, since eye-tracking studies have already shown that people spend the most time looking at a person's face while they are signing.

The current version of MobileASL uses a standard video compression tool to stay within the data transmission limit. Future versions will incorporate custom tools to get better quality. The team developed a scheme to transmit the person's face and hands in high resolution, and the background in lower resolution. Now they are working on another feature that identifies when people are moving their hands, to reduce battery consumption and processing power when the person is not signing.

The team is currently using phones imported from Europe, which are the only ones they could find that would be compatible with the software and have a camera and video screen located on the same side of the phone so that people can film themselves while watching the screen.

Mobile video sign language won't be widely available until the service is provided through a commercial cell-phone manufacturer, Riskin said. The team has already been in discussion with a major cellular network provider that has expressed interest in the project.

The MobileASL team includes Richard Ladner, a UW professor of computer science and engineering; Sheila Hemami, a professor of electrical engineering at Cornell University; Jacob Wobbrock, an assistant professor in the UW's Information School; and UW graduate students Neva Cherniavsky, Jaehong Chon and Rahul Vanam.

For more information, contact Riskin at (206) 685-2313 or riskin@u.washington.edu.

More details on the MobileASL project are at http://mobileasl.cs.washington.edu/index.html. A video demonstration is posted at http://youtube.com/watch?v=FaE1PvJwI8E.

Riskin | Newswise Science News
Further information:
http://www.washington.edu

More articles from Information Technology:

nachricht Accelerating quantum technologies with materials processing at the atomic scale
15.05.2019 | University of Oxford

nachricht A step towards probabilistic computing
15.05.2019 | University of Konstanz

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: The geometry of an electron determined for the first time

Physicists at the University of Basel are able to show for the first time how a single electron looks in an artificial atom. A newly developed method enables them to show the probability of an electron being present in a space. This allows improved control of electron spins, which could serve as the smallest information unit in a future quantum computer. The experiments were published in Physical Review Letters and the related theory in Physical Review B.

The spin of an electron is a promising candidate for use as the smallest information unit (qubit) of a quantum computer. Controlling and switching this spin or...

Im Focus: Self-repairing batteries

UTokyo engineers develop a way to create high-capacity long-life batteries

Engineers at the University of Tokyo continually pioneer new ways to improve battery technology. Professor Atsuo Yamada and his team recently developed a...

Im Focus: Quantum Cloud Computing with Self-Check

With a quantum coprocessor in the cloud, physicists from Innsbruck, Austria, open the door to the simulation of previously unsolvable problems in chemistry, materials research or high-energy physics. The research groups led by Rainer Blatt and Peter Zoller report in the journal Nature how they simulated particle physics phenomena on 20 quantum bits and how the quantum simulator self-verified the result for the first time.

Many scientists are currently working on investigating how quantum advantage can be exploited on hardware already available today. Three years ago, physicists...

Im Focus: Accelerating quantum technologies with materials processing at the atomic scale

'Quantum technologies' utilise the unique phenomena of quantum superposition and entanglement to encode and process information, with potentially profound benefits to a wide range of information technologies from communications to sensing and computing.

However a major challenge in developing these technologies is that the quantum phenomena are very fragile, and only a handful of physical systems have been...

Im Focus: A step towards probabilistic computing

Working group led by physicist Professor Ulrich Nowak at the University of Konstanz, in collaboration with a team of physicists from Johannes Gutenberg University Mainz, demonstrates how skyrmions can be used for the computer concepts of the future

When it comes to performing a calculation destined to arrive at an exact result, humans are hopelessly inferior to the computer. In other areas, humans are...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

SEMANTiCS 2019 brings together industry leaders and data scientists in Karlsruhe

29.04.2019 | Event News

Revered mathematicians and computer scientists converge with 200 young researchers in Heidelberg!

17.04.2019 | Event News

First dust conference in the Central Asian part of the earth’s dust belt

15.04.2019 | Event News

 
Latest News

Plumbene, graphene's latest cousin, realized on the 'nano water cube'

23.05.2019 | Materials Sciences

New flatland material: Physicists obtain quasi-2D gold

23.05.2019 | Materials Sciences

New Boost for ToCoTronics

23.05.2019 | Physics and Astronomy

VideoLinks
Science & Research
Overview of more VideoLinks >>>