Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Deaf, hard-of-hearing students perform first test of sign language by cell phone

17.08.2010
University of Washington engineers are developing the first device able to transmit American Sign Language over U.S. cellular networks. The tool is just completing its initial field test by participants in a UW summer program for deaf and hard-of-hearing students.

"This is the first study of how deaf people in the United States use mobile video phones," said project leader Eve Riskin, a UW professor of electrical engineering.

The MobileASL team has been working to optimize compressed video signals for sign language. By increasing image quality around the face and hands, researchers have brought the data rate down to 30 kilobytes per second while still delivering intelligible sign language. MobileASL also uses motion detection to identify whether a person is signing or not, in order to extend the phones' battery life during video use.

Transmitting sign language as efficiently as possible increases affordability, improves reliability on slower networks and extends battery life, even on devices that might have the capacity to deliver higher quality video.

This summer's field test is allowing the team to see how people use the tool in their daily lives and what obstacles they encounter. Eleven participants are testing the phones for three weeks. They meet with the research team for interviews and occasionally have survey questions pop up after a call is completed asking about the call quality.

The field test began July 28 and concludes this Wednesday. In the first two and a half weeks of the study, some 200 calls were made with an average call duration of a minute and a half, researchers said. A larger field study will begin this winter.

"We know these phones work in a lab setting, but conditions are different in people's everyday lives," Riskin said. "The field study is an important step toward putting this technology into practice." Participants in the current field test are students in the UW Summer Academy for Advancing Deaf and Hard of Hearing in Computing. The academy accepts academically gifted deaf and hard-of-hearing students interested in pursuing computing careers. Students spend nine weeks at the UW taking computer programming and animation classes, meeting with deaf and hard-of-hearing role models who already work in computing fields, UW graduate students and visiting local computer software and hardware companies.

Most study participants say texting or e-mail is currently their preferred method for distance communication. Their experiences with the MobileASL phone are, in general, positive.

"It is good for fast communication," said Tong Song, a Chinese national who is studying at Gallaudet University in Washington, D.C. "Texting sometimes is very slow, because you send the message and you're not sure that the person is going to get it right away. If you're using this kind of phone then you're either able to get in touch with the person or not right away, and you can save a lot of time."

Josiah Cheslik, a UW undergraduate and past participant in the summer academy who is now a teaching assistant, agreed.

"Texting is for short things, like 'I'm here,' or, 'What do you need at the grocery store?'" he said. "This is like making a real phone call."

As everyone knows, text-based communication can also lead to mix-ups.

"Sometimes with texting people will be confused about what it really means," Song said. "With the MobileASL phone people can see each other eye to eye, face to face, and really have better understanding."

Some students also use video chat on a laptop, home computer or video phone terminal, but none of these existing technologies for transmitting sign language fits in your pocket.

Cheslik recounts that during the study one participant was lost riding a Seattle city bus and the two were able to communicate using MobileASL. The student on the bus described what he was seeing and Cheslik helped him navigate where he wanted to go.

Newly released high-end phones, such as the iPhone 4 and the HTC Evo, offer video conferencing. But users are already running into hitches – broadband companies have blocked the bandwidth-hogging video conferencing from their networks, and are rolling out tiered pricing plans that would charge more to heavy data users.

The UW team estimates that iPhone's FaceTime video conferencing service uses nearly 10 times the bandwidth of MobileASL. Even after the anticipated release of an iPhone app to transmit sign language, people would need to own an iPhone 4 and be in an area with very fast network speeds in order to use the service. The MobileASL system could be integrated with the iPhone 4, the HTC Evo, or any device that has a video camera on the same side as the screen.

"We want to deliver affordable, reliable ASL on as many devices as possible," Riskin said. "It's a question of equal access to mobile communication technology."

Jessica Tran, a doctoral student in electrical engineering who is running the field study, is experimenting with different compression systems to extend the life of the battery under heavy video use. Electrical engineering doctoral student Jaehong Chon made MobileASL compatible with H.264, an industry standard for video compression. Tressa Johnson, a master's student in library and information science and a certified ASL interpreter, is studying the phones' impact on the deaf community.

The MobileASL research is primarily funded by the National Science Foundation, with additional gifts from Sprint Nextel Corp., Sorenson Communications and Microsoft Corp. Collaborators at the UW are Richard Ladner, professor of computer science and engineering, and Jacob Wobbrock, assistant professor in the Information School.

The Summer Academy for Advancing Deaf and Hard of Hearing in Computing is applying for a third round of funding from the National Science Foundation. Additional support for this year's program came from the Johnson Family Foundation, the Bill and Melinda Gates Foundation, Cray Corp., Oracle Corp., Google Corp. and SignOn Inc.

Each year the summer academy hosts a premiere of the students' animated short films. This year's showing is Friday, Aug. 20 from 7 to 8 p.m. in Electrical Engineering Building room 125. The event is free and open to the public.

The MobileASL field test ends Wednesday and the Summer Academy ends Friday. To schedule an interview with Summer Academy program participants, contact Rob Roth at 206-685-3237 or robroth@cs.washington.edu.

For more information on the MobileASL project, contact Riskin at 206-685-2313 or riskin@uw.edu. Riskin is out of town until Aug. 23. Graduate students working on the project are available; contact Hannah Hickey at 206-543-2580 or hickeyh@uw.edu to arrange an interview.

MobileASL website: http://mobileasl.cs.washington.edu/
MobileASL on YouTube: http://www.youtube.com/watch?v=FaE1PvJwI8E&feature=player_embedded

MobileASL on Facebook: http://www.facebook.com/pages/MobileASL-University-of-Washington/281541461917

Hannah Hickey | EurekAlert!
Further information:
http://www.uw.edu

More articles from Studies and Analyses:

nachricht Drone vs. truck deliveries: Which create less carbon pollution?
31.05.2017 | University of Washington

nachricht New study: How does Europe become a leading player for software and IT services?
03.04.2017 | Fraunhofer-Institut für System- und Innovationsforschung (ISI)

All articles from Studies and Analyses >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Climate satellite: Tracking methane with robust laser technology

Heatwaves in the Arctic, longer periods of vegetation in Europe, severe floods in West Africa – starting in 2021, scientists want to explore the emissions of the greenhouse gas methane with the German-French satellite MERLIN. This is made possible by a new robust laser system of the Fraunhofer Institute for Laser Technology ILT in Aachen, which achieves unprecedented measurement accuracy.

Methane is primarily the result of the decomposition of organic matter. The gas has a 25 times greater warming potential than carbon dioxide, but is not as...

Im Focus: How protons move through a fuel cell

Hydrogen is regarded as the energy source of the future: It is produced with solar power and can be used to generate heat and electricity in fuel cells. Empa researchers have now succeeded in decoding the movement of hydrogen ions in crystals – a key step towards more efficient energy conversion in the hydrogen industry of tomorrow.

As charge carriers, electrons and ions play the leading role in electrochemical energy storage devices and converters such as batteries and fuel cells. Proton...

Im Focus: A unique data centre for cosmological simulations

Scientists from the Excellence Cluster Universe at the Ludwig-Maximilians-Universität Munich have establised "Cosmowebportal", a unique data centre for cosmological simulations located at the Leibniz Supercomputing Centre (LRZ) of the Bavarian Academy of Sciences. The complete results of a series of large hydrodynamical cosmological simulations are available, with data volumes typically exceeding several hundred terabytes. Scientists worldwide can interactively explore these complex simulations via a web interface and directly access the results.

With current telescopes, scientists can observe our Universe’s galaxies and galaxy clusters and their distribution along an invisible cosmic web. From the...

Im Focus: Scientists develop molecular thermometer for contactless measurement using infrared light

Temperature measurements possible even on the smallest scale / Molecular ruby for use in material sciences, biology, and medicine

Chemists at Johannes Gutenberg University Mainz (JGU) in cooperation with researchers of the German Federal Institute for Materials Research and Testing (BAM)...

Im Focus: Optoelectronic Inline Measurement – Accurate to the Nanometer

Germany counts high-precision manufacturing processes among its advantages as a location. It’s not just the aerospace and automotive industries that require almost waste-free, high-precision manufacturing to provide an efficient way of testing the shape and orientation tolerances of products. Since current inline measurement technology not yet provides the required accuracy, the Fraunhofer Institute for Laser Technology ILT is collaborating with four renowned industry partners in the INSPIRE project to develop inline sensors with a new accuracy class. Funded by the German Federal Ministry of Education and Research (BMBF), the project is scheduled to run until the end of 2019.

New Manufacturing Technologies for New Products

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

Plants are networkers

19.06.2017 | Event News

Digital Survival Training for Executives

13.06.2017 | Event News

Global Learning Council Summit 2017

13.06.2017 | Event News

 
Latest News

Hubble captures massive dead disk galaxy that challenges theories of galaxy evolution

22.06.2017 | Physics and Astronomy

New femto-camera with quadrillion fractions of a second resolution

22.06.2017 | Physics and Astronomy

Rice U. chemists create 3-D printed graphene foam

22.06.2017 | Materials Sciences

VideoLinks
B2B-VideoLinks
More VideoLinks >>>