A group at the University of Washington has developed software that for the first time enables deaf and hard-of-hearing Americans to use sign language over a mobile phone. UW engineers got the phones working together this spring, and recently received a National Science Foundation grant for a 20-person field project that will begin next year in Seattle.
This is the first time two-way real-time video communication has been demonstrated over cell phones in the United States. Since posting a video of the working prototype on YouTube, deaf people around the country have been writing on a daily basis.
"A lot of people are excited about this," said principal investigator Eve Riskin, a UW professor of electrical engineering.
Video is much better than text-messaging because it's faster and it's better at conveying emotion, said Jessica DeWitt, a UW undergraduate in psychology who is deaf and is a collaborator on the MobileASL project. She says a large part of her communication is with facial expressions, which are transmitted over the video phones.
Low data transmission rates on U.S. cellular networks, combined with limited processing power on mobile devices, have so far prevented real-time video transmission with enough frames per second that it could be used to transmit sign language. Communication rates on United States cellular networks allow about one tenth of the data rates common in places such as Europe and Asia (sign language over cell phones is already possible in Sweden and Japan).
Even as faster networks are becoming more common in the United States, there is still a need for phones that would operate on the slower systems.
"The faster networks are not available everywhere," said doctoral student Anna Cavender. "They also cost more. We don't think it's fair for someone who's deaf to have to pay more for his or her cell phone than someone who's hearing."
The team tried different ways to get comprehensible sign language on low-resolution video. They discovered that the most important part of the image to transmit in high resolution is around the face. This is not surprising, since eye-tracking studies have already shown that people spend the most time looking at a person's face while they are signing.
The current version of MobileASL uses a standard video compression tool to stay within the data transmission limit. Future versions will incorporate custom tools to get better quality. The team developed a scheme to transmit the person's face and hands in high resolution, and the background in lower resolution. Now they are working on another feature that identifies when people are moving their hands, to reduce battery consumption and processing power when the person is not signing.
The team is currently using phones imported from Europe, which are the only ones they could find that would be compatible with the software and have a camera and video screen located on the same side of the phone so that people can film themselves while watching the screen.
Mobile video sign language won't be widely available until the service is provided through a commercial cell-phone manufacturer, Riskin said. The team has already been in discussion with a major cellular network provider that has expressed interest in the project.
The MobileASL team includes Richard Ladner, a UW professor of computer science and engineering; Sheila Hemami, a professor of electrical engineering at Cornell University; Jacob Wobbrock, an assistant professor in the UW's Information School; and UW graduate students Neva Cherniavsky, Jaehong Chon and Rahul Vanam.
For more information, contact Riskin at (206) 685-2313 or email@example.com.
More details on the MobileASL project are at http://mobileasl.cs.washington.edu/index.html. A video demonstration is posted at http://youtube.com/watch?v=FaE1PvJwI8E.
Riskin | Newswise Science News
CiViQ brings quantum technologies to the telecommunications arena
21.11.2018 | Fraunhofer-Institut für Nachrichtentechnik, Heinrich-Hertz-Institut, HHI
Earthquake researchers finalists for supercomputing prize
19.11.2018 | University of Tokyo
Innsbruck quantum physicists have constructed a diode for magnetic fields and then tested it in the laboratory. The device, developed by the research groups led by the theorist Oriol Romero-Isart and the experimental physicist Gerhard Kirchmair, could open up a number of new applications.
Electric diodes are essential electronic components that conduct electricity in one direction but prevent conduction in the opposite one. They are found at the...
Max Planck researchers revel the nano-structure of molecular trains and the reason for smooth transport in cellular antennas.
Moving around, sensing the extracellular environment, and signaling to other cells are important for a cell to function properly. Responsible for those tasks...
Researchers at the University of New Hampshire have captured a difficult-to-view singular event involving "magnetic reconnection"--the process by which sparse particles and energy around Earth collide producing a quick but mighty explosion--in the Earth's magnetotail, the magnetic environment that trails behind the planet.
Magnetic reconnection has remained a bit of a mystery to scientists. They know it exists and have documented the effects that the energy explosions can...
Biochips have been developed at TU Wien (Vienna), on which tissue can be produced and examined. This allows supplying the tissue with different substances in a very controlled way.
Cultivating human cells in the Petri dish is not a big challenge today. Producing artificial tissue, however, permeated by fine blood vessels, is a much more...
Faster and secure data communication: This is the goal of a new joint project involving physicists from the University of Würzburg. The German Federal Ministry of Education and Research funds the project with 14.8 million euro.
In our digital world data security and secure communication are becoming more and more important. Quantum communication is a promising approach to achieve...
19.11.2018 | Event News
09.11.2018 | Event News
06.11.2018 | Event News
21.11.2018 | Life Sciences
21.11.2018 | Medical Engineering
21.11.2018 | Physics and Astronomy