With almost all of the U.S. population armed with cellphones – and close to 80 percent carrying a smartphone – mobile phones have become second-nature for most people.
What's coming next, say University of Washington researchers, is the ability to interact with our devices not just with touchscreens, but through gestures in the space around the phone. Some smartphones are starting to incorporate 3-D gesture sensing based on cameras, for example, but cameras consume significant battery power and require a clear view of the user's hands.
UW engineers have developed a new form of low-power wireless sensing technology that could soon contribute to this growing field by letting users "train" their smartphones to recognize and respond to specific hand gestures near the phone.
The technology – developed in the labs of Matt Reynolds and Shwetak Patel, UW associate professors of electrical engineering and of computer science and engineering – uses the phone's wireless transmissions to sense nearby gestures, so it works when a device is out of sight in a pocket or bag and could easily be built into future smartphones and tablets.
"Today's smartphones have many different sensors built in, ranging from cameras to accelerometers and gyroscopes that can track the motion of the phone itself," Reynolds said. "We have developed a new type of sensor that uses the reflection of the phone's own wireless transmissions to sense nearby gestures, enabling users to interact with their phones even when they are not holding the phone, looking at the display or touching the screen."
Team members will present their project, called SideSwipe, and a related paper Oct. 8 at the Association for Computing Machinery's Symposium on User Interface Software and Technology in Honolulu.
When a person makes a call or an app exchanges data with the Internet, a phone transmits radio signals on a 2G, 3G or 4G cellular network to communicate with a cellular base station. When a user's hand moves through space near the phone, the user's body reflects some of the transmitted signal back toward the phone.
The new system uses multiple small antennas to capture the changes in the reflected signal and classify the changes to detect the type of gesture performed. In this way, tapping, hovering and sliding gestures could correspond to various commands for the phone, such as silencing a ring, changing which song is playing or muting the speakerphone. Because the phone's wireless transmissions pass easily through the fabric of clothing or a handbag, the system works even when the phone is stowed away.
"This approach allows us to make the entire space around the phone an interaction space, going beyond a typical touchscreen interface," Patel said. "You can interact with the phone without even seeing the display by using gestures in the 3-D space around the phone."
A group of 10 study participants tested the technology by performing 14 different hand gestures – including hovering, sliding and tapping – in various positions around a smartphone. Each time, the phone was calibrated by learning a user's hand movements, then trained itself to respond. The team found the smartphone recognized gestures with about 87 percent accuracy.
There are other gesture-based technologies, such as "AllSee" and "WiSee" recently developed at the UW, but researchers say there are important advantages to the new approach.
"SideSwipe's directional antenna approach makes interaction with the phone completely self-contained, because you're not depending on anything in the environment other than the phone's own transmissions," Reynolds said. "Because the SideSwipe sensor is based only on low-power receivers and relatively simple signal processing compared with video from a camera, we expect SideSwipe would have a minimal impact on battery life."
The team has filed patents on the technology and will continue developing SideSwipe, integrating the hardware and making a "plug and play" device that could be built into smartphones, said Chen Zhao, project lead and a UW doctoral student in electrical engineering.
Other co-authors are Ke-Yu Chen, a UW doctoral student in electrical engineering, and Md Tanvir Islam Aumi, a doctoral student in computer science and engineering.
This research was funded by the UW.
For more information, contact Reynolds at email@example.com or 206-616-5046.
Project website: http://www.keyuc.com/research/SideSwipe/
Research paper: http://www.keyuc.com/research/SideSwipe/SideSwipe_UIST2014.pdf
Project video: http://youtu.be/KN3GWZ8pt4w
Posted with video, images: http://www.washington.edu/news/2014/09/19/reflected-smartphone-transmissions-enable-gesture-control/
Michelle Ma | Eurek Alert!
Satellite data for agriculture
28.07.2017 | Julius-Maximilians-Universität Würzburg
Magnetic Quantum Objects in a "Nano Egg-Box"
25.07.2017 | Universität Wien
Spectrally narrow x-ray pulses may be “sharpened” by purely mechanical means. This sounds surprisingly, but a team of theoretical and experimental physicists developed and realized such a method. It is based on fast motions, precisely synchronized with the pulses, of a target interacting with the x-ray light. Thereby, photons are redistributed within the x-ray pulse to the desired spectral region.
A team of theoretical physicists from the MPI for Nuclear Physics (MPIK) in Heidelberg has developed a novel method to intensify the spectrally broad x-ray...
Physicists working with researcher Oriol Romero-Isart devised a new simple scheme to theoretically generate arbitrarily short and focused electromagnetic fields. This new tool could be used for precise sensing and in microscopy.
Microwaves, heat radiation, light and X-radiation are examples for electromagnetic waves. Many applications require to focus the electromagnetic fields to...
Strong light-matter coupling in these semiconducting tubes may hold the key to electrically pumped lasers
Light-matter quasi-particles can be generated electrically in semiconducting carbon nanotubes. Material scientists and physicists from Heidelberg University...
Fraunhofer IPA has developed a proximity sensor made from silicone and carbon nanotubes (CNT) which detects objects and determines their position. The materials and printing process used mean that the sensor is extremely flexible, economical and can be used for large surfaces. Industry and research partners can use and further develop this innovation straight away.
At first glance, the proximity sensor appears to be nothing special: a thin, elastic layer of silicone onto which black square surfaces are printed, but these...
3-D shape acquisition using water displacement as the shape sensor for the reconstruction of complex objects
A global team of computer scientists and engineers have developed an innovative technique that more completely reconstructs challenging 3D objects. An ancient...
26.07.2017 | Event News
21.07.2017 | Event News
19.07.2017 | Event News
28.07.2017 | Health and Medicine
28.07.2017 | Power and Electrical Engineering
28.07.2017 | Life Sciences