Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

UD researchers develop revolutionary computer interface technology

08.10.2002


University of Delaware researchers have developed a revolutionary computer interface technology that promises to put the bite on the traditional mouse and mechanical keyboard.




“This is not just a little step in improving the mouse, this is the first step in a new way of communicating with the computer through gestures and the movements of your hands. This is, after all, one of the ways humans interact.” John Elias, UD professor of electrical and computer engineering, said.

Elias and Wayne Westerman, UD visiting assistant professor of electrical and computer engineering, have been working on the new interface for about five years and are now marketing their iGesture product through a company called FingerWorks.


The project started as a doctoral thesis by Westerman, who was then a UD graduate student working with Elias.

The FingerWorks name fits because the technology uses a touch pad and a range of finger motions to communicate commands and keys to the computer. To open a file, you rotate your hand as if opening a jar; to zoom or de-zoom, you expand or contract your hand.

Elias said the communication power of their system is “thousands of times greater” than that of a mouse, which uses just a single moving point as the main input. Using this new technology, two human hands provide 10 points of contact, with a wide range of motion for each, thus providing thousands of different patterns, each of which can mean something different to the computer.

While much about the computer has changed over the last three decades–greater power, faster speeds, more memory–what has not changed is the user interface.

“For what it was invented for, the mouse does a good job,” Elias said. “People accept the mouse and the mechanical keyboard because that’s the way it is. But there are limitations in terms of information flow. There is so much power in the computer, and so much power in the human, but the present situation results in a communications bottleneck between the two.”

Elias and Westerman have a better idea. “I believe we are on the verge of changing the way people interact with computers,” Elias said. “Imagine trying to communicate with another human being using just a mouse and a keyboard. It works, but it is slow and tedious.”

Elias said he could envision in the next 10 years “a very complex gestural language between man and machine.”

The system is a multi-touch, zero force technology, Elias said, meaning the gestures and movements use all the fingers in a light and subtle manner.

Because of that, the system has a second major advantage over the mouse and mechanical keyboard because it can greatly reduce stress injuries such as tendonitis and carpal tunnel syndrome attributed to traditional computer work.

The company markets both stand-alone touch pads and touch pads built into nonmechanical keyboards. In the keyboards, the keys overlap the touch pad so the operator does not have to move his hands when switching between typing and using the mouse. Rather, everything can be done in a smoother flow of hand motions.

Elias explained the touch pad acts like a video camera, recording the objects touching its surface. An embedded microprocessor then applies an algorithmic process to convert those touches into commands understood by the computer.

“To observers watching somebody use multi-touch, it looks a little like magic,” Elias said, illustrating his point on a computer in Evans Hall. “People see lots of things happening on the computer screen but very little hand motion is observed.”

He said the system has been designed so the gestures used make sense for the operation being performed. For instance, you cut text with a pinch and paste it with a flick.

Eventually, he said, the computer password could be a gesture known only to the user.

Elias said people often think that speech recognition systems will become the ultimate user interface. “Voice commands are good for many things but terrible for other things,” Elias said, adding he believes there are inherent problems with a speech-only interface.

“If you want to test this claim, you can do so with a perfect speech recognition system–another human being,” Elias said. “Put somebody in front of your computer and try to do your work by issuing voice commands to him. You’ll quickly find that many common tasks are difficult to do using speech, even though your ‘computer interface’ understands you perfectly.”

Using hand and finger motion to input commands is, for many tasks, much more effective than trying to explain what you want to do in words, he said.

The system is being used at several work stations in Evans Hall and the reaction is largely favorable. It is something of a challenge for some workers, Elias said, because it is like learning a new language.

Susan Foster, UD vice president of information technologies, said she is impressed with the interface and plans to adopt it for use at several computer sites around campus.

“The device is the result of new thinking about the ‘bandwidth’ that constrains the physical interaction between operator and computer,” Foster said. “It capitalizes on human gestures, which are easy to understand and execute. Once learned, like other motor skills, they are readily retained. The assistive qualities of the device also make it quite useful for those with limitations on upper extremity use.”

The plug-and-play device, which requires no special software, should be of particular interest to programmers, graphic designers and editors, Foster said, and she is recommending they consider making use of a new technology that was “born and bred at UD and under continuing development here.”

Neil Thomas | EurekAlert!
Further information:
http://www.fingerworks.com

More articles from Information Technology:

nachricht Cutting edge research for the industries of tomorrow – DFKI and NICT expand cooperation
21.03.2017 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI

nachricht Molecular motor-powered biocomputers
20.03.2017 | Technische Universität Dresden

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Giant Magnetic Fields in the Universe

Astronomers from Bonn and Tautenburg in Thuringia (Germany) used the 100-m radio telescope at Effelsberg to observe several galaxy clusters. At the edges of these large accumulations of dark matter, stellar systems (galaxies), hot gas, and charged particles, they found magnetic fields that are exceptionally ordered over distances of many million light years. This makes them the most extended magnetic fields in the universe known so far.

The results will be published on March 22 in the journal „Astronomy & Astrophysics“.

Galaxy clusters are the largest gravitationally bound structures in the universe. With a typical extent of about 10 million light years, i.e. 100 times the...

Im Focus: Tracing down linear ubiquitination

Researchers at the Goethe University Frankfurt, together with partners from the University of Tübingen in Germany and Queen Mary University as well as Francis Crick Institute from London (UK) have developed a novel technology to decipher the secret ubiquitin code.

Ubiquitin is a small protein that can be linked to other cellular proteins, thereby controlling and modulating their functions. The attachment occurs in many...

Im Focus: Perovskite edges can be tuned for optoelectronic performance

Layered 2D material improves efficiency for solar cells and LEDs

In the eternal search for next generation high-efficiency solar cells and LEDs, scientists at Los Alamos National Laboratory and their partners are creating...

Im Focus: Polymer-coated silicon nanosheets as alternative to graphene: A perfect team for nanoelectronics

Silicon nanosheets are thin, two-dimensional layers with exceptional optoelectronic properties very similar to those of graphene. Albeit, the nanosheets are less stable. Now researchers at the Technical University of Munich (TUM) have, for the first time ever, produced a composite material combining silicon nanosheets and a polymer that is both UV-resistant and easy to process. This brings the scientists a significant step closer to industrial applications like flexible displays and photosensors.

Silicon nanosheets are thin, two-dimensional layers with exceptional optoelectronic properties very similar to those of graphene. Albeit, the nanosheets are...

Im Focus: Researchers Imitate Molecular Crowding in Cells

Enzymes behave differently in a test tube compared with the molecular scrum of a living cell. Chemists from the University of Basel have now been able to simulate these confined natural conditions in artificial vesicles for the first time. As reported in the academic journal Small, the results are offering better insight into the development of nanoreactors and artificial organelles.

Enzymes behave differently in a test tube compared with the molecular scrum of a living cell. Chemists from the University of Basel have now been able to...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

International Land Use Symposium ILUS 2017: Call for Abstracts and Registration open

20.03.2017 | Event News

CONNECT 2017: International congress on connective tissue

14.03.2017 | Event News

ICTM Conference: Turbine Construction between Big Data and Additive Manufacturing

07.03.2017 | Event News

 
Latest News

Argon is not the 'dope' for metallic hydrogen

24.03.2017 | Materials Sciences

Astronomers find unexpected, dust-obscured star formation in distant galaxy

24.03.2017 | Physics and Astronomy

Gravitational wave kicks monster black hole out of galactic core

24.03.2017 | Physics and Astronomy

VideoLinks
B2B-VideoLinks
More VideoLinks >>>