Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:


Eye-tracking data improves prosthetic hands


Prosthetic hands restore only some of the function lost through amputation. But combining electrical signals from forearm muscles with other sources of information, such as eye tracking, promises better prostheses. A study funded by the SNSF gives specialists access to valuable new data.

The hand is a precious limb. Its 34 muscles and 20 joints enable movements of great precision and complexity which are essential for interacting with the environment and with others on a daily basis. Hand amputation thus has severe physical and psychological repercussions on a person’s life.

Everyday movements were recorded to populate a dataset.

© snsf, source: Henning Müller

Myoelectric prosthetic hands, which work by recording electrical muscle signals on the skin, allow amputees to regain some lost function. But dexterity is often limited and the variability of the electrical signals from the forearm alone makes the prosthetics sometimes unreliable.

Henning Müller, professor of business informatics, is investigating how combining data from myoelectric signals with other sources of information could lead to better prosthetics.

Müller has now made available to the scientific community a dataset that includes eye tracking and computer vision as well as other information (electromyography and acceleration sensor data).

The results of this work, funded by the Swiss National Science Foundation (SNSF), have just been published in Nature Scientific Data (*).

Leveraging gaze

“Our eyes move constantly in quick movements called saccades. But when you go to grasp an object, your eyes fixate on it for a few hundred milliseconds. Consequently, eye tracking provides valuable information about detecting both the object a person intends to grasp and the possible gestures required”, says Müller, professor at the HES-SO in Sierre and titular professor in the Faculty of Medicine at the University of Geneva.

Moreover, unlike the muscles of the amputated limb, which atrophy and send different myoelectric signals, gaze remains similar. Computer vision – i.e. computer recognition of objects in the field of vision – can also be used together with eye tracking to partially automate prosthetic hands.

In order to link common hand gestures with information from the muscles of the amputated limb and these new data sources, Müller studied 45 people – 15 amputees and 30 able-bodied subjects – in an identical experimental setting.

Each participant had 12 electrodes affixed to their forearm and acceleration sensors on their arm and head. Eye-tracking glasses recorded eye movements while the participants performed 10 common movements for grasping and manipulating various objects, such as picking up a pencil or a fork, or playing with a ball.

The movements were determined in collaboration with the Institute of Physiotherapy at the HES-SO Valais. Computer modelling of the gestures enabled Müller to build up a new multimodal dataset of hand movements comprising different types of data. The dataset includes information not only from the electrodes but also from recordings of forearm acceleration, eye tracking, computer vision and measurements of head movements.

Free access to data

This multidisciplinary study at the HES-SO, the University Hospital of Zurich and the Italian Institute of Technology in Milan was part of the Sinergia programme. “It’s a significant piece of work resulting from two years of data acquisition”, says Müller. “Importantly, we’ve had access to amputees through the University of Padua in Italy.

In Switzerland it’s hard to find large numbers of volunteers for these kinds of studies, and most datasets are thus based on only three to four participants.”

Another advantage of the new dataset is that the sample of amputees is comparable to that of the control group, which was not the case in previous studies. Using this data will make it possible to better understand the consequences of amputation.

The dataset offers prospects for the manufacture of smart myoelectric prosthetic hands. “By integrating the information from eye tracking, we can improve the functionality of the prosthetics and thus the comfort and independence of the amputees”, says Müller.

This important work has now been made freely available to the scientific community. More than a thousand research groups from all over the world have already accessed older versions of the dataset, developed during previous projects.

Encouraging interdisciplinary research

Sinergia is a programme of the Swiss National Science Foundation that promotes interdisciplinary collaboration of two to four groups engaged in pioneering research.

The text of this press release, a download image and further information are available on the website of the Swiss National Science Foundation.

Wissenschaftliche Ansprechpartner:

Henning Müller
HES-SO Valais
Technopole 3
3960 Sierre
Phone: + 41 27 606 90 36 / +41 76 516 5002


(*) M. Cognolato, A. Gijsberts, V. Gregori, G. Saetta, K. Giacomino, A.-G. Mittaz Hager, A. Gigli, D. Faccio, C. Tiengo, F. Bassetto, B. Caputo, P. Brugger, M. Atzori, H. Müller: Gaze, visual, myoelectric, and inertial data of grasps for intelligent prosthetics, Scientific Data (2020).

Weitere Informationen:

SNF - Medien Abteilung Kommunikation | idw - Informationsdienst Wissenschaft

More articles from Interdisciplinary Research:

nachricht Protein pores packed in polymers make super-efficient filtration membranes
29.01.2020 | University of Texas at Austin

nachricht Nanocontainers introduced into the nucleus of living cells
28.01.2020 | Universität Basel

All articles from Interdisciplinary Research >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: New coronavirus module in SORMAS

HZI-developed app for disease control is expanded to stop the spread of the pathogen

At the end of December 2019, the first cases of pneumonia caused by a novel coronavirus were reported from the Chinese city of Wuhan. Since then, infections...

Im Focus: New insights could lead to superconductivity in ambient conditions

A team of researchers from Switzerland, the US and Poland have found evidence of a uniquely high density of hydrogen atoms in a metal hydride. The smaller spacings between the atoms might enable packing significantly more hydrogen into the material to a point where it could begin to superconduct at room temperature and ambient pressure.

The scientists conducted neutron scattering experiments at the Oak Ridge National Laboratory (ORNL) in the US on samples of zirconium vanadium hydride at...

Im Focus: Viscosity measurements offer new insights into the earth's mantle

An international research group with Dr. Longjian Xie from the Bavarian Research Institute of Experimental Geochemistry & Geophysics (BGI) of the University of Bayreuth has succeeded for the first time in measuring the viscosity that molten solids exhibit under the pressure and temperature conditions found in the lower earth mantle. The data obtained support the assumption that a bridgmanite-enriched rock layer was formed during the early history of the earth at a depth of around 1,000 kilometres – at the border to the upper mantle.

In addition, the data also provides indications that the lower mantle contains larger reservoirs of materials that originated in an early magma ocean and have...

Im Focus: Fast rotating white dwarf drags its space-time in a cosmic dance

According to Einstein's general relativity, the rotation of a massive object produces a dragging of space-time in its vicinity. This effect has been measured, in the case of the Earth’s rotation, with satellite experiments. With the help of a radio pulsar, an international team of scientists (with important contributions from scientists at the Max Planck Institute for Radio Astronomy in Bonn, Germany) were able to detect the swirling of the space-time around its fast-rotating white dwarf-companion star, and thus confirm the theory behind the formation of this unique binary star system.

In 1999, a unique binary system was discovered with the Australian Parkes Radio Telescope in the constellation Musca (the Fly), close to the famous Southern...

Im Focus: Quantum logic spectroscopy unlocks potential of highly charged ions

Scientists from the Physikalisch-Technische Bundesanstalt (PTB) and the Max Planck Institute for Nuclear Physics (MPIK) have carried out pioneering optical measurements of highly charged ions with unprecedented precision. To do this, they isolated a single Ar¹³⁺ ion from an extremely hot plasma and brought it practically to rest inside an ion trap together with a laser-cooled, singly charged ion. Employing quantum logic spectroscopy on the ion pair, they have increased the relative precision by a factor of a hundred million over previous methods. This opens up the multitude of highly charged ions for novel atomic clocks and further avenues in the search for new physics. [Nature, 29.01.2020]

Highly charged ions are—although seemingly exotic—a very natural form of visible matter. All the matter in our sun and in all other stars is highly ionized,...

All Focus news of the innovation-report >>>



Industry & Economy
Event News

11th Advanced Battery Power Conference, March 24-25, 2020 in Münster/Germany

16.01.2020 | Event News

Laser Colloquium Hydrogen LKH2: fast and reliable fuel cell manufacturing

15.01.2020 | Event News

„Advanced Battery Power“- Conference, Contributions are welcome!

07.01.2020 | Event News

Latest News

Free radicals from immune cells are direct cause of salt-sensitive hypertension

11.02.2020 | Health and Medicine

Distant giant planets form differently than 'failed stars'

11.02.2020 | Physics and Astronomy

Using sound and light to generate ultra-fast data transfer

11.02.2020 | Information Technology

Science & Research
Overview of more VideoLinks >>>