People recognize gestures and interpret glances very quickly and almost automatically. Computers and robots cannot do this. That is why scientists around the world are working on ways to make human-computer collaboration more social, efficient and flexible. Computer scientists from Saarbrücken and Stuttgart have now reached an important milestone together with psychologists from Australia. The software system they developed processes a person's eye movements to calculate whether they are vulnerable, sociable, tolerant, conscientious or curious.
"Not only do our eyes let us capture the environment, they also are the window to our soul, because they reveal who we are, how we feel and what we do," explains Andreas Bulling, who heads the research group "Perceptual User Interfaces" in Saarbrücken at the Max Planck Institute for Informatics and the Cluster of Excellence of Saarland University.
With scientists in Stuttgart and Australia, Bulling has trained the group’s own software system so that it can evaluate eye movements and draw conclusions on the traits of a person. The research team used special computational methods of machine learning.
To obtain training and evaluation data, 50 students at Flinders University in Australia, including 42 women and eight men, with a mean age of 22 years, took part in a study. Upon arrival in the lab, the researchers equipped the students with a so-called "eye tracker."
This device filmed the subject's eye movements as they strolled around the campus for about ten minutes, buying coffee or other items at the campus store. Afterwards, the scientists asked the students to take off their glasses and fill in special questionnaires to determine their personality and level of curiosity in a conventional way.
"In order to analyze the recorded eye data regardless of the duration of the recording, we worked with a shiftable time window without blurring any characteristics," explains Bulling. From each of the resulting windows, the researchers gained 207 characteristics. These included statistics on gaze fixation as well as the blink rate.
Based on eye data and the information from the questionnaires, the researchers developed for each character trait a classifier consisting of 100 decision trees, and trained it. The result: In the subsequent test with previously unused data, they were able to prove that the software system reliably recognizes traits such as emotional lability, sociability, compatibility and conscientiousness.
"We can transfer this knowledge about nonverbal behavior to robots so that they behave like humans. Such systems would then communicate with humans in a much more natural way, making them more efficient and more flexible," Bulling explains the benefits of the research.
Together with Sabrina Hoppe from the University of Stuttgart, Tobias Loetscher from the University of South Australia in Adelaide, Australia and Stephanie Morey from Flinders University, also in Adelaide, Bulling has discussed the results in the article "Eye Movements During Everyday Behavior Predict Personality Traits" published in the journal "Frontiers in Human Neuroscience".
The project was funded by the Australian Research Council, the Cluster of Excellence "Multimodal Computing and Interaction" at Saarland University, and a doctoral scholarship from the German National Academic Foundation.
Competence Center Computer Science Saarland
Saarland Informatics Campus E1.7
Tel.: +49 681 302 70741
Dr. Andreas Bulling
Perceptual User Interfaces Group
Cluster of Excellence "Multimodal Computing and Interaction"
Saarland Informatics Campus E1 4
Tel .: +49 681 932 52128
Review "Eye Movements During Everyday Behavior Predict Personality Traits":
Data and source code: https://github.molgen.mpg.de/sabrina-hoppe/everyday-eye-movements-predict-person...
Friederike Meyer zu Tittingdorf | Universität des Saarlandes
German Research Foundation supports new theoretical physics project at Jacobs University Bremen
18.12.2018 | Jacobs University Bremen gGmbH
New Foldable Drone Flies through Narrow Holes in Rescue Missions
12.12.2018 | Universität Zürich
Researchers from the University of Basel have reported a new method that allows the physical state of just a few atoms or molecules within a network to be controlled. It is based on the spontaneous self-organization of molecules into extensive networks with pores about one nanometer in size. In the journal ‘small’, the physicists reported on their investigations, which could be of particular importance for the development of new storage devices.
Around the world, researchers are attempting to shrink data storage devices to achieve as large a storage capacity in as small a space as possible. In almost...
The more objects we make "smart," from watches to entire buildings, the greater the need for these devices to store and retrieve massive amounts of data quickly without consuming too much power.
Millions of new memory cells could be part of a computer chip and provide that speed and energy savings, thanks to the discovery of a previously unobserved...
What if, instead of turning up the thermostat, you could warm up with high-tech, flexible patches sewn into your clothes - while significantly reducing your...
A widely used diabetes medication combined with an antihypertensive drug specifically inhibits tumor growth – this was discovered by researchers from the University of Basel’s Biozentrum two years ago. In a follow-up study, recently published in “Cell Reports”, the scientists report that this drug cocktail induces cancer cell death by switching off their energy supply.
The widely used anti-diabetes drug metformin not only reduces blood sugar but also has an anti-cancer effect. However, the metformin dose commonly used in the...
A research team from the University of Zurich has developed a new drone that can retract its propeller arms in flight and make itself small to fit through narrow gaps and holes. This is particularly useful when searching for victims of natural disasters.
Inspecting a damaged building after an earthquake or during a fire is exactly the kind of job that human rescuers would like drones to do for them. A flying...
12.12.2018 | Event News
10.12.2018 | Event News
06.12.2018 | Event News
18.12.2018 | Materials Sciences
18.12.2018 | Physics and Astronomy
18.12.2018 | Physics and Astronomy