People recognize gestures and interpret glances very quickly and almost automatically. Computers and robots cannot do this. That is why scientists around the world are working on ways to make human-computer collaboration more social, efficient and flexible. Computer scientists from Saarbrücken and Stuttgart have now reached an important milestone together with psychologists from Australia. The software system they developed processes a person's eye movements to calculate whether they are vulnerable, sociable, tolerant, conscientious or curious.
"Not only do our eyes let us capture the environment, they also are the window to our soul, because they reveal who we are, how we feel and what we do," explains Andreas Bulling, who heads the research group "Perceptual User Interfaces" in Saarbrücken at the Max Planck Institute for Informatics and the Cluster of Excellence of Saarland University.
With scientists in Stuttgart and Australia, Bulling has trained the group’s own software system so that it can evaluate eye movements and draw conclusions on the traits of a person. The research team used special computational methods of machine learning.
To obtain training and evaluation data, 50 students at Flinders University in Australia, including 42 women and eight men, with a mean age of 22 years, took part in a study. Upon arrival in the lab, the researchers equipped the students with a so-called "eye tracker."
This device filmed the subject's eye movements as they strolled around the campus for about ten minutes, buying coffee or other items at the campus store. Afterwards, the scientists asked the students to take off their glasses and fill in special questionnaires to determine their personality and level of curiosity in a conventional way.
"In order to analyze the recorded eye data regardless of the duration of the recording, we worked with a shiftable time window without blurring any characteristics," explains Bulling. From each of the resulting windows, the researchers gained 207 characteristics. These included statistics on gaze fixation as well as the blink rate.
Based on eye data and the information from the questionnaires, the researchers developed for each character trait a classifier consisting of 100 decision trees, and trained it. The result: In the subsequent test with previously unused data, they were able to prove that the software system reliably recognizes traits such as emotional lability, sociability, compatibility and conscientiousness.
"We can transfer this knowledge about nonverbal behavior to robots so that they behave like humans. Such systems would then communicate with humans in a much more natural way, making them more efficient and more flexible," Bulling explains the benefits of the research.
Together with Sabrina Hoppe from the University of Stuttgart, Tobias Loetscher from the University of South Australia in Adelaide, Australia and Stephanie Morey from Flinders University, also in Adelaide, Bulling has discussed the results in the article "Eye Movements During Everyday Behavior Predict Personality Traits" published in the journal "Frontiers in Human Neuroscience".
The project was funded by the Australian Research Council, the Cluster of Excellence "Multimodal Computing and Interaction" at Saarland University, and a doctoral scholarship from the German National Academic Foundation.
Competence Center Computer Science Saarland
Saarland Informatics Campus E1.7
Tel.: +49 681 302 70741
Dr. Andreas Bulling
Perceptual User Interfaces Group
Cluster of Excellence "Multimodal Computing and Interaction"
Saarland Informatics Campus E1 4
Tel .: +49 681 932 52128
Review "Eye Movements During Everyday Behavior Predict Personality Traits":
Data and source code: https://github.molgen.mpg.de/sabrina-hoppe/everyday-eye-movements-predict-person...
Friederike Meyer zu Tittingdorf | Universität des Saarlandes
5G and AI – Synergy in the Digital Age
03.12.2019 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI
Big Data makes intensive care better
02.12.2019 | Schweizerischer Nationalfonds SNF
With ultracold chemistry, researchers get a first look at exactly what happens during a chemical reaction
The coldest chemical reaction in the known universe took place in what appears to be a chaotic mess of lasers. The appearance deceives: Deep within that...
Abnormal scarring is a serious threat resulting in non-healing chronic wounds or fibrosis. Scars form when fibroblasts, a type of cell of connective tissue, reach wounded skin and deposit plugs of extracellular matrix. Until today, the question about the exact anatomical origin of these fibroblasts has not been answered. In order to find potential ways of influencing the scarring process, the team of Dr. Yuval Rinkevich, Group Leader for Regenerative Biology at the Institute of Lung Biology and Disease at Helmholtz Zentrum München, aimed to finally find an answer. As it was already known that all scars derive from a fibroblast lineage expressing the Engrailed-1 gene - a lineage not only present in skin, but also in fascia - the researchers intentionally tried to understand whether or not fascia might be the origin of fibroblasts.
Fibroblasts kit - ready to heal wounds
Research from a leading international expert on the health of the Great Lakes suggests that the growing intensity and scale of pollution from plastics poses serious risks to human health and will continue to have profound consequences on the ecosystem.
In an article published this month in the Journal of Waste Resources and Recycling, Gail Krantzberg, a professor in the Booth School of Engineering Practice...
Conventional light microscopes cannot distinguish structures when they are separated by a distance smaller than, roughly, the wavelength of light. Superresolution microscopy, developed since the 1980s, lifts this limitation, using fluorescent moieties. Scientists at the Max Planck Institute for Polymer Research have now discovered that graphene nano-molecules can be used to improve this microscopy technique. These graphene nano-molecules offer a number of substantial advantages over the materials previously used, making superresolution microscopy even more versatile.
Microscopy is an important investigation method, in physics, biology, medicine, and many other sciences. However, it has one disadvantage: its resolution is...
03.12.2019 | Event News
15.11.2019 | Event News
15.11.2019 | Event News
03.12.2019 | Life Sciences
03.12.2019 | Materials Sciences
03.12.2019 | Medical Engineering