EPFL scientists are studying how to identify drivers' emotions using embedded cameras that film their faces
Technology now allows us to read facial expressions and identify which of the seven universal emotions a person is feeling: fear, anger, joy, sadness, disgust, surprise, or suspicion. This is very useful in video game development, medicine, marketing, and, perhaps less obviously, in driver safety. We know that in addition to fatigue, the emotional state of the driver is a risk factor.
The device detects anger on the driver's face.
Credit: EPFL-LTS5 & PSA
Irritation, in particular, can make drivers more aggressive and less attentive. EPFL researchers, in collaboration with PSA Peugeot Citroën, have developed an on-board emotion detector based on the analysis of facial expressions. Tests carried out using a prototype indicate that the idea could have promising applications.
It's not easy to measure emotions within the confines of a car, especially non-invasively. The solution explored by scientists in EPFL's Signal Processing 5 Laboratory (LTS5), who specialize in facial detection, monitoring and analysis, is to get drivers' faces to do the job. In collaboration with PSA Peugeot Citroën, LTS5 adapted a facial detection device for use in a car, using an infrared camera placed behind the steering wheel.
The problem was to get the device to recognize irritation on the face of a driver. Everyone expresses this state somewhat differently – a kick, an epithet, a nervous tic or an impassive face. To simplify the task at this stage of the project, Hua Gao and Anil Yüce, who spearheaded the research, chose to track only two expressions: anger and disgust, whose manifestations are similar to those of anger.
Two phases of tests were carried out. First, the system "learned" to identify the two emotions using a series of photos of subjects expressing them. Then the same exercise was carried out using videos. The images were taken both in an office setting as well as in real life situations, in a car that was made available for the project.
The rapidity with which the comparison between filmed images and thus detection could be carried out depended on the analysis methods used. But overall, the system worked well and irritation could be accurately detected in the majority of cases. When the test failed, it was usually because this state is very variable from individual to individual. This is where the difficulty will always lie, given the diversity of how we express anger. Additional research aims to explore updating the system in real-time – to complement the static database – a self-taught human-machine interface, or a more advanced facial monitoring algorithm, says Hua Gao.
Detecting emotions is only one indicator for improving driver safety and comfort. In this project, it was coupled with a fatigue detector that measures the percentage of eyelid closure. The LTS5 is also working on detecting other states on drivers' faces such as distraction, and on lip reading for use in vocal recognition. These projects are coordinated by EPFL's Transportation Center and carried out in collaboration with PSA Peugeot Citroën.
Jean-Philippe Thiran | EurekAlert!
Deadly Japan quake and tsunami spurred global warming, ozone loss
26.03.2015 | American Geophysical Union
When clocks are set forward, life satisfaction declines
26.03.2015 | Sozio-oekonomisches Panel (SOEP)
In an experiment at the Department of Energy's SLAC National Accelerator Laboratory, scientists precisely measured the temperature and structure of aluminum as...
The IPH presents a solution at HANNOVER MESSE 2015 to make ship traffic more reliable while decreasing the maintenance costs at the same time. In cooperation with project partners, the research institute from Hannover, Germany, has developed a sensor system which continuously monitors the condition of the marine gearbox, thus preventing breakdowns. Special feature: the monitoring system works wirelessly and energy-autonomously. The required electrical power is generated where it is needed – directly at the sensor.
As well as cars need to be certified regularly (in Germany by the TÜV – Technical Inspection Association), ships need to be inspected – if the powertrain stops...
When an earthquake hits, the faster first responders can get to an impacted area, the more likely infrastructure--and lives--can be saved.
The Atlantic overturning is one of Earth’s most important heat transport systems, pumping warm water northwards and cold water southwards. Also known as the Gulf Stream system, it is responsible for the mild climate in northwestern Europe.
Scientists now found evidence for a slowdown of the overturning – multiple lines of observation suggest that in recent decades, the current system has been...
Because they are regularly subjected to heavy vehicle traffic, emissions, moisture and salt, above- and underground parking garages, as well as bridges, frequently experience large areas of corrosion. Most inspection systems to date have only been capable of inspecting smaller surface areas.
From April 13 to April 17 at the Hannover Messe (hall 2, exhibit booth C16), engineers from the Fraunhofer Institute for Nondestructive Testing IZFP will be...
25.03.2015 | Event News
19.03.2015 | Event News
17.03.2015 | Event News
27.03.2015 | Agricultural and Forestry Science
27.03.2015 | Materials Sciences
27.03.2015 | Ecology, The Environment and Conservation