EPFL scientists are studying how to identify drivers' emotions using embedded cameras that film their faces
Technology now allows us to read facial expressions and identify which of the seven universal emotions a person is feeling: fear, anger, joy, sadness, disgust, surprise, or suspicion. This is very useful in video game development, medicine, marketing, and, perhaps less obviously, in driver safety. We know that in addition to fatigue, the emotional state of the driver is a risk factor.
The device detects anger on the driver's face.
Credit: EPFL-LTS5 & PSA
Irritation, in particular, can make drivers more aggressive and less attentive. EPFL researchers, in collaboration with PSA Peugeot Citroën, have developed an on-board emotion detector based on the analysis of facial expressions. Tests carried out using a prototype indicate that the idea could have promising applications.
It's not easy to measure emotions within the confines of a car, especially non-invasively. The solution explored by scientists in EPFL's Signal Processing 5 Laboratory (LTS5), who specialize in facial detection, monitoring and analysis, is to get drivers' faces to do the job. In collaboration with PSA Peugeot Citroën, LTS5 adapted a facial detection device for use in a car, using an infrared camera placed behind the steering wheel.
The problem was to get the device to recognize irritation on the face of a driver. Everyone expresses this state somewhat differently – a kick, an epithet, a nervous tic or an impassive face. To simplify the task at this stage of the project, Hua Gao and Anil Yüce, who spearheaded the research, chose to track only two expressions: anger and disgust, whose manifestations are similar to those of anger.
Two phases of tests were carried out. First, the system "learned" to identify the two emotions using a series of photos of subjects expressing them. Then the same exercise was carried out using videos. The images were taken both in an office setting as well as in real life situations, in a car that was made available for the project.
The rapidity with which the comparison between filmed images and thus detection could be carried out depended on the analysis methods used. But overall, the system worked well and irritation could be accurately detected in the majority of cases. When the test failed, it was usually because this state is very variable from individual to individual. This is where the difficulty will always lie, given the diversity of how we express anger. Additional research aims to explore updating the system in real-time – to complement the static database – a self-taught human-machine interface, or a more advanced facial monitoring algorithm, says Hua Gao.
Detecting emotions is only one indicator for improving driver safety and comfort. In this project, it was coupled with a fatigue detector that measures the percentage of eyelid closure. The LTS5 is also working on detecting other states on drivers' faces such as distraction, and on lip reading for use in vocal recognition. These projects are coordinated by EPFL's Transportation Center and carried out in collaboration with PSA Peugeot Citroën.
Jean-Philippe Thiran | EurekAlert!
Brands are Perceived in the Same Way as Faces
28.08.2015 | Leuphana Universität Lüneburg
“Bank & Zukunft 2015” trend survey highlights the need for banks to reform business models
21.08.2015 | Fraunhofer-Institut für Arbeitswirtschaft und Organisation IAO
A University of Oklahoma astrophysicist and his Chinese collaborator have found two supermassive black holes in Markarian 231, the nearest quasar to Earth, using observations from NASA's Hubble Space Telescope.
The discovery of two supermassive black holes--one larger one and a second, smaller one--are evidence of a binary black hole and suggests that supermassive...
A team of European researchers have developed a model to simulate the impact of tsunamis generated by earthquakes and applied it to the Eastern Mediterranean. The results show how tsunami waves could hit and inundate coastal areas in southern Italy and Greece. The study is published today (27 August) in Ocean Science, an open access journal of the European Geosciences Union (EGU).
Though not as frequent as in the Pacific and Indian oceans, tsunamis also occur in the Mediterranean, mainly due to earthquakes generated when the African...
In mountainous regions earthquakes often cause strong landslides, which can be exacerbated by heavy rain. However, after an initial increase, the frequency of these mass wasting events, often enormous and dangerous, declines, in fact independently of meteorological events and aftershocks.
These new findings are presented by a German-Franco-Japanese team of geoscientists in the current issue of the journal Geology, under the lead of the GFZ...
Bacteria do not cease to amaze us with their survival strategies. A research team from the University of Basel's Biozentrum has now discovered how bacteria enter a sleep mode using a so-called FIC toxin. In the current issue of “Cell Reports”, the scientists describe the mechanism of action and also explain why their discovery provides new insights into the evolution of pathogens.
For many poisons there are antidotes which neutralize their toxic effect. Toxin-antitoxin systems in bacteria work in a similar manner: As long as a cell...
It comes when called, bringing care utensils with it and recording how they are used: Fraunhofer IPA is developing an intelligent care cart that provides care staff with physical and informational support in their day-to-day work. The scientists at Fraunhofer IPA have now completed a first prototype. In doing so, they are continuing in their efforts to improve working conditions in the care sector and are developing solutions designed to address the challenges of demographic change.
Technical assistance systems can improve the difficult working conditions in residential nursing homes and hospitals by helping the staff in their work and...
20.08.2015 | Event News
20.08.2015 | Event News
19.08.2015 | Event News
28.08.2015 | Physics and Astronomy
28.08.2015 | Health and Medicine
28.08.2015 | Life Sciences