Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:


New Sensor Technologies and Mobile Robotics for Emotion-sensitive Assistance Systems


In the context of the project „EmAsIn”, Fraunhofer IPA collaborates with industrial and scientific partners to develop new assistance systems for people suffering from affective disorders or dementia. The assistance systems should not only support the user informatively, but also recognize his habitual human communication patterns, react accordingly and enable interaction. Therefore, those systems shall be evolved from a technical tool into a competent companion.

“EmAsIn” stands for “Emotion-sensitive Assistance Systems for Reactive Psychological Interaction with People”. Within the scope of the project, the team will study how people with illnesses can overcome special psychological or cognitive challenges in their everyday lives with the aid of targeted human-machine interaction and which aids can improve their quality of life.

The project partners expand and enhance technologies of the Care-O-bot® 3 for the human-machine-interaction.

Source: Kniff Projektagentur GbR

For optimal results, the partners are actively collaborating with people suffering from dementia or affective disorders and jointly investigating technological approaches and assistance functions.

User specific Human-Machine Interaction

Along with illness-related situations, the new system should be able to recognize social behavior patterns and nonverbal clues in human communication. In particular, the project team will study personalized information transfer concepts and new user interface concepts that specifically provide support functions and encouraging stimuli in situations recognized by the system as critical.

The project also aims to extend existing assistance systems in this direction and upgrade them with new functions that detect and interpret implicit human communication signals, such as emotions or gestures, and that are able to derive and perform suitable support actions.

Recognize emotions reliably and react appropriately

For many years, Fraunhofer IPA has been working on the development of technical assistance systems that provide informational and actuatory support to elderly users. An example project is “safe@home”, in which the scientists realized a touchless and discrete assistance system for private environments using stationary 3D sensors.

The system detects falls as well as immobility and derives suitable actions, such as informing neighbors or an emergency call center. Mobile robots like the Care-O-bot® or the emergency assistance „MoBiNa“ are able to connect with those stationary sensors and can drive autonomously to the person in need of help after a fall. At the same time, they serve as communication platforms for the direct conversation with the emergency center.

In the current project, scientists of Fraunhofer IPA are further developing those technologies, specifically the stationary sensors for the detection of emotions as well as the mobile robotic system as an interaction and information interface. The challenge is to realize reliable emotion recognition. Whereas falls can be detected by motion sequences, emotions are expressed by gestures or the behavior of a person. The assistant systems must interpret those and adjust their reaction accordingly.

Project information:
Project title: EmAsIn (Emotion-sensitive Assistance Systems for Reactive Psychological Interaction with People)
Duration: 01-09-2015 to 31-08-2018
Support: The project is supported by the German Federal Ministry of Education and Research (BMBF) in connection with the federal government’s High-Tech 2020 strategy. It forms part of the InterEmotio program, which promotes the evolution of technical tools into interactive assistants by means of systems sensitive to social and emotional contexts for optimized human-machine interaction.
Partner: ITK Engineering AG (project management, sensor systems and telemedicine), Cognitec Systems GmbH and Sikom Software GmbH (image and audio data processing), Fraunhofer IPA and FZI Research Centre Computer Science (gesture and condition recognition, mobile applications), Institute for Clinical Psychology of the Hospital Stuttgart and BruderhausDiakonie (application context, medical and nursing expertise, advices on ethical and social issues, evaluation of the results).

Expert Contact:
Julia Denecke; Phone: 0711-970 1829; E-Mail:

Press and Public Relations
Jörg-Dieter Walz | Phone +49 711 970-1667 | | Fraunhofer Institute for Manufacturing Engineering and Automation IPA | Nobelstrasse 12 | 70569 Stuttgart

Weitere Informationen:

Jörg Walz | Fraunhofer-Institut für Produktionstechnik und Automatisierung IPA

More articles from Information Technology:

nachricht Next Generation Cryptography
20.03.2018 | Fraunhofer-Institut für Sichere Informationstechnologie SIT

nachricht TIB’s Visual Analytics Research Group to develop methods for person detection and visualisation
19.03.2018 | Technische Informationsbibliothek (TIB)

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Researchers at Fraunhofer monitor re-entry of Chinese space station Tiangong-1

In just a few weeks from now, the Chinese space station Tiangong-1 will re-enter the Earth's atmosphere where it will to a large extent burn up. It is possible that some debris will reach the Earth's surface. Tiangong-1 is orbiting the Earth uncontrolled at a speed of approx. 29,000 km/h.Currently the prognosis relating to the time of impact currently lies within a window of several days. The scientists at Fraunhofer FHR have already been monitoring Tiangong-1 for a number of weeks with their TIRA system, one of the most powerful space observation radars in the world, with a view to supporting the German Space Situational Awareness Center and the ESA with their re-entry forecasts.

Following the loss of radio contact with Tiangong-1 in 2016 and due to the low orbital height, it is now inevitable that the Chinese space station will...

Im Focus: Alliance „OLED Licht Forum“ – Key partner for OLED lighting solutions

Fraunhofer Institute for Organic Electronics, Electron Beam and Plasma Technology FEP, provider of research and development services for OLED lighting solutions, announces the founding of the “OLED Licht Forum” and presents latest OLED design and lighting solutions during light+building, from March 18th – 23rd, 2018 in Frankfurt a.M./Germany, at booth no. F91 in Hall 4.0.

They are united in their passion for OLED (organic light emitting diodes) lighting with all of its unique facets and application possibilities. Thus experts in...

Im Focus: Mars' oceans formed early, possibly aided by massive volcanic eruptions

Oceans formed before Tharsis and evolved together, shaping climate history of Mars

A new scenario seeking to explain how Mars' putative oceans came and went over the last 4 billion years implies that the oceans formed several hundred million...

Im Focus: Tiny implants for cells are functional in vivo

For the first time, an interdisciplinary team from the University of Basel has succeeded in integrating artificial organelles into the cells of live zebrafish embryos. This innovative approach using artificial organelles as cellular implants offers new potential in treating a range of diseases, as the authors report in an article published in Nature Communications.

In the cells of higher organisms, organelles such as the nucleus or mitochondria perform a range of complex functions necessary for life. In the networks of...

Im Focus: Locomotion control with photopigments

Researchers from Göttingen University discover additional function of opsins

Animal photoreceptors capture light with photopigments. Researchers from the University of Göttingen have now discovered that these photopigments fulfill an...

All Focus news of the innovation-report >>>



Industry & Economy
Event News

Virtual reality conference comes to Reutlingen

19.03.2018 | Event News

Ultrafast Wireless and Chip Design at the DATE Conference in Dresden

16.03.2018 | Event News

International Tinnitus Conference of the Tinnitus Research Initiative in Regensburg

13.03.2018 | Event News

Latest News

TRAPPIST-1 planets provide clues to the nature of habitable worlds

21.03.2018 | Physics and Astronomy

The search for dark matter widens

21.03.2018 | Materials Sciences

Natural enemies reduce pesticide use

21.03.2018 | Life Sciences

Science & Research
Overview of more VideoLinks >>>