New Sensor Technologies and Mobile Robotics for Emotion-sensitive Assistance Systems

The project partners expand and enhance technologies of the Care-O-bot® 3 for the human-machine-interaction. Source: Kniff Projektagentur GbR

“EmAsIn” stands for “Emotion-sensitive Assistance Systems for Reactive Psychological Interaction with People”. Within the scope of the project, the team will study how people with illnesses can overcome special psychological or cognitive challenges in their everyday lives with the aid of targeted human-machine interaction and which aids can improve their quality of life.

For optimal results, the partners are actively collaborating with people suffering from dementia or affective disorders and jointly investigating technological approaches and assistance functions.

User specific Human-Machine Interaction

Along with illness-related situations, the new system should be able to recognize social behavior patterns and nonverbal clues in human communication. In particular, the project team will study personalized information transfer concepts and new user interface concepts that specifically provide support functions and encouraging stimuli in situations recognized by the system as critical.

The project also aims to extend existing assistance systems in this direction and upgrade them with new functions that detect and interpret implicit human communication signals, such as emotions or gestures, and that are able to derive and perform suitable support actions.

Recognize emotions reliably and react appropriately

For many years, Fraunhofer IPA has been working on the development of technical assistance systems that provide informational and actuatory support to elderly users. An example project is “safe@home”, in which the scientists realized a touchless and discrete assistance system for private environments using stationary 3D sensors.

The system detects falls as well as immobility and derives suitable actions, such as informing neighbors or an emergency call center. Mobile robots like the Care-O-bot® or the emergency assistance „MoBiNa“ are able to connect with those stationary sensors and can drive autonomously to the person in need of help after a fall. At the same time, they serve as communication platforms for the direct conversation with the emergency center.

In the current project, scientists of Fraunhofer IPA are further developing those technologies, specifically the stationary sensors for the detection of emotions as well as the mobile robotic system as an interaction and information interface. The challenge is to realize reliable emotion recognition. Whereas falls can be detected by motion sequences, emotions are expressed by gestures or the behavior of a person. The assistant systems must interpret those and adjust their reaction accordingly.

Project information:
Project title: EmAsIn (Emotion-sensitive Assistance Systems for Reactive Psychological Interaction with People)
Duration: 01-09-2015 to 31-08-2018
Support: The project is supported by the German Federal Ministry of Education and Research (BMBF) in connection with the federal government’s High-Tech 2020 strategy. It forms part of the InterEmotio program, which promotes the evolution of technical tools into interactive assistants by means of systems sensitive to social and emotional contexts for optimized human-machine interaction.
Partner: ITK Engineering AG (project management, sensor systems and telemedicine), Cognitec Systems GmbH and Sikom Software GmbH (image and audio data processing), Fraunhofer IPA and FZI Research Centre Computer Science (gesture and condition recognition, mobile applications), Institute for Clinical Psychology of the Hospital Stuttgart and BruderhausDiakonie (application context, medical and nursing expertise, advices on ethical and social issues, evaluation of the results).

Expert Contact:
Julia Denecke; Phone: 0711-970 1829; E-Mail: julia.denecke@ipa.fraunhofer.de

Press and Public Relations
Jörg-Dieter Walz | Phone +49 711 970-1667 | presse@ipa.fraunhofer.de | Fraunhofer Institute for Manufacturing Engineering and Automation IPA | Nobelstrasse 12 | 70569 Stuttgart

http://www.ipa.fraunhofer.de
http://www.ipa.fraunhofer.de/emotionssensitive_assistenzsysteme.html

Media Contact

Jörg Walz Fraunhofer-Institut für Produktionstechnik und Automatisierung IPA

All latest news from the category: Information Technology

Here you can find a summary of innovations in the fields of information and data processing and up-to-date developments on IT equipment and hardware.

This area covers topics such as IT services, IT architectures, IT management and telecommunications.

Back to home

Comments (0)

Write a comment

Newest articles

Security vulnerability in browser interface

… allows computer access via graphics card. Researchers at Graz University of Technology were successful with three different side-channel attacks on graphics cards via the WebGPU browser interface. The attacks…

A closer look at mechanochemistry

Ferdi Schüth and his team at the Max Planck Institut für Kohlenforschung in Mülheim/Germany have been studying the phenomena of mechanochemistry for several years. But what actually happens at the…

Severe Vulnerabilities Discovered in Software to Protect Internet Routing

A research team from the National Research Center for Applied Cybersecurity ATHENE led by Prof. Dr. Haya Schulmann has uncovered 18 vulnerabilities in crucial software components of Resource Public Key…

Partners & Sponsors