Applying the facial expression recognition algorithm, the developed prototype is capable of processing a sequence of frontal images of moving faces and recognizing the person’s facial expression. The software can be applied to video sequences in realistic situations and can identify the facial expression of a person seated in front of a computer screen. Although still only a prototype, the software is capable of working on a desktop computer or even on a laptop.
Flexibility and adaptability
The system analyses the face of a person sitting in front of a camera connected to a computer running the prototype. The system analyses the person’s face (up to 30 images per second) through several boxes, each “attached” to or focusing on part of the user’s face. These boxes monitor the user’s facial movements until they manage to determine what the facial expression is by comparison with the expressions captured from different people (333 sequences) from the Cohn-Kanade database.
The system’s success rate on the Cohn-Kanade database is 89%. It can work under adverse conditions where ambient lighting, frontal facial movements or camera displacements produce major changes in facial appearance.
This software has a range of applications: advanced human-computer interfaces, improved relations with the e-commerce consumers, and metaverse avatars with an unprecedented capability to relate to the person they represent.
This software can enrich advanced human-computer interfaces because it would enable the construction of avatars that really do simulate a person’s facial expression. This is a really exciting prospect for sectors like the video games industry.
Electronic commerce could also benefit from this technology. During the e-commerce buying process, the computer would be able to identify potential buyers’ gestures, determine whether or not they intend to make a purchase and even gauge how satisfied they are with a product or service by helping to reduce the ambiguities of spoken or written language.
Applied to metaverses like Second Life, this software would also enable the avatars representing system users to act out the feelings of the user captured through facial expressions.
Although there are some facial analysis products on the market, none specifically target the analysis of user facial expressions. Visit the Computational Perception and Robotics Research Group’s website for videos illustrating the algorithm in operation.
Additionally, while most similar systems developed by other researchers focus on just part of expression recognition, the developed prototype does the whole job: 1) locates and monitors the face in the image using an algorithm that works despite changes of illumination or user movement, and 2) classifies the user’s facial expression. Finally, it also incorporates an original algorithm that calculates the likely evolution of the analysed user’s facial expressions.
Eduardo Martínez | alfa
Information integration and artificial intelligence for better diagnosis and therapy decisions
24.05.2017 | Fraunhofer MEVIS - Institut für Bildgestützte Medizin
World's thinnest hologram paves path to new 3-D world
18.05.2017 | RMIT University
Staphylococcus aureus is a feared pathogen (MRSA, multi-resistant S. aureus) due to frequent resistances against many antibiotics, especially in hospital infections. Researchers at the Paul-Ehrlich-Institut have identified immunological processes that prevent a successful immune response directed against the pathogenic agent. The delivery of bacterial proteins with RNA adjuvant or messenger RNA (mRNA) into immune cells allows the re-direction of the immune response towards an active defense against S. aureus. This could be of significant importance for the development of an effective vaccine. PLOS Pathogens has published these research results online on 25 May 2017.
Staphylococcus aureus (S. aureus) is a bacterium that colonizes by far more than half of the skin and the mucosa of adults, usually without causing infections....
Physicists from the University of Würzburg are capable of generating identical looking single light particles at the push of a button. Two new studies now demonstrate the potential this method holds.
The quantum computer has fuelled the imagination of scientists for decades: It is based on fundamentally different phenomena than a conventional computer....
An international team of physicists has monitored the scattering behaviour of electrons in a non-conducting material in real-time. Their insights could be beneficial for radiotherapy.
We can refer to electrons in non-conducting materials as ‘sluggish’. Typically, they remain fixed in a location, deep inside an atomic composite. It is hence...
Two-dimensional magnetic structures are regarded as a promising material for new types of data storage, since the magnetic properties of individual molecular building blocks can be investigated and modified. For the first time, researchers have now produced a wafer-thin ferrimagnet, in which molecules with different magnetic centers arrange themselves on a gold surface to form a checkerboard pattern. Scientists at the Swiss Nanoscience Institute at the University of Basel and the Paul Scherrer Institute published their findings in the journal Nature Communications.
Ferrimagnets are composed of two centers which are magnetized at different strengths and point in opposing directions. Two-dimensional, quasi-flat ferrimagnets...
An Australian-Chinese research team has created the world's thinnest hologram, paving the way towards the integration of 3D holography into everyday...
24.05.2017 | Event News
23.05.2017 | Event News
22.05.2017 | Event News
26.05.2017 | Life Sciences
26.05.2017 | Life Sciences
26.05.2017 | Physics and Astronomy