Published this month in the peer-reviewed journal Language & Speech, the new technique tracks in real time facial expressions and head movements during a video conference and maps these movements to models of faces – producing a 'cloned' face.
These facial expressions and head movements can be manipulated live to alter the apparent expressiveness, identity, race, or even gender of a talker. Moreover, these visual cues can be manipulated such that neither participant in the conversation is aware of the manipulation.
Developed by Dr Barry-John Theobald of UEA's School of Computing Sciences, in collaboration with Dr Iain Matthews (Disney Research), Prof Steven Boker (University of Virginia) and Prof Jeffrey Cohn (University of Pittsburgh), the new facial expression cloning technique is already being trialed by psychologists in the US to challenge pre-conceived assumptions about how humans behave during conversations.
For example, it is well-known that you move your head differently when speaking to a woman than when speaking to a man. The new software has helped show that this difference is not because of your conversational partner's appearance, but instead due to the way they move. If a person appears to be a woman but moves like a man, others will respond with movements similar to those made when speaking to a man.
It is also likely to have application in the entertainment industry where life-like animated characters might be required.
"Spoken words are supplemented with non-verbal visual cues to enhance the meaning of what we are saying, signify our emotional state, or provide feedback during a face-to-face conversation," said Dr Theobald, lead author of the new paper. "Being able to manipulate these properties in a controlled manner allows us to measure precisely their effects on behaviour during conversation.
"This exciting new technology allows us to manipulate faces in this way for the first time. Many of these effects would otherwise be impossible to achieve, even using highly-skilled actors."
The work is funded by the Engineering and Physical Sciences Research Council (EPSRC) and the National Science Foundation (NSF).
'Mapping and Manipulating Facial Expression' by Barry-John Theobald (UEA), Iain Matthews (Weta Digital Ltd, New Zealand), Michael Mangini (University of Notre Dame, US), Jeffrey Spies (University of Virginia), Timothy Brick (University of Virginia), Jeffrey Cohn (University of Pittsburgh) and Steven Boker (University of Virginia) is published in the June edition of Language and Speech.
Simon Dunford | EurekAlert!
Ultra-precise chip-scale sensor detects unprecedentedly small changes at the nanoscale
18.01.2017 | The Hebrew University of Jerusalem
Data analysis optimizes cyber-physical systems in telecommunications and building automation
18.01.2017 | Fraunhofer-Institut für Algorithmen und Wissenschaftliches Rechnen SCAI
An important step towards a completely new experimental access to quantum physics has been made at University of Konstanz. The team of scientists headed by...
Yersiniae cause severe intestinal infections. Studies using Yersinia pseudotuberculosis as a model organism aim to elucidate the infection mechanisms of these...
Researchers from the University of Hamburg in Germany, in collaboration with colleagues from the University of Aarhus in Denmark, have synthesized a new superconducting material by growing a few layers of an antiferromagnetic transition-metal chalcogenide on a bismuth-based topological insulator, both being non-superconducting materials.
While superconductivity and magnetism are generally believed to be mutually exclusive, surprisingly, in this new material, superconducting correlations...
Laser-driving of semimetals allows creating novel quasiparticle states within condensed matter systems and switching between different states on ultrafast time scales
Studying properties of fundamental particles in condensed matter systems is a promising approach to quantum field theory. Quasiparticles offer the opportunity...
Among the general public, solar thermal energy is currently associated with dark blue, rectangular collectors on building roofs. Technologies are needed for aesthetically high quality architecture which offer the architect more room for manoeuvre when it comes to low- and plus-energy buildings. With the “ArKol” project, researchers at Fraunhofer ISE together with partners are currently developing two façade collectors for solar thermal energy generation, which permit a high degree of design flexibility: a strip collector for opaque façade sections and a solar thermal blind for transparent sections. The current state of the two developments will be presented at the BAU 2017 trade fair.
As part of the “ArKol – development of architecturally highly integrated façade collectors with heat pipes” project, Fraunhofer ISE together with its partners...
19.01.2017 | Event News
10.01.2017 | Event News
09.01.2017 | Event News
19.01.2017 | Earth Sciences
19.01.2017 | Life Sciences
19.01.2017 | Physics and Astronomy