Published this month in the peer-reviewed journal Language & Speech, the new technique tracks in real time facial expressions and head movements during a video conference and maps these movements to models of faces – producing a 'cloned' face.
These facial expressions and head movements can be manipulated live to alter the apparent expressiveness, identity, race, or even gender of a talker. Moreover, these visual cues can be manipulated such that neither participant in the conversation is aware of the manipulation.
Developed by Dr Barry-John Theobald of UEA's School of Computing Sciences, in collaboration with Dr Iain Matthews (Disney Research), Prof Steven Boker (University of Virginia) and Prof Jeffrey Cohn (University of Pittsburgh), the new facial expression cloning technique is already being trialed by psychologists in the US to challenge pre-conceived assumptions about how humans behave during conversations.
For example, it is well-known that you move your head differently when speaking to a woman than when speaking to a man. The new software has helped show that this difference is not because of your conversational partner's appearance, but instead due to the way they move. If a person appears to be a woman but moves like a man, others will respond with movements similar to those made when speaking to a man.
It is also likely to have application in the entertainment industry where life-like animated characters might be required.
"Spoken words are supplemented with non-verbal visual cues to enhance the meaning of what we are saying, signify our emotional state, or provide feedback during a face-to-face conversation," said Dr Theobald, lead author of the new paper. "Being able to manipulate these properties in a controlled manner allows us to measure precisely their effects on behaviour during conversation.
"This exciting new technology allows us to manipulate faces in this way for the first time. Many of these effects would otherwise be impossible to achieve, even using highly-skilled actors."
The work is funded by the Engineering and Physical Sciences Research Council (EPSRC) and the National Science Foundation (NSF).
'Mapping and Manipulating Facial Expression' by Barry-John Theobald (UEA), Iain Matthews (Weta Digital Ltd, New Zealand), Michael Mangini (University of Notre Dame, US), Jeffrey Spies (University of Virginia), Timothy Brick (University of Virginia), Jeffrey Cohn (University of Pittsburgh) and Steven Boker (University of Virginia) is published in the June edition of Language and Speech.
Simon Dunford | EurekAlert!
Powerful IT security for the car of the future – research alliance develops new approaches
25.05.2018 | Universität Ulm
Supercomputing the emergence of material behavior
18.05.2018 | University of Texas at Austin, Texas Advanced Computing Center
The more electronics steer, accelerate and brake cars, the more important it is to protect them against cyber-attacks. That is why 15 partners from industry and academia will work together over the next three years on new approaches to IT security in self-driving cars. The joint project goes by the name Security For Connected, Autonomous Cars (SecForCARs) and has funding of €7.2 million from the German Federal Ministry of Education and Research. Infineon is leading the project.
Vehicles already offer diverse communication interfaces and more and more automated functions, such as distance and lane-keeping assist systems. At the same...
A research team led by physicists at the Technical University of Munich (TUM) has developed molecular nanoswitches that can be toggled between two structurally different states using an applied voltage. They can serve as the basis for a pioneering class of devices that could replace silicon-based components with organic molecules.
The development of new electronic technologies drives the incessant reduction of functional component sizes. In the context of an international collaborative...
At the LASYS 2018, from June 5th to 7th, the Laser Zentrum Hannover e.V. (LZH) will be showcasing processes for the laser material processing of tomorrow in hall 4 at stand 4E75. With blown bomb shells the LZH will present first results of a research project on civil security.
At this year's LASYS, the LZH will exhibit light-based processes such as cutting, welding, ablation and structuring as well as additive manufacturing for...
There are videos on the internet that can make one marvel at technology. For example, a smartphone is casually bent around the arm or a thin-film display is rolled in all directions and with almost every diameter. From the user's point of view, this looks fantastic. From a professional point of view, however, the question arises: Is that already possible?
At Display Week 2018, scientists from the Fraunhofer Institute for Applied Polymer Research IAP will be demonstrating today’s technological possibilities and...
So-called quantum many-body scars allow quantum systems to stay out of equilibrium much longer, explaining experiment | Study published in Nature Physics
Recently, researchers from Harvard and MIT succeeded in trapping a record 53 atoms and individually controlling their quantum state, realizing what is called a...
25.05.2018 | Event News
02.05.2018 | Event News
13.04.2018 | Event News
25.05.2018 | Event News
25.05.2018 | Machine Engineering
25.05.2018 | Life Sciences