A computer science Ph.D. student can turn his face into a remote control that speeds and slows video playback. The proof-of-concept demonstration is part of a larger project to use automated facial expression recognition to make robots more effective teachers.
Jacob Whitehill, a computer science Ph.D. student from UC San Diego's Jacobs School of Engineering, is leading this project. It builds on technology for detecting facial expressions being developed at UC San Diego's Machine Perception Laboratory (MPLab), part of the Institute for Neural Computation, and housed in the UCSD Division of Calit2.
Watch Jacob Whitehill turn his face into a remote control in a three minute video at: http://video-jsoe.ucsd.edu/asx/Whitehill_UC_San_Diego.wmv.asx
In a recent pilot study, Whitehill and colleagues demonstrated that information within the facial expressions people make while watching recorded video lectures can be used to predict a person's preferred viewing speed of the video and how difficult a person perceives the lecture at each moment in time.
This new work is at the intersection of facial expression recognition research and automated tutoring systems.
"If I am a student dealing with a robot teacher and I am completely puzzled and yet the robot keeps presenting new material, that's not going to be very useful to me. If, instead, the robot stops and says, 'Oh, maybe you're confused,' and I say, 'Yes, thank you for stopping,' that's really good," said Whitehill, the computer science Ph.D. student leading the project.
The work is being presented in June 2008 at two peer-reviewed academic conferences. On June 25, Whitehill presents his findings at the Intelligent Tutoring Systems conference. On Saturday, June 28, Marian Stewart Bartlett, a co-director of the Machine Perception Laboratory, will present this work at the 2008 IEEE International Workshop on Computer Vision and Pattern Recognition for Human Communicative Behavior Analysis.
In the pilot study, the facial movements people made when they perceived the lecture to be difficult varied widely from person to person. Most of the 8 test subjects, however, blinked less frequently during difficult parts of the lecture than during easier portions of the lecture, which is supported by findings in psychology.
One of the next steps for this project is to determine what facial movements one person naturally makes when they are exposed to difficult or easy lecture material. From here, Whitehill could then train a user specific model that predicts when a lecture should be sped up or slowed down based on the spontaneous facial expressions a person makes, explained Whitehill.
To collect examples of the kinds of facial expressions involved in teaching and learning, Whitehill taught a group of people in his lab about German grammar and recorded the sessions using video conferencing software.
"I wanted to see the kinds of cues that students and teachers use to try to modulate or enrich the instruction. To me, it's about understanding and optimizing interactions between students and teachers," said Whitehill.
"I can see you nodding right now, for instance," said Whitehill during the interview. "That suggests to me that you're understanding, that I can keep going with what I am saying. If you give me a puzzled look, I might back up for a second."
Daniel Kane | EurekAlert!
UT professor develops algorithm to improve online mapping of disaster areas
29.11.2016 | University of Tennessee at Knoxville
New standard helps optical trackers follow moving objects precisely
23.11.2016 | National Institute of Standards and Technology (NIST)
A multi-institutional research collaboration has created a novel approach for fabricating three-dimensional micro-optics through the shape-defined formation of porous silicon (PSi), with broad impacts in integrated optoelectronics, imaging, and photovoltaics.
Working with colleagues at Stanford and The Dow Chemical Company, researchers at the University of Illinois at Urbana-Champaign fabricated 3-D birefringent...
In experiments with magnetic atoms conducted at extremely low temperatures, scientists have demonstrated a unique phase of matter: The atoms form a new type of quantum liquid or quantum droplet state. These so called quantum droplets may preserve their form in absence of external confinement because of quantum effects. The joint team of experimental physicists from Innsbruck and theoretical physicists from Hannover report on their findings in the journal Physical Review X.
“Our Quantum droplets are in the gas phase but they still drop like a rock,” explains experimental physicist Francesca Ferlaino when talking about the...
The Max Planck Institute for Physics (MPP) is opening up a new research field. A workshop from November 21 - 22, 2016 will mark the start of activities for an innovative axion experiment. Axions are still only purely hypothetical particles. Their detection could solve two fundamental problems in particle physics: What dark matter consists of and why it has not yet been possible to directly observe a CP violation for the strong interaction.
The “MADMAX” project is the MPP’s commitment to axion research. Axions are so far only a theoretical prediction and are difficult to detect: on the one hand,...
Broadband rotational spectroscopy unravels structural reshaping of isolated molecules in the gas phase to accommodate water
In two recent publications in the Journal of Chemical Physics and in the Journal of Physical Chemistry Letters, researchers around Melanie Schnell from the Max...
The efficiency of power electronic systems is not solely dependent on electrical efficiency but also on weight, for example, in mobile systems. When the weight of relevant components and devices in airplanes, for instance, is reduced, fuel savings can be achieved and correspondingly greenhouse gas emissions decreased. New materials and components based on gallium nitride (GaN) can help to reduce weight and increase the efficiency. With these new materials, power electronic switches can be operated at higher switching frequency, resulting in higher power density and lower material costs.
Researchers at the Fraunhofer Institute for Solar Energy Systems ISE together with partners have investigated how these materials can be used to make power...
16.11.2016 | Event News
01.11.2016 | Event News
14.10.2016 | Event News
02.12.2016 | Medical Engineering
02.12.2016 | Agricultural and Forestry Science
02.12.2016 | Physics and Astronomy