A computer science Ph.D. student can turn his face into a remote control that speeds and slows video playback. The proof-of-concept demonstration is part of a larger project to use automated facial expression recognition to make robots more effective teachers.
Jacob Whitehill, a computer science Ph.D. student from UC San Diego's Jacobs School of Engineering, is leading this project. It builds on technology for detecting facial expressions being developed at UC San Diego's Machine Perception Laboratory (MPLab), part of the Institute for Neural Computation, and housed in the UCSD Division of Calit2.
Watch Jacob Whitehill turn his face into a remote control in a three minute video at: http://video-jsoe.ucsd.edu/asx/Whitehill_UC_San_Diego.wmv.asx
In a recent pilot study, Whitehill and colleagues demonstrated that information within the facial expressions people make while watching recorded video lectures can be used to predict a person's preferred viewing speed of the video and how difficult a person perceives the lecture at each moment in time.
This new work is at the intersection of facial expression recognition research and automated tutoring systems.
"If I am a student dealing with a robot teacher and I am completely puzzled and yet the robot keeps presenting new material, that's not going to be very useful to me. If, instead, the robot stops and says, 'Oh, maybe you're confused,' and I say, 'Yes, thank you for stopping,' that's really good," said Whitehill, the computer science Ph.D. student leading the project.
The work is being presented in June 2008 at two peer-reviewed academic conferences. On June 25, Whitehill presents his findings at the Intelligent Tutoring Systems conference. On Saturday, June 28, Marian Stewart Bartlett, a co-director of the Machine Perception Laboratory, will present this work at the 2008 IEEE International Workshop on Computer Vision and Pattern Recognition for Human Communicative Behavior Analysis.
In the pilot study, the facial movements people made when they perceived the lecture to be difficult varied widely from person to person. Most of the 8 test subjects, however, blinked less frequently during difficult parts of the lecture than during easier portions of the lecture, which is supported by findings in psychology.
One of the next steps for this project is to determine what facial movements one person naturally makes when they are exposed to difficult or easy lecture material. From here, Whitehill could then train a user specific model that predicts when a lecture should be sped up or slowed down based on the spontaneous facial expressions a person makes, explained Whitehill.
To collect examples of the kinds of facial expressions involved in teaching and learning, Whitehill taught a group of people in his lab about German grammar and recorded the sessions using video conferencing software.
"I wanted to see the kinds of cues that students and teachers use to try to modulate or enrich the instruction. To me, it's about understanding and optimizing interactions between students and teachers," said Whitehill.
"I can see you nodding right now, for instance," said Whitehill during the interview. "That suggests to me that you're understanding, that I can keep going with what I am saying. If you give me a puzzled look, I might back up for a second."
Daniel Kane | EurekAlert!
Marine Skin dives deeper for better monitoring
23.04.2019 | King Abdullah University of Science & Technology (KAUST)
CubeSats prove their worth for scientific missions
17.04.2019 | American Physical Society
For the first time, physicists at the University of Basel have succeeded in measuring the magnetic properties of atomically thin van der Waals materials on the nanoscale. They used diamond quantum sensors to determine the strength of the magnetization of individual atomic layers of the material chromium triiodide. In addition, they found a long-sought explanation for the unusual magnetic properties of the material. The journal Science has published the findings.
The use of atomically thin, two-dimensional van der Waals materials promises innovations in numerous fields in science and technology. Scientists around the...
Flexible, organic and printed electronics conquer everyday life. The forecasts for growth promise increasing markets and opportunities for the industry. In Europe, top institutions and companies are engaged in research and further development of these technologies for tomorrow's markets and applications. However, access by SMEs is difficult. The European project SmartEEs - Smart Emerging Electronics Servicing works on the establishment of a European innovation network, which supports both the access to competences as well as the support of the enterprises with the assumption of innovations and the progress up to the commercialization.
It surrounds us and almost unconsciously accompanies us through everyday life - printed electronics. It starts with smart labels or RFID tags in clothing, we...
The human eye is particularly sensitive to green, but less sensitive to blue and red. Chemists led by Hubert Huppertz at the University of Innsbruck have now developed a new red phosphor whose light is well perceived by the eye. This increases the light yield of white LEDs by around one sixth, which can significantly improve the energy efficiency of lighting systems.
Light emitting diodes or LEDs are only able to produce light of a certain colour. However, white light can be created using different colour mixing processes.
Researchers led by Francesca Ferlaino from the University of Innsbruck and the Austrian Academy of Sciences report in Physical Review X on the observation of supersolid behavior in dipolar quantum gases of erbium and dysprosium. In the dysprosium gas these properties are unprecedentedly long-lived. This sets the stage for future investigations into the nature of this exotic phase of matter.
Supersolidity is a paradoxical state where the matter is both crystallized and superfluid. Predicted 50 years ago, such a counter-intuitive phase, featuring...
A stellar flare 10 times more powerful than anything seen on our sun has burst from an ultracool star almost the same size as Jupiter
17.04.2019 | Event News
15.04.2019 | Event News
09.04.2019 | Event News
26.04.2019 | Physics and Astronomy
26.04.2019 | Life Sciences
26.04.2019 | Physics and Astronomy