University of Maryland researchers conducted one of the first in-depth analyses on whether people recall information better through virtual reality, as opposed to desktop computers
While the use of virtual reality (VR) for gaming and entertainment continues to grow, the technology also shows promise for changing the landscape of industries such as medicine, education and workforce training.
With this recent emphasis on the use of VR in high-impact areas, University of Maryland researchers conducted one of the first in-depth analyses on whether people learn better through virtual, immersive environments, as opposed to more traditional platforms like a two-dimensional desktop computer or hand-held tablet.
The researchers found that people remember information better if it is presented to them in a virtual environment. The results of the study were recently published in the journal Virtual Reality.
"This data is exciting in that it suggests that immersive environments could offer new pathways for improved outcomes in education and high-proficiency training," says Amitabh Varshney, professor of computer science and dean of the College of Computer, Mathematical, and Natural Sciences at UMD. Varshney leads several major research efforts on the UMD campus involving virtual and augmented reality (AR), including close collaboration with health care professionals interested in developing AR-based diagnostic tools for emergency medicine and VR training for surgical residents.
In addition to Varshney, the paper's authors include Catherine Plaisant, a senior research scientist in the University of Maryland Institute for Advanced Computer Studies, and Eric Krokos, a doctoral student in computer science.
For the study, the UMD team used the concept of a "memory palace," where people recall an object or item by placing it in an imaginary physical location like a building or town. This method--researchers refer to it as spatial mnemonic encoding--has been used since classical times, taking advantage of the human brain's ability to spatially organize thoughts and memories.
"Humans have always used visual-based methods to help them remember information, whether it's cave drawings, clay tablets, printed text and images, or video," says Krokos, who was lead author on the paper. "We wanted to see if virtual reality might be the next logical step in this progression."
For the study, the UMD researchers recruited 40 volunteers--mostly UMD students unfamiliar with virtual reality. The researchers split the participants into two groups: one viewed information first via a VR head-mounted display and then on a desktop; the other did the opposite.
Both groups received printouts of well-known faces--including Abraham Lincoln, the Dalai Lama, Arnold Schwarzenegger and Marilyn Monroe--and familiarized themselves with the images. Next, the researchers showed the participants the faces using the memory palace format with two imaginary locations: an interior room of an ornate palace and an external view of a medieval town. Both of the study groups navigated each memory palace for five minutes. Desktop participants used a mouse to change their viewpoint, while VR users turned their heads from side to side and looked up and down.
Next, Krokos asked the users to memorize the location of each of the faces shown. Half the faces were positioned in different locations within the interior setting--Oprah Winfrey appeared at the top of a grand staircase; Stephen Hawking was a few steps down, followed by Shrek. On the ground floor, Napoleon Bonaparte's face sat above majestic wooden table, while The Rev. Martin Luther King Jr. was positioned in the center of the room.
Similarly, for the medieval town setting, users viewed images that included Hillary Clinton's face on the left side of a building, with Mickey Mouse and Batman placed at varying heights on nearby structures.
Then, the scene went blank, and after a two-minute break, each memory palace reappeared with numbered boxes where the faces had been. The research participants were then asked to recall which face had been in each location where a number was now displayed.
The key, say the researchers, was for participants to identify each face by its physical location and its relation to surrounding structures and faces--and also the location of the image relative to the user's own body.
"By visually navigating the scene, users could determine that 'Hillary Clinton is in the top left window and it looks like she is about 20 yards from where I am sitting,'" says Krokos, who conducted the user-study in the Augmentarium, a visualization testbed lab on the UMD campus that launched in 2015 with funding from the National Science Foundation.
The results showed an 8.8 percent improvement overall in recall accuracy using the VR headsets, a statistically significant number according to the research team.
In post-study questionnaires, all 40 participants said that they were completely comfortable--and adept--in navigating a desktop computer to access information, yet all but two said they preferred the immersive VR environment as a potential learning platform. The questionnaire also found that only two people said they felt "uncomfortable" using VR.
Many of the participants said the immersive "presence" while using VR allowed them to focus better. This was reflected in the research results: 40 percent of the participants scored at least 10 percent higher in recall ability using VR over the desktop display.
There has been much prior psychological research on the amount of recall that humans typically possess, notes Plaisant, who is an expert in human-computer interaction. Recent research in cognitive psychology suggests that the mind is inherently embodied, and that the way humans create and recall mental constructs is influenced by the way they perceive and move, she adds.
"This leads to the possibility that a spatial virtual memory palace--experienced in an immersive virtual environment--could enhance learning and recall by leveraging a person's overall sense of body position, movement and acceleration," Plaisant says.
The UMD team believes this study will lay the groundwork for other scientific inquiry on the value of VR and AR for education.
"By showing that virtual reality can help improve recall, it opens the door to further studies that look at the impact of VR-based training modules at all levels--from elementary school children learning astronomy to trauma residents acquiring the latest knowledge in lifesaving procedures," Varshney says. "We believe the future of education and innovation will benefit greatly from the use of these new visual technologies."
This work was supported by the National Science Foundation (Grant Nos. 14-29404 and 15-64212), the state of Maryland's MPower initiative and the NVIDIA CUDA Center of Excellence program. The content of this article does not necessarily reflect the views of these organizations.
The research paper, "Virtual memory palaces: immersion aids recall," Eric Krokos, Catherine Plaisant and Amitabh Varshney, was published online in the journal Virtual Reality on May 16, 2018.
Media Relations Contact: Tom Ventsias, 301.405.5933, firstname.lastname@example.org
About the College of Computer, Mathematical, and Natural Sciences:
The College of Computer, Mathematical, and Natural Sciences at the University of Maryland educates more than 9,000 future scientific leaders in its undergraduate and graduate programs each year. The college's 10 departments and more than a dozen interdisciplinary research centers foster scientific discovery with annual sponsored research funding exceeding $175 million.
Tom Ventsias | EurekAlert!
New AI system manages road infrastructure via Google Street View
19.06.2019 | RMIT University
'Alexa, monitor my heart': Researchers develop first contactless cardiac arrest AI system for smart speakers
19.06.2019 | University of Washington
From June 25th to 27th 2019, the Fraunhofer Institute for Digital Media Technology IDMT in Ilmenau (Germany) will be presenting a new solution for acoustic quality inspection allowing contact-free, non-destructive testing of manufactured parts and components. The method which has reached Technology Readiness Level 6 already, is currently being successfully tested in practical use together with a number of industrial partners.
Reducing machine downtime, manufacturing defects, and excessive scrap
The quality of additively manufactured components depends not only on the manufacturing process, but also on the inline process control. The process control ensures a reliable coating process because it detects deviations from the target geometry immediately. At LASER World of PHOTONICS 2019, the Fraunhofer Institute for Laser Technology ILT will be demonstrating how well bi-directional sensor technology can already be used for Laser Material Deposition (LMD) in combination with commercial optics at booth A2.431.
Fraunhofer ILT has been developing optical sensor technology specifically for production measurement technology for around 10 years. In particular, its »bd-1«...
The well-known representation of chemical elements is just one example of how objects can be arranged and classified
The periodic table of elements that most chemistry books depict is only one special case. This tabular overview of the chemical elements, which goes back to...
Light can be used not only to measure materials’ properties, but also to change them. Especially interesting are those cases in which the function of a material can be modified, such as its ability to conduct electricity or to store information in its magnetic state. A team led by Andrea Cavalleri from the Max Planck Institute for the Structure and Dynamics of Matter in Hamburg used terahertz frequency light pulses to transform a non-ferroelectric material into a ferroelectric one.
Ferroelectricity is a state in which the constituent lattice “looks” in one specific direction, forming a macroscopic electrical polarisation. The ability to...
Researchers at TU Graz calculate the most accurate gravity field determination of the Earth using 1.16 billion satellite measurements. This yields valuable knowledge for climate research.
The Earth’s gravity fluctuates from place to place. Geodesists use this phenomenon to observe geodynamic and climatological processes. Using...
24.06.2019 | Event News
29.04.2019 | Event News
17.04.2019 | Event News
25.06.2019 | Architecture and Construction
25.06.2019 | Life Sciences
25.06.2019 | Power and Electrical Engineering