A few summers ago throngs of people began using the Pokemon Go app, the first mass-market augmented reality game, to collect virtual creatures hiding in the physical world.
For now, AR remains mostly a solo activity, but soon people might be using the technology for a variety of group activities, such as playing multi-user games or collaborating on work or creative projects.
The team tested ShareAR with three case study apps: Cubist Art (top panel), which lets users create and share virtual artwork with each other; Doc Edit (bottom left panel), which lets users create virtual notes or lists they can share or keep private; and Paintball (bottom right panel), which lets users play paintball with virtual paint. In the Doc Edit app, the semi-transparent gray box in the top left corner represents a "ghost object," or a document that another user wishes to remain private.
Credit: Ruth et al./USENIX Security Symposium
But how can developers guard against bad actors who try to hijack these experiences, and prevent privacy breaches in environments that span digital and physical space?
University of Washington security researchers have developed ShareAR, a toolkit that lets app developers build in collaborative and interactive features without sacrificing their users' privacy and security. The researchers presented their findings Aug. 14 at the USENIX Security Symposium in Santa Clara, California.
"A key role for computer security and privacy research is to anticipate and address future risks in emerging technologies," said co-author Franziska Roesner, an assistant professor in the Paul G. Allen School of Computer Science & Engineering. "It is becoming clear that multi-user AR has a lot of potential, but there has not been a systematic approach to addressing the possible security and privacy issues that will arise."
Sharing virtual objects in AR is in some ways like sharing files on a cloud-based platform like Google Drive -- but there's a big difference.
"AR content isn't confined to a screen like a Google Doc is. It's embedded into the physical world you see around you," said first author Kimberly Ruth, a UW undergraduate student in the Allen School. "That means there are security and privacy considerations that are unique to AR."
For example, people could potentially add virtual inappropriate images to physical public parks, scrawl virtual offensive messages on places of worship or even place a virtual "kick me" sign on an unsuspecting user's back.
"We wanted to think about how the technology should respond when a person tries to harass or spy on others, or tries to steal or vandalize other users' AR content," Ruth said. "But we also don't want to shut down the positive aspects of being able to share content using AR technologies, and we don't want to force developers to choose between functionality and security."
To address these concerns, the team created a prototype toolkit, ShareAR, for the Microsoft HoloLens. ShareAR helps applications create, share and keep track of objects that users share with each other.
Another potential issue with multi-user AR is that developers need a way to signal the physical location of someone's private virtual content to keep other users from accidentally standing in between that person and their work -- like standing between someone and the TV. So the team developed "ghost objects" for ShareAR.
"A ghost object serves as a placeholder for another virtual object. It has the same physical location and rough 3D bulk as the object it stands in for, but it doesn't show any of the sensitive information that the original object contains," Ruth said. "The benefit of this approach over putting up a virtual wall is that, if I'm interacting with a virtual private messaging window, another person in the room can't sneak up behind me and peer over my shoulder to see what I'm typing -- they always see the same placeholder from any angle."
The team tested ShareAR with three case study apps. Creating objects and changing permission settings within the apps were the most computationally expensive actions. But, even when the researchers tried to stress out the system with large numbers of users and shared objects, ShareAR took no longer than 5 milliseconds to complete a task. In most cases, it took less than 1 millisecond.
Developers can now download ShareAR to use for their own HoloLens apps.
"We'll be very interested in hearing feedback from developers on what's working well for them and what they'd like to see improved," Ruth said. "We believe that engaging with technology builders while AR is still in development is the key to tackling these security and privacy challenges before they become widespread."
Tadayoshi Kohno, a professor in the Allen School, is also a co-author on this paper. This research was funded by the National Science Foundation and the Washington Research Foundation.
Grant numbers: CNS-1513584, CNS-1565252, CNS-1651230
FROM: Sarah McQuate
University of Washington
Sarah McQuate | EurekAlert!
Quantum computers by AQT and University of Innsbruck leverage Cirq for quantum algorithm development
16.09.2019 | Universität Innsbruck
Artificial Intelligence speeds up photodynamics simulations
12.09.2019 | University of Vienna
Later during this century, around 2060, a paradigm shift in global energy consumption is expected: we will spend more energy for cooling than for heating....
Researchers from the Department of Atomically Resolved Dynamics of the Max Planck Institute for the Structure and Dynamics of Matter (MPSD) at the Center for Free-Electron Laser Science in Hamburg, the University of Potsdam (both in Germany) and the University of Toronto (Canada) have pieced together a detailed time-lapse movie revealing all the major steps during the catalytic cycle of an enzyme. Surprisingly, the communication between the protein units is accomplished via a water-network akin to a string telephone. This communication is aligned with a ‘breathing’ motion, that is the expansion and contraction of the protein.
This time-lapse sequence of structures reveals dynamic motions as a fundamental element in the molecular foundations of biology.
Two research teams have succeeded simultaneously in measuring the long-sought Thorium nuclear transition, which enables extremely precise nuclear clocks. TU Wien (Vienna) is part of both teams.
If you want to build the most accurate clock in the world, you need something that "ticks" very fast and extremely precise. In an atomic clock, electrons are...
Researchers from Chalmers University of Technology have demonstrated a detector made from graphene that could revolutionize the sensors used in next-generation space telescopes. The findings were recently published in the scientific journal Nature Astronomy.
Beyond superconductors, there are few materials that can fulfill the requirements needed for making ultra-sensitive and fast terahertz (THz) detectors for...
A supersolid is a state of matter that can be described in simplified terms as being solid and liquid at the same time. In recent years, extensive efforts have been devoted to the detection of this exotic quantum matter. A research team led by Tilman Pfau and Tim Langen at the 5th Institute of Physics of the University of Stuttgart has succeeded in proving experimentally that the long-sought supersolid state of matter exists. The researchers report their results in Nature magazine.
In our everyday lives, we are familiar with matter existing in three different states: solid, liquid, or gas. However, if matter is cooled down to extremely...
10.09.2019 | Event News
04.09.2019 | Event News
29.08.2019 | Event News
16.09.2019 | Life Sciences
16.09.2019 | Materials Sciences
16.09.2019 | Health and Medicine