UZH researchers have taught drones how to fly using an eye-inspired camera, opening the door to them performing fast, agile maneuvers and flying in low-light environments. Possible applications could include supporting rescue teams with search missions at dusk or dawn.
To fly safely, drones need to know their precise position and orientation in space at all times. While commercial drones solve this problem using GPS, this only works outdoors, and is not very reliable, especially in urban environments.
Furthermore, the conventional cameras mounted on drones work only when there is a high amount of light available, and the drone’s speed has to be limited otherwise the resulting image is motion-blurred and cannot be used by computer vision algorithms. To solve this problem, professional drones use sensors that are elaborate, expensive, and bulky, such as laser scanners.
First combination of artificial intelligence and robotics
A group of researchers from the University of Zurich and the Swiss research consortium NCCR Robotics has now developed an innovative alternative approach, enabling drones to fly in a wide range of conditions using an eye-inspired camera that can easily cope with high-speed motion.
It can even see in the dark much more effectively than the conventional cameras currently used by all commercial drones. “This research is the first of its kind in the fields of artificial intelligence and robotics, and will soon enable drones to fly autonomously and faster than ever, including in low-light environments,” says Prof. Davide Scaramuzza, Director of the Robotics and Perception Group at UZH. He and his team have already taught drones to use their onboard cameras to infer their position and orientation in space.
Camera captures light changes for each pixel
Event cameras, which were invented at UZH together with ETH Zurich, do not need to capture full light on the entire bio-inspired retina in order to have a clear picture. Unlike their conventional counterparts, they only report changes in brightness for each pixel, ensuring perfectly sharp vision even during fast motion or in low-light environments. The UZH researchers have also de-signed new software able to efficiently process the output from such cameras, harnessing this to enable autonomous flight at higher speeds and in lower light than currently possible with com-mercial drones.
Drones equipped with an event camera and the software designed by the Swiss researchers could assist search and rescue teams in scenarios where conventional drones would be of no use – for example on missions at dusk or dawn or when there is too little light for normal cameras to work. They would also be able to fly faster in disaster areas, where time is critical in saving survivors.
Prototype ready for the future
“There is still a lot of work to be done before these drones can be deployed in the real world since the event camera used for our research is an early prototype. We have yet to prove that our soft-ware also works reliably outdoors,” says PhD Student Henri Rebecq. And Professor Scaramuzza adds: “We think this is achievable, however, and our recent work has already demonstrated that combining a standard camera with an event-based camera improves the accuracy and reliability of the system.”
Antoni Rosinol Vidal, Henri Rebecq, Timo Horstschaefer, Davide Scaramuzza. Hybrid, Frame and Event-based Visual Inertial Odometry for Robust, Autonomous Navigation of Quadrotors. IEEE Robotics and Automation Letters, September 19, 2017.
Video UZH Flying Robots: https://www.youtube.com/watch?time_continue=1&v=GZ1L9gXPfvc
Melanie Nyfeler | Universität Zürich
Reversing cause and effect is no trouble for quantum computers
20.07.2018 | Centre for Quantum Technologies at the National University of Singapore
Study suggests buried Internet infrastructure at risk as sea levels rise
18.07.2018 | University of Wisconsin-Madison
A new manufacturing technique uses a process similar to newspaper printing to form smoother and more flexible metals for making ultrafast electronic devices.
The low-cost process, developed by Purdue University researchers, combines tools already used in industry for manufacturing metals on a large scale, but uses...
For the first time ever, scientists have determined the cosmic origin of highest-energy neutrinos. A research group led by IceCube scientist Elisa Resconi, spokesperson of the Collaborative Research Center SFB1258 at the Technical University of Munich (TUM), provides an important piece of evidence that the particles detected by the IceCube neutrino telescope at the South Pole originate from a galaxy four billion light-years away from Earth.
To rule out other origins with certainty, the team led by neutrino physicist Elisa Resconi from the Technical University of Munich and multi-wavelength...
For the first time a team of researchers have discovered two different phases of magnetic skyrmions in a single material. Physicists of the Technical Universities of Munich and Dresden and the University of Cologne can now better study and understand the properties of these magnetic structures, which are important for both basic research and applications.
Whirlpools are an everyday experience in a bath tub: When the water is drained a circular vortex is formed. Typically, such whirls are rather stable. Similar...
Physicists working with Roland Wester at the University of Innsbruck have investigated if and how chemical reactions can be influenced by targeted vibrational excitation of the reactants. They were able to demonstrate that excitation with a laser beam does not affect the efficiency of a chemical exchange reaction and that the excited molecular group acts only as a spectator in the reaction.
A frequently used reaction in organic chemistry is nucleophilic substitution. It plays, for example, an important role in in the synthesis of new chemical...
Optical spectroscopy allows investigating the energy structure and dynamic properties of complex quantum systems. Researchers from the University of Würzburg present two new approaches of coherent two-dimensional spectroscopy.
"Put an excitation into the system and observe how it evolves." According to physicist Professor Tobias Brixner, this is the credo of optical spectroscopy....
13.07.2018 | Event News
12.07.2018 | Event News
03.07.2018 | Event News
20.07.2018 | Power and Electrical Engineering
20.07.2018 | Information Technology
20.07.2018 | Materials Sciences