Scientists at the University of Bonn and the University of British Columbia (Vancouver, Canada) have developed a novel camera system which can see around the corner without using a mirror. Using diffusely reflected light, it reconstructs the shape of objects outside of the field of view.
The researchers will be reporting their results at the international Conference for Computer Vision and Pattern Recognition (CVPR) from June 24-27 in Columbus (Ohio, USA).
A laser shines on the wall; a camera watches the scene. Nothing more than white ingrain wallpaper with a bright spot of light can be seen through the lens. A computer records these initially unremarkable images and as the data is processed further, little by little, the outlines of an object appear on a screen.
Yet, this object is behind a partition and the camera cannot possibly have seen it – we have apparently looked around the corner. A magic trick? "No," says Prof. Dr.-Ing. Matthias B. Hullin from the Institute of Computer Science II at the University of Bonn. "This is an actual reconstruction from diffusely scattered light. Our camera, combined with a mathematical procedure, enables us to virtually transform this wall into a mirror."
Scattered light is used as a source of information
The laser dot on the wall is by itself a source of scattered light, which serves as the crucial source of information. Some of this light, in a roundabout way, falls back onto the wall and finally into the camera. "We are recording a kind of light echo, that is, time-resolved data, from which we can reconstruct the object," explains the Bonn computer scientist. "Part of the light has also come into contact with the unknown object and it thus brings valuable information with it about its shape and appearance."
To be able to measure such echoes, a special camera system is required which Prof. Hullin has developed together with his colleagues at the University of British Columbia (Vancouver, Canada) and further refined after his return to Bonn. In contrast to conventional cameras, it records not just the direction from which the light is coming but also how long it took the light to get from the source to the camera.
The technical complexity for this is comparatively low – suitable image sensors came onto the mass market long ago. They are mainly found in depth image cameras as they are used, for instance, as video game controllers or for range measurements in the automotive field. The actual challenge is to elicit the desired information from such time-of-flight measurements. Hullin compares the situation to a room which reverberates so greatly that one can no longer have a conversation with one's partner. "In principle, we are measuring nothing other than the sum of numerous light reflections which reached the camera through many different paths and which are superimposed on each other on the image sensor."
This problem, known as multipath interference, has been giving engineers headaches for a long time. Traditionally, one would attempt to remove the undesired multipath scatter and only use the direct portion of the signal. Based on an advanced mathematical model, Hullin and his colleagues, however, developed a method which can obtain the desired information exclusively from what would usually be considered noise rather than signal. Since multipath light also originates from objects which are not at all in the field of view, the researchers can thus make visible what is virtually invisible.
Minimal technical complexity and intelligent programming
"The accuracy of our method has its limits, of course," says Prof. Hullin – the results are still limited to rough outlines. However, the researchers assume that based on the rapid development of technical components and mathematical models, an even higher resolution can be achieved soon. Together with his colleagues, he will present the method at the international Conference for Computer Vision and Pattern Recognition (CVPR) from June 24 to 27 in Columbus (Ohio, USA). The new technology is received with great interest – Hullin hopes that similar approaches can be used, for example, in telecommunications, remote sensing and medical imaging.
Publication: Felix Heide, Lei Xiao, Wolfgang Heidrich und Matthias B. Hullin, "Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors“.
Prof. Dr.-Ing. Matthias B. Hullin
Institute of Computer Science II
University of Bonn
Johannes Seiler | idw - Informationsdienst Wissenschaft
Rapid Detection of Cracks and Corrosion using Magnetic Stray Flux
28.04.2015 | Fraunhofer-Institut für Zerstörungsfreie Prüfverfahren IZFP
Winter Hack: Textured Rubber that Grips Slick, Icy Surfaces
18.03.2015 | American Institute of Physics (AIP)
Physicists have developed an innovative method that could enable the efficient use of nanocomponents in electronic circuits. To achieve this, they have developed a layout in which a nanocomponent is connected to two electrical conductors, which uncouple the electrical signal in a highly efficient manner. The scientists at the Department of Physics and the Swiss Nanoscience Institute at the University of Basel have published their results in the scientific journal “Nature Communications” together with their colleagues from ETH Zurich.
Electronic components are becoming smaller and smaller. Components measuring just a few nanometers – the size of around ten atoms – are already being produced...
Development and implementation of an advanced automobile parking navigation platform for parking services
To fulfill the requirements of the industry, PolyU researchers developed the Advanced Automobile Parking Navigation Platform, which includes smart devices,...
The world's first electrical car and passenger ferry powered by batteries has entered service in Norway. The ferry only uses 150 kWh per route, which...
On Tuesday, 19 May 2015 the research icebreaker Polarstern will leave its home port in Bremerhaven, setting a course for the Arctic. Led by Dr Ilka Peeken from the Alfred Wegener Institute, Helmholtz Centre for Polar and Marine Research (AWI) a team of 53 researchers from 11 countries will investigate the effects of climate change in the Arctic, from the surface ice floes down to the seafloor.
RV Polarstern will enter the sea-ice zone north of Spitsbergen. Covering two shallow regions on their way to deeper waters, the scientists on board will focus...
Nanoengineers at the University of California, San Diego developed a gel filled with toxin-absorbing nanosponges that could lead to an effective treatment for skin and wound infections caused by MRSA (methicillin-resistant Staphylococcus aureus), an antibiotic-resistant bacteria. This "nanosponge-hydrogel" minimized the growth of skin lesions on mice infected with MRSA - without the use of antibiotics. The researchers recently published their findings online in Advanced Materials.
To make the nanosponge-hydrogel, the team mixed nanosponges, which are nanoparticles that absorb dangerous toxins produced by MRSA, E. coli and other...
20.05.2015 | Event News
18.05.2015 | Event News
12.05.2015 | Event News
22.05.2015 | Materials Sciences
22.05.2015 | Information Technology
22.05.2015 | Materials Sciences