Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Smart Software Gives Surveillance Eyes a ‘Brain’

13.02.2004


In these days of heightened security and precautions, surveillance cameras watching over us as we cross darkened parking lots or looking over our shoulders at airports may seem reassuring, but they’re only of use if someone is watching them. Researchers at the University of Rochester’s computer science laboratories have found a way to give these cameras a rudimentary brain to keep an eye out for us, and the research is already been licensed to a Rochester company with an aim toward homeland security.



“Compared to paying a human, computer time is cheap and getting cheaper,” says Randal Nelson, associate professor of computer science and creator of the software “brain”. “If we can get intelligent machines to stand in for people in observation tasks, we can achieve knowledge about our environment that would otherwise be unaffordable.”

Far from being an electronic “Big Brother,” the software would only focus on things for which it was trained to look—like a gun in an airport, or the absence of a piece of equipment in a lab. Nelson has even created a prototype system that helps a person find things around the house, such as where reading glasses were left.


Nelson set about experimenting with how to differentiate various objects in a simple black-and-white video image like that used in a typical surveillance camera. The software initially looks for changes that happen within the image, such as someone placing a cola can on a desk. The change in the image is immediately highlighted as the software begins trying to figure out if the change in the image is a new object in the scene, or the absence of an object that was there before. Using numerous methods, such as matching up background lines that were broken when the new object was set in front of them, the prototype system is accurate most of the time. It then takes an inventory of all the colors of the object so that an operator can ask the software to “zoom in on that red thing” and the software will comply, even though the soda can in question may be red and silver and overlaid with shadows.

The next step, however, is where Nelson’s software really shines. Nelson has been working for years on ways to get a computer to recognize an object on sight. He began this line of research over a decade ago as he wrote software to help a robot “shop”—picking out a single item, like a box of cereal, from several similar items. One of the tasks he recently gave his students was to set up a game where teams tried to “steal” objects from one another’s table while the tables were monitored by smart cameras. The students would find new ways to defeat the software, and consequently develop new upgrades to the system so it couldn’t be fooled again.

Though a six-month-old baby can distinguish different objects from different angles, getting a computer to do it is a Herculean task of processing, and more complicated still is identifying a simple object in a complicated natural setting like a room bustling with activity.

Unlike the baby, the software needs to be told a lot about an object before it’s able to discern it. Depending on how complex an object is, the software may need anywhere from one to 100 photos of the object from different angles. Something very simple, like a piece of paper, can be “grasped” by the program with a single picture; a soda can may take half a dozen, while a complex object like an ornate lamp may need many photographs taken from different angles to capture all its facets. With those images in mind, the software matches the new object it sees with its database of object to determine what the new object is.

The technology for this ‘smart camera’ has already been licensed to the local company PL E-Communications, LLC., which has plans to develop the technology to control video cameras for security applications. For instance, CEO Paul Simpson is looking into using linked cameras covering a wide area to exchange information about certain objects, be they suspicious packages in an airport or a suspicious truck driving through a city under military control. Even unmanned aerial reconnaissance drones like the Predator that made headlines during the current Iraqi war can use the technology to keep an eye on an area for days at a time, noting when and where objects move.

“We’re hoping to make this technology do things that were long thought impossible—making things more secure without the need to have a human operator on hand every second.” says Simpson.

Nelson and PL E-Communications were connected through the Center for Electronic Imaging Systems (CEIS), a NYSTAR-sponsored Center for Advanced Technology (CATs) devoted to promoting economic development in the greater Rochester region and New York State. CEIS develops and transfers technology from local universities to industry for commercialization, and by educating the next generation of leaders in the fields of electronic imaging and microelectronics design.

Jonathan Sherwood | University of Rochester
Further information:
http://www.rochester.edu/news/show.php?id=1698

More articles from Information Technology:

nachricht Open source software helps researchers extract key insights from huge sensor datasets
22.03.2019 | Universität des Saarlandes

nachricht Touchscreens go 3D with buttons that pulsate and vibrate under your fingertips
14.03.2019 | Universität des Saarlandes

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: The taming of the light screw

DESY and MPSD scientists create high-order harmonics from solids with controlled polarization states, taking advantage of both crystal symmetry and attosecond electronic dynamics. The newly demonstrated technique might find intriguing applications in petahertz electronics and for spectroscopic studies of novel quantum materials.

The nonlinear process of high-order harmonic generation (HHG) in gases is one of the cornerstones of attosecond science (an attosecond is a billionth of a...

Im Focus: Magnetic micro-boats

Nano- and microtechnology are promising candidates not only for medical applications such as drug delivery but also for the creation of little robots or flexible integrated sensors. Scientists from the Max Planck Institute for Polymer Research (MPI-P) have created magnetic microparticles, with a newly developed method, that could pave the way for building micro-motors or guiding drugs in the human body to a target, like a tumor. The preparation of such structures as well as their remote-control can be regulated using magnetic fields and therefore can find application in an array of domains.

The magnetic properties of a material control how this material responds to the presence of a magnetic field. Iron oxide is the main component of rust but also...

Im Focus: Self-healing coating made of corn starch makes small scratches disappear through heat

Due to the special arrangement of its molecules, a new coating made of corn starch is able to repair small scratches by itself through heat: The cross-linking via ring-shaped molecules makes the material mobile, so that it compensates for the scratches and these disappear again.

Superficial micro-scratches on the car body or on other high-gloss surfaces are harmless, but annoying. Especially in the luxury segment such surfaces are...

Im Focus: Stellar cartography

The Potsdam Echelle Polarimetric and Spectroscopic Instrument (PEPSI) at the Large Binocular Telescope (LBT) in Arizona released its first image of the surface magnetic field of another star. In a paper in the European journal Astronomy & Astrophysics, the PEPSI team presents a Zeeman- Doppler-Image of the surface of the magnetically active star II Pegasi.

A special technique allows astronomers to resolve the surfaces of faraway stars. Those are otherwise only seen as point sources, even in the largest telescopes...

Im Focus: Heading towards a tsunami of light

Researchers at Chalmers University of Technology and the University of Gothenburg, Sweden, have proposed a way to create a completely new source of radiation. Ultra-intense light pulses consist of the motion of a single wave and can be described as a tsunami of light. The strong wave can be used to study interactions between matter and light in a unique way. Their research is now published in the scientific journal Physical Review Letters.

"This source of radiation lets us look at reality through a new angle - it is like twisting a mirror and discovering something completely different," says...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

International Modelica Conference with 330 visitors from 21 countries at OTH Regensburg

11.03.2019 | Event News

Selection Completed: 580 Young Scientists from 88 Countries at the Lindau Nobel Laureate Meeting

01.03.2019 | Event News

LightMAT 2019 – 3rd International Conference on Light Materials – Science and Technology

28.02.2019 | Event News

 
Latest News

Solving the efficiency of Gram-negative bacteria

22.03.2019 | Life Sciences

Bacteria bide their time when antibiotics attack

22.03.2019 | Life Sciences

Open source software helps researchers extract key insights from huge sensor datasets

22.03.2019 | Information Technology

VideoLinks
Science & Research
Overview of more VideoLinks >>>