Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Smart Software Gives Surveillance Eyes a ‘Brain’

13.02.2004


In these days of heightened security and precautions, surveillance cameras watching over us as we cross darkened parking lots or looking over our shoulders at airports may seem reassuring, but they’re only of use if someone is watching them. Researchers at the University of Rochester’s computer science laboratories have found a way to give these cameras a rudimentary brain to keep an eye out for us, and the research is already been licensed to a Rochester company with an aim toward homeland security.



“Compared to paying a human, computer time is cheap and getting cheaper,” says Randal Nelson, associate professor of computer science and creator of the software “brain”. “If we can get intelligent machines to stand in for people in observation tasks, we can achieve knowledge about our environment that would otherwise be unaffordable.”

Far from being an electronic “Big Brother,” the software would only focus on things for which it was trained to look—like a gun in an airport, or the absence of a piece of equipment in a lab. Nelson has even created a prototype system that helps a person find things around the house, such as where reading glasses were left.


Nelson set about experimenting with how to differentiate various objects in a simple black-and-white video image like that used in a typical surveillance camera. The software initially looks for changes that happen within the image, such as someone placing a cola can on a desk. The change in the image is immediately highlighted as the software begins trying to figure out if the change in the image is a new object in the scene, or the absence of an object that was there before. Using numerous methods, such as matching up background lines that were broken when the new object was set in front of them, the prototype system is accurate most of the time. It then takes an inventory of all the colors of the object so that an operator can ask the software to “zoom in on that red thing” and the software will comply, even though the soda can in question may be red and silver and overlaid with shadows.

The next step, however, is where Nelson’s software really shines. Nelson has been working for years on ways to get a computer to recognize an object on sight. He began this line of research over a decade ago as he wrote software to help a robot “shop”—picking out a single item, like a box of cereal, from several similar items. One of the tasks he recently gave his students was to set up a game where teams tried to “steal” objects from one another’s table while the tables were monitored by smart cameras. The students would find new ways to defeat the software, and consequently develop new upgrades to the system so it couldn’t be fooled again.

Though a six-month-old baby can distinguish different objects from different angles, getting a computer to do it is a Herculean task of processing, and more complicated still is identifying a simple object in a complicated natural setting like a room bustling with activity.

Unlike the baby, the software needs to be told a lot about an object before it’s able to discern it. Depending on how complex an object is, the software may need anywhere from one to 100 photos of the object from different angles. Something very simple, like a piece of paper, can be “grasped” by the program with a single picture; a soda can may take half a dozen, while a complex object like an ornate lamp may need many photographs taken from different angles to capture all its facets. With those images in mind, the software matches the new object it sees with its database of object to determine what the new object is.

The technology for this ‘smart camera’ has already been licensed to the local company PL E-Communications, LLC., which has plans to develop the technology to control video cameras for security applications. For instance, CEO Paul Simpson is looking into using linked cameras covering a wide area to exchange information about certain objects, be they suspicious packages in an airport or a suspicious truck driving through a city under military control. Even unmanned aerial reconnaissance drones like the Predator that made headlines during the current Iraqi war can use the technology to keep an eye on an area for days at a time, noting when and where objects move.

“We’re hoping to make this technology do things that were long thought impossible—making things more secure without the need to have a human operator on hand every second.” says Simpson.

Nelson and PL E-Communications were connected through the Center for Electronic Imaging Systems (CEIS), a NYSTAR-sponsored Center for Advanced Technology (CATs) devoted to promoting economic development in the greater Rochester region and New York State. CEIS develops and transfers technology from local universities to industry for commercialization, and by educating the next generation of leaders in the fields of electronic imaging and microelectronics design.

Jonathan Sherwood | University of Rochester
Further information:
http://www.rochester.edu/news/show.php?id=1698

More articles from Information Technology:

nachricht Research on light-matter interaction could improve electronic and optoelectronic devices
11.10.2018 | Rensselaer Polytechnic Institute

nachricht Unique Deep Learning Infrastructure - DFKI receives first NVIDIA DGX-2 supercomputer in Europe
11.10.2018 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Storage & Transport of highly volatile Gases made safer & cheaper by the use of “Kinetic Trapping"

Augsburg chemists present a new technology for compressing, storing and transporting highly volatile gases in porous frameworks/New prospects for gas-powered vehicles

Storage of highly volatile gases has always been a major technological challenge, not least for use in the automotive sector, for, for example, methane or...

Im Focus: Disrupting crystalline order to restore superfluidity

When we put water in a freezer, water molecules crystallize and form ice. This change from one phase of matter to another is called a phase transition. While this transition, and countless others that occur in nature, typically takes place at the same fixed conditions, such as the freezing point, one can ask how it can be influenced in a controlled way.

We are all familiar with such control of the freezing transition, as it is an essential ingredient in the art of making a sorbet or a slushy. To make a cold...

Im Focus: Micro energy harvesters for the Internet of Things

Fraunhofer IWS Dresden scientists print electronic layers with polymer ink

Thin organic layers provide machines and equipment with new functions. They enable, for example, tiny energy recuperators. In future, these will be installed...

Im Focus: Dynamik einzelner Proteine

Neue Messmethode erlaubt es Forschenden, die Bewegung von Molekülen lange und genau zu verfolgen

Das Zusammenspiel aus Struktur und Dynamik bestimmt die Funktion von Proteinen, den molekularen Werkzeugen der Zelle. Durch Fortschritte in der...

Im Focus: Dynamics of individual proteins

New measurement method allows researchers to precisely follow the movement of individual molecules over long periods of time

The function of proteins – the molecular tools of the cell – is governed by the interplay of their structure and dynamics. Advances in electron microscopy have...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

Berlin5GWeek: Private industrial networks and temporary 5G connectivity islands

16.10.2018 | Event News

5th International Conference on Cellular Materials (CellMAT), Scientific Programme online

02.10.2018 | Event News

Major Project: The New Silk Road

01.10.2018 | Event News

 
Latest News

Unravelling the genetics of fungal fratricide

16.10.2018 | Life Sciences

Blue phosphorus -- mapped and measured for the first time

16.10.2018 | Physics and Astronomy

Berlin5GWeek: Private industrial networks and temporary 5G connectivity islands

16.10.2018 | Event News

VideoLinks
Science & Research
Overview of more VideoLinks >>>