Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Smart Software Gives Surveillance Eyes a ‘Brain’

13.02.2004


In these days of heightened security and precautions, surveillance cameras watching over us as we cross darkened parking lots or looking over our shoulders at airports may seem reassuring, but they’re only of use if someone is watching them. Researchers at the University of Rochester’s computer science laboratories have found a way to give these cameras a rudimentary brain to keep an eye out for us, and the research is already been licensed to a Rochester company with an aim toward homeland security.



“Compared to paying a human, computer time is cheap and getting cheaper,” says Randal Nelson, associate professor of computer science and creator of the software “brain”. “If we can get intelligent machines to stand in for people in observation tasks, we can achieve knowledge about our environment that would otherwise be unaffordable.”

Far from being an electronic “Big Brother,” the software would only focus on things for which it was trained to look—like a gun in an airport, or the absence of a piece of equipment in a lab. Nelson has even created a prototype system that helps a person find things around the house, such as where reading glasses were left.


Nelson set about experimenting with how to differentiate various objects in a simple black-and-white video image like that used in a typical surveillance camera. The software initially looks for changes that happen within the image, such as someone placing a cola can on a desk. The change in the image is immediately highlighted as the software begins trying to figure out if the change in the image is a new object in the scene, or the absence of an object that was there before. Using numerous methods, such as matching up background lines that were broken when the new object was set in front of them, the prototype system is accurate most of the time. It then takes an inventory of all the colors of the object so that an operator can ask the software to “zoom in on that red thing” and the software will comply, even though the soda can in question may be red and silver and overlaid with shadows.

The next step, however, is where Nelson’s software really shines. Nelson has been working for years on ways to get a computer to recognize an object on sight. He began this line of research over a decade ago as he wrote software to help a robot “shop”—picking out a single item, like a box of cereal, from several similar items. One of the tasks he recently gave his students was to set up a game where teams tried to “steal” objects from one another’s table while the tables were monitored by smart cameras. The students would find new ways to defeat the software, and consequently develop new upgrades to the system so it couldn’t be fooled again.

Though a six-month-old baby can distinguish different objects from different angles, getting a computer to do it is a Herculean task of processing, and more complicated still is identifying a simple object in a complicated natural setting like a room bustling with activity.

Unlike the baby, the software needs to be told a lot about an object before it’s able to discern it. Depending on how complex an object is, the software may need anywhere from one to 100 photos of the object from different angles. Something very simple, like a piece of paper, can be “grasped” by the program with a single picture; a soda can may take half a dozen, while a complex object like an ornate lamp may need many photographs taken from different angles to capture all its facets. With those images in mind, the software matches the new object it sees with its database of object to determine what the new object is.

The technology for this ‘smart camera’ has already been licensed to the local company PL E-Communications, LLC., which has plans to develop the technology to control video cameras for security applications. For instance, CEO Paul Simpson is looking into using linked cameras covering a wide area to exchange information about certain objects, be they suspicious packages in an airport or a suspicious truck driving through a city under military control. Even unmanned aerial reconnaissance drones like the Predator that made headlines during the current Iraqi war can use the technology to keep an eye on an area for days at a time, noting when and where objects move.

“We’re hoping to make this technology do things that were long thought impossible—making things more secure without the need to have a human operator on hand every second.” says Simpson.

Nelson and PL E-Communications were connected through the Center for Electronic Imaging Systems (CEIS), a NYSTAR-sponsored Center for Advanced Technology (CATs) devoted to promoting economic development in the greater Rochester region and New York State. CEIS develops and transfers technology from local universities to industry for commercialization, and by educating the next generation of leaders in the fields of electronic imaging and microelectronics design.

Jonathan Sherwood | University of Rochester
Further information:
http://www.rochester.edu/news/show.php?id=1698

More articles from Information Technology:

nachricht Controlling robots with brainwaves and hand gestures
20.06.2018 | Massachusetts Institute of Technology, CSAIL

nachricht Innovative autonomous system for identifying schools of fish
20.06.2018 | IMDEA Networks Institute

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Temperature-controlled fiber-optic light source with liquid core

In a recent publication in the renowned journal Optica, scientists of Leibniz-Institute of Photonic Technology (Leibniz IPHT) in Jena showed that they can accurately control the optical properties of liquid-core fiber lasers and therefore their spectral band width by temperature and pressure tuning.

Already last year, the researchers provided experimental proof of a new dynamic of hybrid solitons– temporally and spectrally stationary light waves resulting...

Im Focus: Overdosing on Calcium

Nano crystals impact stem cell fate during bone formation

Scientists from the University of Freiburg and the University of Basel identified a master regulator for bone regeneration. Prasad Shastri, Professor of...

Im Focus: AchemAsia 2019 will take place in Shanghai

Moving into its fourth decade, AchemAsia is setting out for new horizons: The International Expo and Innovation Forum for Sustainable Chemical Production will take place from 21-23 May 2019 in Shanghai, China. With an updated event profile, the eleventh edition focusses on topics that are especially relevant for the Chinese process industry, putting a strong emphasis on sustainability and innovation.

Founded in 1989 as a spin-off of ACHEMA to cater to the needs of China’s then developing industry, AchemAsia has since grown into a platform where the latest...

Im Focus: First real-time test of Li-Fi utilization for the industrial Internet of Things

The BMBF-funded OWICELLS project was successfully completed with a final presentation at the BMW plant in Munich. The presentation demonstrated a Li-Fi communication with a mobile robot, while the robot carried out usual production processes (welding, moving and testing parts) in a 5x5m² production cell. The robust, optical wireless transmission is based on spatial diversity; in other words, data is sent and received simultaneously by several LEDs and several photodiodes. The system can transmit data at more than 100 Mbit/s and five milliseconds latency.

Modern production technologies in the automobile industry must become more flexible in order to fulfil individual customer requirements.

Im Focus: Sharp images with flexible fibers

An international team of scientists has discovered a new way to transfer image information through multimodal fibers with almost no distortion - even if the fiber is bent. The results of the study, to which scientist from the Leibniz-Institute of Photonic Technology Jena (Leibniz IPHT) contributed, were published on 6thJune in the highly-cited journal Physical Review Letters.

Endoscopes allow doctors to see into a patient’s body like through a keyhole. Typically, the images are transmitted via a bundle of several hundreds of optical...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

Munich conference on asteroid detection, tracking and defense

13.06.2018 | Event News

2nd International Baltic Earth Conference in Denmark: “The Baltic Sea region in Transition”

08.06.2018 | Event News

ISEKI_Food 2018: Conference with Holistic View of Food Production

05.06.2018 | Event News

 
Latest News

Graphene assembled film shows higher thermal conductivity than graphite film

22.06.2018 | Materials Sciences

Fast rising bedrock below West Antarctica reveals an extremely fluid Earth mantle

22.06.2018 | Earth Sciences

Zebrafish's near 360 degree UV-vision knocks stripes off Google Street View

22.06.2018 | Life Sciences

VideoLinks
Science & Research
Overview of more VideoLinks >>>