Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Innovative image processing for service robots

17.03.2014

Fraunhofer IPA presents new technologies for 3D environment perception and object recognition

Warehouse robots capable of sorting chaotically delivered parts; domestic assistance robots able to distinguish between graspable objects and living areas; cleaning robots that detect and remove dirt: the systems developed at Fraunhofer IPA for three-dimensional object recognition and environment sensing allow robots to accomplish even complex tasks.


3D object recognition in variable light conditions or when partially hidden.

Image credit: Fraunhofer IPA


3D environment perception: The initial situation (left) is segmented into homogeneous areas (centre). Then the surface properties are determined (right) (e. g. green cylinder).

Image credit: Fraunhofer IPA

At Automatica 2014, Fraunhofer IPA will present innovative technologies for image processing and collision-free manipulation in a dynamic environment.

Accurate, fast, flexible and easy to operate for the user: these are the key criteria for real-world 3D image-processing solutions for robot systems. Fraunhofer IPA has developed a diverse and versatile software library for automatic object recognition and teach-in as well as for three-dimensional environment sensing.

At Automatica 2014, Fraunhofer IPA will demonstrate not only how a robot system can execute collision-free motions, including in a dynamic environment, but also how it can reliably recognize, classify and grasp objects.

Recognition and classification of textured and textureless objects

To reliably manipulate objects in a dynamic everyday environment, a robot system must be capable of recognizing and localizing the objects. The image processing searches selectively for feature points, which are assembled into a model and stored. This makes it possible for objects to be recognized also in variable light conditions or when partially hidden. And that’s not all the 3D object recognition system can do: the combination of geometrical shapes also allows it to determine the class or category of an object.

For example, the robot “knows” that a table is made up of a horizontal panel on top of four vertical cylinders, that a bottle is an oblong cylinder, a milk carton is a rectangular solid and a dish is a hemisphere. “Thanks to the combination of object recognition and classification, the robot can independently ‘learn’, or be intuitively taught to identify, specific objects or general object classes,” explains Jan Fischer, research assistant in the Robot and Assistance Systems department.

“Also in a variable environment, it is capable of reliably recognizing objects – in under a second.” The exhibit at Automatica 2014 will demonstrate the fast and reliable recognition of any object in an undefined environment.

Environment perception

To generate a 3D map, the robot senses its environment three-dimensionally using a combination of colour camera and depth camera, which produces a point cloud with accurately assigned distance values. The point clouds, which are recorded at different times, must first be registered in a common coordinate system. Next, the point data are segmented into geometric primitives, such as polygons.

This makes it possible for the relevant regions and objects to be reliably identified in real-time. In addition to collision-free navigation and manipulation, this also allows the option of remote control by a human operator, who can make sense of the communicated data more quickly. “We have many years of experience in this area and can offer a versatile technology capable of being tailored to suit different requirements and applications,” says Georg Arbeiter, project manager in the Robot and Assistance Systems department.

The exhibit at Automatica 2014 will demonstrate collision-free manipulation in a dynamic environment. Workpieces are moved alternately by two robot arms, the second arm in each case representing a dynamic obstacle. The methods developed by Fraunhofer IPA use camera data to generate an environment model that is used as an input for planning the motion of a robot arm. Both moving obstacles and graspable objects can be identified. This makes the method suitable for applications requiring fast and flexible reactions to changes in environment.

Applications

Learnable 3D object recognition and environment sensing can be used in a variety of areas and have been successfully implemented by Fraunhofer IPA in a wide range of different applications:
-in an industrial setting for autonomous driverless transport systems or for handling, warehousing and sorting operations;
-as a key technology for developing advanced assistance robots designed to provide a higher quality of life to people who are in need of assistance;
-to support growing automation in agriculture, e.g. to detect when fruit and vegetables are ready for picking or to enable milking robots to identify and localize cows’ udders;
-to enable cleaning robots to automatically detect dirt.

Contact
Dipl.-Ing. Georg Arbeiter, georg.arbeiter@ipa.fraunhofer.de, phone +49 711 970-1299
Richard Bormann M.Sc., richard.bormann@ipa.fraunhofer.de, phone +49 711 970-1062
Dipl.-Inf. Jan Fischer, jan.fischer@ipa.fraunhofer.de, phone +49 711 970-1191

More at Automatica – 6th International Trade Fair for Automation and Mechatronics
3 to 6 June 2014
New Trade Fair Centre Munich
Hall A4 | Stand 530
www.automatica-munich.com

Weitere Informationen:

http://www.ipa.fraunhofer.de/6D-Objekterkennung.520.0.html?&L=2http://www.ip...

Jörg Walz | Fraunhofer-Institut

Further reports about: Automatisierung IPA Produktionstechnik Trade classification identify processing sensing sorting

More articles from Trade Fair News:

nachricht SYSTEMS INTEGRATION 2018 in Switzerland focuses on building blocks for industrial digitalization
20.11.2017 | IVAM Fachverband für Mikrotechnik

nachricht Medica 2017: New software enables early diagnosis of arteriosclerosis
06.11.2017 | Technische Universität Kaiserslautern

All articles from Trade Fair News >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Frictional Heat Powers Hydrothermal Activity on Enceladus

Computer simulation shows how the icy moon heats water in a porous rock core

Heat from the friction of rocks caused by tidal forces could be the “engine” for the hydrothermal activity on Saturn's moon Enceladus. This presupposes that...

Im Focus: Nanoparticles help with malaria diagnosis – new rapid test in development

The WHO reports an estimated 429,000 malaria deaths each year. The disease mostly affects tropical and subtropical regions and in particular the African continent. The Fraunhofer Institute for Silicate Research ISC teamed up with the Fraunhofer Institute for Molecular Biology and Applied Ecology IME and the Institute of Tropical Medicine at the University of Tübingen for a new test method to detect malaria parasites in blood. The idea of the research project “NanoFRET” is to develop a highly sensitive and reliable rapid diagnostic test so that patient treatment can begin as early as possible.

Malaria is caused by parasites transmitted by mosquito bite. The most dangerous form of malaria is malaria tropica. Left untreated, it is fatal in most cases....

Im Focus: A “cosmic snake” reveals the structure of remote galaxies

The formation of stars in distant galaxies is still largely unexplored. For the first time, astron-omers at the University of Geneva have now been able to closely observe a star system six billion light-years away. In doing so, they are confirming earlier simulations made by the University of Zurich. One special effect is made possible by the multiple reflections of images that run through the cosmos like a snake.

Today, astronomers have a pretty accurate idea of how stars were formed in the recent cosmic past. But do these laws also apply to older galaxies? For around a...

Im Focus: Visual intelligence is not the same as IQ

Just because someone is smart and well-motivated doesn't mean he or she can learn the visual skills needed to excel at tasks like matching fingerprints, interpreting medical X-rays, keeping track of aircraft on radar displays or forensic face matching.

That is the implication of a new study which shows for the first time that there is a broad range of differences in people's visual ability and that these...

Im Focus: Novel Nano-CT device creates high-resolution 3D-X-rays of tiny velvet worm legs

Computer Tomography (CT) is a standard procedure in hospitals, but so far, the technology has not been suitable for imaging extremely small objects. In PNAS, a team from the Technical University of Munich (TUM) describes a Nano-CT device that creates three-dimensional x-ray images at resolutions up to 100 nanometers. The first test application: Together with colleagues from the University of Kassel and Helmholtz-Zentrum Geesthacht the researchers analyzed the locomotory system of a velvet worm.

During a CT analysis, the object under investigation is x-rayed and a detector measures the respective amount of radiation absorbed from various angles....

All Focus news of the innovation-report >>>

Anzeige

Anzeige

Event News

Ecology Across Borders: International conference brings together 1,500 ecologists

15.11.2017 | Event News

Road into laboratory: Users discuss biaxial fatigue-testing for car and truck wheel

15.11.2017 | Event News

#Berlin5GWeek: The right network for Industry 4.0

30.10.2017 | Event News

 
Latest News

Desert ants cannot be fooled

23.11.2017 | Life Sciences

By saving cost and energy, the lighting revolution may increase light pollution

23.11.2017 | Earth Sciences

Retreating permafrost coasts threaten the fragile Arctic environment

23.11.2017 | Earth Sciences

VideoLinks
B2B-VideoLinks
More VideoLinks >>>