Fraunhofer IPA presents new technologies for 3D environment perception and object recognition
Warehouse robots capable of sorting chaotically delivered parts; domestic assistance robots able to distinguish between graspable objects and living areas; cleaning robots that detect and remove dirt: the systems developed at Fraunhofer IPA for three-dimensional object recognition and environment sensing allow robots to accomplish even complex tasks.
3D object recognition in variable light conditions or when partially hidden.
Image credit: Fraunhofer IPA
At Automatica 2014, Fraunhofer IPA will present innovative technologies for image processing and collision-free manipulation in a dynamic environment.
Accurate, fast, flexible and easy to operate for the user: these are the key criteria for real-world 3D image-processing solutions for robot systems. Fraunhofer IPA has developed a diverse and versatile software library for automatic object recognition and teach-in as well as for three-dimensional environment sensing.
At Automatica 2014, Fraunhofer IPA will demonstrate not only how a robot system can execute collision-free motions, including in a dynamic environment, but also how it can reliably recognize, classify and grasp objects.
Recognition and classification of textured and textureless objects
To reliably manipulate objects in a dynamic everyday environment, a robot system must be capable of recognizing and localizing the objects. The image processing searches selectively for feature points, which are assembled into a model and stored. This makes it possible for objects to be recognized also in variable light conditions or when partially hidden. And that’s not all the 3D object recognition system can do: the combination of geometrical shapes also allows it to determine the class or category of an object.
For example, the robot “knows” that a table is made up of a horizontal panel on top of four vertical cylinders, that a bottle is an oblong cylinder, a milk carton is a rectangular solid and a dish is a hemisphere. “Thanks to the combination of object recognition and classification, the robot can independently ‘learn’, or be intuitively taught to identify, specific objects or general object classes,” explains Jan Fischer, research assistant in the Robot and Assistance Systems department.
“Also in a variable environment, it is capable of reliably recognizing objects – in under a second.” The exhibit at Automatica 2014 will demonstrate the fast and reliable recognition of any object in an undefined environment.
To generate a 3D map, the robot senses its environment three-dimensionally using a combination of colour camera and depth camera, which produces a point cloud with accurately assigned distance values. The point clouds, which are recorded at different times, must first be registered in a common coordinate system. Next, the point data are segmented into geometric primitives, such as polygons.
This makes it possible for the relevant regions and objects to be reliably identified in real-time. In addition to collision-free navigation and manipulation, this also allows the option of remote control by a human operator, who can make sense of the communicated data more quickly. “We have many years of experience in this area and can offer a versatile technology capable of being tailored to suit different requirements and applications,” says Georg Arbeiter, project manager in the Robot and Assistance Systems department.
The exhibit at Automatica 2014 will demonstrate collision-free manipulation in a dynamic environment. Workpieces are moved alternately by two robot arms, the second arm in each case representing a dynamic obstacle. The methods developed by Fraunhofer IPA use camera data to generate an environment model that is used as an input for planning the motion of a robot arm. Both moving obstacles and graspable objects can be identified. This makes the method suitable for applications requiring fast and flexible reactions to changes in environment.
Learnable 3D object recognition and environment sensing can be used in a variety of areas and have been successfully implemented by Fraunhofer IPA in a wide range of different applications:
-in an industrial setting for autonomous driverless transport systems or for handling, warehousing and sorting operations;
-as a key technology for developing advanced assistance robots designed to provide a higher quality of life to people who are in need of assistance;
-to support growing automation in agriculture, e.g. to detect when fruit and vegetables are ready for picking or to enable milking robots to identify and localize cows’ udders;
-to enable cleaning robots to automatically detect dirt.
Dipl.-Ing. Georg Arbeiter, email@example.com, phone +49 711 970-1299
Richard Bormann M.Sc., firstname.lastname@example.org, phone +49 711 970-1062
Dipl.-Inf. Jan Fischer, email@example.com, phone +49 711 970-1191
More at Automatica – 6th International Trade Fair for Automation and Mechatronics
3 to 6 June 2014
New Trade Fair Centre Munich
Hall A4 | Stand 530
Jörg Walz | Fraunhofer-Institut
Siemens solutions support diagnosis and treatment of cardiovascular diseases
31.08.2015 | Siemens AG
Fraunhofer IBMT presents Ultrasound Technology and Mobile Lab Technologies at IAA 2015
26.08.2015 | Fraunhofer-Institut für Biomedizinische Technik IBMT
China's Loess Plateau was formed by wind alternately depositing dust or removing dust over the last 2.6 million years, according to a new report from University of Arizona geoscientists. The study is the first to explain how the steep-fronted plateau formed.
China's Loess Plateau was formed by wind alternately depositing dust or removing dust over the last 2.6 million years, according to a new report from...
The leaves of the lotus flower, and other natural surfaces that repel water and dirt, have been the model for many types of engineered liquid-repelling surfaces. As slippery as these surfaces are, however, tiny water droplets still stick to them. Now, Penn State researchers have developed nano/micro-textured, highly slippery surfaces able to outperform these naturally inspired coatings, particularly when the water is a vapor or tiny droplets.
Enhancing the mobility of liquid droplets on rough surfaces could improve condensation heat transfer for power-plant heat exchangers, create more efficient...
Longer, more severe, and hotter droughts and a myriad of other threats, including diseases and more extensive and severe wildfires, are threatening to transform some of the world's temperate forests, a new study published in Science has found. Without informed management, some forests could convert to shrublands or grasslands within the coming decades.
"While we have been trying to manage for resilience of 20th century conditions, we realize now that we must prepare for transformations and attempt to ease...
A University of Oklahoma astrophysicist and his Chinese collaborator have found two supermassive black holes in Markarian 231, the nearest quasar to Earth, using observations from NASA's Hubble Space Telescope.
The discovery of two supermassive black holes--one larger one and a second, smaller one--are evidence of a binary black hole and suggests that supermassive...
A team of European researchers have developed a model to simulate the impact of tsunamis generated by earthquakes and applied it to the Eastern Mediterranean. The results show how tsunami waves could hit and inundate coastal areas in southern Italy and Greece. The study is published today (27 August) in Ocean Science, an open access journal of the European Geosciences Union (EGU).
Though not as frequent as in the Pacific and Indian oceans, tsunamis also occur in the Mediterranean, mainly due to earthquakes generated when the African...
20.08.2015 | Event News
20.08.2015 | Event News
19.08.2015 | Event News
02.09.2015 | Earth Sciences
02.09.2015 | Studies and Analyses
01.09.2015 | Press release