Movies portray robots that can move through the world as easily as humans, and use their hands to operate everything from dishwashers to computers with ease. But in reality, the creation of robots with these skills remains a major challenge. Researchers at the University of Massachusetts Amherst are solving this problem by giving a mobile robotic arm the ability to “see” its environment through a digital camera.
“Mobile robots play an important role in many settings, including planetary exploration and manufacturing,” says Dov Katz, a doctoral student of computer science. “Giving them the ability to manipulate objects will extend their use in medical care and household assistance.”
Results of experiments performed by Katz and Oliver Brock, a professor of computer science, were presented at the Proceedings of the International Electrical and Electronics Engineers Conference on Robotics and Automation May 21 in Pasadena, Calif.
So far, the team has successfully taught their creation, dubbed the UMan, or UMass Mobile Manipulator, to approach unfamiliar objects, such as scissors, garden shears and jointed wooden toys – and learn how they work by pushing on them and observing how they change, the same process used by children as they explore the world.
Like a child forming a memory, UMan then stores this knowledge of how the objects move as a “kinematic model” which can be used to perform specific tasks, such as opening scissors and shears to a 90 degree angle. Video shot by the team shows UMan easily completing this task.
According to Katz, teaching the UMan, to “walk” was the easy part. “UMan sits on a base with four wheels that allow it to move in any direction, and a system of lasers keeps it from bumping into objects by judging their distance from the base,” says Katz, who filmed the UMan taking its first trip around the laboratory navigating through a maze of boxes.
The key was giving the UMan eyes in the form of a digital camera that sits on the wrist. Once they added the camera, which coupled manipulating objects with the ability to “see,” the complex computer algorithms needed to instruct the UMan to perform specific tasks became much simpler.
A video shot by the team shows what the UMan “sees” as it approaches a jointed wooden toy on a wooden table, which appears as a uniform field of green dots. The first gentle touch from the hand quickly separates the toy from the background, and moving the various parts eventually labels each section with a specific color, identifying all the moving pieces and the joints holding them together. UMan then stores this knowledge, and can use it to put the object in a specific shape.
Future research by Katz and Brock will focus on teaching UMan to operate different types of machines, including doorknobs and light switches, and work on taking UMan’s manipulation skills into three dimensions.
“Once robots learn to combine movement, perception and the manipulation of objects, they will be able to perform meaningful work in environments that are unstructured and constantly changing,” says Katz. “At that point, we will have robots that can explore new planets and clean houses in a flexible way.”
Dov Katz | newswise
Failures in power grids: Dynamically induced cascades
25.05.2018 | Technische Universität Dresden
Beyond the limits of conventional electronics: stable organic molecular nanowires
24.05.2018 | Tokyo Institute of Technology
The more electronics steer, accelerate and brake cars, the more important it is to protect them against cyber-attacks. That is why 15 partners from industry and academia will work together over the next three years on new approaches to IT security in self-driving cars. The joint project goes by the name Security For Connected, Autonomous Cars (SecForCARs) and has funding of €7.2 million from the German Federal Ministry of Education and Research. Infineon is leading the project.
Vehicles already offer diverse communication interfaces and more and more automated functions, such as distance and lane-keeping assist systems. At the same...
A research team led by physicists at the Technical University of Munich (TUM) has developed molecular nanoswitches that can be toggled between two structurally different states using an applied voltage. They can serve as the basis for a pioneering class of devices that could replace silicon-based components with organic molecules.
The development of new electronic technologies drives the incessant reduction of functional component sizes. In the context of an international collaborative...
At the LASYS 2018, from June 5th to 7th, the Laser Zentrum Hannover e.V. (LZH) will be showcasing processes for the laser material processing of tomorrow in hall 4 at stand 4E75. With blown bomb shells the LZH will present first results of a research project on civil security.
At this year's LASYS, the LZH will exhibit light-based processes such as cutting, welding, ablation and structuring as well as additive manufacturing for...
There are videos on the internet that can make one marvel at technology. For example, a smartphone is casually bent around the arm or a thin-film display is rolled in all directions and with almost every diameter. From the user's point of view, this looks fantastic. From a professional point of view, however, the question arises: Is that already possible?
At Display Week 2018, scientists from the Fraunhofer Institute for Applied Polymer Research IAP will be demonstrating today’s technological possibilities and...
So-called quantum many-body scars allow quantum systems to stay out of equilibrium much longer, explaining experiment | Study published in Nature Physics
Recently, researchers from Harvard and MIT succeeded in trapping a record 53 atoms and individually controlling their quantum state, realizing what is called a...
25.05.2018 | Event News
02.05.2018 | Event News
13.04.2018 | Event News
25.05.2018 | Event News
25.05.2018 | Machine Engineering
25.05.2018 | Life Sciences