Movies portray robots that can move through the world as easily as humans, and use their hands to operate everything from dishwashers to computers with ease. But in reality, the creation of robots with these skills remains a major challenge. Researchers at the University of Massachusetts Amherst are solving this problem by giving a mobile robotic arm the ability to “see” its environment through a digital camera.
“Mobile robots play an important role in many settings, including planetary exploration and manufacturing,” says Dov Katz, a doctoral student of computer science. “Giving them the ability to manipulate objects will extend their use in medical care and household assistance.”
Results of experiments performed by Katz and Oliver Brock, a professor of computer science, were presented at the Proceedings of the International Electrical and Electronics Engineers Conference on Robotics and Automation May 21 in Pasadena, Calif.
So far, the team has successfully taught their creation, dubbed the UMan, or UMass Mobile Manipulator, to approach unfamiliar objects, such as scissors, garden shears and jointed wooden toys – and learn how they work by pushing on them and observing how they change, the same process used by children as they explore the world.
Like a child forming a memory, UMan then stores this knowledge of how the objects move as a “kinematic model” which can be used to perform specific tasks, such as opening scissors and shears to a 90 degree angle. Video shot by the team shows UMan easily completing this task.
According to Katz, teaching the UMan, to “walk” was the easy part. “UMan sits on a base with four wheels that allow it to move in any direction, and a system of lasers keeps it from bumping into objects by judging their distance from the base,” says Katz, who filmed the UMan taking its first trip around the laboratory navigating through a maze of boxes.
The key was giving the UMan eyes in the form of a digital camera that sits on the wrist. Once they added the camera, which coupled manipulating objects with the ability to “see,” the complex computer algorithms needed to instruct the UMan to perform specific tasks became much simpler.
A video shot by the team shows what the UMan “sees” as it approaches a jointed wooden toy on a wooden table, which appears as a uniform field of green dots. The first gentle touch from the hand quickly separates the toy from the background, and moving the various parts eventually labels each section with a specific color, identifying all the moving pieces and the joints holding them together. UMan then stores this knowledge, and can use it to put the object in a specific shape.
Future research by Katz and Brock will focus on teaching UMan to operate different types of machines, including doorknobs and light switches, and work on taking UMan’s manipulation skills into three dimensions.
“Once robots learn to combine movement, perception and the manipulation of objects, they will be able to perform meaningful work in environments that are unstructured and constantly changing,” says Katz. “At that point, we will have robots that can explore new planets and clean houses in a flexible way.”
Dov Katz | newswise
Silicon solar cell of ISFH yields 25% efficiency with passivating POLO contacts
08.12.2016 | Institut für Solarenergieforschung GmbH
Robot on demand: Mobile machining of aircraft components with high precision
06.12.2016 | Fraunhofer IFAM
Physicists of the University of Würzburg have made an astonishing discovery in a specific type of topological insulators. The effect is due to the structure of the materials used. The researchers have now published their work in the journal Science.
Topological insulators are currently the hot topic in physics according to the newspaper Neue Zürcher Zeitung. Only a few weeks ago, their importance was...
In recent years, lasers with ultrashort pulses (USP) down to the femtosecond range have become established on an industrial scale. They could advance some applications with the much-lauded “cold ablation” – if that meant they would then achieve more throughput. A new generation of process engineering that will address this issue in particular will be discussed at the “4th UKP Workshop – Ultrafast Laser Technology” in April 2017.
Even back in the 1990s, scientists were comparing materials processing with nanosecond, picosecond and femtosesecond pulses. The result was surprising:...
Have you ever wondered how you see the world? Vision is about photons of light, which are packets of energy, interacting with the atoms or molecules in what...
A multi-institutional research collaboration has created a novel approach for fabricating three-dimensional micro-optics through the shape-defined formation of porous silicon (PSi), with broad impacts in integrated optoelectronics, imaging, and photovoltaics.
Working with colleagues at Stanford and The Dow Chemical Company, researchers at the University of Illinois at Urbana-Champaign fabricated 3-D birefringent...
In experiments with magnetic atoms conducted at extremely low temperatures, scientists have demonstrated a unique phase of matter: The atoms form a new type of quantum liquid or quantum droplet state. These so called quantum droplets may preserve their form in absence of external confinement because of quantum effects. The joint team of experimental physicists from Innsbruck and theoretical physicists from Hannover report on their findings in the journal Physical Review X.
“Our Quantum droplets are in the gas phase but they still drop like a rock,” explains experimental physicist Francesca Ferlaino when talking about the...
16.11.2016 | Event News
01.11.2016 | Event News
14.10.2016 | Event News
09.12.2016 | Life Sciences
09.12.2016 | Ecology, The Environment and Conservation
09.12.2016 | Health and Medicine