From picking up a cube to writing with a pen – learning dexterous manipulation skills on real-world robotic systems

The robot hand lifts an object and twists it around. Max-Planck-Institut für Intelligente Systeme

From August 3, researchers around the world are invited to take part in a challenge where each team can run its algorithm on standardized robotic platforms.

The tasks range from manipulating a cube to writing with a pen. Participants can advance research, demonstrate that their algorithm works best not only in simulation but also on a real-world task, and win prizes.

On August 3, the Max Planck Institute for Intelligent Systems (MPI-IS) in Tübingen, Germany, will launch the first global real-world robotics manipulation challenge in the cloud.

The robotics challenge aims to democratize research by giving researchers around the globe access to advanced robotic systems. Until now, this access has generally been limited to top academic and industrial labs in the US, Europe, and Japan.

“We hope that this competition will lead to a more inclusive robotic learning community, foster exchange across academic and industry labs, and spark cooperation,” says Stefan Bauer, a research group leader in the Empirical Inference Department at the MPI-IS.

“But we also want to create a benchmark to know what algorithm works best. We can collect much more data than what is possible in individual labs, as we have standardized tasks on a standardized platform.” Manuel Wüthrich, who is also part of the challenge’s organizing team, adds: “Since the robotic systems run around the clock, they generate enough data to actually use deep learning.”

The robotic platform resembles a hand with three fingers. It is surrounded by three cameras that provide images to measure the results. Several identical robotic platforms have been set up around the robotic lab at the MPI-IS in Tübingen to run the learning algorithms the participating teams submit.

Participants can execute their algorithms remotely thanks to a convenient and simple interface. Each team will have a budget of more than 100 real robot hours on one of the high-performing robotic platforms, without any restrictions on the algorithms they execute.

The challenge comprises three stages. First, participants familiarize themselves with the overall setup and aim to solve a task in a physical simulator. Next, they solve simple real-world tasks: specifically, they are required to train the robot to pick up an object and perform in-hand manipulation with a cube. In the final stage, the robot has to pick up a pen and write a short phrase like “I won!”.

To achieve these tasks, participants need to design advanced control or reinforcement learning algorithms. “We want to see the extent to which the teams are able to tune their algorithms to fulfill these very difficult tasks. Using a learning-based algorithm for writing with a pen can probably be considered a breakthrough in robotic manipulation,” says Wüthrich.

“For the first time, we can benchmark all these algorithms on real robots, making them comparable” says Bauer. “Before, this kind of benchmarking was done mainly in simulation. There is no noise or friction, and contacts are simplified, which makes very impressive results in simulation possible. However, these insights do not typically translate to real robots, in particular for tasks that involve contact and complex interactions with the environment.”

Wüthrich adds: “Now, a relatively large number of people who previously didn’t have access to such an advanced robotic platform are able to participate. While some top-notch universities may have extraordinarily good and advanced robots, for most researchers, it is very difficult to gain access to real robotic systems. It is very costly in terms of time and money. Our goal is thus to give a greater number of people access and an opportunity to achieve impressive manipulation results.”

The Real Robotic Challenge will run for 16 weeks. Ultimately, it will help advance the state of the art in dexterous manipulation, which has myriad applications. These include, for instance, construction, cleaning, patient and elder care, agriculture, and product assembly.

Twitter: @robo_challenge #RoboChallenge…

Press Contact:
Linda Behringer
Communications Manager at the Max Planck Institute for Intelligent Systems, Germany
+49 151 2300 1111

Media Contact

Linda Behringer Max-Planck-Institut für Intelligente Systeme

Alle Nachrichten aus der Kategorie: Information Technology

Here you can find a summary of innovations in the fields of information and data processing and up-to-date developments on IT equipment and hardware.

This area covers topics such as IT services, IT architectures, IT management and telecommunications.

Zurück zur Startseite

Kommentare (0)

Schreib Kommentar

Neueste Beiträge

Who stole the light?

Self-induced ultrafast demagnetization limits the amount of light diffracted from magnetic samples at soft x-ray energies. Free electron X-ray lasers deliver intense ultrashort pulses of x-rays, which can be used…

Could breadfruit be the next superfood?

UBC researchers say yes Breadfruit is sustainable, environmentally friendly and a high-production crop. A fruit used for centuries in countries around the world is getting the nutritional thumbs-up from a…

New calculation refines comparison of matter with antimatter

Theorists publish improved prediction for the tiny difference in kaon decays observed by experiments. -An international collaboration of theoretical physicists–including scientists from the U.S. Department of Energy’s (DOE) Brookhaven National…

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.