Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:


From picking up a cube to writing with a pen – learning dexterous manipulation skills on real-world robotic systems


MPI-IS in Tübingen is hosting a challenge that aims to advance the state of the art in robotic manipulation and make the field more accessible to a greater number of researchers.

From August 3, researchers around the world are invited to take part in a challenge where each team can run its algorithm on standardized robotic platforms.

The robot hand lifts an object and twists it around.

Max-Planck-Institut für Intelligente Systeme

The tasks range from manipulating a cube to writing with a pen. Participants can advance research, demonstrate that their algorithm works best not only in simulation but also on a real-world task, and win prizes.

On August 3, the Max Planck Institute for Intelligent Systems (MPI-IS) in Tübingen, Germany, will launch the first global real-world robotics manipulation challenge in the cloud.

The robotics challenge aims to democratize research by giving researchers around the globe access to advanced robotic systems. Until now, this access has generally been limited to top academic and industrial labs in the US, Europe, and Japan.

“We hope that this competition will lead to a more inclusive robotic learning community, foster exchange across academic and industry labs, and spark cooperation,” says Stefan Bauer, a research group leader in the Empirical Inference Department at the MPI-IS.

“But we also want to create a benchmark to know what algorithm works best. We can collect much more data than what is possible in individual labs, as we have standardized tasks on a standardized platform.” Manuel Wüthrich, who is also part of the challenge’s organizing team, adds: “Since the robotic systems run around the clock, they generate enough data to actually use deep learning.”

The robotic platform resembles a hand with three fingers. It is surrounded by three cameras that provide images to measure the results. Several identical robotic platforms have been set up around the robotic lab at the MPI-IS in Tübingen to run the learning algorithms the participating teams submit.

Participants can execute their algorithms remotely thanks to a convenient and simple interface. Each team will have a budget of more than 100 real robot hours on one of the high-performing robotic platforms, without any restrictions on the algorithms they execute.

The challenge comprises three stages. First, participants familiarize themselves with the overall setup and aim to solve a task in a physical simulator. Next, they solve simple real-world tasks: specifically, they are required to train the robot to pick up an object and perform in-hand manipulation with a cube. In the final stage, the robot has to pick up a pen and write a short phrase like “I won!”.

To achieve these tasks, participants need to design advanced control or reinforcement learning algorithms. “We want to see the extent to which the teams are able to tune their algorithms to fulfill these very difficult tasks. Using a learning-based algorithm for writing with a pen can probably be considered a breakthrough in robotic manipulation,” says Wüthrich.

“For the first time, we can benchmark all these algorithms on real robots, making them comparable” says Bauer. “Before, this kind of benchmarking was done mainly in simulation. There is no noise or friction, and contacts are simplified, which makes very impressive results in simulation possible. However, these insights do not typically translate to real robots, in particular for tasks that involve contact and complex interactions with the environment.”

Wüthrich adds: “Now, a relatively large number of people who previously didn’t have access to such an advanced robotic platform are able to participate. While some top-notch universities may have extraordinarily good and advanced robots, for most researchers, it is very difficult to gain access to real robotic systems. It is very costly in terms of time and money. Our goal is thus to give a greater number of people access and an opportunity to achieve impressive manipulation results.”

The Real Robotic Challenge will run for 16 weeks. Ultimately, it will help advance the state of the art in dexterous manipulation, which has myriad applications. These include, for instance, construction, cleaning, patient and elder care, agriculture, and product assembly.

Twitter: @robo_challenge #RoboChallenge

Press Contact:
Linda Behringer
Communications Manager at the Max Planck Institute for Intelligent Systems, Germany
+49 151 2300 1111

Weitere Informationen:

Linda Behringer | Max-Planck-Institut für Intelligente Systeme
Further information:

More articles from Information Technology:

nachricht DFKI Installs New NVIDIA DGX A100 System for Accelerating Artificial Intelligence Research
28.07.2020 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI

nachricht Brazilian researchers develop an optical fiber made of gel derived from marine algae
27.07.2020 | Fundação de Amparo à Pesquisa do Estado de São Paulo

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: NYUAD astrophysicist investigates the possibility of life below the surface of Mars

  • A rover expected to explore below the surface of Mars in 2022 has the potential to provide more insights
  • The findings published in Scientific Reports, Springer Nature suggests the presence of traces of water on Mars, raising the question of the possibility of a life-supporting environment

Although no life has been detected on the Martian surface, a new study from astrophysicist and research scientist at the Center for Space Science at NYU Abu...

Im Focus: Manipulating non-magnetic atoms in a chromium halide enables tuning of magnetic properties

New approach creates synthetic layered magnets with unprecedented level of control over their magnetic properties

The magnetic properties of a chromium halide can be tuned by manipulating the non-magnetic atoms in the material, a team, led by Boston College researchers,...

Im Focus: A new method to significantly increase the range and stability of optical tweezers

Scientists of Tomsk Polytechnic University jointly with a team of the V.E. Zuev Institute of Atmospheric Optics of the Siberian Branch of the Russian Academy of Sciences have discovered a method to increase the operation range of optical traps also known

Optical tweezers are a device which uses a laser beam to move micron-sized objects such as living cells, proteins, and molecules. In 2018, the American...

Im Focus: Princeton scientists discover a topological magnet that exhibits exotic quantum effects

Magnet's novel quantum effects extend to room temperature

An international team led by researchers at Princeton University has uncovered a new class of magnet that exhibits novel quantum effects that extend to room...

Im Focus: New 'super light source' should allow fascinating insights into atoms

International team of scientists with Mainz participation proposes plans for high-intensity gamma radiation source at CERN

The ‘Gamma Factory initiative’ – an international team of scientists – is currently exploring a novel research tool: They propose to develop a source of...

All Focus news of the innovation-report >>>



Industry & Economy
Event News

“Conference on Laser Polishing – LaP 2020”: The final touches for surfaces

23.07.2020 | Event News

Conference radar for cybersecurity

21.07.2020 | Event News

Contact Tracing Apps against COVID-19: German National Academy Leopoldina hosts international virtual panel discussion

07.07.2020 | Event News

Latest News

COVID-19 research: Anti-viral strategy with double effect - Possible Achilles’ heel of SARS-CoV-2 virus identified

29.07.2020 | Life Sciences

Model links patterns in sediment to rain, uplift and sea level change

28.07.2020 | Earth Sciences

A new way to target cancers using 'synthetic lethality'

28.07.2020 | Health and Medicine

Science & Research
Overview of more VideoLinks >>>