TUM technology endows brain-controlled exoskeleton with sense of touch
According to researchers in the Walk Again Project, all systems are go for a bold demonstration of neuroscience and cognitive technology in action: On June 12, during the opening of the FIFA 2014 World Cup in Brazil, a paralyzed person wearing a brain-controlled robotic exoskeleton is expected to make the first kick of the football championship.
The Walk Again Project is an international collaboration of more than one hundred scientists, led by Prof. Miguel Nicolelis of Duke University and the International Institute for Neurosciences of Natal, Brazil. Prof. Gordon Cheng, head of the Institute for Cognitive Systems at the Technische Universität München (TUM), is a leading partner.
Eight Brazilian patients, men and women between 20 and 40 years of age who are paralyzed from the waist down, have been training for months to use the exoskeleton. The system works by recording electrical activity in the patient's brain, recognizing his or her intention – such as to take a step or kick a ball – and translating that to action. It also gives the patient tactile feedback using sensitive artificial skin created by Cheng's institute.
The feeling of touching the ground
Inspiration for this so-called CellulARSkin technology – as well as for the Walk Again Project itself – came from a 2008 collaboration. As Cheng sums up that complex and widely reported experiment, "Miguel set up a monkey walking on a treadmill in North Carolina, and then I made my humanoid robot walk with the signal in Kyoto." It was a short step for the researchers to envision a paralyzed person walking with the help of a robotic exoskeleton that could be guided by mental activity alone.
"Our brains are very adaptive in the way that we can extend our embodiment to use tools," Cheng says, "as in driving a car or eating with chopsticks. After the Kyoto experiment, we felt certain that the brain could also liberate a paralyzed person to walk using an external body." It was clear that technical advances would be required to allow a relatively compact, lightweight exoskeleton to be assembled, and that visual feedback would not be enough. A sense of touch would be essential for the patient's emotional comfort as well as control over the exoskeleton. Thus the challenge was to give a paralyzed person, together with the ability to walk, the feeling of touching the ground.
A versatile solution
Upon joining TUM in 2010, Cheng made it a research priority for his institute to improve on the state of the art in tactile sensing for robotic systems. The result, CellulARSkin, provides a framework for a robust and self-organizing surface sensor network. It can be implemented using standard off-the-shelf hardware and thus will benefit from future improvements in miniaturization, performance, and cost.
The basic unit is a flat, six-sided package of electronic components including a low-power-consumption microprocessor as well as sensors that detect pre-touch proximity, pressure, vibration, temperature, and even movement in three-dimensional space. Any number of these individual "cells" can be networked together in a honeycomb pattern, protected in the current prototype by a rubbery skin of molded elastomer.
"It's not just the sensor that's important," Cheng says. "The intelligence of the sensor is even more important." Cooperation among the networked cells, and between the network and a central system, allows CellulARSkin to configure itself for each specific application and to recover automatically from certain kinds of damage. These capabilities offer advantages in enabling smarter, safer interaction of machines with people, and in rapid setup of industrial robots – as is being pursued in the EU-sponsored project "Factory in a Day."
In the Walk Again Project, CellulARSkin is being used in two ways. Integrated with the exoskeleton, for example on the bottoms of the feet, the artificial skin sends signals to tiny motors that vibrate against the patient's arms. Through training with this kind of indirect sensory feedback, a patient can learn to incorporate the robotic legs and feet into his or her own body schema. CellulARSkin is also being wrapped around parts of the patient's own body to help the medical team monitor for any signs of distress or discomfort.
A milestone, but "just the beginning"
"I think some people see the World Cup opening as the end," Cheng says, "but it's really just the beginning. This may be a major milestone, but we have a lot more work to do." He views the event as a public demonstration of what science can do for people. "Also, I see it as a great tribute to all the patients' hard work and their bravery!"
Prof. Gordon Cheng
Institute for Cognitive Systems
Technische Universität München
Tel: +49 89 289 26800
Prof. Gordon Cheng | Technische Universität München
Flexible OLED applications arrive
28.06.2016 | Fraunhofer-Institut für Organische Elektronik, Elektronenstrahl- und Plasmatechnik FEP
Energy from Sunlight: Further Steps towards Artificial Photosynthesis
24.06.2016 | Universität Basel
R2D2, a joint project to analyze and development high-TRL processes and technologies for manufacture of flexible organic light-emitting diodes (OLEDs) funded by the German Federal Ministry of Education and Research (BMBF) has been successfully completed.
In contrast to point light sources like LEDs made of inorganic semiconductor crystals, organic light-emitting diodes (OLEDs) are light-emitting surfaces. Their...
High resolution rotational spectroscopy reveals an unprecedented number of conformations of an odorant molecule – a new world record!
In a recent publication in the journal Physical Chemistry Chemical Physics, researchers from the Max Planck Institute for the Structure and Dynamics of Matter...
Strands of cow cartilage substitute for ink in a 3D bioprinting process that may one day create cartilage patches for worn out joints, according to a team of engineers. "Our goal is to create tissue that can be used to replace large amounts of worn out tissue or design patches," said Ibrahim T. Ozbolat, associate professor of engineering science and mechanics. "Those who have osteoarthritis in their joints suffer a lot. We need a new alternative treatment for this."
Cartilage is a good tissue to target for scale-up bioprinting because it is made up of only one cell type and has no blood vessels within the tissue. It is...
Physicists in Innsbruck have realized the first quantum simulation of lattice gauge theories, building a bridge between high-energy theory and atomic physics. In the journal Nature, Rainer Blatt‘s and Peter Zoller’s research teams describe how they simulated the creation of elementary particle pairs out of the vacuum by using a quantum computer.
Elementary particles are the fundamental buildings blocks of matter, and their properties are described by the Standard Model of particle physics. The...
A year and a half on the outer wall of the International Space Station ISS in altitude of 400 kilometers is a real challenge. Whether a primordial bacterium...
09.06.2016 | Event News
24.05.2016 | Event News
20.05.2016 | Event News
28.06.2016 | Physics and Astronomy
28.06.2016 | Earth Sciences
28.06.2016 | Earth Sciences