Without words – what if computers could intuitively understand us
The experimental setting is not entirely unlike the popular children’s party game Topfschlagen (“Hit the Pot!”): one child is blindfolded and has to find a hidden pot by “blindly feeling around”. The other children sit in a circle, calling out “hot” or “cold”, depending on how close the blindfolded child is to the pot.
Dr. Thorsten Zander, postdoc in the research group for Biopsychology and Neuroergonomics led by Prof. Klaus Dr. Gramann at TU Berlin, working in collaboration with Laurens Krol (TU Berlin) and Prof. Dr. Nils Birbaumer (University of Tübingen), conducted an experiment with his participants based on a similar principle: the participants were instructed to watch a computer screen showing a flashing cursor that randomly jumps through a grid of 16 nodes toward a pre-specified target in one of the corners.
Each participant wore a headset with a network of several electrodes. Their brainwaves were captured by a so-called Brain-Computer Interface (BCI) and sent to a special software application to be analyzed and evaluated. The participants were given one single task: watch the cursor as it randomly jumps around.
“The results were spectacular: over time, as the participants simply watched the screen, the cursor found the target more and more quickly. In the first round, it needed 27 jumps on average to reach the objective. But in subsequent rounds, it could do it in 13,” reported Thorsten Zander, a mathematician by training.
The computer “learns” from the participants without requiring them to participate intentionally – or without them necessarily even knowing. The participants’ brains naturally play the role of the children in the party game, unknowingly revealing information to the computer about which movements are “hot” (when the cursor moves toward the target) and which are “cold” (when the cursor moves away from the target).
“We were able to show for the very first time that a passive brain-computer interface is capable of detecting unconscious brain signals, analyzing them, and turning them into an actionable instruction for the computer,” explained Thorsten Zander. These results are now published in the prestigious journal “Proceedings of the National Academy of Sciences” (PNAS).
“The brain activity used by the computer to determine the accuracy of the motion of the cursor is emitted by the medial prefrontal cortex region of the brain. We know from the literature that precisely this area of the brain is where so-called ‘predictive coding’ takes place.” ‘Predictive coding’ describes the brain’s tendency to construct a specific model of its surroundings and continuously make predictions about what will happen next in order to be able to respond adequately. For example, this allows people to anticipate the trajectory of a falling cup within a split second, so that they can catch it before it hits the floor.
“When the participants look at the flashing cursor, which they do not know they can influence, and see that it moves in the ‘hot direction – toward the target, the brain's prediction is confirmed, resulting in a certain ‘peak’ in their brain activity. If the cursor jumps in the ‘cold’ direction, the brain’s prediction is rejected, which creates a different peak,” explained Thorsten Zander. Each of these types of peak is detected by the BCI and converted into motion commands for the cursor by a special algorithm. The algorithm deduces the direction of the target from the brain’s unconscious reactions.
Thorsten Zander’s vision is not just to move cursors reliably across the screen. He is working toward a new type of neuroadaptive technology: “We’ve had computers for around 60 years. In that time, the performance of these computers has grown exponentially, but the interaction between humans and computers remains limited by the bottleneck of communicating human intentions to the machine by pressing keys or moving the mouse.
In this paper, we demonstrated for the first time that, after a suitable calibration phase, passive brain-computer interfaces can do more than simply detect yes/no decisions from our brain activity. They can reconstruct a model of complex thought processes from it and extract various pieces of information, allowing the computer to independently deduce machine instructions without requiring conscious human input.” This opens completely new avenues for interaction: consider for example how computers are already capable of suggesting frequently visited websites. In Thorsten Zander’s vision, the computers of the future might be able to use the current peaks in our brain activity to determine whether we are more likely to go online shopping or look for work.
This also carries serious ethical implications. Because of this and other similar work, a large conference on neuroadaptive technologies will be held in Berlin in July 2017, focusing on the ethical aspects of this technology, among other things.
One interesting question remains unanswered: can participants suppress the unconscious information revealed to the computer by their brain activity via the BCI? “That’s exactly what our next project will attempt to find out. It has just now been approved by the DFG,” says Thorsten Zander.
For further information please contact:
Dr. Thorsten Zander
Biological Psychology and Neuroergonomics
Stefanie Terp | idw - Informationsdienst Wissenschaft
Drones shown to make traffic crash site assessments safer, faster and more accurate
17.01.2019 | Purdue University
Next generation photonic memory devices are light-written, ultrafast and energy efficient
15.01.2019 | Eindhoven University of Technology
The scientific and political community alike stress the importance of German Antarctic research
Joint Press Release from the BMBF and AWI
The Antarctic is a frigid continent south of the Antarctic Circle, where researchers are the only inhabitants. Despite the hostile conditions, here the Alfred...
World first experiments on sensor that may revolutionise everything from medical devices to unmanned vehicles
The new sensor - capable of detecting vibrations of living cells - may revolutionise everything from medical devices to unmanned vehicles.
Dead and alive at the same time? Researchers at the Max Planck Institute of Quantum Optics have implemented Erwin Schrödinger’s paradoxical gedanken experiment employing an entangled atom-light state.
In 1935 Erwin Schrödinger formulated a thought experiment designed to capture the paradoxical nature of quantum physics. The crucial element of this gedanken...
Cellulose obtained from wood has amazing material properties. Empa researchers are now equipping the biodegradable material with additional functionalities to produce implants for cartilage diseases using 3D printing.
It all starts with an ear. Empa researcher Michael Hausmann removes the object shaped like a human ear from the 3D printer and explains:
The phenomenon of so-called superlubricity is known, but so far the explanation at the atomic level has been missing: for example, how does extremely low friction occur in bearings? Researchers from the Fraunhofer Institutes IWM and IWS jointly deciphered a universal mechanism of superlubricity for certain diamond-like carbon layers in combination with organic lubricants. Based on this knowledge, it is now possible to formulate design rules for supra lubricating layer-lubricant combinations. The results are presented in an article in Nature Communications, volume 10.
One of the most important prerequisites for sustainable and environmentally friendly mobility is minimizing friction. Research and industry have been dedicated...
16.01.2019 | Event News
14.01.2019 | Event News
12.12.2018 | Event News
18.01.2019 | Materials Sciences
18.01.2019 | Life Sciences
18.01.2019 | Health and Medicine