Without words – what if computers could intuitively understand us
The experimental setting is not entirely unlike the popular children’s party game Topfschlagen (“Hit the Pot!”): one child is blindfolded and has to find a hidden pot by “blindly feeling around”. The other children sit in a circle, calling out “hot” or “cold”, depending on how close the blindfolded child is to the pot.
Dr. Thorsten Zander, postdoc in the research group for Biopsychology and Neuroergonomics led by Prof. Klaus Dr. Gramann at TU Berlin, working in collaboration with Laurens Krol (TU Berlin) and Prof. Dr. Nils Birbaumer (University of Tübingen), conducted an experiment with his participants based on a similar principle: the participants were instructed to watch a computer screen showing a flashing cursor that randomly jumps through a grid of 16 nodes toward a pre-specified target in one of the corners.
Each participant wore a headset with a network of several electrodes. Their brainwaves were captured by a so-called Brain-Computer Interface (BCI) and sent to a special software application to be analyzed and evaluated. The participants were given one single task: watch the cursor as it randomly jumps around.
“The results were spectacular: over time, as the participants simply watched the screen, the cursor found the target more and more quickly. In the first round, it needed 27 jumps on average to reach the objective. But in subsequent rounds, it could do it in 13,” reported Thorsten Zander, a mathematician by training.
The computer “learns” from the participants without requiring them to participate intentionally – or without them necessarily even knowing. The participants’ brains naturally play the role of the children in the party game, unknowingly revealing information to the computer about which movements are “hot” (when the cursor moves toward the target) and which are “cold” (when the cursor moves away from the target).
“We were able to show for the very first time that a passive brain-computer interface is capable of detecting unconscious brain signals, analyzing them, and turning them into an actionable instruction for the computer,” explained Thorsten Zander. These results are now published in the prestigious journal “Proceedings of the National Academy of Sciences” (PNAS).
“The brain activity used by the computer to determine the accuracy of the motion of the cursor is emitted by the medial prefrontal cortex region of the brain. We know from the literature that precisely this area of the brain is where so-called ‘predictive coding’ takes place.” ‘Predictive coding’ describes the brain’s tendency to construct a specific model of its surroundings and continuously make predictions about what will happen next in order to be able to respond adequately. For example, this allows people to anticipate the trajectory of a falling cup within a split second, so that they can catch it before it hits the floor.
“When the participants look at the flashing cursor, which they do not know they can influence, and see that it moves in the ‘hot direction – toward the target, the brain's prediction is confirmed, resulting in a certain ‘peak’ in their brain activity. If the cursor jumps in the ‘cold’ direction, the brain’s prediction is rejected, which creates a different peak,” explained Thorsten Zander. Each of these types of peak is detected by the BCI and converted into motion commands for the cursor by a special algorithm. The algorithm deduces the direction of the target from the brain’s unconscious reactions.
Thorsten Zander’s vision is not just to move cursors reliably across the screen. He is working toward a new type of neuroadaptive technology: “We’ve had computers for around 60 years. In that time, the performance of these computers has grown exponentially, but the interaction between humans and computers remains limited by the bottleneck of communicating human intentions to the machine by pressing keys or moving the mouse.
In this paper, we demonstrated for the first time that, after a suitable calibration phase, passive brain-computer interfaces can do more than simply detect yes/no decisions from our brain activity. They can reconstruct a model of complex thought processes from it and extract various pieces of information, allowing the computer to independently deduce machine instructions without requiring conscious human input.” This opens completely new avenues for interaction: consider for example how computers are already capable of suggesting frequently visited websites. In Thorsten Zander’s vision, the computers of the future might be able to use the current peaks in our brain activity to determine whether we are more likely to go online shopping or look for work.
This also carries serious ethical implications. Because of this and other similar work, a large conference on neuroadaptive technologies will be held in Berlin in July 2017, focusing on the ethical aspects of this technology, among other things.
One interesting question remains unanswered: can participants suppress the unconscious information revealed to the computer by their brain activity via the BCI? “That’s exactly what our next project will attempt to find out. It has just now been approved by the DFG,” says Thorsten Zander.
For further information please contact:
Dr. Thorsten Zander
Biological Psychology and Neuroergonomics
Stefanie Terp | idw - Informationsdienst Wissenschaft
NASA CubeSat to test miniaturized weather satellite technology
10.11.2017 | NASA/Goddard Space Flight Center
New approach uses light instead of robots to assemble electronic components
08.11.2017 | The Optical Society
The WHO reports an estimated 429,000 malaria deaths each year. The disease mostly affects tropical and subtropical regions and in particular the African continent. The Fraunhofer Institute for Silicate Research ISC teamed up with the Fraunhofer Institute for Molecular Biology and Applied Ecology IME and the Institute of Tropical Medicine at the University of Tübingen for a new test method to detect malaria parasites in blood. The idea of the research project “NanoFRET” is to develop a highly sensitive and reliable rapid diagnostic test so that patient treatment can begin as early as possible.
Malaria is caused by parasites transmitted by mosquito bite. The most dangerous form of malaria is malaria tropica. Left untreated, it is fatal in most cases....
The formation of stars in distant galaxies is still largely unexplored. For the first time, astron-omers at the University of Geneva have now been able to closely observe a star system six billion light-years away. In doing so, they are confirming earlier simulations made by the University of Zurich. One special effect is made possible by the multiple reflections of images that run through the cosmos like a snake.
Today, astronomers have a pretty accurate idea of how stars were formed in the recent cosmic past. But do these laws also apply to older galaxies? For around a...
Just because someone is smart and well-motivated doesn't mean he or she can learn the visual skills needed to excel at tasks like matching fingerprints, interpreting medical X-rays, keeping track of aircraft on radar displays or forensic face matching.
That is the implication of a new study which shows for the first time that there is a broad range of differences in people's visual ability and that these...
Computer Tomography (CT) is a standard procedure in hospitals, but so far, the technology has not been suitable for imaging extremely small objects. In PNAS, a team from the Technical University of Munich (TUM) describes a Nano-CT device that creates three-dimensional x-ray images at resolutions up to 100 nanometers. The first test application: Together with colleagues from the University of Kassel and Helmholtz-Zentrum Geesthacht the researchers analyzed the locomotory system of a velvet worm.
During a CT analysis, the object under investigation is x-rayed and a detector measures the respective amount of radiation absorbed from various angles....
The quantum world is fragile; error correction codes are needed to protect the information stored in a quantum object from the deteriorating effects of noise. Quantum physicists in Innsbruck have developed a protocol to pass quantum information between differently encoded building blocks of a future quantum computer, such as processors and memories. Scientists may use this protocol in the future to build a data bus for quantum computers. The researchers have published their work in the journal Nature Communications.
Future quantum computers will be able to solve problems where conventional computers fail today. We are still far away from any large-scale implementation,...
15.11.2017 | Event News
15.11.2017 | Event News
30.10.2017 | Event News
22.11.2017 | Medical Engineering
22.11.2017 | Materials Sciences
22.11.2017 | Health and Medicine