Without words – what if computers could intuitively understand us
The experimental setting is not entirely unlike the popular children’s party game Topfschlagen (“Hit the Pot!”): one child is blindfolded and has to find a hidden pot by “blindly feeling around”. The other children sit in a circle, calling out “hot” or “cold”, depending on how close the blindfolded child is to the pot.
Dr. Thorsten Zander, postdoc in the research group for Biopsychology and Neuroergonomics led by Prof. Klaus Dr. Gramann at TU Berlin, working in collaboration with Laurens Krol (TU Berlin) and Prof. Dr. Nils Birbaumer (University of Tübingen), conducted an experiment with his participants based on a similar principle: the participants were instructed to watch a computer screen showing a flashing cursor that randomly jumps through a grid of 16 nodes toward a pre-specified target in one of the corners.
Each participant wore a headset with a network of several electrodes. Their brainwaves were captured by a so-called Brain-Computer Interface (BCI) and sent to a special software application to be analyzed and evaluated. The participants were given one single task: watch the cursor as it randomly jumps around.
“The results were spectacular: over time, as the participants simply watched the screen, the cursor found the target more and more quickly. In the first round, it needed 27 jumps on average to reach the objective. But in subsequent rounds, it could do it in 13,” reported Thorsten Zander, a mathematician by training.
The computer “learns” from the participants without requiring them to participate intentionally – or without them necessarily even knowing. The participants’ brains naturally play the role of the children in the party game, unknowingly revealing information to the computer about which movements are “hot” (when the cursor moves toward the target) and which are “cold” (when the cursor moves away from the target).
“We were able to show for the very first time that a passive brain-computer interface is capable of detecting unconscious brain signals, analyzing them, and turning them into an actionable instruction for the computer,” explained Thorsten Zander. These results are now published in the prestigious journal “Proceedings of the National Academy of Sciences” (PNAS).
“The brain activity used by the computer to determine the accuracy of the motion of the cursor is emitted by the medial prefrontal cortex region of the brain. We know from the literature that precisely this area of the brain is where so-called ‘predictive coding’ takes place.” ‘Predictive coding’ describes the brain’s tendency to construct a specific model of its surroundings and continuously make predictions about what will happen next in order to be able to respond adequately. For example, this allows people to anticipate the trajectory of a falling cup within a split second, so that they can catch it before it hits the floor.
“When the participants look at the flashing cursor, which they do not know they can influence, and see that it moves in the ‘hot direction – toward the target, the brain's prediction is confirmed, resulting in a certain ‘peak’ in their brain activity. If the cursor jumps in the ‘cold’ direction, the brain’s prediction is rejected, which creates a different peak,” explained Thorsten Zander. Each of these types of peak is detected by the BCI and converted into motion commands for the cursor by a special algorithm. The algorithm deduces the direction of the target from the brain’s unconscious reactions.
Thorsten Zander’s vision is not just to move cursors reliably across the screen. He is working toward a new type of neuroadaptive technology: “We’ve had computers for around 60 years. In that time, the performance of these computers has grown exponentially, but the interaction between humans and computers remains limited by the bottleneck of communicating human intentions to the machine by pressing keys or moving the mouse.
In this paper, we demonstrated for the first time that, after a suitable calibration phase, passive brain-computer interfaces can do more than simply detect yes/no decisions from our brain activity. They can reconstruct a model of complex thought processes from it and extract various pieces of information, allowing the computer to independently deduce machine instructions without requiring conscious human input.” This opens completely new avenues for interaction: consider for example how computers are already capable of suggesting frequently visited websites. In Thorsten Zander’s vision, the computers of the future might be able to use the current peaks in our brain activity to determine whether we are more likely to go online shopping or look for work.
This also carries serious ethical implications. Because of this and other similar work, a large conference on neuroadaptive technologies will be held in Berlin in July 2017, focusing on the ethical aspects of this technology, among other things.
One interesting question remains unanswered: can participants suppress the unconscious information revealed to the computer by their brain activity via the BCI? “That’s exactly what our next project will attempt to find out. It has just now been approved by the DFG,” says Thorsten Zander.
For further information please contact:
Dr. Thorsten Zander
Biological Psychology and Neuroergonomics
Stefanie Terp | idw - Informationsdienst Wissenschaft
Football through the eyes of a computer
14.06.2018 | Universität Konstanz
People recall information better through virtual reality, says new UMD study
14.06.2018 | University of Maryland
Moving into its fourth decade, AchemAsia is setting out for new horizons: The International Expo and Innovation Forum for Sustainable Chemical Production will take place from 21-23 May 2019 in Shanghai, China. With an updated event profile, the eleventh edition focusses on topics that are especially relevant for the Chinese process industry, putting a strong emphasis on sustainability and innovation.
Founded in 1989 as a spin-off of ACHEMA to cater to the needs of China’s then developing industry, AchemAsia has since grown into a platform where the latest...
The BMBF-funded OWICELLS project was successfully completed with a final presentation at the BMW plant in Munich. The presentation demonstrated a Li-Fi communication with a mobile robot, while the robot carried out usual production processes (welding, moving and testing parts) in a 5x5m² production cell. The robust, optical wireless transmission is based on spatial diversity; in other words, data is sent and received simultaneously by several LEDs and several photodiodes. The system can transmit data at more than 100 Mbit/s and five milliseconds latency.
Modern production technologies in the automobile industry must become more flexible in order to fulfil individual customer requirements.
An international team of scientists has discovered a new way to transfer image information through multimodal fibers with almost no distortion - even if the fiber is bent. The results of the study, to which scientist from the Leibniz-Institute of Photonic Technology Jena (Leibniz IPHT) contributed, were published on 6thJune in the highly-cited journal Physical Review Letters.
Endoscopes allow doctors to see into a patient’s body like through a keyhole. Typically, the images are transmitted via a bundle of several hundreds of optical...
Light detection and control lies at the heart of many modern device applications, such as smartphone cameras. Using graphene as a light-sensitive material for...
Water molecules exist in two different forms with almost identical physical properties. For the first time, researchers have succeeded in separating the two forms to show that they can exhibit different chemical reactivities. These results were reported by researchers from the University of Basel and their colleagues in Hamburg in the scientific journal Nature Communications.
From a chemical perspective, water is a molecule in which a single oxygen atom is linked to two hydrogen atoms. It is less well known that water exists in two...
13.06.2018 | Event News
08.06.2018 | Event News
05.06.2018 | Event News
15.06.2018 | Materials Sciences
15.06.2018 | Ecology, The Environment and Conservation
15.06.2018 | Power and Electrical Engineering