The brain patterns that drive this behavior are not well-understood, but a new study from MIT’s McGovern Institute for Brain Research shows that habit formation appears to be an innate ability that is fine-tuned by experience — specifically, the costs and rewards of certain choices.
Neuroscientists led by Institute Professor Ann Graybiel found that untrained monkeys performing a simple visual scanning task gradually developed efficient patterns that allowed them to minimize the time it took to receive their reward.
The task was designed to mimic natural scenarios — a nearly infinite number of choices for the monkeys to make and an unpredictable reward structure. “We wanted to create an environment that would be similar to the world we walk around in every day — an environment where there are lots of choices the animal can make,” says Theresa Desrochers, an MIT graduate student and lead author of a paper describing the work in the Proceedings of the National Academy of Sciences the week of Oct. 25.
The findings not only help reveal how the brain forms habits, but also could shed light on neurological disorders where amplified habit-formation results in highly repetitive behavior, such as Tourette’s syndrome, obsessive-compulsive disorder and schizophrenia, says Graybiel.
Graybiel and Desrochers took an unusual approach to their study. In most behavioral studies of monkeys, the researchers first train the animals to perform a task, then begin experiments. In this case, Graybiel and Desrochers wanted to see if the monkeys could learn a simple visual free-scanning task with no training at all.
The researchers measured the monkeys’ eye movements and brain activity as they looked at a grid of either four or nine dots. In each trial, after a period of time when the monkey just looked around, a different dot was randomly chosen to be “baited,” meaning that the monkey succeeded in the trial when its gaze landed on that dot. After a successful trial ended, the monkey received a food reward.
While the task itself is simple, it is capable of generating a rich variety of behavior, due to the number of choices available to the animals. The monkeys performed such trials about 1,000 times a day, and over several months, they developed ways to look at all of the different dots in sequences that were more and more cost-effective — meaning that they reached the target dot faster.
The changes were gradual: The animals would use one pattern for five to 10 days, then shift to a slightly different pattern. When looking at the entire mass of data, the researchers couldn’t tell what was driving these changes. However, a trial-by-trial analysis revealed that very small variations in the scanning patterns could reduce the overall time to receive the reward, which would then reinforce that behavior and lead the monkey to adopt the new pattern.
“The upshot was that tiny little changes in cost — how far they moved the eyes — seemed to be driving these shifts until they did it as optimally as they could, despite the fact that they had never been instructed,” says Graybiel.
This suggests that primates have an “inborn tendency to maximize reward and minimize cost,” says Graybiel. She and Desrochers believe the same kind of phenomenon, known as reinforcement learning, may also guide human habit formation.
“When you drive to work, it’s never going to take exactly the same amount of time. You might try one different street to avoid a stoplight, or some other subtle variation. At some point, you may completely shift,” says Desrochers.
Desrochers and Graybiel plan to design studies that will test whether humans show the same kind of habit-forming behavior in an eye-scanning task similar to the one the monkeys learned. They also hope to discover which parts of the brain control habit formation. They believe that the basal ganglia, which play a role in learning, and the prefrontal cortex, which is involved in planning, are likely candidates.
Funding: National Eye Institute Grant, the Office of Naval Research Grant, National Defense Science and Engineering Graduate Fellowship, Friends of the McGovern Fellowship and a Sloan Research Fellowship
Source: “Optimal habits can develop spontaneously through sensitivity to local cost” by, Theresa M. Desrochers, Dezhe Z. Jin, Noah D. Goodman, and Ann M. Graybiel. Proceedings of the National Academy of Sciences, 25 October, 2010.
Julie Pryor | Newswise Science News
Further reports about: > Brain > Brain Research > Eating Habits > Proceedings of the National Academy of Sciences > Science TV > Tourette’s syndrome > eye movement > fine-tuned by experience > habit-formation results > neurological disorders > obsessive-compulsive disorder > schizophrenia > visual scanning task
Obstructing the ‘inner eye’
07.07.2017 | Friedrich-Schiller-Universität Jena
Drone vs. truck deliveries: Which create less carbon pollution?
31.05.2017 | University of Washington
Physicists have developed a new technique that uses electrical voltages to control the electron spin on a chip. The newly-developed method provides protection from spin decay, meaning that the contained information can be maintained and transmitted over comparatively large distances, as has been demonstrated by a team from the University of Basel’s Department of Physics and the Swiss Nanoscience Institute. The results have been published in Physical Review X.
For several years, researchers have been trying to use the spin of an electron to store and transmit information. The spin of each electron is always coupled...
What is the mass of a proton? Scientists from Germany and Japan successfully did an important step towards the most exact knowledge of this fundamental constant. By means of precision measurements on a single proton, they could improve the precision by a factor of three and also correct the existing value.
To determine the mass of a single proton still more accurate – a group of physicists led by Klaus Blaum and Sven Sturm of the Max Planck Institute for Nuclear...
The research team of Prof. Dr. Oliver Einsle at the University of Freiburg's Institute of Biochemistry has long been exploring the functioning of nitrogenase....
A one trillion tonne iceberg - one of the biggest ever recorded -- has calved away from the Larsen C Ice Shelf in Antarctica, after a rift in the ice,...
Physics supports biology: Researchers from PTB have developed a model system to investigate friction phenomena with atomic precision
Friction: what you want from car brakes, otherwise rather a nuisance. In any case, it is useful to know as precisely as possible how friction phenomena arise –...
21.07.2017 | Event News
19.07.2017 | Event News
12.07.2017 | Event News
21.07.2017 | Earth Sciences
21.07.2017 | Power and Electrical Engineering
21.07.2017 | Physics and Astronomy