(Press-News.org) Cambridge-- As anyone who has traveled with young children knows, maintaining focus on distant goals can be a challenge. A new study from MIT suggests how the brain achieves this task, and indicates that the neurotransmitter dopamine may signal the value of long-term rewards. The findings may also explain why patients with Parkinson's disease — in which dopamine signaling is impaired — often have difficulty in sustaining motivation to finish tasks.
The work is described this week in the journal Nature.
Previous studies have linked dopamine to rewards, and have shown that dopamine neurons show brief bursts of activity when animals receive an unexpected reward. These dopamine signals are believed to be important for reinforcement learning, the process by which an animal learns to perform actions that lead to reward.
Taking the long view
In most studies, that reward has been delivered within a few seconds. In real life, though, gratification is not always immediate: Animals must often travel in search of food, and must maintain motivation for a distant goal while also responding to more immediate cues. The same is true for humans: A driver on a long road trip must remain focused on reaching a final destination while also reacting to traffic, stopping for snacks, and entertaining children in the back seat.
The MIT team, led by Institute Professor Ann Graybiel — who is also an investigator at MIT's McGovern Institute for Brain Research — decided to study how dopamine changes during a maze task approximating work for delayed gratification. The researchers trained rats to navigate a maze to reach a reward. During each trial a rat would hear a tone instructing it to turn either right or left at an intersection to find a chocolate milk reward.
Rather than simply measuring the activity of dopamine-containing neurons, the MIT researchers wanted to measure how much dopamine was released in the striatum, a brain structure known to be important in reinforcement learning. They teamed up with Paul Phillips of the University of Washington, who has developed a technology called fast-scan cyclic voltammetry (FSCV) in which tiny, implanted, carbon-fiber electrodes allow continuous measurements of dopamine concentration based on its electrochemical fingerprint.
"We adapted the FSCV method so that we could measure dopamine at up to four different sites in the brain simultaneously, as animals moved freely through the maze," explains first author Mark Howe, a former graduate student with Graybiel who is now a postdoc in the Department of Neurobiology at Northwestern University. "Each probe measures the concentration of extracellular dopamine within a tiny volume of brain tissue, and probably reflects the activity of thousands of nerve terminals."
Gradual increase in dopamine
From previous work, the researchers expected that they might see pulses of dopamine released at different times in the trial, "but in fact we found something much more surprising," Graybiel says: The level of dopamine increased steadily throughout each trial, peaking as the animal approached its goal — as if in anticipation of a reward.
The rats' behavior varied from trial to trial — some runs were faster than others, and sometimes the animals would stop briefly — but the dopamine signal did not vary with running speed or trial duration. Nor did it depend on the probability of getting a reward, something that had been suggested by previous studies.
"Instead, the dopamine signal seems to reflect how far away the rat is from its goal," Graybiel explains. "The closer it gets, the stronger the signal becomes." The researchers also found that the size of the signal was related to the size of the expected reward: When rats were trained to anticipate a larger gulp of chocolate milk, the dopamine signal rose more steeply to a higher final concentration.
In some trials the T-shaped maze was extended to a more complex shape, requiring animals to run further and to make extra turns before reaching a reward. During these trials, the dopamine signal ramped up more gradually, eventually reaching the same level as in the shorter maze. "It's as if the animal were adjusting its expectations, knowing that it had further to go," Graybiel says.
An 'internal guidance system'
"This means that dopamine levels could be used to help an animal make choices on the way to the goal and to estimate the distance to the goal," says Terrence Sejnowski of the Salk Institute, a computational neuroscientist who is familiar with the findings but who was not involved with the study. "This 'internal guidance system' could also be useful for humans, who also have to make choices along the way to what may be a distant goal."
One question that Graybiel hopes to examine in future research is how the signal arises within the brain. Rats and other animals form cognitive maps of their spatial environment, with so-called "place cells" that are active when the animal is in a specific location. "As our rats run the maze repeatedly," she says, "we suspect they learn to associate each point in the maze with its distance from the reward that they experienced on previous runs."
As for the relevance of this research to humans, Graybiel says, "I'd be shocked if something similar were not happening in our own brains." It's known that Parkinson's patients, in whom dopamine signaling is impaired, often appear to be apathetic, and have difficulty in sustaining motivation to complete a long task. "Maybe that's because they can't produce this slow ramping dopamine signal," Graybiel says.
###
Patrick Tierney at MIT and Stefan Sandberg at the University of Washington also contributed to the study, which was funded by the National Institutes of Health, the National Parkinson Foundation, the CHDI Foundation, the Sydney family and Mark Gorenberg.
Written by The McGovern Institute
MIT researchers reveal how the brain keeps eyes on the prize
Researchers reveal how the brain remains focused on long-term goals
2013-08-05
ELSE PRESS RELEASES FROM THIS DATE:
Vanderbilt scientists discover potential new way to treat anxiety
2013-08-05
Chemically modified inhibitors of the COX-2 enzyme relieve anxiety behaviors in mice by activating natural "endocannabinoids" without gastrointestinal side effects, Vanderbilt University scientists will report next week.
Endocannabinoids are natural signaling molecules that activate cannabinoid receptors in the brain, the same receptors turned on by the active ingredient in marijuana.
These receptors are also found in the gastrointestinal system and elsewhere in the body, and there is evidence that they play a role in wide range of physiological and pathological processes, ...
Study reveals potential role of 'love hormone' oxytocin in brain function
2013-08-05
In a loud, crowded restaurant, having the ability to focus on the people and conversation at your own table is critical. Nerve cells in the brain face similar challenges in separating wanted messages from background chatter. A key element in this process appears to be oxytocin, typically known as the “love hormone” for its role in promoting social and parental bonding.
In a study appearing online August 4 in Nature, NYU Langone Medical Center researchers decipher how oxytocin, acting as a neurohormone in the brain, not only reduces background noise, but more importantly, ...
'Insect soup' holds DNA key for monitoring biodiversity
2013-08-05
Scientists at the University of East Anglia have shown that sequencing the DNA of crushed up creepy crawlies can accelerate the monitoring and cataloguing of biodiversity around the world.
Research published today in the journal Ecology Letters shows that a process known as 'metabarcoding' is much faster than and just as reliable as standard biodiversity datasets assembled with traditional labour-intensive methods.
The breakthrough means that changing environments and endangered species can be monitored more easily than ever before. It could help researchers find endangered ...
Moms' high-fat, sugary diets may lead to offspring with a taste for alcohol, sensitivity to drugs
2013-08-04
HONOLULU – Vulnerability to alcohol and drug abuse may begin in the womb and be linked to how much fatty and sugary foods a mother eats during pregnancy, according to findings from animal lab experiments presented at APA's 121st Annual Convention.
"The majority of women in the U.S. at child-bearing age are overweight, and this is most likely due to overeating the tasty, high-fat, high-sugar foods you find everywhere in our society. The rise in prenatal and childhood obesity and the rise in number of youths abusing alcohol and drugs merits looking into all the possible ...
Often misidentified, multiracial people value accurate perceptions
2013-08-03
HONOLULU – Multiracial people may be misidentified more often as being white than black and may value being accurately identified more so than single-race individuals, according to research presented at APA's 121st Annual Convention.
"Today, the distinctions among white, black, Latino and Asian people are becoming blurred by the increasing frequency and prominence of multiracial people," said Jacqueline M. Chen, PhD, of the University of California, Davis. "Still, average Americans have difficulty identifying multiracial people who don't conform to the traditional single-race ...
Video games boost visual attention but reduce impulse control
2013-08-03
A person playing a first-person shooter video game like Halo or Unreal Tournament must make decisions quickly. That fast-paced decision-making, it turns out, boosts the player's visual skills but comes at a cost, according to new research: reducing the person's ability to inhibit impulsive behavior. This reduction in what is called "proactive executive control" appears to be yet another way that violent video games can increase aggressive behavior.
"We believe that any game that requires the same type of rapid responding as in most first-person shooters may produce similar ...
New coating turns ordinary glass into super glass
2013-08-03
VIDEO:
The SLIPS coating makes glass so slippery that droplets of liquids slip off quickly even at a shallow angle. Here, from top to bottom, a droplet of octane, an ingredient...
Click here for more information.
August 2, 2013 – A new transparent, bioinspired coating makes ordinary glass tough, self-cleaning and incredibly slippery, a team from the Wyss Institute for Biologically Inspired Engineering at Harvard University and Harvard School of Engineering and Applied Sciences ...
Grape consumption associated with healthier eating patterns in US children and adults
2013-08-03
Sacramento, CA (August 2, 2013) – In a new observational study published in the Journal of Food Science, researchers looked at the association of grape consumption, in the non-alcoholic forms most commonly consumed – fresh grapes, raisins and 100% grape juice – with the diet quality of a recent, nationally representative sample of U.S. children and adults. Their findings suggest that, among adults and children, consumption of grapes and grape products is associated with healthier dietary patterns and improved nutrient intakes.
Researchers analyzed the diets of more than ...
Mount Sinai researchers develop first successful laboratory model for studying hepatitis C
2013-08-03
By differentiating monkey stem cells into liver cells and inducing successful infection, researchers from the Icahn School of Medicine at Mount Sinai have shown for the first time that the hepatitis C virus (HCV) can replicate in monkeys, according to research published in the journal Gastroenterology. The new findings may lead to the first new animal model and provide new avenues for developing treatments and vaccines for this disease, which impacts more than three million people in the United States.
Scientists have tried for decades to develop animal models to study ...
How to stop bleeding in the ER caused by warfarin
2013-08-03
WASHINGTON — Prothrombin complex concentrates (PCCs) are faster and more effective than fresh frozen plasma at reversing hemorrhage caused by the anti-coagulant warfarin, despite plasma being the most commonly used therapy. A literature review published last month in Annals of Emergency Medicine suggests that physicians in the United States should join those around the world in following recommendations of multiple specialty organizations to use PCCs as the first line of defense in this common and life-threatening emergency ("Rapid Reversal of Warfarin-Associated Hemorrhage ...
LAST 30 PRESS RELEASES:
A third of licensed GPs in England not working in NHS general practice
ChatGPT “thought on the fly” when put through Ancient Greek maths puzzle
Engineers uncover why tiny particles form clusters in turbulent air
GLP-1RA drugs dramatically reduce death and cardiovascular risk in psoriasis patients
Psoriasis linked to increased risk of vision-threatening eye disease, study finds
Reprogramming obesity: New drug from Italian biotech aims to treat the underlying causes of obesity
Type 2 diabetes may accelerate development of multiple chronic diseases, particularly in the early stages, UK Biobank study suggests
Resistance training may improve nerve health, slow aging process, study shows
Common and inexpensive medicine halves the risk of recurrence in patients with colorectal cancer
SwRI-built instruments to monitor, provide advanced warning of space weather events
Breakthrough advances sodium-based battery design
New targeted radiation therapy shows near-complete response in rare sarcoma patients
Does physical frailty contribute to dementia?
Soccer headers and brain health: Study finds changes within folds of the brain
Decoding plants’ language of light
UNC Greensboro study finds ticks carrying Lyme disease moving into western NC
New implant restores blood pressure balance after spinal cord injury
New York City's medical specialist advantage may be an illusion, new NYU Tandon research shows
Could a local anesthetic that doesn’t impair motor function be within reach?
1 in 8 Italian cetacean strandings show evidence of fishery interactions, with bottlenose and striped dolphins most commonly affected, according to analysis across four decades of data and more than 5
In the wild, chimpanzees likely ingest the equivalent of several alcoholic drinks every day
Warming of 2°C intensifies Arctic carbon sink but weakens Alpine sink, study finds
Bronze and Iron Age cultures in the Middle East were committed to wine production
Indian adolescents are mostly starting their periods at an earlier age than 25 years ago
Temporary medical centers in Gaza known as "Medical Points" (MPs) treat an average of 117 people daily with only about 7 staff per MP
Rates of alcohol-induced deaths among the general population nearly doubled from 1999 to 2024
PLOS One study: In adolescent lab animals exposed to cocaine, High-Intensity Interval Training boosts aversion to the drug
Scientists identify four ways our bodies respond to COVID-19 vaccines
Stronger together: A new fusion protein boosts cancer immunotherapy
Hidden brain waves as triggers for post-seizure wandering
[Press-News.org] MIT researchers reveal how the brain keeps eyes on the prizeResearchers reveal how the brain remains focused on long-term goals