(Press-News.org) Cambridge-- As anyone who has traveled with young children knows, maintaining focus on distant goals can be a challenge. A new study from MIT suggests how the brain achieves this task, and indicates that the neurotransmitter dopamine may signal the value of long-term rewards. The findings may also explain why patients with Parkinson's disease — in which dopamine signaling is impaired — often have difficulty in sustaining motivation to finish tasks.
The work is described this week in the journal Nature.
Previous studies have linked dopamine to rewards, and have shown that dopamine neurons show brief bursts of activity when animals receive an unexpected reward. These dopamine signals are believed to be important for reinforcement learning, the process by which an animal learns to perform actions that lead to reward.
Taking the long view
In most studies, that reward has been delivered within a few seconds. In real life, though, gratification is not always immediate: Animals must often travel in search of food, and must maintain motivation for a distant goal while also responding to more immediate cues. The same is true for humans: A driver on a long road trip must remain focused on reaching a final destination while also reacting to traffic, stopping for snacks, and entertaining children in the back seat.
The MIT team, led by Institute Professor Ann Graybiel — who is also an investigator at MIT's McGovern Institute for Brain Research — decided to study how dopamine changes during a maze task approximating work for delayed gratification. The researchers trained rats to navigate a maze to reach a reward. During each trial a rat would hear a tone instructing it to turn either right or left at an intersection to find a chocolate milk reward.
Rather than simply measuring the activity of dopamine-containing neurons, the MIT researchers wanted to measure how much dopamine was released in the striatum, a brain structure known to be important in reinforcement learning. They teamed up with Paul Phillips of the University of Washington, who has developed a technology called fast-scan cyclic voltammetry (FSCV) in which tiny, implanted, carbon-fiber electrodes allow continuous measurements of dopamine concentration based on its electrochemical fingerprint.
"We adapted the FSCV method so that we could measure dopamine at up to four different sites in the brain simultaneously, as animals moved freely through the maze," explains first author Mark Howe, a former graduate student with Graybiel who is now a postdoc in the Department of Neurobiology at Northwestern University. "Each probe measures the concentration of extracellular dopamine within a tiny volume of brain tissue, and probably reflects the activity of thousands of nerve terminals."
Gradual increase in dopamine
From previous work, the researchers expected that they might see pulses of dopamine released at different times in the trial, "but in fact we found something much more surprising," Graybiel says: The level of dopamine increased steadily throughout each trial, peaking as the animal approached its goal — as if in anticipation of a reward.
The rats' behavior varied from trial to trial — some runs were faster than others, and sometimes the animals would stop briefly — but the dopamine signal did not vary with running speed or trial duration. Nor did it depend on the probability of getting a reward, something that had been suggested by previous studies.
"Instead, the dopamine signal seems to reflect how far away the rat is from its goal," Graybiel explains. "The closer it gets, the stronger the signal becomes." The researchers also found that the size of the signal was related to the size of the expected reward: When rats were trained to anticipate a larger gulp of chocolate milk, the dopamine signal rose more steeply to a higher final concentration.
In some trials the T-shaped maze was extended to a more complex shape, requiring animals to run further and to make extra turns before reaching a reward. During these trials, the dopamine signal ramped up more gradually, eventually reaching the same level as in the shorter maze. "It's as if the animal were adjusting its expectations, knowing that it had further to go," Graybiel says.
An 'internal guidance system'
"This means that dopamine levels could be used to help an animal make choices on the way to the goal and to estimate the distance to the goal," says Terrence Sejnowski of the Salk Institute, a computational neuroscientist who is familiar with the findings but who was not involved with the study. "This 'internal guidance system' could also be useful for humans, who also have to make choices along the way to what may be a distant goal."
One question that Graybiel hopes to examine in future research is how the signal arises within the brain. Rats and other animals form cognitive maps of their spatial environment, with so-called "place cells" that are active when the animal is in a specific location. "As our rats run the maze repeatedly," she says, "we suspect they learn to associate each point in the maze with its distance from the reward that they experienced on previous runs."
As for the relevance of this research to humans, Graybiel says, "I'd be shocked if something similar were not happening in our own brains." It's known that Parkinson's patients, in whom dopamine signaling is impaired, often appear to be apathetic, and have difficulty in sustaining motivation to complete a long task. "Maybe that's because they can't produce this slow ramping dopamine signal," Graybiel says.
###
Patrick Tierney at MIT and Stefan Sandberg at the University of Washington also contributed to the study, which was funded by the National Institutes of Health, the National Parkinson Foundation, the CHDI Foundation, the Sydney family and Mark Gorenberg.
Written by The McGovern Institute
MIT researchers reveal how the brain keeps eyes on the prize
Researchers reveal how the brain remains focused on long-term goals
2013-08-05
ELSE PRESS RELEASES FROM THIS DATE:
Vanderbilt scientists discover potential new way to treat anxiety
2013-08-05
Chemically modified inhibitors of the COX-2 enzyme relieve anxiety behaviors in mice by activating natural "endocannabinoids" without gastrointestinal side effects, Vanderbilt University scientists will report next week.
Endocannabinoids are natural signaling molecules that activate cannabinoid receptors in the brain, the same receptors turned on by the active ingredient in marijuana.
These receptors are also found in the gastrointestinal system and elsewhere in the body, and there is evidence that they play a role in wide range of physiological and pathological processes, ...
Study reveals potential role of 'love hormone' oxytocin in brain function
2013-08-05
In a loud, crowded restaurant, having the ability to focus on the people and conversation at your own table is critical. Nerve cells in the brain face similar challenges in separating wanted messages from background chatter. A key element in this process appears to be oxytocin, typically known as the “love hormone” for its role in promoting social and parental bonding.
In a study appearing online August 4 in Nature, NYU Langone Medical Center researchers decipher how oxytocin, acting as a neurohormone in the brain, not only reduces background noise, but more importantly, ...
'Insect soup' holds DNA key for monitoring biodiversity
2013-08-05
Scientists at the University of East Anglia have shown that sequencing the DNA of crushed up creepy crawlies can accelerate the monitoring and cataloguing of biodiversity around the world.
Research published today in the journal Ecology Letters shows that a process known as 'metabarcoding' is much faster than and just as reliable as standard biodiversity datasets assembled with traditional labour-intensive methods.
The breakthrough means that changing environments and endangered species can be monitored more easily than ever before. It could help researchers find endangered ...
Moms' high-fat, sugary diets may lead to offspring with a taste for alcohol, sensitivity to drugs
2013-08-04
HONOLULU – Vulnerability to alcohol and drug abuse may begin in the womb and be linked to how much fatty and sugary foods a mother eats during pregnancy, according to findings from animal lab experiments presented at APA's 121st Annual Convention.
"The majority of women in the U.S. at child-bearing age are overweight, and this is most likely due to overeating the tasty, high-fat, high-sugar foods you find everywhere in our society. The rise in prenatal and childhood obesity and the rise in number of youths abusing alcohol and drugs merits looking into all the possible ...
Often misidentified, multiracial people value accurate perceptions
2013-08-03
HONOLULU – Multiracial people may be misidentified more often as being white than black and may value being accurately identified more so than single-race individuals, according to research presented at APA's 121st Annual Convention.
"Today, the distinctions among white, black, Latino and Asian people are becoming blurred by the increasing frequency and prominence of multiracial people," said Jacqueline M. Chen, PhD, of the University of California, Davis. "Still, average Americans have difficulty identifying multiracial people who don't conform to the traditional single-race ...
Video games boost visual attention but reduce impulse control
2013-08-03
A person playing a first-person shooter video game like Halo or Unreal Tournament must make decisions quickly. That fast-paced decision-making, it turns out, boosts the player's visual skills but comes at a cost, according to new research: reducing the person's ability to inhibit impulsive behavior. This reduction in what is called "proactive executive control" appears to be yet another way that violent video games can increase aggressive behavior.
"We believe that any game that requires the same type of rapid responding as in most first-person shooters may produce similar ...
New coating turns ordinary glass into super glass
2013-08-03
VIDEO:
The SLIPS coating makes glass so slippery that droplets of liquids slip off quickly even at a shallow angle. Here, from top to bottom, a droplet of octane, an ingredient...
Click here for more information.
August 2, 2013 – A new transparent, bioinspired coating makes ordinary glass tough, self-cleaning and incredibly slippery, a team from the Wyss Institute for Biologically Inspired Engineering at Harvard University and Harvard School of Engineering and Applied Sciences ...
Grape consumption associated with healthier eating patterns in US children and adults
2013-08-03
Sacramento, CA (August 2, 2013) – In a new observational study published in the Journal of Food Science, researchers looked at the association of grape consumption, in the non-alcoholic forms most commonly consumed – fresh grapes, raisins and 100% grape juice – with the diet quality of a recent, nationally representative sample of U.S. children and adults. Their findings suggest that, among adults and children, consumption of grapes and grape products is associated with healthier dietary patterns and improved nutrient intakes.
Researchers analyzed the diets of more than ...
Mount Sinai researchers develop first successful laboratory model for studying hepatitis C
2013-08-03
By differentiating monkey stem cells into liver cells and inducing successful infection, researchers from the Icahn School of Medicine at Mount Sinai have shown for the first time that the hepatitis C virus (HCV) can replicate in monkeys, according to research published in the journal Gastroenterology. The new findings may lead to the first new animal model and provide new avenues for developing treatments and vaccines for this disease, which impacts more than three million people in the United States.
Scientists have tried for decades to develop animal models to study ...
How to stop bleeding in the ER caused by warfarin
2013-08-03
WASHINGTON — Prothrombin complex concentrates (PCCs) are faster and more effective than fresh frozen plasma at reversing hemorrhage caused by the anti-coagulant warfarin, despite plasma being the most commonly used therapy. A literature review published last month in Annals of Emergency Medicine suggests that physicians in the United States should join those around the world in following recommendations of multiple specialty organizations to use PCCs as the first line of defense in this common and life-threatening emergency ("Rapid Reversal of Warfarin-Associated Hemorrhage ...
LAST 30 PRESS RELEASES:
Einstein Probe releases its Science White Paper
Music-based therapy may improve depressive symptoms in people with dementia
No evidence that substituting NHS doctors with physician associates is necessarily safe
At-home brain speed tests bridge cognitive data gaps
CRF appoints Josep Rodés-Cabau, M.D., Ph.D., as editor-in-chief of structural heart: the journal of the heart team
Violent crime is indeed a root cause of migration, according to new study
Customized smartphone app shows promise in preventing further cognitive decline among older adults diagnosed with mild impairment
Impact of COVID-19 on education not going away, UM study finds
School of Public Health researchers receive National Academies grant to assess environmental conditions in two Houston neighborhoods
Three Speculum articles recognized with prizes
ACM A.M. Turing Award honors two researchers who led the development of cornerstone AI technology
Incarcerated people are disproportionately impacted by climate change, CU doctors say
ESA 2025 Graduate Student Policy Award Cohort Named
Insomnia, lack of sleep linked to high blood pressure in teens
Heart & stroke risks vary among Asian American, Native Hawaiian & Pacific Islander adults
Levels of select vitamins & minerals in pregnancy may be linked to lower midlife BP risk
Large study of dietary habits suggests more plant oils, less butter could lead to better health
Butter and plant-based oils intake and mortality
20% of butterflies in the U.S. have disappeared since 2000
Bacterial ‘jumping genes’ can target and control chromosome ends
Scientists identify genes that make humans and Labradors more likely to become obese
Early-life gut microbes may protect against diabetes, research in mice suggests
Study raises the possibility of a country without butterflies
Study reveals obesity gene in dogs that is relevant to human obesity studies
A rapid decline in US butterfly populations
Indigenous farming practices have shaped manioc’s genetic diversity for millennia
Controlling electrons in molecules at ultrafast timescales
Tropical forests in the Americas are struggling to keep pace with climate change
Brain mapping unlocks key Alzheimer’s insights
Clinical trial tests novel stem-cell treatment for Parkinson’s disease
[Press-News.org] MIT researchers reveal how the brain keeps eyes on the prizeResearchers reveal how the brain remains focused on long-term goals