PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Pinpointing the brain's arbitrator

Caltech researchers ID a brain mechanism that weighs decisions

2014-02-05
(Press-News.org) Contact information: Deborah Williams-Hedges
debwms@caltech.edu
626-395-3227
California Institute of Technology
Pinpointing the brain's arbitrator Caltech researchers ID a brain mechanism that weighs decisions

We tend to be creatures of habit. In fact, the human brain has a learning system that is devoted to guiding us through routine, or habitual, behaviors. At the same time, the brain has a separate goal-directed system for the actions we undertake only after careful consideration of the consequences. We switch between the two systems as needed. But how does the brain know which system to give control to at any given moment? Enter The Arbitrator.

Researchers at the California Institute of Technology (Caltech) have, for the first time, pinpointed areas of the brain—the inferior lateral prefrontal cortex and frontopolar cortex—that seem to serve as this "arbitrator" between the two decision-making systems, weighing the reliability of the predictions each makes and then allocating control accordingly. The results appear in the current issue of the journal Neuron.

According to John O'Doherty, the study's principal investigator and director of the Caltech Brain Imaging Center, understanding where the arbitrator is located and how it works could eventually lead to better treatments for brain disorders, such as drug addiction, and psychiatric disorders, such as obsessive-compulsive disorder. These disorders, which involve repetitive behaviors, may be driven in part by malfunctions in the degree to which behavior is controlled by the habitual system versus the goal-directed system.

"Now that we have worked out where the arbitrator is located, if we can find a way of altering activity in this area, we might be able to push an individual back toward goal-directed control and away from habitual control," says O'Doherty, who is also a professor of psychology at Caltech. "We're a long way from developing an actual treatment based on this for disorders that involve over-egging of the habit system, but this finding has opened up a highly promising avenue for further research."

In the study, participants played a decision-making game on a computer while connected to a functional magnetic resonance imaging (fMRI) scanner that monitored their brain activity. Participants were instructed to try to make optimal choices in order to gather coins of a certain color, which were redeemable for money.

During a pre-training period, the subjects familiarized themselves with the game—moving through a series of on-screen rooms, each of which held different numbers of red, yellow, or blue coins. During the actual game, the participants were told which coins would be redeemable each round and given a choice to navigate right or left at two stages, knowing that they would collect only the coins in their final room. Sometimes all of the coins were redeemable, making the task more habitual than goal-directed. By altering the probability of getting from one room to another, the researchers were able to further test the extent of participants' habitual and goal-directed behavior while monitoring corresponding changes in their brain activity.

With the results from those tests in hand, the researchers were able to compare the fMRI data and choices made by the subjects against several computational models they constructed to account for behavior. The model that most accurately matched the experimental data involved the two brain systems making separate predictions about which action to take in a given situation. Receiving signals from those systems, the arbitrator kept track of the reliability of the predictions by measuring the difference between the predicted and actual outcomes for each system. It then used those reliability estimates to determine how much control each system should exert over the individual's behavior. In this model, the arbitrator ensures that the system making the most reliable predictions at any moment exerts the greatest degree of control over behavior.

"What we're showing is the existence of higher-level control in the human brain," says Sang Wan Lee, lead author of the new study and a postdoctoral scholar in neuroscience at Caltech. "The arbitrator is basically making decisions about decisions."

In line with previous findings from the O'Doherty lab and elsewhere, the researchers saw in the brain scans that an area known as the posterior putamen was active at times when the model predicted that the habitual system should be calculating prediction values. Going a step further, they examined the connectivity between the posterior putamen and the arbitrator. What they found might explain how the arbitrator sets the weight for the two learning systems: the connection between the arbitrator area and the posterior putamen changed according to whether the goal-directed or habitual system was deemed to be more reliable. However, no such connection effects were found between the arbitrator and brain regions involved in goal-directed learning. This suggests that the arbitrator may work mainly by modulating the activity of the habitual system.

"One intriguing possibility arising from these findings, which we will need to test in future work, is that being in a habitual mode of behavior may be the default state," says O'Doherty. "So when the arbitrator determines you need to be more goal-directed in your behavior, it accomplishes this by inhibiting the activity of the habitual system, almost like pressing the breaks on your car when you are in drive."



INFORMATION:



The paper in Neuron is titled "Neural computations underlying arbitration between model-based and model-free learning." In addition to O'Doherty and Lee, Shinsuke Shimojo, the Gertrude Baltimore Professor of Experimental Psychology at Caltech, is also a coauthor. The work was completed with funding from the National Institutes of Health, the Gordon and Betty Moore Foundation, the Japan Science and Technology Agency, and the Caltech-Tamagawa Global COE Program.



ELSE PRESS RELEASES FROM THIS DATE:

Study untangles divergent US job-tenure patterns

2014-02-05
WASHINGTON, DC, February 5, 2014 — Have American jobs become less stable? Do workers change ...

Predicting cardiovascular events in sleep apnea

2014-02-05
Obstructive sleep apnea (OSA) generally is associated with increased risk for cardiovascular (CV) disease. OSA is usually measured using the apnea-hypopnea index (AHI), the number of times that breathing pauses or severely slows per hour of sleep. ...

Educational toolkit did not improve quality of care or outcomes for patients with diabetes

2014-02-05
An educational toolkit designed to improve care of patients with diabetes was not effective, Baiju R Shah and colleagues (University of Toronto) found in a cluster randomized trial conducted in 2009-2011. ...

Pattern of higher blood pressure in early adulthood helps predict risk of heart disease

2014-02-05
In an analysis of blood pressure patterns over a 25-year span from young adulthood to middle age, individuals who exhibited elevated and increasing blood pressure levels ...

Study shows potential usefulness of non-invasive measure of heart tissue scarring

2014-02-05
Scarring of tissue in the upper chamber of the heart (atrium) was associated with recurrent rhythm disorder after treatment, according to a study in the February 5 issue of JAMA. ...

Pre-term infants with severe retinopathy more likely to have non-visual disabilities

2014-02-05
In a group of very low-birth-weight infants, severe retinopathy of prematurity was associated with nonvisual disabilities at age 5 years, according to a study in the February ...

Do you have a sweet tooth? Honeybees have a sweet claw

2014-02-05
New research on the ability of honeybees to taste with claws on their forelegs reveals details on how this information is processed, according to a study published in the open-access journal, Frontiers in Behavioral Neuroscience. Insects ...

Clearer labels needed on drugs containing animal products

2014-02-05
Dr Kinesh Patel and Dr Kate Tatham say most medications prescribed in primary care contain animal derived products and it ...

Is institutional racism happening in our hospitals?

2014-02-05
Dr Nadeem Moghal, from George Eliot Hospital in Warwickshire, draws on the Macpherson report (the police ...

Time to act on mobile phone use while driving, say experts

2014-02-05
Charles and Barry Pless argue that, with a quarter of crashes in the United States now attributed to mobile phone use, "we can't wait for perfect evidence before ...

LAST 30 PRESS RELEASES:

A third of licensed GPs in England not working in NHS general practice

ChatGPT “thought on the fly” when put through Ancient Greek maths puzzle

Engineers uncover why tiny particles form clusters in turbulent air

GLP-1RA drugs dramatically reduce death and cardiovascular risk in psoriasis patients

Psoriasis linked to increased risk of vision-threatening eye disease, study finds

Reprogramming obesity: New drug from Italian biotech aims to treat the underlying causes of obesity

Type 2 diabetes may accelerate development of multiple chronic diseases, particularly in the early stages, UK Biobank study suggests

Resistance training may improve nerve health, slow aging process, study shows

Common and inexpensive medicine halves the risk of recurrence in patients with colorectal cancer

SwRI-built instruments to monitor, provide advanced warning of space weather events

Breakthrough advances sodium-based battery design

New targeted radiation therapy shows near-complete response in rare sarcoma patients

Does physical frailty contribute to dementia?

Soccer headers and brain health: Study finds changes within folds of the brain

Decoding plants’ language of light

UNC Greensboro study finds ticks carrying Lyme disease moving into western NC

New implant restores blood pressure balance after spinal cord injury

New York City's medical specialist advantage may be an illusion, new NYU Tandon research shows

Could a local anesthetic that doesn’t impair motor function be within reach?

1 in 8 Italian cetacean strandings show evidence of fishery interactions, with bottlenose and striped dolphins most commonly affected, according to analysis across four decades of data and more than 5

In the wild, chimpanzees likely ingest the equivalent of several alcoholic drinks every day

Warming of 2°C intensifies Arctic carbon sink but weakens Alpine sink, study finds

Bronze and Iron Age cultures in the Middle East were committed to wine production

Indian adolescents are mostly starting their periods at an earlier age than 25 years ago

Temporary medical centers in Gaza known as "Medical Points" (MPs) treat an average of 117 people daily with only about 7 staff per MP

Rates of alcohol-induced deaths among the general population nearly doubled from 1999 to 2024

PLOS One study: In adolescent lab animals exposed to cocaine, High-Intensity Interval Training boosts aversion to the drug

Scientists identify four ways our bodies respond to COVID-19 vaccines

Stronger together: A new fusion protein boosts cancer immunotherapy

Hidden brain waves as triggers for post-seizure wandering

[Press-News.org] Pinpointing the brain's arbitrator
Caltech researchers ID a brain mechanism that weighs decisions