PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Assessing others: Evaluating the expertise of humans and computer algorithms

2014-01-16
(Press-News.org) Contact information: Caltech Media Relations
mr@caltech.edu
California Institute of Technology
Assessing others: Evaluating the expertise of humans and computer algorithms How do we come to recognize expertise in another person and integrate new information with our prior assessments of that person's ability? The brain mechanisms underlying these sorts of evaluations—which are relevant to how we make decisions ranging from whom to hire, whom to marry, and whom to elect to Congress—are the subject of a new study by a team of neuroscientists at the California Institute of Technology (Caltech).

In the study, published in the journal Neuron, Antonio Rangel, Bing Professor of Neuroscience, Behavioral Biology, and Economics, and his associates used functional magnetic resonance imaging (fMRI) to monitor the brain activity of volunteers as they moved through a particular task. Specifically, the subjects were asked to observe the shifting value of a hypothetical financial asset and make predictions about whether it would go up or down. Simultaneously, the subjects interacted with an "expert" who was also making predictions.

Half the time, subjects were shown a photo of a person on their computer screen and told that they were observing that person's predictions. The other half of the time, the subjects were told they were observing predictions from a computer algorithm, and instead of a face, an abstract logo appeared on their screen. However, in every case, the subjects were interacting with a computer algorithm—one programmed to make correct predictions 30, 40, 60, or 70 percent of the time.

Subjects' trust in the expertise of agents, whether "human" or not, was measured by the frequency with which the subjects made bets for the agents' predictions, as well as by the changes in those bets over time as the subjects observed more of the agents' predictions and their consequent accuracy.

This trust, the researchers found, turned out to be strongly linked to the accuracy of the subjects' own predictions of the ups and downs of the asset's value.

"We often speculate on what we would do in a similar situation when we are observing others—what would I do if I were in their shoes?" explains Erie D. Boorman, formerly a postdoctoral fellow at Caltech and now a Sir Henry Wellcome Research Fellow at the Centre for FMRI of the Brain at the University of Oxford, and lead author on the study. "A growing literature suggests that we do this automatically, perhaps even unconsciously."

Indeed, the researchers found that subjects increasingly sided with both "human" agents and computer algorithms when the agents' predictions matched their own. Yet this effect was stronger for "human" agents than for algorithms.

This asymmetry—between the value placed by the subjects on (presumably) human agents and on computer algorithms—was present both when the agents were right and when they were wrong, but it depended on whether or not the agents' predictions matched the subjects'. When the agents were correct, subjects were more inclined to trust the human than algorithm in the future when their predictions matched the subjects' predictions. When they were wrong, human experts were easily and often "forgiven" for their blunders when the subject made the same error. But this "benefit of the doubt" vote, as Boorman calls it, did not extend to computer algorithms. In fact, when computer algorithms made inaccurate predictions, the subjects appeared to dismiss the value of the algorithm's future predictions, regardless of whether or not the subject agreed with its predictions.

Since the sequence of predictions offered by "human" and algorithm agents was perfectly matched across different test subjects, this finding shows that the mere suggestion that we are observing a human or a computer leads to key differences in how and what we learn about them.

A major motivation for this study was to tease out the difference between two types of learning: what Rangel calls "reward learning" and "attribute learning." "Computationally," says Boorman, "these kinds of learning can be described in a very similar way: We have a prediction, and when we observe an outcome, we can update that prediction."

Reward learning, in which test subjects are given money or other valued goods in response to their own successful predictions, has been studied extensively. Social learning—specifically about the attributes of others (or so-called attribute learning)—is a newer topic of interest for neuroscientists. In reward learning, the subject learns how much reward they can obtain, whereas in attribute learning, the subject learns about some characteristic of other people.

This self/other distinction shows up in the subjects' brain activity, as measured by fMRI during the task. Reward learning, says Boorman, "has been closely correlated with the firing rate of neurons that release dopamine"—a neurotransmitter involved in reward-motivated behavior—and brain regions to which they project, such as the striatum and ventromedial prefrontal cortex. Boorman and colleagues replicated previous studies in showing that this reward system made and updated predictions about subjects' own financial reward. Yet during attribute learning, another network in the brain—consisting of the medial prefrontal cortex, anterior cingulate gyrus, and temporal parietal junction, which are thought to be a critical part of the mentalizing network that allows us to understand the state of mind of others—also made and updated predictions, but about the expertise of people and algorithms rather than their own profit.

The differences in fMRIs between assessments of human and nonhuman agents were subtler. "The same brain regions were involved in assessing both human and nonhuman agents," says Boorman, "but they were used differently."

"Specifically, two brain regions in the prefrontal cortex—the lateral orbitofrontal cortex and medial prefrontal cortex—were used to update subjects' beliefs about the expertise of both humans and algorithms," Boorman explains. "These regions show what we call a 'belief update signal.'" This update signal was stronger when subjects agreed with the "human" agents than with the algorithm agents and they were correct. It was also stronger when they disagreed with the computer algorithms than when they disagreed with the "human" agents and they were incorrect. This finding shows that these brain regions are active when assigning credit or blame to others.

"The kind of learning strategies people use to judge others based on their performance has important implications when it comes to electing leaders, assessing students, choosing role models, judging defendents, and so on," Boorman notes. Knowing how this process happens in the brain, says Rangel, "may help us understand to what extent individual differences in our ability to assess the competency of others can be traced back to the functioning of specific brain regions."

### The study, "The Behavioral and Neural Mechanisms Underlying the Tracking of Expertise," was also coauthored by John P. O'Doherty, professor of psychology and director of the Caltech Brain Imaging Center, and Ralph Adolphs, Bren Professor of Psychology and Neuroscience and professor of biology. The research was supported by the National Science Foundation, the National Institutes of Health, the Betty and Gordon Moore Foundation, the Lipper Foundation, and the Wellcome Trust.


ELSE PRESS RELEASES FROM THIS DATE:

Massive galaxy cluster verifies predictions of cosmological theory

2014-01-16
Massive galaxy cluster verifies predictions of cosmological theory First detection of the Kinetic SZ Effect in an individual galaxy cluster By observing a high-speed component of a massive galaxy cluster, Caltech/JPL scientists and collaborators have detected ...

World's largest animal genome belongs to locust

2014-01-16
World's largest animal genome belongs to locust Offering new insight into explaining their swarming and long-distance migratory behaviors January 14, 2014, Shenzhen, China - Researchers from Institute of Zoology, Chinese Academy of Sciences, BGI and other institutes have successfully decoded ...

Altering the community of gut bacteria promotes health and increases lifespan

2014-01-16
Altering the community of gut bacteria promotes health and increases lifespan Study published in Cell provides first systemic understanding of aging gut Scientists at the Buck Institute for Research on Aging have promoted health and increased lifespan ...

Drugs that weaken traumatic memories hold promise for PTSD treatment

2014-01-16
Drugs that weaken traumatic memories hold promise for PTSD treatment Memories of traumatic events often last a lifetime because they are so difficult to treat through behavioral approaches. A preclinical study in mice published by Cell Press January 16th in the journal Cell ...

The life cycle of a jellyfish (and a way to control it)

2014-01-16
The life cycle of a jellyfish (and a way to control it) Those free-swimming jellyfish in the sea don't start out in that familiar medusa form, but rather start as sessile and asexual polyps. Now, researchers reporting in the Cell Press journal Current Biology on January ...

JCI early table of contents for Jan. 16, 2014

2014-01-16
JCI early table of contents for Jan. 16, 2014 Macrophages target tumor cells following monoclonal antibody therapy Monoclonal antibodies directed against tumor antigens have proven effective for treating some forms of cancer. Despite the increasing use ...

Macrophages target tumor cells following monoclonal antibody therapy

2014-01-16
Macrophages target tumor cells following monoclonal antibody therapy Monoclonal antibodies directed against tumor antigens have proven effective for treating some forms of cancer. Despite the increasing use of monoclonal antibody therapy, it is not clear ...

Targeting a cell cycle inhibitor promotes beta cell replication

2014-01-16
Targeting a cell cycle inhibitor promotes beta cell replication One of the factors underlying the development of type 2 diabetes is loss of β cell mass, resulting in decreased insulin production. Once lost, β cell mass cannot be restored. In ...

Unraveling misfolded molecules using 'reprogrammed' yeast protein

2014-01-16
Unraveling misfolded molecules using 'reprogrammed' yeast protein Implications for new brain disease therapies PHILADELPHIA - At the heart of brain diseases such as amyotrophic lateral sclerosis (ALS), Alzheimer's disease, and Parkinson's ...

The symphony of life, revealed

2014-01-16
The symphony of life, revealed A new imaging technique captures the vibrations of proteins, tiny motions critical to human life BUFFALO, N.Y. — Like the strings on a violin or the pipes of an organ, the proteins in the human body vibrate in different patterns, scientists ...

LAST 30 PRESS RELEASES:

Air pollution impacts an aging society

UC Davis researchers achieve total synthesis of ibogaine

Building better biomaterials for cancer treatments

Brain stimulation did not improve impaired motor skills after stroke

Some species of baleen whales avoid attracting killer whales by singing too low to be heard

Wasteful tests before surgery: Study shows how to reduce them safely

UCalgary researchers confirm best approach for stroke in medium-sized blood vessels

Nationwide, 34 local schools win NFL PLAY 60 grants to help students move more

New software developed at Wayne State University will help study chemical and biological systems

uOttawa study unveils new insights into how neural stem cells are activated in the adult human brain

Cystic fibrosis damages the immune system early on

Novel ‘living’ biomaterial aims to advance regenerative medicine

Warding off superbugs with a pinch of turmeric

Ophthalmic complications in patients on antidiabetic GLP-1 medications are concerning neuro-ophthalmologists

Physicians committee research policy director speaks today at hearing on taxpayer funded animal cruelty

New technology lights way for accelerating coral reef restoration

Electroencephalography may help guide treatments for language disorders

Multinational research project shows how life on Earth can be measured from space

Essential genome of malaria parasite Plasmodium knowlesi mapped

Ice streams move due to tiny ice quakes

Whale song has remarkable similarities to human speech in terms of efficiency

Uncovered: How mice override instinctive fear responses

A pathway that contributes to insulin resistance can be targeted, mouse study shows

Special Issue: The cryosphere

Scientists discover brain mechanism that helps overcome fear

Mantis shrimp clubs filter sound to mitigate damage

Large differences in water-seeking ability found in U.S. corn varieties

Whale song has structure similar to human language

Cracking the Burmese python code: New data zeroes in on game-changing strategies

Risk it or kick it? Study analyzes NFL coaches’ risk tolerance on fourth down

[Press-News.org] Assessing others: Evaluating the expertise of humans and computer algorithms