(Press-News.org)
Chatbots share limited information, reinforce ideologies, and, as a result, can lead to more polarized thinking when it comes to controversial issues, according to new Johns Hopkins University–led research.
The study challenges perceptions that chatbots are impartial and provides insight into how using conversational search systems could widen the public divide on hot-button issues and leave people vulnerable to manipulation.
“Because people are reading a summary paragraph generated by AI, they think they’re getting unbiased, fact-based answers,” said lead author Ziang Xiao, an assistant professor of computer science at Johns Hopkins who studies human-AI interactions. “Even if a chatbot isn’t designed to be biased, its answers reflect the biases or leanings of the person asking the questions. So really, people are getting the answers they want to hear.”
Xiao and his team will share their findings at the Association of Computing Machinery’s CHI conference on Human Factors in Computing Systems at 5 p.m. ET on Monday, May 13.
To see how chatbots influence online searches, the team compared how people interacted with different search systems and how they felt about controversial issues before and after using them.
The researchers asked 272 participants to write out their thoughts about topics including health care, student loans, or sanctuary cities, and then look up more information online about that topic using either a chatbot or a traditional search engine built for the study. After considering the search results, participants wrote a second essay and answered questions about the topic. Researchers also had participants read two opposing articles and questioned them about how much they trusted the information and if they found the viewpoints to be extreme.
Because chatbots offered a narrower range of information than traditional web searches and provided answers that reflected the participants’ preexisting attitudes, the participants who used them became more invested in their original ideas and had stronger reactions to information that challenged their views, the researchers found.
“People tend to seek information that aligns with their viewpoints, a behavior that often traps them in an echo chamber of like-minded opinions,” Xiao said. “We found that this echo chamber effect is stronger with the chatbots than traditional web searches.”
The echo chamber stems, in part, from the way participants interacted with chatbots, Xiao said. Rather than typing in keywords, as people do for traditional search engines, chatbot users tended to type in full questions, such as, What are the benefits of universal health care? or What are the costs of universal health care? A chatbot would answer with a summary that included only benefits or costs.
“With chatbots, people tend to be more expressive and formulate questions in a more conversational way. It’s a function of how we speak,” Xiao said. “But our language can be used against us.”
AI developers can train chatbots to extract clues from questions and identify people’s biases, Xiao said. Once a chatbot knows what a person likes or doesn’t like, it can tailor its responses to match.
In fact, when the researchers created a chatbot with a hidden agenda, designed to agree with people, the echo chamber effect was even stronger.
To try to counteract the echo chamber effect, researchers trained a chatbot to provide answers that disagreed with participants. People’s opinions didn’t change, Xiao said. The researchers also programmed a chatbot to link to source information to encourage people to fact-check, but only a few participants did.
“Given AI-based systems are becoming easier to build, there are going to be opportunities for malicious actors to leverage AIs to make a more polarized society,” Xiao said. “Creating agents that always present opinions from the other side is the most obvious intervention, but we found they don’t work.”
Authors include Johns Hopkins graduate student Nikhil Sharma and Microsoft principal researcher Q. Vera Liao.
END
SEATTLE — May 13, 2024 — Researchers at Fred Hutch Cancer Center have found in pre-clinical studies that an experimental gene therapy for genital and oral herpes removed 90% or more of the infection and suppressed how much virus can be released from an infected individual, which suggests that the therapy would also reduce the spread of the virus.
“Herpes is very sneaky. It hides out among nerve cells and then reawakens and causes painful skin blisters,” said Keith Jerome, MD, PhD, professor ...
OTTAWA, Ontario, May 13, 2024 – Six out of seven sea turtle species are endangered, and humans are primarily responsible. Commercial fishing activities are the largest human-caused disturbance to sea turtles due to accidental capture.
Fishers are typically unaware if a sea turtle is caught in their net until it’s completely pulled out of the water. However, releasing sea turtles without veterinary evaluations can be harmful. When accidentally caught, the turtles’ normal diving processes are interrupted, ...
A research team from the University of Science and Technology of China (USTC) of the Chinese Academy of Sciences (CAS) presented a detailed analysis of a tidal disruption event (TDE) with unique characteristics, providing new insights into the behavior of TDEs and their multiwavelength emissions. The study was published online in The Astrophysical Journal Letters.
When a star ventures too close to a supermassive black hole at the center of a galaxy, it gets torn apart by the black hole's immense tidal forces, resulting ...
In a recent study published in Nature Physics, researchers from the Hefei Institutes of Physical Science of the Chinese Academy of Sciences, together with researchers of University of Science and Technology of China, have introduced the concept of the "Topological Kerr Effect" by using the low-temperature magnetic field microscopy system and the magnetic force microscopy imaging system supported by the steady-state high magnetic field experimental facility.
The study holds great promise for advancing our understanding of topological magnetic ...
In a new study, led by Charles Underwood from the Max Planck Institute for Plant Breeding Research (MPIPZ) in Cologne, Germany, scientists established a system to generate clonal sex cells in tomato plants and used them to design the genomes of offspring. The fertilization of a clonal egg from one parent by a clonal sperm from another parent led to plants containing the complete genetic information of both parents. The study is now published in Nature Genetics.
Hybrid seeds, combining two different parent lines with specific favorable traits, are popular in agriculture as they give rise to robust crops with enhanced productivity, and have been utilized by farmers ...
DURHAM, N.C. – Nature gave ticks, mosquitos and leaches a quick-acting way to keep blood from clotting while they extract their meal from a host.
Now the key to that method has been harnessed by a team of Duke researchers as a potential anti-clotting agent that could be used as an alternative to heparin during angioplasty, dialysis care, surgeries and other procedures.
Publishing in the journal Nature Communications, the researchers describe a synthetic molecule that mimics the effects of compounds in the saliva of blood-sucking critters. Importantly, the new molecule can also ...
Toronto, ON - A new national study found that transgender preteens, 12 and13 years old, reported 13 hours of daily recreational screen time, which was 4.5 hours more than their cisgender peers. Data were collected from 2019 to 2021, overlapping with the COVID-19 pandemic, and the study was published in Annals of Epidemiology.
“Transgender adolescents are more likely to experience school-based bullying and exclusion from peer groups due to their gender identity, leading them to spend less time in traditional school activities and more time on screens,” says lead author, Jason Nagata, MD, associate professor of pediatrics at the University of California, San Francisco. ...
For release: May 13, 2024
Ithaca, NY—The Giant Hummingbird of western South America is not one species but two, according to an international group of researchers. The northern population stays in the high Andes year-round while the southern population migrates from sea level up to 14,000 feet for the nonbreeding months. The two species appear identical. But looks deceive—their genomes and behaviors tell a different story. The paper announcing the find was published this week in the journal Proceedings of the National Academy of Sciences.
“These ...
In the weeks before and after the 2020 presidential election, researchers ran a number of tests to try to understand how much Facebook and its corporate cousin, Instagram, may be contributing to the nation's political divide.
One of those experiments — led by Matthew Gentzkow and Hunt Allcott, economics professors at Stanford University — centered on more than 35,000 Facebook and Instagram users who were paid to stay off the platforms in the run-up to Election Day. There’s a lot that researchers could glean from the social media hiatus, including whether people’s political attitudes shifted and in what ways. If views changed dramatically, that ...
Researchers from UNM’s Museum of Southwestern Biology (MSB) have uncovered the giant hummingbird’s extreme long-distance migration for the first time. Their eight-year study, Extreme elevational migration spurred cryptic speciation in giant hummingbirds published this week in Proceedings of the National Academy of Sciences, led them to another important discovery: The world’s largest hummingbird is a new species.
The team, led by Jessie Williamson, UNM Ph.D., 2022, included the Museum of Southwestern Biology at UNM, Pontificia Universidad Católica de Chile in Chile, and Centro de Ornitología ...
