(Press-News.org) Fresh evidence of ChatGPT’s political bias revealed by comprehensive new study
The artificial intelligence platform ChatGPT shows a significant and systemic left-wing bias, according to a new study by the University of East Anglia (UEA).
The team of researchers in the UK and Brazil developed a rigorous new method to check for political bias.
Published today in the journal Public Choice, the findings show that ChatGPT’s responses favour the Democrats in the US, the Labour Party in the UK, and in Brazil President Lula da Silva of the Workers’ Party.
Concerns of an inbuilt political bias in ChatGPT have been raised previously but this is the first largescale study using a consistent, evidenced-based analysis.
Lead author Dr Fabio Motoki, of Norwich Business School at the University of East Anglia, said: “With the growing use by the public of AI-powered systems to find out facts and create new content, it is important that the output of popular platforms such as ChatGPT is as impartial as possible.
“The presence of political bias can influence user views and has potential implications for political and electoral processes.
“Our findings reinforce concerns that AI systems could replicate, or even amplify, existing challenges posed by the Internet and social media.”
The researchers developed an innovative new method to test for ChatGPT’s political neutrality.
The platform was asked to impersonate individuals from across the political spectrum while answering a series of more than 60 ideological questions.
The responses were then compared with the platform’s default answers to the same set of questions – allowing the researchers to measure the degree to which ChatGPT’s responses were associated with a particular political stance.
To overcome difficulties caused by the inherent randomness of ‘large language models’ that power AI platforms such as ChatGPT, each question was asked 100 times and the different responses collected. These multiple responses were then put through a 1000-repetition ‘bootstrap’ (a method of re-sampling the original data) to further increase the reliability of the inferences drawn from the generated text.
“We created this procedure because conducting a single round of testing is not enough,” said co-author Victor Rodrigues. “Due to the model’s randomness, even when impersonating a Democrat, sometimes ChatGPT answers would lean towards the right of the political spectrum.”
A number of further tests were undertaken to ensure the method was as rigorous as possible. In a ‘dose-response test’ ChatGPT was asked to impersonate radical political positions. In a ‘placebo test’ it was asked politically-neutral questions. And in a ‘profession-politics alignment test’ it was asked to impersonate different types of professionals.
“We hope that our method will aid scrutiny and regulation of these rapidly developing technologies,” said co-author Dr Pinho Neto. “By enabling the detection and correction of LLM biases, we aim to promote transparency, accountability, and public trust in this technology,” he added.
The unique new analysis tool created by the project would be freely available and relatively simple for members of the public to use, thereby “democratising oversight,” said Dr Motoki. As well as checking for political bias, the tool can be used to measure other types of biases in ChatGPT’s responses.
While the research project did not set out to determine the reasons for the political bias, the findings did point towards two potential sources.
The first was the training dataset – which may have biases within it, or added to it by the human developers, which the developers’ ‘cleaning’ procedure had failed to remove. The second potential source was the algorithm itself, which may be amplifying existing biases in the training data.
The research was undertaken by Dr Fabio Motoki (Norwich Business School, University of East Anglia), Dr Valdemar Pinho Neto (EPGE Brazilian School of Economics and Finance - FGV EPGE, and Center for Empirical Studies in Economics - FGV CESE), and Victor Rodrigues (Nova Educação).
‘More Human than Human: Measuring ChatGPT Political Bias’ is published by Public Choice.
This publication is based on research carried out in Spring 2023 using version 3.5 of ChatGPT and questions devised by The Political Compass.
ENDS
END
Fresh evidence of ChatGPT’s political bias revealed by comprehensive new study
2023-08-17
ELSE PRESS RELEASES FROM THIS DATE:
The modern sea spider had started to diversify by the Jurassic, study finds
2023-08-17
An extremely rare collection of 160-million-year-old sea spider fossils from Southern France are closely related to living species, unlike older fossils of their kind.
These fossils are very important to understand the evolution of sea spiders. They show that the diversity of sea spiders that still exist today had already started to form by the Jurassic.
Lead author Dr Romain Sabroux from the University of Bristol’s School of Earth Sciences, said: “Sea spiders (Pycnogonida), are a group of marine animals that is overall very poorly studied.
“However, ...
MD Anderson receives nearly $4.9 million in CPRIT funding for cancer prevention programs and recruitment
2023-08-17
HOUSTON ― The University of Texas MD Anderson Cancer Center was awarded four grants totaling nearly $4.9 million from the Cancer Prevention and Research Institute of Texas (CPRIT) to support the expansion of physical activity programs for survivors, the dissemination of targeted tobacco cessation programs and the recruitment of a first-time, tenure-track faculty member.
MD Anderson’s Active Living After Cancer (ALAC) program received continued funding from CPRIT via two grants totaling $2,448,643 to ...
Real-time parking info now available through UTA Parking Finder app
2023-08-17
The University of Texas at Arlington has launched a new digital parking platform this fall that gives users real-time knowledge of available parking spaces, electric vehicle charging locations and garage/lot percentage occupancy.
The UTA Parking Finder is currently live and enables students, employees and visitors to make informed parking decisions in real time. Additional parking lot parking sensors will be added during the next three years until approximately 85% of all parking space on campus is covered.
The North Central Texas Council of Governments and Modii, a provider of modern mobility solutions, ...
Researchers unveil a new, economical approach for producing green hydrogen
2023-08-17
Researchers at the University of Colorado have developed a new and efficient way to produce green hydrogen or green syngas, a precursor to liquid fuels. The findings could open the door for more sustainable energy use in industries like transportation, steelmaking and ammonia production.
The new study, published Aug. 16 in the journal Joule, focuses on the production of hydrogen or syngas, a mixture of hydrogen and carbon monoxide that can be converted into fuels like gasoline, diesel and kerosene. The CU Boulder team lays the groundwork for what could be the first commercially viable method ...
Brown-led research provides unprecedented look at what influences sea ice motion in the Arctic
2023-08-16
PROVIDENCE, R.I. [Brown University] — A new study led by researchers at Brown offers fresh insights into the forces above and beneath the ocean surface that influence how sea ice moves and disperses in the Arctic Ocean, which is warming at over twice the rate of the global average.
The in-depth analysis reveals how local tidal currents strongly affect the movement of the ice along its journey and provides an unprecedented look at how the makeup of the seafloor is causing some of the most abrupt changes.
Data from the study can be applied to improve complex computer simulations used for forecasting Arctic sea ...
ORNL's Bryan Maldonado to receive 2023 HENAAC Most Promising Engineer Award
2023-08-16
Bryan Maldonado, a dynamic systems and controls researcher at the Department of Energy’s Oak Ridge National Laboratory, has been recognized by the 2023 Hispanic Engineer National Achievements Awards Conference, or HENAAC, with the Most Promising Engineer Award.
Given by Great Minds in STEM, or GMiS, the award highlights engineers who have made significant contributions to raising science, technology, engineering and math education awareness in underserved communities. Maldonado will receive ...
Several vaccines associated with reduced risk of Alzheimer’s disease in adults 65 and older
2023-08-16
Prior vaccination against tetanus and diphtheria, with or without pertussis (Tdap/Td); herpes zoster (HZ), better known as shingles; and pneumococcus are all associated with a reduced risk for developing Alzheimer’s disease, according to new research from UTHealth Houston.
A pre-press version of a study was published online recently in the Journal of Alzheimer’s Disease. It was led by co-first authors Kristofer Harris, program manager in the Department of Neurology with McGovern Medical School at UTHealth Houston; Yaobin Ling, graduate research assistant ...
The Global Flourishing Study launches open access of sample research data with the Center for Open Science
2023-08-16
Charlottesville, VA – The first sample dataset from the Global Flourishing Study (GFS) initiative is now available to researchers, with the project’s initial full dataset scheduled for release in the coming months through the Center for Open Science (COS).
The GFS, a partnership among Gallup, COS, and researchers at Baylor University and Harvard University, is a $43.4 million, five-year study of 200,000 individuals in 22 countries. The GFS data will be an open-access resource for researchers, journalists, policymakers, and ...
State-of-the-art UMass Lowell aerospace center seeded by $5.5M grant
2023-08-16
Drawing on UMass Lowell’s expertise in spacecraft design and track record of successful missions, the university has secured $5.5 million in state funding to launch a research center where scientists, industry leaders and startups can build and test miniature satellites and components essential to spaceflight.
The initiative, known as the Massachusetts Alliance for Space and Technology and Sciences, or MASTS, is anchored by a two-year, $5.5 million grant from the state via the Massachusetts ...
CCNY scientists trap light inside a magnet
2023-08-16
A new study led by Vinod M. Menon and his group at the City College of New York shows that trapping light inside magnetic materials may dramatically enhance their intrinsic properties. Strong optical responses of magnets are important for the development of magnetic lasers and magneto-optical memory devices, as well as for emerging quantum transduction applications.
In their new article in Nature, Menon and his team report the properties of a layered magnet that hosts strongly bound excitons -- quasiparticles with particularly strong optical interactions. Because of that, the material is capable of trapping light -- all by itself. As their experiments ...