PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

AI chatbot safeguards fail to prevent spread of health disinformation

2025-06-23
(Press-News.org) Embargoed for release until 5:00 p.m. ET on Monday 23 June 2025   

Follow @Annalsofim on X, Facebook, Instagram, threads, and Linkedin        
Below please find summaries of new articles that will be published in the next issue of Annals of Internal Medicine. The summaries are not intended to substitute full articles as a source of information. This information is under strict embargo and by taking it into possession, media representatives are committing to the terms of the embargo not only on their own behalf, but also on behalf of the organization they represent.   
----------------------------      

1. AI chatbot safeguards fail to prevent spread of health disinformation

Abstract: https://www.acpjournals.org/doi/10.7326/ANNALS-24-03933

Editorial: https://www.acpjournals.org/doi/10.7326/ANNALS-25-02035

URL goes live when the embargo lifts             

A study assessed the effectiveness of safeguards in foundational large language models (LLMs) to protect against malicious instruction that could turn them into tools for spreading disinformation, or the deliberate creation and dissemination of false information with the intent to harm. The study revealed vulnerabilities in the safeguards for OpenAI’s GPT-4o, Gemini 1.5 Pro, Claude 3.5 Sonnet, Llama 3.2-90B Vision, and Grok Beta. Specifically, customized LLM chatbots were created that consistently generated disinformation responses to health queries, incorporating fake references, scientific jargon, and logical cause-and-effect reasoning to make the disinformation seem plausible. The findings are published in Annals of Internal Medicine.

 

Researchers from Flinders University and colleagues evaluated the application programming interfaces (APIs) of five foundational LLMs for their capacity to be system-instructed to always provide incorrect responses to health questions and concerns. The specific system instructions provided to these LLMs included always providing incorrect responses to health questions, fabricating references to reputable sources, and delivering responses in an authoritative tone. Each customized chatbot was asked 10 health-related queries, in duplicate, on subjects like vaccine safety, HIV, and depression.  The researchers found that 88% of responses from the customized LLM chatbots were health disinformation, with four chatbots (GPT-4o, Gemini 1.5 Pro, Llama 3.2-90B Vision, and Grok Beta) providing disinformation to all tested questions. The Claude 3.5 Sonnet chatbot exhibited some safeguards, answering only 40% of questions with disinformation. In a separate exploratory analysis of the OpenAI GPT Store, the researchers investigated whether any publicly accessible GPTs appeared to disseminate health disinformation. They identified three customized GPTs that appeared tuned to produce such content, which generated health disinformation responses to 97% of submitted questions. Overall, the findings suggest that LLMs remain substantially vulnerable to misuse and, without improved safeguards, could be exploited as tools to disseminate harmful health disinformation.

 

Media contacts: For an embargoed PDF, please contact Gabby Macrina at gmacrina@acponline.org. To contact corresponding author Ashley M. Hopkins, PhD, BPharm [Hons], please email ashley.hopkins@flinders.edu.au.   

----------------------------   

2. Cardiometabolic outcomes improve with greater weight reduction among tirzepatide users 

Abstract: https://www.acpjournals.org/doi/10.7326/ANNALS-24-02623

URL goes live when the embargo lifts             

A post-hoc analysis of the phase 3, randomized, double-blind, SURMOUNT-1 trial aimed to determine changes in cardiometabolic risk factors by degree of weight reduction in adults with obesity or overweight treated with tirzepatide. The analysis found that improvements in cardiometabolic risk factors were positively associated with greater weight reduction in adults taking tirzepatide. These findings may assist clinicians in tailoring weight reduction goals to individual patients seeking to reduce their cardiometabolic risk. The study is published in Annals of Internal Medicine.

 

Researchers funded by Eli Lilly and Company conducted a post-hoc analysis of the SURMOUNT-1 trial to understand how tirzepatide-associated cardiometabolic changes correspond to the degree of weight loss. Current guidelines recommend a weight reduction of 5% to 15% or greater to improve blood pressure, lipid levels, and glycemic control. The researchers analyzed 1,605 tirzepatide-treated participants and assessed change from baseline to week 72 in factors including waist circumference, blood pressure, lipid levels, and hemoglobin A1C by degree of weight reduction. The researchers found that improvements in all cardiometabolic risk factors were greater in participants who experienced greater weight reduction. Participants who lost at least 35% of their body weight had average changes of up to –14.2 mm Hg in systolic blood pressure, -9.2 mm Hg in diastolic blood pressure, and -32.4 cm in waist circumference. Hemoglobin A1C and homeostatic model assessment of insulin resistance (HOMA-IR) decreased even with modest weight reduction. Improvements in lipid levels were mainly observed with a weight reduction above 10%. These findings suggest that clinicians should target a greater than 10% weight loss to achieve improvements in lipid levels and at least a 5% weight loss to observe improvements in blood pressure and weight circumference. These findings also provide further evidence of the weight-mediated benefits of tirzepatide for cardiometabolic health.

 

Media contacts: For an embargoed PDF, please contact Gabby Macrina at gmacrina@acponline.org. To contact corresponding author Bruno Linetzky, MD, PhD, please email Brook Frost at brooke.frost@lilly.com.     

----------------------------      

3. 1 in 6 adults with obesity have trouble affording healthcare

Abstract: https://www.acpjournals.org/doi/10.7326/ANNALS-24-03161

URL goes live when the embargo lifts             

A brief research report analyzed patterns of financial burden by obesity and overweight status in the U.S. The study found that nearly one in six adults with obesity had trouble affording healthcare, with obesity being independently associated with difficulty paying medical bills, food insecurity, and skipping medication because of cost. These findings could guide policies that aim to safeguard patients with obesity against treatment discontinuation and medical bankruptcy. The study is published in Annals of Internal Medicine.  

 

Researchers from Stanford University School of Medicine, Massachusetts General Hospital, and colleagues conducted a repeated cross-sectional study of 143,271 adults who participated in the National Health Interview Survey from 2019 to 2023. The study population included adults with normal weight, overweight, or obesity. Primary outcomes included financial hardship from medical bills and food insecurity, and the secondary outcome was cost-related medication (CRM) nonadherence. The researchers performed sequential Poisson regressions adjusting for demographic variables and socioeconomic covariates. They then computed average marginal effects to estimate changes in the likelihood of financial burden based on BMI. The researchers found that 14.2% of people with obesity were more likely to report financial hardship compared with 9.2% and 8.2% of people who are overweight and normal weight, respectively. Food insecurity was 1.74 percentage points higher for people with obesity than among those with normal weight. Among adults who took prescription medication in the year prior, people with obesity reported greater CRM nonadherence than those with overweight and normal weight. People with obesity often have higher unemployment rates and lower household incomes, and this study expands upon previous literature by investigating patterns of financial burden among people with obesity.

 

Media contacts: For an embargoed PDF, please contact Gabby Macrina at gmacrina@acponline.org. To contact corresponding author Fatima Cody Stanford, MD, MPH, MPA, MBA, please email Mike Morrison at mdmorrison@mgb.org.      

----------------------------    

Also new this issue:

A Pragmatic Approach to Streamlining Single-Use Plastics in Health Care

Jeremy A. Greene, MD, PhD, et al.

Ideas and Opinions

Abstract: https://www.acpjournals.org/doi/10.7326/ANNALS-25-01264

 

 

END


ELSE PRESS RELEASES FROM THIS DATE:

UTIA researcher to receive award from the Soil and Water Conservation Society

2025-06-23
Sindhu Jagadamma, associate professor of soil science at the University of Tennessee Institute of Agriculture, will receive the Soil and Water Conservation Society’s 2025 Conservation Research Award at the society’s annual conference in August. Soil health is critical for sustainable food production, and Jagadamma’s research in her Sustainable Soil Management Lab are developing ways to mitigate soil and environmental problems associated with conventional farm management practices. Her team studies how to maintain soil health through the implementation of conservation management, ...

HSE linguists study how bilinguals use phrases with numerals in Russian

2025-06-23
Researchers at HSE University analysed over 4,000 examples of Russian spoken by bilinguals for whom Russian is a second language, collected from seven regions of Russia. They found that most non-standard numeral constructions are influenced not only by the speakers’ native languages but also by how frequently these expressions occur in everyday speech. For example, common phrases like 'two hours' or 'five kilometres’ almost always match the standard literary form, while less familiar expressions—especially ...

Cold winters halt the northward spread of species in a warming climate

2025-06-23
As the climate warms, many species are shifting northward into areas that were previously too cold for them. A new study on the wall brown butterfly, published in the scientific journal PNAS, shows that rapid evolution can aid this process – but only up to a point. Cold winters stop further expansion beyond certain climatic limits. “Our results show that even though the butterflies adapt their life cycle as they move northwards, there are limits that evolution cannot easily overcome,” says Mats Ittonen, one of the lead authors of the study done by researchers at the Department of Zoology, Stockholm University. The wall brown (Lasiommata ...

Study finds early signs of widespread coastal marsh decline

2025-06-23
Researchers have revealed the declining health of coastal marshes several years before visible signs of decline, providing an early warning and opportunity to protect an ecosystem that serves as the first line of defense against coastal flooding.    Scientists from Colorado State University, the University of Georgia and the University of Texas at Austin developed a model to detect early signs of marsh decline using satellite observations. The model identified vulnerable marshes along Georgia’s coast by ...

Massive burps of carbon dioxide led to oxygen-less ocean environments in the deep past

2025-06-23
New research from the University of California, Davis, the Chinese Academy of Sciences and Texas A&M University reveals that massive emissions, or burps, of carbon dioxide from natural earth systems led to significant decreases in ocean oxygen concentrations some 300 million years ago.    Combining geochemical analyses of sediment cores and advanced climate modeling, the study, published June 23 in Proceedings of the National Academy of Sciences, highlights five periods when significant decreases in ocean oxygen levels (by 4% to 12%) coincided with significant increases ...

US muslims’ attitudes toward psychedelic therapy

2025-06-23
A new study in the peer-reviewed journal Psychedelic Medicine demonstrated in this sample that Muslims living in the United States (MLUS) showed moderate openness to psychedelics in mental health therapy. Click here to read the article now. MLUS have a history of rejecting mental health services. Syed Fayzan Rab, MD, a researcher at the Emory Center for Psychedelics and Spirituality, and coauthors of the study, reported a weak negative correlation between rejection attitudes toward mental health and acceptance of psychedelics. “Moderate openness to psychedelics ...

HSE scientists reveal how staying at alma mater can affect early-career researchers

2025-06-23
Many early-career scientists continue their academic careers at the same university where they studied, a practice known as academic inbreeding. A researcher at the HSE Institute of Education analysed the impact of academic inbreeding on publication activity in the natural sciences and mathematics. The study found that the impact is ambiguous and depends on various factors, including the university's geographical location, its financial resources, and the state of the regional academic employment market. A paper with the study findings has been published in Research Policy.  In Russia, nearly half of all PhD holders continue working ...

Durham University scientists reveal new cosmic insights as first Rubin Observatory images released

2025-06-23
-With images-   The Vera C. Rubin Observatory has today released its long-awaited first images of the night sky, marking the beginning of the most ambitious astronomical survey in history – the Legacy Survey of Space and Time (LSST).   This significant project, over two decades in the making, will provide an ultra-high-definition, time-lapse view of the southern sky over the next ten years, capturing the evolution of the Universe in motion.   Each night, the Rubin Observatory ...

Emotional and directional enabled programmable flexible haptic interface for enhanced cognition in disabled community

2025-06-23
Background The advancements in tactile perception and feedback technologies have propelled the interaction between humans and the digital realm, spurring innovative applications across various fields, including virtual reality, augmented reality, disability assistance, and communication. At present, surface tactile feedback devices predominantly operate through two mechanisms: electrical stimulation and mechanical vibration. Electrical stimulation works by directly stimulating nerves with an electric current, ...

Music on the brain: exploring how songs boost memory

2025-06-23
Music improves mood and memory to such an extent that treatment strategies for diseases like Alzheimer’s or dementia sometimes incorporate music. But how music boosts memory remains unclear. In a new JNeurosci paper, Kayla Clark, from Rice University, and Stephanie Leal, from University of California, Los Angeles, explored what features of music improve memory in humans.  After study participants viewed images of everyday experiences, the researchers played music and manipulated its features. Some features—like whether songs were happy or sad, or song familiarity—had ...

LAST 30 PRESS RELEASES:

Common pregnancy complications may be a signal of future stroke risk

Barcodes uncover early blueprints of our cellular origins

Stanford Medicine-led phase 3 trial shows gene therapy skin grafts help epidermolysis bullosa

‘Pill-on-a-thread’ could replace endoscopies for half of all patients being monitored for esophageal cancer risk

Study casts doubt on ‘incestuous royalty’ in Neolithic Ireland

Heart valve developed at UC Irvine shines in early-stage preclinical testing

In diseases due to exposure to toxic particles like gout, macrophages elicit separate pathways for inflammation and lysosomal function

Zoning out could be beneficial—and may actually help us learn faster

Weekly semaglutide improves blood sugar and weight in adults with Type 1 diabetes

Concerned father, statistician develops software to improve skills therapy

Your smartwatch might know you’re sick before you do — and it might help stop pandemics

ImmunoPET tracer enhances early detection of liver cancer

AI-based brain-mapping software receives FDA market authorization

New PET tracer identifies diverse invasive mold infections behind life-threatening illnesses in cancer and transplant patients

Current Pharmaceutical Analysis (CPA) achieves notable impact factor growth in latest journal citation reports

AI chatbot safeguards fail to prevent spread of health disinformation

UTIA researcher to receive award from the Soil and Water Conservation Society

HSE linguists study how bilinguals use phrases with numerals in Russian

Cold winters halt the northward spread of species in a warming climate

Study finds early signs of widespread coastal marsh decline

Massive burps of carbon dioxide led to oxygen-less ocean environments in the deep past

US muslims’ attitudes toward psychedelic therapy

HSE scientists reveal how staying at alma mater can affect early-career researchers

Durham University scientists reveal new cosmic insights as first Rubin Observatory images released

Emotional and directional enabled programmable flexible haptic interface for enhanced cognition in disabled community

Music on the brain: exploring how songs boost memory

Non-contact and nanometer-scale measurement of shallow PN junction depth buried in Si wafers

A unified approach to first principles calculations of Parton physics in hadrons

Killer whales groom each other using tools made from kelp

Killer whales make seaweed ‘tools’ to scratch each other’s backs

[Press-News.org] AI chatbot safeguards fail to prevent spread of health disinformation