Generative AI’s diagnostic capabilities comparable to non-specialist doctors
Meta-analysis of medical research with LLMs reveals diagnostic accuracy
2025-04-18
(Press-News.org)
The use of generative AI for diagnostics has attracted attention in the medical field and many research papers have been published on this topic. However, because the evaluation criteria were different for each study, a comprehensive analysis was needed to determine the extent AI could be used in actual medical settings and what advantages it featured in comparison to doctors.
A research group led by Dr. Hirotaka Takita and Associate Professor Daiju Ueda at Osaka Metropolitan University’s Graduate School of Medicine conducted a meta-analysis of generative AI’s diagnostic capabilities using 83 research papers published between June 2018 and June 2024 that covered a wide range of medical specialties. Of the large language models (LLMs) that were analyzed, ChatGPT was the most commonly studied.
The comparative evaluation revealed that medical specialists had a 15.8% higher diagnostic accuracy than generative AI. The average diagnostic accuracy of generative AI was 52.1%, with the latest models of generative AI sometimes showing accuracy on par with non-specialist doctors.
“This research shows that generative AI’s diagnostic capabilities are comparable to non-specialist doctors. It could be used in medical education to support non-specialist doctors and assist in diagnostics in areas with limited medical resources.” stated Dr. Takita. “Further research, such as evaluations in more complex clinical scenarios, performance evaluations using actual medical records, improving the transparency of AI decision-making, and verification in diverse patient groups, is needed to verify AI’s capabilities.”
The findings were published in npj Digital Medicine.
###
About OMU
Established in Osaka as one of the largest public universities in Japan, Osaka Metropolitan University is committed to shaping the future of society through “Convergence of Knowledge” and the promotion of world-class research. For more research news, visit https://www.omu.ac.jp/en/ and follow us on social media: X, Facebook, Instagram, LinkedIn.
END
ELSE PRESS RELEASES FROM THIS DATE:
2025-04-18
Bottom Line: A subset of patients with non-small cell lung cancer (NSCLC) who discontinued immune checkpoint inhibitor (ICI) therapy due to immune-related adverse events (irAEs) continued to experience long-term disease control.
Journal in Which the Study was Published: Clinical Cancer Research, a journal of the American Association for Cancer Research (AACR)
Authors: Senior author Mark Awad, MD, PhD, chief of the Thoracic Oncology Service at Memorial Sloan Kettering Cancer Center, and first author Federica Pecci, MD, a research fellow at Dana-Farber Cancer Institute
Background: Immune ...
2025-04-18
In 1638, an earthquake in what is now New Hampshire had Plymouth, Massachusetts colonists stumbling from the strong shaking and water sloshing out of the pots used by Native Americans to cook a midday meal along the St. Lawrence River, according to contemporaneous reports.
When Roger Williams, founder of the Rhode Island colony, talked with local Native Americans, he reported that the younger tribe members were surprised by the earthquake. But older tribe members said they had felt similar shaking four times in the past 80 years.
In his talk at the Seismological ...
2025-04-18
Sediment cores drawn from four lakes in Guatemala record the distinct direction that ground shaking traveled during a 1976 magnitude 7.5 earthquake that devastated the country, according to researchers at the Seismological Society of America’s Annual Meeting.
The earthquake, which killed more than 23,000 people and left about 1.5 million people homeless, took place along the Motagua Fault, at the boundary between the North American and Caribbean tectonic plate boundary.
Severe ground shaking from the 1976 earthquake caused landslides ...
2025-04-18
At the Seismological Society of America’s Annual Meeting, researchers posed a seemingly simple question: how wide are faults?
Using data compiled from single earthquakes across the world, Christie Rowe of the Nevada Seismological Laboratory at the University of Nevada, Reno and Alex Hatem of the U.S. Geological Survey sought a more comprehensive answer, one that considers both surface and deep traces of seismic rupture and creep.
By compiling observations of recent earthquakes, Rowe and Hatem conclude that from Turkey to California, it’s not just a ...
2025-04-17
Our immune systems weaken as we get older, making fewer cells that fight infection and help us recover from illness and injury. Scientists aren’t completely sure why. They may have a better idea now, however, thanks to a new study in GeroScience.
“Immune cell changes occur during aging for a number of reasons, but we still don’t completely understand why we have fewer antibody-producing cells with age,” said Leslie Crews, Ph.D., assistant professor of medicine at University of California San Diego School of Medicine, co-leader of the Hematologic Malignancies Research ...
2025-04-17
Smokers and people who recently quit are more likely to face complications after having an operation than non-smokers, a new study reveals.
Experts say there is an urgent need for focussed action to encourage people to stop smoking before undergoing elective surgery, after the pan-European research revealed that 19.5% of elective surgery patients are current smokers.
Backed by National Institute for Health and Care Research (NIHR) funding, researchers discovered higher smoking rates among younger patients (18-40 years: 26.8%) and male patients (22.1%). Healthy adults without long-term conditions also exhibited ...
2025-04-17
*Note – this is an early press release from the European Congress on Obesity in Malaga, Spain, 11-14 May. Please credit the congress when using this research.*
New research to be presented at this year’s European Congress on Obesity (ECO 2025, Malaga, Spain, 11-14 May) shows that women are much more aware of knowledgeable about the obesity drugs GLP-1/GIP receptor agonists (that include semaglutide and tirzepatide). The study is by Nadja Auerbach, Voy*, London, UK and Dr Austen El-Osta, Director of the Self-Care Academic Research Unit (SCARU) at the School of Public Health, Imperial College London, UK, and colleagues.
Multiple ...
2025-04-17
Research published in the Journal of Neurochemistry has detailed the role of a protein, hnRNP A1, in the formation and stability of myelin, suggesting an important impact on neurodegenerative diseases and mental disorders such as multiple sclerosis and schizophrenia. The findings pave the way for new research and potential treatments.
Myelin is a fatty substance produced by oligodendrocytes (cells of the central nervous system) that forms a sheath, like a kind of “insulator.” It “protects” the extensions of neurons (axons) and increases the conduction speed of nerve impulses that carry information ...
2025-04-17
New York, NY | April 17, 2025 - In an editorial in the American Journal of Public Health, a team led by researchers from the CUNY Graduate School of Public Health and Health Policy (CUNY SPH) say public ignorance and apathy towards bird flu (highly pathogenic avian influenza, or HPAI) could pose a serious obstacle to containing the virus and preventing a larger-scale public health crisis.
The authors, including CUNY SPH Assistant Professor Rachael Piltch-Loeb, Associate Professor Katarzyna Wyka, ...
2025-04-17
Researchers at the Johns Hopkins Bloomberg School of Public Health contributed to a new Centers for Disease Control and Prevention report examining autism among children who turned 4 and 8 years old in 2022. The CDC report, which includes data from 16 study sites across the U.S. including Maryland, found an overall prevalence of autism of 1 in 31 (3.2%) among 8-year-olds in 2022.
The Maryland study site, led by researchers at Bloomberg School’s Wendy Klag Center for Autism and Developmental Disabilities, found a prevalence of 1 in 38 (2.6%) ...
LAST 30 PRESS RELEASES:
[Press-News.org] Generative AI’s diagnostic capabilities comparable to non-specialist doctors
Meta-analysis of medical research with LLMs reveals diagnostic accuracy
