(Press-News.org) OAK BROOK, Ill. – A new artificial intelligence (AI) model combines imaging information with clinical patient data to improve diagnostic performance on chest X-rays, according to a study published in Radiology, a journal of the Radiological Society of North America (RSNA).
Clinicians consider both imaging and non-imaging data when diagnosing diseases. However, current AI-based approaches are tailored to solve tasks with only one type of data at a time.
Transformer-based neural networks, a relatively new class of AI models, have the ability to combine imaging and non-imaging data for a more accurate diagnosis. These transformer models were initially developed for the computer processing of human language. They have since fueled large language models like ChatGPT and Google’s AI chat service, Bard.
“Unlike convolutional neural networks, which are tuned to process imaging data, transformer models form a more general type of neural network,” said study lead author Firas Khader, M.Sc., a Ph.D. student in the Department of Diagnostic and Interventional Radiology at University Hospital Aachen in Aachen, Germany. “They rely on a so-called attention mechanism, which allows the neural network to learn about relationships in its input.”
This capability is ideal for medicine, where multiple variables like patient data and imaging findings are often integrated into the diagnosis.
Khader and colleagues developed a transformer model tailored for medical use. They trained it on imaging and non-imaging patient data from two databases containing information from a combined total of more than 82,000 patients.
The researchers trained the model to diagnose up to 25 conditions using non-imaging data, imaging data, or a combination of both, referred to as multimodal data.
Compared to the other models, the multimodal model showed improved diagnostic performance for all conditions.
The model has potential as an aid to clinicians in a time of growing workloads.
“With patient data volumes increasing steadily over the years and time that the doctors can spend per patient being limited, it might become increasingly challenging for clinicians to interpret all available information effectively,” Khader said. “Multimodal models hold the promise to assist clinicians in their diagnosis by facilitating the aggregation of the available data into an accurate diagnosis.”
The proposed model could serve as a blueprint for seamlessly integrating large data volumes, Khader said.
“Multimodal Deep Learning for Integrating Chest Radiographs and Clinical Parameters - A Case for Transformers.” Collaborating with Dr. Khader were Gustav Müller-Franzes, M.Sc., Tianci Wang, B.Sc., Tianyu Han, M.Sc., Soroosh Tayebi Arasteh, M.Sc., Christoph Haarburger, Ph.D., Johannes Stegmaier, Ph.D., Keno Bressem, M.D., Christiane Kuhl, M.D., Sven Nebelung, M.D., Jakob Nikolas Kather, M.D., and Daniel Truhn, M.D., Ph.D.
In 2023, Radiology is celebrating its 100th anniversary with 12 centennial issues, highlighting Radiology’s legacy of publishing exceptional and practical science to improve patient care.
Radiology is edited by Linda Moy, M.D., New York University, New York, N.Y., and owned and published by the Radiological Society of North America, Inc. (https://pubs.rsna.org/journal/radiology)
RSNA is an association of radiologists, radiation oncologists, medical physicists and related scientists promoting excellence in patient care and health care delivery through education, research and technologic innovation. The Society is based in Oak Brook, Illinois. (RSNA.org)
For patient-friendly information on chest X-rays, visit RadiologyInfo.org.
A two-phase NIH grant will fund research into a new CRISPR-based gene therapy platform that will target genetic brain diseases like Angelman syndrome and H1-4 (HIST1H1E) syndrome.
A roughly $40 million National Institutes of Health (NIH) grant awarded to Yale School of Medicine will support the development of a gene-editing platform technology capable of reaching the human brain. The innovative new genome-editing technology, which was developed from the first phase from NIH Common Fund Somatic Cell Genome Editing (SCGE) program, could potentially lead to treatments or cures for many neurogenetic diseases.
Neurogenetic disorders ...
When scientists viewed the James Webb Space Telescope’s (JWST) first images of the universe’s earliest galaxies, they were shocked. The young galaxies appeared too bright, too massive and too mature to have formed so soon after the Big Bang. It would be like an infant growing into an adult within just a couple years.
The startling discovery even caused some physicists to question the standard model of cosmology, wondering whether or not it should be upended.
Using new simulations, a Northwestern University-led ...
Van Andel Institute’s Nick Burton, Ph.D., has earned a five-year, nearly $2.9 million New Innovator Award from the National Institutes of Health Common Fund to find new ways to fix or prevent insulin resistance, a key driver of Type 2 diabetes.
Although manageable with treatment, there currently is no way to repair the underlying mechanisms that cause the disease. Furthermore, it remains unclear why some people are more prone to Type 2 diabetes while others are resistant. To find a solution, Burton ...
SAN ANTONIO — October 3, 2023 —A new study led by Southwest Research Institute (SwRI) Planetary Scientist and Associate Vice President Dr. Alan Stern posits that the large, approximately 5-kilometer-long mounds that dominate the appearance of the larger lobe of the pristine Kuiper Belt object Arrokoth are similar enough to suggest a common origin. The SwRI study suggests that these “building blocks” could guide further work on planetesimal formational models. Stern presented these findings this week ...
NEW YORK, Oct. 3, 2023 — Mandë Holford, a professor in the Chemistry and Biochemistry departments at Hunter College and The City University of New York Graduate Center (CUNY Graduate Center), has won a National Institutes of Health Common Fund Pioneer Award for her trailblazing research exploring the therapeutic opportunities and properties of venoms from cephalopods and other marine mollusks. Holford received one of eight Pioneer Awards granted in 2023, which will total more than $47.7 million over five years.
This is the first time a CUNY ...
AUGUSTA, Ga. (Oct. 4, 2022) – A synthetic peptide developed by researchers at the Medical College of Georgia could help reduce vascular problems associated with acute respiratory distress syndrome in COVID-19.
In severe cases, COVID-19 is associated with the syndrome, which happens when fluid builds up in the tiny, elastic air sacs in the lungs, keeping them from filling with enough air and keeping oxygen from reaching the bloodstream. “These are the people who get the sickest from ...
MedAxiom, the premier source for cardiovascular organizational performance solutions, has released its 2023 Cardiovascular Provider Compensation and Production Survey Report that includes data from the largest number of providers since its debut. The report features a foreword from MedAxiom President and CEO Jerry Blackwell, MD, MBA, FACC, on the consistency of year-over-year data from 2021 to 2022, the importance of a robust pool of data to form the foundation of the report, and the application of data as a strategic planning tool.
2023 Report Highlights:
Compensation and production ...
Quantum annealing (QA) is a cutting-edge algorithm that leverages the unique properties of quantum computing to tackle complex combinatorial optimization problems (a class of mathematical problems dealing with discrete-variable functions). Quantum computers use the rules of quantum physics to solve such problems potentially faster than classical computers. In essence, they can explore multiple solutions to a problem simultaneously, giving them a significant speed advantage for certain tasks over classical computers. In particular, QA harnesses the phenomenon of “quantum ...
LOS ANGELES — City of Hope, one of the largest cancer research and treatment organizations in the United States, is opening a multicenter clinical trial to evaluate the efficacy of robotic-assisted, single-incision mastectomies. The minimally invasive procedure, which preserves the nipple and leaves only a small hidden scar on the side of the body, could potentially lead to significant improvements for breast surgery.
“City of Hope is once again taking the lead in investigating innovations, treatments and therapies that are making big leaps forward for patients with cancer. We’re participating ...
Oak Brook, IL – A Special Issue of SLAS Discovery, Emerging Drug Discovery Ecosystems, is new for September. Volume 28, Issue 6 features three perspectives, one original research article and one protocol that align with the Virginia Drug Discovery Consortium (VaDDC) and its efforts to enhance and promote drug discovery and development in the Commonwealth of Virginia.
An acute respiratory distress syndrome drug development collaboration stimulated by the Virginia Drug Discovery Consortium