Testing and evaluation of health care applications of large language models

JAMA

2024-10-15

(Press-News.org) About The Study: Existing evaluations of large language models mostly focus on accuracy of question answering for medical examinations, without consideration of real patient care data. Dimensions such as fairness, bias, and toxicity and deployment considerations received limited attention. Future evaluations should adopt standardized applications and metrics, use clinical data, and broaden focus to include a wider range of tasks and specialties.

Corresponding Author: To contact the corresponding author, Nigam H. Shah, MBBS, PhD, email nigam@stanford.edu.

To access the embargoed study: Visit our For The Media website at this link https://media.jamanetwork.com/

(doi:10.1001/jama.2024.21700)

Editor’s Note: Please see the article for additional information, including other authors, author contributions and affiliations, conflict of interest and financial disclosures, and funding and support.

# # #

Embed this link to provide your readers free access to the full-text article This link will be live at the embargo time https://jamanetwork.com/journals/jama/fullarticle/10.1001/jama.2024.21700?guestAccessKey=dcffc9b1-79d9-4409-9187-a60ea9c30a51&utm_source=For_The_Media&utm_medium=referral&utm_campaign=ftm_links&utm_content=tfl&utm_term=101524

END

ELSE PRESS RELEASES FROM THIS DATE:

FDA perspective on the regulation of AI in health care and biomedicine

2024-10-15

About The Study: Strong oversight by the U.S. Food and Drug Administration (FDA) protects the long-term success of industries by focusing on evaluation to advance regulated technologies that improve health. The FDA will continue to play a central role in ensuring safe, effective, and trustworthy AI tools to improve the lives of patients and clinicians alike. However, all involved entities will need to attend to AI with the rigor this transformative technology merits. Corresponding Author: To contact the corresponding author, Haider J. Warraich, MD, email haider.warraich@fda.hhs.gov. To ...

Arthropods dominate plant litter decomposition in drylands

2024-10-15

Researchers have shown that larger insects such as woodlice and beetles play as much of a crucial role in leaf litter decomposition across different habitats and seasons as microbes and smaller invertebrates. The research, published today as a final Version of Record after previously appearing as a Reviewed Preprint in eLife, was described by editors as a fundamental study that substantially advances our understanding of the role of different-sized soil invertebrates in shaping the rates of leaf litter decomposition. The authors provide compelling evidence that the summed effects of all decomposers on decomposition rates, with large-sized invertebrates being ...

World-renowned organic chemists attend inaugural science symposium hosted by Rice’s Global Paris Center

2024-10-15

The inaugural Art and Science of Total Synthesis of Natural and Designed Molecules for Biology and Medicine (ASTS-NDM 2024) symposium brought together some of the world’s most renowned organic chemists Oct. 2-4 at the historic Club de la Chasse et de la Nature in Paris. Hosted by Rice University’s Global Paris Center , the event explored the evolving role of synthetic organic chemistry and total synthesis of natural and designed molecules in fields such as medicine, materials science and chemical biology. The three-day symposium attracted leading figures in synthetic organic chemistry, featuring 18 speakers who presented ...

The trees of Miami’s future

2024-10-15

In Miami—a place known for one of the most diverse tree canopies in the world—nearly half of the native trees may struggle to survive in the coming decades, a new University of Miami study indicates. Due to global warming, temperatures may simply become too hot for some of the types of trees that dominate the city’s current landscape, like live oaks, slash pines, and cabbage palms. But the research also found that strategically planting more tropical trees may help the local canopy stay resilient in the face of climate change. Through an extensive data analysis project, a team of ecologists in the Department of Biology in the College of Arts and Sciences discovered ...

MIT team takes a major step toward fully 3D-printed active electronics

2024-10-15

CAMBRIDGE, MA – Active electronics — components that can control electrical signals — usually contain semiconductor devices that receive, store, and process information. These components, which must be made in a clean room, require advanced fabrication technology that is not widely available outside a few specialized manufacturing centers. During the Covid-19 pandemic, the lack of widespread semiconductor fabrication facilities was one cause of a worldwide electronics shortage, which drove up costs for consumers and had implications in everything from economic growth to national defense. The ability to 3D print an entire, active electronic ...

Accelerated three-year medical school students perform as well as peers in traditional four-year programs

2024-10-15

Graduates who went to medical school for three years performed equally well on tests of skill and knowledge as their peers who followed a four-year program, a new study shows. The accelerated three-year MD pathway offered by NYU Grossman School of Medicine beginning in 2013 was designed to help students earn their medical degrees sooner with reduced debt, which some experts say reaches $250,000 on average by graduation. The school was the first in the United States to offer a three-year MD program that ...

SwRI-developed instruments will study potential habitability of Jupiter’s moon Europa

2024-10-15

SAN ANTONIO — October 15, 2024 —Two Southwest Research Institute instruments were launched aboard NASA’s Europa Clipper spacecraft on Oct. 14 from the agency’s Kennedy Space Center. The spacecraft is designed to conduct a detailed reconnaissance of Jupiter’s moon Europa, investigating whether it could hold conditions suitable for life. The SwRI-developed MAss Spectrometer for Planetary EXploration (MASPEX) and Ultraviolet Spectrograph (Europa-UVS) are among nine science instruments and a gravity science investigation that were developed to explore Europa, Jupiter’s fourth-largest ...

Proposed scoring system may enhance equity in organ transplantation, increase transplant rates and improve patient survival

2024-10-15

Tuesday, Oct. 15, 2024, Cleveland: Researchers at Cleveland Clinic and Case Western Reserve University (CWRU) have developed a new method that could potentially help provide better access to lung transplant for transplant candidates who are hard to match because of their blood type or height. An analysis published in the Journal of Heart & Lung Transplantation showed significant inequity in lung transplant access based on these candidate characteristics and proposes a method for addressing it. Lung transplant candidates require organs from donors of similar height and compatible blood type. Currently, to allow equally sick candidates equal ...

Survivors of childhood brain cancer are more likely to be held back in school

2024-10-15

In 2019, Raymond Mailhot was visiting with a young patient and his family facing a scary diagnosis – brain cancer. Treatments were incredibly effective, and the young boy was going to survive, Mailhot shared in Spanish with the Venezuelan immigrants. But life would be disrupted at home, at the hospital, and at school, likely for months, he said. “His story really made me want to dig deeper into the scholastic performance of survivors,” said Mailhot, M.D., M.P.H, an associate professor of radiation oncology at the University of Florida. “We discovered that survivors had twice the odds of being held back and performed significantly worse on state testing ...

Updating offshore turbine designs to reflect storms’ complexity is key

2024-10-15

WASHINGTON, Oct. 15, 2024 – The U.S. is ramping up plans for a major increase in offshore wind production, with 30 gigawatts of new installations expected by 2030 and a total of 110 gigawatts by 2050. But to be successful, the country needs to design turbines that can withstand the challenges of tropical storms. “Extreme weather impacts on offshore wind turbines are not fully understood by the industry,” author Jiali Wang said. “Manufacturers design wind turbines based on international design standards, but better models and data are needed to study the impacts of extreme weather ...

Testing and evaluation of health care applications of large language models

ELSE PRESS RELEASES FROM THIS DATE:

LAST 30 PRESS RELEASES: