(Press-News.org) What was the question you set out to answer with this study?
ChatGPT, a new language processing tool driven by artificial intelligence (AI), provides conversational text responses to questions and can generate valuable information for enquiring individuals, but the quality of ChatGPT-generated answers to medical questions is currently unclear.
What Methods or Approach Did You Use?
We retrieved eight common questions and answers about colonoscopy from the publicly available webpages of three randomly-selected hospitals from the top-20 list of the US News & World Report Best Hospitals for Gastroenterology and Gastrointestinal Surgery.
We inputted these questions as prompts for ChatGPT for two times on the same day and recorded the ChatGPT-generated answers.
We then used a plagiarism detection software to compare the text similarity among all answers. Finally, to objectively interpret the quality of ChatGPT-generated answers, four gastroenterologists rated 36 random pairs of questions and answers for the following quality indicators on a 7-point scale:
(1) ease of understanding
(2) scientific adequacy
(3) satisfaction with the answer
Raters were also asked to interpret whether the answers were AI-generated or not.
What Did You Find?
ChatGPT answers had extremely low text similarity compared with answers on hospital webpages, while the text similarity ranged from 28% to 77% between the two ChatGPT answers.
ChatGPT answers were rated similarly by gastroenterologists to non-AI answers in terms of ease of understanding, but with the average AI scores higher than non-AI scores. Scores were also similar related to scientific adequacy and satisfaction with the answers. The raters were only 48% accurate in telling which answers were provided by ChatGPT.
This study is the first of its kind to demonstrate that a contemporary large language model–derived conversational AI program is able to provide easy to understand, scientifically adequate, and generally satisfactory answers to common questions about colonoscopy, as determined by gastroenterologists.
Such programs may help to optimize clinical communication to patients, especially for high volume procedures like colonoscopy. Conversational AI empowered by large language models like ChatGPT has the potential to transform and benefit shared decision-making by patients and physicians.
What are the Implications?
Future research should explore responses to a broader sample of patient questions and clinical conditions and include both patients and physicians as raters.
END
Research spotlight: a conversational artificial intelligence program can generate credible medical information in response to common patient questions
2023-05-17
ELSE PRESS RELEASES FROM THIS DATE:
How breast cancer arises
2023-05-17
In what may turn out to be a long-missing piece in the puzzle of breast cancer, Harvard Medical School researchers have identified the molecular sparkplug that ignites cases of the disease currently unexplained by the classical model of breast-cancer development.
A report on the team’s work is published May 17 in Nature.
“We have identified what we believe is the original molecular trigger that initiates a cascade culminating in breast tumor development in a subset of breast cancers that are driven by estrogen,” said study senior investigator Peter Park, professor of ...
Astronomers find potentially volcano-covered Earth-size world
2023-05-17
Cambridge, Mass. – Astronomers have discovered an Earth-size exoplanet, a world beyond the solar system, that may be carpeted with volcanoes and could potentially support life. Called LP 791-18 d, the planet could undergo volcanic outbursts as often as Jupiter’s moon Io, the most volcanically active body in the solar system.
The planet was first reported in Nature and the discovery was made possible in part due to ground-based observations made by the Center for Astrophysics | Harvard & Smithsonian.
LP 791-18 d orbits a small red dwarf star about 90 light-years away in a southern constellation called Crater. The ...
Vigorous exercise not tied to increased risk of adverse events in rare heart condition
2023-05-17
Vigorous exercise does not appear to increase the risk of death or life-threatening arrhythmia for people with hypertrophic cardiomyopathy (HCM), according to a study supported by the National Institutes of Health. HCM is a rare, inherited disorder that causes the heart muscle to become thick and enlarged and affects 1 in 500 people worldwide. It has been associated with sudden cardiac death in young athletes and other young people. However, the study, published in JAMA Cardiology, found that people with the disease who exercise vigorously are no more likely to die or experience severe cardiac events than those who exercised moderately ...
Climate change made record Asia humid heatwave at least 30 times more likely: attribution study
2023-05-17
Human-caused climate change made April’s record-breaking humid heatwave in Bangladesh, India, Laos and Thailand at least 30 times more likely, according to rapid attribution analysis by an international team of leading climate scientists as part of the World Weather Attribution group. The study also concludes that the high vulnerability in the region, which is one of the world’s heatwave hotpots, amplified the impacts.
In April, parts of south and southeast Asia experienced an intense heatwave, with record-breaking temperatures that passed 42ºC in Laos and 45°C in Thailand. The heat ...
Study finds link between deprived areas and number of children in care proceedings in England
2023-05-17
A strong link between the extent of deprivation of local authorities in England and their numbers of children going into the care system through the family courts has been uncovered by researchers at Lancaster University.
The study, available online and due to be published in July 2023 in the journal Children & Society, found that for every one unit increase in the standardized Office for National Statistics’ (ONS) English index of multiple area deprivation, the number of children in care proceedings in English family courts increased by around 70%.
The research team analysed data from the English Children and Family Court Advisory and Support Service ...
Call for papers: JMIR Dermatology special theme issue on teledermatology
2023-05-17
JMIR Dermatology—the official journal of the International Society of Teledermatology (ISTD)—and the journal’s guest editors welcome submissions to a special theme issue to coincide with the 10th ISTD World Congress held at the 23rd World Congress of Dermatology on July 4 to 7, 2023, in Singapore.
This theme issue will allow attendees of the ISTD World Congress to share their work with a wider audience by disseminating their work in a well-respected, peer-reviewed, open-access journal.
Teledermatology has been increasingly gaining recognition as a means of delivering dermatological ...
Researchers show that a machine learning model can improve mortality risk prediction for cardiac surgery patients
2023-05-17
A machine learning-based model that enables medical institutions to predict the mortality risk for individual cardiac surgery patients has been developed by a Mount Sinai research team, providing a significant performance advantage over current population-derived models.
The new data-driven algorithm, built on troves of electronic health records (EHR), is the first institution-specific model for assessing a cardiac patient’s risk prior to surgery, thus allowing health care providers to pursue the best course of action for that individual. The team’s work was described in a study published in The Journal of Thoracic and Cardiovascular Surgery ...
Machine learning lets researchers see beyond the spectrum
2023-05-17
Tokyo, Japan – Organic chemistry, the study of carbon-based molecules, underlies not only the science of living organisms, but is critical for many current and future technologies, such as organic light-emitting diode (OLED) displays. Understanding the electronic structure of a material’s molecules is key to predicting the material’s chemical properties.
In a study recently published by researchers at the Institute of Industrial Science, The University of Tokyo, a machine-learning algorithm was developed to predict the density ...
The predicted average annual net carbon sink of Gracilaria cultivation in China from 2021 to 2030 may double that of the last ten years
2023-05-17
A marine research team led by Professor YAN Qingyun has proposed a method to assess the net carbon sink of marine macroalgae (Gracilaria) cultivation. Then, they calculated the net carbon sink of Gracilaria cultivation in China based on the yield of annual cultivated Gracilaria in the last ten years. Also, the net carbon sink trend of Gracilaria cultivation in the next ten years was predicted by the autoregressive integrated moving average model (ARIMA). Finally, they explored the potential carbon sink increase and methane reduction related to Gracilaria cultivation in China through a scenario analysis.
Their results suggested that the net carbon sink ...
Countries would be well advised to assist each other with regard to gas
2023-05-17
Prior to Putin’s invasion of Ukraine, Europe sourced a great deal of natural gas from Russia. But as a result of EU sanctions on Russia, this supply is no longer there. European countries have scrambled to find and secure new suppliers. But if both the war and these sanctions last into next winter, gas will remain in short supply – especially if next winter is a cold one and people need a lot of gas for heating. There is a distinct possibility that a shortage of gas will mean homes go unheated and will force industry to halt production. As a result, some countries might ...