(Press-News.org) Evaluation of diagnostic studies is often a challenge in diseases that are not defined by a specific test. Assessment of the accuracy of diagnostic tests is essential because they may be used to define who is considered to have a disease and receive treatment for it. However, measuring the accuracy of a diagnostic test requires an accurate gold standard, which defines which patients truly have and do not have the disease. Studies of diseases not defined by a specific test often rely on expert panels to establish the gold standard. In a systematic review and analysis of the diagnostic literature using expert panels to define the gold standard for a given disease, Loes Bertens and colleagues from University Medical Center Utrecht determined how expert panels were used in such studies and how well their process was described and reliability assessed.
The authors evaluated 81 diagnostic studies published up to May 31, 2012, including studies of diagnostic tests for psychiatric disorders (30 of 81 papers, 37%), half of which pertained to
dementia, cardiovascular diseases (17 papers, 21%), and respiratory disorders (10 papers,
12%). They found that reporting was often incomplete, with 83% of studies missing at least some important information about the expert panel. In 75% of studies the panel consisted of three or fewer members, and panel members were blinded to the results of the test results being evaluated in only 31% of studies. Blinding is important because knowledge of the index text results could influence the panelists' decision as to whether the patient had the disease. Reproducibility of the decision process was assessed in only 21% of studies.
The authors state, "Complete and accurate reporting is a prerequisite for judging potential bias in a study and for allowing readers to apply the same study methods. In total, only 14 (17%) papers reported complete data on key issues such as the panel constitution, the information presented to the panel and the exact decision process to determine the final diagnosis." They also found that despite publication of reporting guidelines, the completeness of reporting did not improve over time, perhaps because the reporting guidelines do not include specific criteria for expert panel diagnoses. The authors make a number of recommendations to improve reporting of expert panel diagnosis. They conclude, "Our review revealed a large variation in applied methods as well as major deficiencies in the reporting of key features of the panel diagnosis process…The results of our review may serve as a starting point in the development of formal guidelines on methodology and reporting of panel diagnosis."
###
Funding: The study was conducted as part of the Dutch National Care for the Elderly Program (ZonMw-NPO). Research grant from the ''Netherlands Organization for Health Research and Development'' (ZonMw grant 311040302). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing Interests: The authors have declared that no competing interests exist.
Citation: Bertens LCM, Broekhuizen BDL, Naaktgeboren CA, Rutten FH, Hoes AW, et al. (2013) Use of Expert Panels to Define the Reference Standard in Diagnostic Research: A Systematic Review of Published Methods and Reporting. PLoS Med 10(10): e1001531. doi:10.1371/journal.pmed.1001531
IN YOUR COVERAGE PLEASE USE THIS URL TO PROVIDE ACCESS TO THE FREELY AVAILABLE PAPER:
http://www.plosmedicine.org/article/info%3Adoi%2F10.1371%2Fjournal.pmed.1001531
Contact:
Loes Bertens
University Medical Center Utrecht
NETHERLANDS
mobile: +31 6 142 86 663
l.c.m.bertens-3@umcutrecht.nl
Expert panel diagnosis for diagnostic test poorly described, experts not blinded to test under study
2013-10-16
ELSE PRESS RELEASES FROM THIS DATE:
Protective pathway identified to counter toxicity associated with Alzheimer's disease
2013-10-16
New research led by Marco Prado, PhD, of Western University has identified a pathway used by the brain to try to protect itself from toxicity that occurs with Alzheimer's disease (AD). Prado and his colleagues at the Robarts Research Institute and at the A.C. Camargo Cancer Center in Brazil have done extensive work on the role of prion protein. They found that toxicity of amyloid-β peptides, one of the major culprits in AD, can be decreased by preventing it from interacting with the prion protein. When a protein called stress-inducible phosphoprotein 1 (STI1) interacts ...
Penn researchers take first step toward a macular dystrophy gene therapy
2013-10-16
Vitelliform macular dystrophy, also known as Best disease, is one of a group of vision-robbing conditions called bestrophinopathies that affect children and young adults. Caused by inherited mutations in the BEST1 gene, these diseases cause severe declines in central vision as patients age.
With a new study, University of Pennsylvania researchers report "encouraging" findings that mark the first clear step in developing a gene therapy that could prevent vision loss or event restore vision in individuals suffering from these conditions.
The research, conducted in dogs, ...
Study finds high variability among primary care physicians in rate of PSA screening of older men
2013-10-16
"No organization recommends prostate-specific antigen (PSA) screening in men older than 75 years. Nevertheless, testing rates remain high," write Elizabeth Jaramillo, M.D., of the University of Texas Medical Branch, Galveston, and colleagues in a Research Letter appearing in the October 16 issue of JAMA. The authors examined whether PSA screening rates would vary substantially among primary care physicians (PCPs) and if the variance would depend on which PCP patients used.
Using complete Medicare Part A and B data for Texas, the researchers selected PCPs whose patient ...
For patients with diabetes, angioplasty and bypass surgery lead to similar long-term benefits for quality of life
2013-10-16
For patients with diabetes and coronary artery disease in more than one artery, treatment with coronary artery bypass graft surgery provided slightly better health status and quality of life between 6 months and 2 years than procedures using drug-eluting stents, although beyond 2 years the difference disappeared, according to a study in the October 16 issue of JAMA.
Although previous studies have demonstrated that coronary artery bypass graft (CABG) surgery is generally preferred over percutaneous coronary intervention (PCI; procedures such as balloon angioplasty or ...
Medication taken for nausea during pregnancy not associated with increased risk of major malformations
2013-10-16
In an analysis that included more than 40,000 women exposed to the nausea medication metoclopramide in pregnancy, use of this drug was not associated with significantly increased risk of major congenital malformations overall, spontaneous abortion, and stillbirth, according to a study in the October 16 issue of JAMA.
More than 50 percent of pregnant women experience nausea and vomiting, typically early in their pregnancy. The care of most women is managed conservatively, but 10 percent to 15 percent of those with nausea and vomiting will eventually receive drug treatment. ...
Researchers estimate 1 in 2,000 people in the UK carry variant CJD proteins
2013-10-16
The survey provides the most robust prevalence measure to date - and identifies abnormal prion protein across a wider age group than found previously and in all genotypes.
An accompanying editorial says that although the disease remains rare, "infection" may be relatively common and doctors need to understand the public health measures that are in place to protect patients.
Variant Creutzfeldt-Jakob disease (vCJD) is a degenerative brain disease – often called the human form of bovine spongiform encephalopathy (BSE) or "mad cow disease." It emerged after widespread ...
New estimates give updated count of Iraq war deaths between 2003 and 2011
2013-10-16
During the U.S.-led invasion and occupation of Iraq from 2003 to 2011, for every three people killed by violence, two died as a result of the collapse of the infrustructure that supports health care, clean water, nutrition, and transportation, according to new estimates in a study from the University of Washington Department of Global Health published Oct. 15 in the open access journal PLOS Medicine. All told, the researchers estimate nearly a half million people died from causes that could be attributed to the war.
Researchers from Johns Hopkins University, Simon Fraser ...
Moderate to severe psoriasis linked to chronic kidney disease, say experts
2013-10-16
The authors recommend closer monitoring for kidney problems in patients with 3% or more of their body surface area affected to help detect and treat signs early and suggest careful consideration of medications which may cause kidney disease in this at risk patient population.
Psoriasis is a common, chronic inflammatory disease of the skin and joints that affects 2-4% of the general population. Increasing evidence suggests that psoriasis is associated with diabetes and heart disease independent of traditional risk factors. Some doctors think psoriasis may also be associated ...
Poorest areas of England will lose out under proposed new NHS funding formula, warn experts
2013-10-16
Professor Clare Bambra and Dr Alison Copeland from Durham University argue that "the more affluent, healthier south east will benefit most and the poorer, less healthy north will lose out substantially." And they urge worried BMJ readers to respond to the consultation.
NHS funding is allocated to areas on the principle of providing "equal opportunity of access for equal need," they explain. To help achieve this, the current NHS allocation formula incorporates a deprivation related measure, known as the "health inequality weighting."
But the relative roles of deprivation ...
World ocean systems undermined by climate change by 2100
2013-10-16
An ambitious new study describes the full chain of events by which ocean biogeochemical changes triggered by manmade greenhouse gas emissions may cascade through marine habitats and organisms, penetrating to the deep ocean and eventually influencing humans.
Previous analyses have focused mainly on ocean warming and acidification, considerably underestimating the biological and social consequences of climate change. Factoring in predictable synergistic changes such as the depletion of dissolved oxygen in seawater and a decline in productivity of ocean ecosystems, the ...