(Press-News.org) Depending on the analysis strategy used, estimating treatment outcomes in metaanalyses may differ and may result in major alterations in the conclusions derived from the analysis, according to a study in the August 13 issue of JAMA.
Meta-analyses of randomized clinical trials (RCTs) are generally considered to provide among the best evidence of efficacy of medical interventions. They should be conducted as part of a systematic review, a scientifically rigorous approach that identifies, selects, and appraises all relevant studies. Which trials to combine in a metaanalysis remains a persistent dilemma. Meta-analysis of all trials may produce a precise but biased estimate, according to background information in the article.
Agnes Dechartres, M.D., Ph.D., of the Centre de Recherche Epidemiologie et Statistique, INSERM U1153, Paris, and colleagues compared treatment outcomes estimated by meta-analysis of all trials and several alternative strategies for analysis: single most precise trial (i.e., trial with the narrowest confidence interval), meta-analysis restricted to the 25 percent largest trials, limit meta-analysis (a meta-analysis model adjusted for small-study effect), and meta-analysis restricted to trials at low overall risk of bias. The researchers included 163 meta-analyses published between 2008 and 2010 in high-impact-factor journals and between 2011 and 2013 in the Cochrane Database of Systematic Reviews: 92 (705 RCTs) with subjective outcomes and 71 (535 RCTs) with objective outcomes.
The researchers found that treatment outcome estimates differed depending on the analytic strategy used, with treatment outcomes frequently being larger with meta-analysis of all trials than with the single most precise trial, meta-analysis of the largest trials, and limit metaanalysis. The difference in treatment outcomes between these strategies was substantial in 47 of 92 (51 percent) meta-analyses of subjective outcomes and in 28 of 71 (39 percent) meta-analyses of objective outcomes. The authors did not find any difference in treatment outcomes by overall risk of bias.
"In this study, we compared meta-analysis of all trials with several 'bestevidence' alternative strategies and found that estimated treatment outcomes differed depending on the strategy used. We cannot say which strategy is the best because … we cannot know with 100 percent certainty the truth in any research question. Nevertheless, our results raise important questions about meta-analyses and outline the need to rethink certain principles," the researchers write.
"We recommend that authors of meta-analyses systematically assess the robustness of their results by performing sensitivity analyses. We suggest the comparison of the meta-analysis result to the result for the single most precise trial or metaanalysis of the largest trials and careful interpretation of the meta-analysis result if they disagree."
(doi:10.1001/jama.2014.8166; Available pre-embargo to the media at http://media.jamanetwork.com)
Editor's Note: Please see the article for additional information, including other authors, author contributions and affiliations, financial disclosures, funding and support, etc.
Editorial: Meta-analysis as Evidence - Building a Better Pyramid
Jesse A. Berlin, Sc.D., of Johnson & Johnson, Titusville, N.J., and Robert M. Golub, M.D., Deputy Editor, JAMA, write in an accompanying editorial that "findings such as those in the study by Dechartres et al reinforce concerns that journals and readers have about metaanalysis as a study design. Those findings deserve consideration not only in the planning of the studies but in the journal peer review and evaluation. They also reinforce the need for circumspection in study interpretation."
"Meta-analysis has the potential to be the best source of evidence to inform decision making. The underlying methods have become much more sophisticated in the last few decades, but achieving this potential will require continued advances in the underlying science, parallel to the advances that have occurred with other biomedical research design and statistics. Until that occurs, an informed reader must approach these studies, as with all other literature, as imperfect information that requires critical appraisal and assessment of applicability of the findings to individual patients. This is not easy, and it requires skill and intelligence. Whatever clinical evidence looks like, and wherever it is placed on a pyramid, there are no shortcuts to truth."
(doi:10.1001/jama.2014.8167; Available pre-embargo to the media at http://media.jamanetwork.com)
Editor's Note: The authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest and none were reported.
INFORMATION: END
Approach used to conduct meta-analyses may affect outcomes
2014-08-12
ELSE PRESS RELEASES FROM THIS DATE:
Tropical Storm Iselle departs Hawaii while Julio stays well north
2014-08-12
The Tropical Rainfall Measuring Mission or TRMM satellite passed over Tropical Storm Iselle and gathered data on clouds and rainfall as it affected Hawaii.
Iselle was once a rather powerful category 4 hurricane in the East Pacific with sustained winds estimated at 120 knots (~138 mph) by the National Hurricane Center. Fortunately, a combination of southwesterly wind shear, drier air and cooler waters weakened Iselle considerably as it approached the Hawaiian Islands. Although much weaker, Iselle still struck the southeast Kau coast of the Big Island of Hawaii as a rather ...
Infants absorb more than we might think
2014-08-12
This news release is available in French. Montreal, August 12, 2014 — Does a baby know that a dog can jump a fence while a school bus can't? Can a toddler grasp that a cat can avoid colliding with a wall, while a table being pushed into a wall can't?
A new study from Concordia shows that infants as young as 10-months old can tell the difference between the kinds of paths naturally taken by a walking animal, compared to a moving car or piece of furniture.
That's important information because the ability to categorize things as animate beings or inanimate objects is ...
This week from AGU: Supperrotation on Venus and Titan, exploratory modeling
2014-08-12
This Week From AGU: Supperrotation on Venus and Titan, exploratory modeling
From AGU's journals: Atmospheric forces drive development of superrotation
Planetary scientists are still puzzling over how superrotation—when a planet's atmosphere rotates faster than its surface—develops on a small or slowly rotating planet like Venus or Titan. Previous researchers have suggested that a certain kind of atmospheric eddy activity is required to retain the momentum surplus over the equator of a planet, where superrotation develops, but have not yet identified this underlying ...
Mouth bacteria can change its diet, supercomputers reveal
2014-08-12
Bacteria inside your mouth drastically change how they act when you're diseased, according to research using supercomputers at the Texas Advanced Computing Center (TACC). Scientists say these surprising findings might lead to better ways to prevent or even reverse the gum disease periodontitis, diabetes, and Crohn's disease.
Marvin Whiteley, professor of molecular biosciences and director of the Center for Infectious Disease at The University of Texas at Austin, led the study published in April 2014 in the journal mBio.
"What we were trying to figure out," said Whiteley, ...
Kessler Foundation scientists identify predictors of prospective memory deficit post TBI
2014-08-12
West Orange, NJ. August 12, 2014. Kessler Foundation scientists have identified predictors of prospective memory impairment after traumatic brain injury (TBI). Findings were epublished on July 28 by the Journal of the International Neuropsychological Society. The article, "Rule monitoring ability predicts event-based prospective memory performance in individuals with TBI," is authored by Jessica Paxton, PhD, and Nancy Chiaravalloti, PhD, of Kessler Foundation. This is the first study to examine the role of rule monitoring, an executive function, post-TBI.
Prospective ...
Less radical procedures offer similar cancer control for kidney cancer patients
2014-08-12
ROCHESTER, Minn. – Needle-guided tumor destruction procedures offer near equivalent lengths of local cancer control compared to surgery for patients with small kidney cancer tumors, according to the results of a large study published in the journal European Urology. "If validated, these data suggest that an update to clinical guidelines would be warranted," says the study's lead author, R. Houston Thompson, M.D., a Mayo Clinic urologist.
Dr. Thompson says radical nephrectomy – surgical removal of the entire kidney – has historically been the standard of care for management ...
A gene linked to disease found to play a critical role in normal memory development
2014-08-12
JUPITER, FL, August 12, 2014 – It has been more than 20 years since scientists discovered that mutations in the gene huntingtin cause the devastating progressive neurological condition Huntington's disease, which involves involuntary movements, emotional disturbance and cognitive impairment. Surprisingly little, however, has been known about the gene's role in normal brain activity.
Now, a study from The Scripps Research Institute's (TSRI's) Florida campus and Columbia University shows it plays a critical role in long-term memory.
"We found that huntingtin expression ...
UTMB researchers develop model to predict COPD hospital readmission
2014-08-12
Researchers at the University of Texas Medical Branch at Galveston have identified predictors of early rehospitalization among patients hospitalized for complications of chronic obstructive pulmonary disease. This study was recently published in the Annals of the American Thoracic Society.
In a nationwide analysis of more than 8,000 commercially insured adult patients with COPD, UTMB researchers concluded that several modifiable factors, such as appropriate prescriptions upon discharge and early follow up after discharge from the hospital, were associated with lower likelihood ...
Hand sanitizers in classrooms do not reduce school absences in children
2014-08-12
Installing alcohol-based hand sanitizer dispensers in the classrooms does not lead to reductions in the rate of school absences in children, according to a study published in this week's PLOS Medicine led by Patricia Priest and colleagues from the University of Otago, New Zealand.
The researchers conducted a cluster randomized trial that that randomly assigned 68 city primary schools in New Zealand to the intervention or control group and measured the rate of school absence in children (aged 5 years) attending the participating schools. All children received ...
Heart failure is a substantial health burden in low- and middle-income countries
2014-08-12
Heart failure is a major public health burden in many low- and middle-income countries (LMICs), with substantial variation in the presentation, causes, management, and outcomes of heart failure across different LMICs, according to a study published in this week's PLOS Medicine. The study, led by Kazem Rahimi and colleagues from the George Institute for Global Health, also finds that a large proportion of patients are not receiving pharmacological treatments for heart failure.
The researchers conducted a systematic review and identified 49 published studies and 4 unpublished ...