(Press-News.org) A new study has found some scientists are unknowingly tweaking experiments and analysis methods to increase their chances of getting results that are easily published.
The study conducted by scientists at The Australian National University (ANU) is the most comprehensive investigation into a type of publication bias called p-hacking.
P-hacking happens when researchers either consciously or unconsciously analyse their data multiple times or in multiple ways until they get a desired result. If p-hacking is common, the exaggerated results could lead to misleading conclusions, even when evidence comes from multiple studies.
"We found evidence that p-hacking is happening throughout the life sciences," said lead author Dr Megan Head from the ANU Research School of Biology.
The study used text mining to extract p-values - a number that indicates how likely it is that a result occurs by chance - from more than 100,000 research papers published around the world, spanning many scientific disciplines, including medicine, biology and psychology.
"Many researchers are not aware that certain methods could make some results seem more important than they are. They are just genuinely excited about finding something new and interesting," Dr Head said.
"I think that pressure to publish is one factor driving this bias. As scientists we are judged by how many publications we have and the quality of the scientific journals they go in.
"Journals, especially the top journals, are more likely to publish experiments with new, interesting results, creating incentive to produce results on demand."
Dr Head said the study found a high number of p-values that were only just over the traditional threshold that most scientists call statistically significant.
"This suggests that some scientists adjust their experimental design, datasets or statistical methods until they get a result that crosses the significance threshold," she said.
"They might look at their results before an experiment is finished, or explore their data with lots of different statistical methods, without realising that this can lead to bias."
The concern with p-hacking is that it could get in the way of forming accurate scientific conclusions, even when scientists review the evidence by combining results from multiple studies.
For example, if some studies show a particular drug is effective in treating hypertension, but other studies find it is not effective, scientists would analyse all the data to reach an overall conclusion. But if enough results have been p-hacked, the drug would look more effective than it is.
"We looked at the likelihood of this bias occurring in our own specialty, evolutionary biology, and although p-hacking was happening it wasn't common enough to drastically alter general conclusions that could be made from the research," she said.
"But greater awareness of p-hacking and its dangers is important because the implications of p-hacking may be different depending on the question you are asking."
INFORMATION:
DENVER - The German Lung Cancer Screening Intervention Trial (LUSI) shows that the early repeat scan rate for suspicious findings decreased by more than 80% with the second and subsequent low-dose computed tomography (LDCT) screens, but emphasizes the need to have an organized screening program with the baseline scan available for comparison.
In the United States the National Lung Cancer Screening Trial (NLST) showed that annual lung cancer screening of high-risk individuals with LDCT reduces lung cancer mortality by 20% and overall mortality by 7%. There are now multiple ...
A new study, published today in the journal Scientific Reports, has identified a rural community in Brazil that still follows the earlier sleep and wake times similar to pre-industrial times.
The team of researchers from the University of Surrey and the University of São Paulo studied the population of Baependi, a small rural town in south-eastern Brazil, whose sleep/wake cycle is much more aligned with that of our ancestors.
"In big cities, the availability of cheap electricity has brought us both artificial lighting and a multitude of other electronic devices ...
A new technique invented at Caltech to produce graphene--a material made up of an atom-thick layer of carbon--at room temperature could help pave the way for commercially feasible graphene-based solar cells and light-emitting diodes, large-panel displays, and flexible electronics.
"With this new technique, we can grow large sheets of electronic-grade graphene in much less time and at much lower temperatures," says Caltech staff scientist David Boyd, who developed the method.
Boyd is the first author of a new study, published in the March 18 issue of the journal Nature ...
SPOKANE, Wash.--Washington State University researchers have found a mechanism by which omega-3 fatty acids inhibit the growth and spread of prostate cancer cells. The findings, which are at odds with a 2013 study asserting that omega-3s increase the risk of prostate cancer, point the way to more effective anti-cancer drugs.
Scientists have long known that omega 3s reduce inflammation and have anti-diabetic effects, and some recently discovered how this happens.
"But we're the first to show that they work this way in cancer," said Kathryn Meier, a professor of pharmacy ...
NEW YORK (March 17, 2015)--A new tuberculosis (TB) drug regimen designed to improve options for TB therapy eliminated more bacteria from sputum than standard therapy and did so at a faster rate, according to data from a phase 2b clinical trial published today in The Lancet. These results are published just as the global phase 3 clinical trial, designed to bring this regimen through the last stage of testing, has begun.
PaMZ is a three-drug regimen comprised of two candidate drugs that are not yet licensed for use against TB: pretomanid (Pa), formerly known as PA-824, ...
Chemical changes that occur in tree leaves after being attacked by insects and mammals can impact nearby streams, which rely on fallen plant material as a food source, report scientists from the University of Chicago Department of Ecology and Evolution. The study, published March 17 in the journal Proceedings of the Royal Society B, shows how interactions between terrestrial and aquatic ecosystems are an essential part of understanding ecological responses to climate change.
Graduate student Sara Jackrel and Timothy Wootton, PhD, professor in the Department of Ecology ...
Longer duration of breastfeeding is linked with increased intelligence in adulthood, longer schooling, and higher adult earnings, a study following a group of almost 3500 newborns for 30 years published in The Lancet Global Health journal has found.
"The effect of breastfeeding on brain development and child intelligence is well established, but whether these effects persist into adulthood is less clear,"* explains lead author Dr Bernardo Lessa Horta from the Federal University of Pelotas in Brazil.
"Our study provides the first evidence that prolonged breastfeeding ...
Alteplase is a tissue plasminogen activator (tPA) that helps to disperse blood clots in a process called thrombolysis.
Most major stroke guidelines support use of alteplase up to 4.5 hours after stroke onset, but Dr Brian Alper and colleagues believe that current guidance is based on uncertain evidence and they call for urgent reconsideration of the available data to guide policy decisions.
The UK regulator, the Medicines and Healthcare Regulatory Agency (MHRA), is planning to analyse all relevant sources of evidence and reassess the balance of benefits and risks for ...
Previous research among young and older adults has suggested that the context in which drinking occurs may contribute to specific alcohol-related problems, such as aggression, risky sex, and drinking and driving. However, little is known about how young drinkers select drinking contexts. A longitudinal study of drinking patterns, and demographic and psychosocial characteristics associated with youth drinking in different contexts, has found that where youth drink alcohol varies by characteristics such as age, gender, drinking frequency, smoking, and deviant behaviors.
Results ...
Both the Diagnostic and Statistical Manual of Mental Disorders, 5th edition (DSM-5), and the International Statistical Classification of Diseases and Related Health Problems, 10th Edition (ICD-10) have established diagnostic criteria for alcohol use disorders (AUDs). While the DSM is widely used by clinicians, the U.S. Centers for Medicare and Medicaid Services has recently called for providers to bill for services using ICD-10 designations. Given the ramifications for who will and will be not eligible for treatment, this study compares the two diagnostic approaches, finding ...
