(Press-News.org) An international group of academic leaders, journal editors and funding-agency representatives and disciplinary leaders, including Rick Wilson, the Herbert S. Autrey Chair of Political Science and professor of statistics and psychology at Rice University, has announced guidelines to further strengthen transparency and reproducibility practices in science research reporting.
The group, the Transparency and Openness Promotion (TOP) Committee at the Center for Open Science in Charlottesville, Va., outlined its new guidelines in a story published in this week's edition of the journal Science.
While transparency, openness and reproducibility are readily recognized as vital features of science and embraced by scientists as a norm and value in their work, a growing body of evidence suggests that those qualities are not necessarily evident today.
"A likely culprit for this disconnect is an academic reward system that insufficiently incentivizes open practices," Wilson said. "In the present reward system, the emphasis on innovation undermines practices that support openness. Too often, publication requirements -- whether actual or perceived -- fail to encourage transparent, open and reproducible science."
TOP's objective is to translate scientific norms and values into concrete actions and change the current incentive structures to drive researchers' behavior toward more openness.
"We know the disciplines differ in what is emphasized, so we sought to produce guidelines that focus on what is shared across disciplines," Wilson said.
Each of eight standards has three levels of adoption in the TOP guidelines; each moves scientific communication toward greater openness, according to the article in Science. These standards are modular, facilitating adoption in whole or in part. However, they also complement each other; commitment to one standard may facilitate adoption of others.
The standards include citation standards for journals, data transparency, analytic methods (code) transparency, research materials transparency, design and analysis transparency, preregistration of studies, preregistration of analysis plans and replication.
Two standards reward researchers for the time and effort they have spent engaging in open practices. Citation standards extend current article citation norms to data, code and research materials. Regular and rigorous citation of these materials credits them as original intellectual contributions. Replication standards recognize the value of replication for independent verification of research results and identify the conditions under which replication studies will be published in the journal.
Four of the standards describe what openness means across the scientific process so that research can be reproduced and evaluated. Reproducibility increases confidence in findings and also allows scholars to learn more about what results mean. Design standards increase transparency about the research process and reduce vague or incomplete reporting of the methodology. Standards for research materials encourage the provision of all elements of that methodology, and data-sharing standards give authors an incentive to make data available in trusted repositories.
The final two standards address the values resulting from preregistration. Standards for preregistration of studies facilitate the discovery of research, even unpublished research, by ensuring that the existence of the study is recorded in a public registry. Preregistrations of analysis plans certify the distinction between confirmatory and exploratory research, or what is also called hypothesis-testing versus hypothesis-generating research. Making the distinction between confirmatory and exploratory methods transparent can enhance reproducibility.
"The guidelines are sensitive to concerns by both journals and researchers," Wilson said. "For example, we encourage journals to state exceptions to sharing because of ethical issues, intellectual property concerns or availability of necessary resources. We encourage journals to pick and choose among the different levels and standards in order to define what they expect of the researchers.
"We acknowledge the variation in evolving norms about research transparency. Depending on the discipline or publishing format, some of the standards may not be relevant for a journal. Journal and publisher decisions can be based on many factors -- including their readiness to adopt modest to stronger transparency standards for authors, internal journal operations and disciplinary norms and expectations," Wilson said.
The present version of the guidelines is not the last word on standards for openness in science, according to the report. "As with any research enterprise, the available empirical evidence will expand with application and use of these guidelines," the TOP Committee wrote. "To reflect this evolutionary process, the guidelines are accompanied by a version number and will be improved as experience with them accumulates."
An information commons and support team at the Center for Open Science is available (top@cos.io) to assist journals in selection and adoption of standards and will track adoption across journals. Adopting journals may also suggest revisions that improve the guidelines or make them more flexible or adaptable for the needs of particular subdisciplines.
To read the complete guidelines, go to https://osf.io/ud578/.
INFORMATION:
For more information or to schedule an interview with Wilson, contact:
David Ruth
david@rice.edu
713-348-6327
Rice University
Follow Rice News and Media Relations via Twitter @RiceUNews.
Rainwater could save people in India a bucket of money, according to a new study by scientists looking at NASA satellite data.
The study, partially funded by NASA's Precipitation Measurement Missions, found that collecting rainwater for vegetable irrigation could reduce water bills, increase caloric intake and even provide a second source of income for people in India.
The study, published in the June issue of Urban Water Journal, is based on precipitation data from the Tropical Rainfall Measuring Mission (TRMM), a joint mission between NASA and the Japan Aerospace ...
The majority of the United States' poor aren't sitting on street corners. They're employed at low-paying jobs, struggling to support themselves and a family.
In the past, differing definitions of employment and poverty prevented researchers from agreeing on who and how many constitute the "working poor."
But a new study by sociologists at BYU, Cornell and LSU provides a rigorous new estimate. Their work suggests about 10 percent of working households are poor. Additionally, households led by women, minorities or individuals with low education are more likely to be ...
A new study led by researchers at Scripps Institution of Oceanography at UC San Diego indicates a steady population trend for blue whales and an upward population trend for fin whales in Southern California.
Scripps marine acoustician Ana Širović and her colleagues in the Marine Bioacoustics Lab and Scripps Whale Acoustic Lab intermittently deployed 16 High-frequency Acoustic Recording Packages (HARPs)--devices that sit on the seafloor with a suspended hydrophone (an underwater microphone)--to collect acoustic data on whales off Southern California from 2006-2012. ...
MINNEAPOLIS - A new study suggests that errors on memory and thinking tests may signal Alzheimer's up to 18 years before the disease can be diagnosed. The research is published in the June 24, 2015, online issue of Neurology®, the medical journal of the American Academy of Neurology.
"The changes in thinking and memory that precede obvious symptoms of Alzheimer's disease begin decades before," said study author Kumar B. Rajan, PhD, with Rush University Medical Center in Chicago. "While we cannot currently detect such changes in individuals at risk, we were able to ...
"Hydraulic fracturing" (or fracking) and "environmentally friendly" often do not appear in the same sentence together. But as the United States teeters on the precipice of a shale gas boom, Northwestern University professor Fengqi You is exploring ways to make the controversial activity easier on the environment -- and the wallet.
"Shale gas is promising," said You, assistant professor of chemical and biological engineering at Northwestern's McCormick School of Engineering and Applied Science. "No matter if you like it or not, it's already out there. The question we want ...
Over 50 leading doctors and academics including Fiona Godlee, editor in chief of The BMJ, have signed an open letter published in The Guardian today calling on the Wellcome Trust to divest from fossil fuel companies.
The letter is part of The Guardian's "Keep it in the Ground" Campaign that is urging the world's two biggest charitable funds -- the Wellcome Trust and the Gates Foundation -- to move their money out of fossil fuels.
It reads: "Divestment rests on the premise that it is wrong to profit from an industry whose core business threatens human and planetary health, ...
EDMONTON, Alberta, June 25 -- Working towards the ultimate goal to develop therapeutics to treat diseases such as Alzheimer's, Parkinson's, ALS, and BSE (Mad Cow Disease), University of Alberta scientists Michael Woodside, Hao Yu, and Derek Dee are investigating the physical principles underlying the formation of misfolded protein aggregates. The aggregates of misfolded proteins -- proteins that clump together in the "wrong" structure -- feature prominently in these fatal degenerative diseases.
"This is the big mystery we're trying to solve," says Woodside, a professor ...
INDIANAPOLIS -- Indiana University cancer researchers found that a particular microRNA may be a potent therapeutic agent against pancreatic cancer. The research was published June 22 in the journal Scientific Reports.
Led by Janaiah Kota, Ph.D., assistant professor of medical and molecular genetics at the IU School of Medicine and a researcher at the Indiana University Melvin and Bren Simon Cancer Center, the researchers found that restoring missing microRNA-29 (miR-29) in pancreatic cancer stromal cells reduced the viability and growth of the cancerous cells.
A thick ...
A new study published in the Articles in Advance section of Transportation Science, a journal of the Institute for Operations Research and the Management Sciences (INFORMS), improves how air traffic managers cope with unexpected delays and provides them with more predictable ways to manage arrival traffic at airports with adverse weather.
The study, Incorporating Predictability into Cost Optimization for Ground Delay Programs, is by Yi Liu and Mark Hansen of the University of California, Berkeley. Ms. Liu received honorable mention for her research in the 2013 INFORMS ...
Scientists from Ludwig-Maximilians-Universitaet (LMU) in Munich and the Max Planck Institute for Quantum Optics can image the optical properties of individual nanoparticles with a novel microscope.
Nanomaterials play an essential role in many areas of daily life. There is thus a large interest to gain detailed knowledge about their optical and electronic properties. Conventional microscopes get beyond their limits when particle size falls to the range of a few 10 nanometers where a single particle provides only a vanishingly small signal. As a consequence, many investigations ...
