PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Call for better social science research transparency

2014-01-03
(Press-News.org) Contact information: Kathleen Maclay
kmaclay@berkeley.edu
510-643-5651
University of California - Berkeley
Call for better social science research transparency

In the Friday (Jan. 3) edition of the journal Science, an interdisciplinary group is calling on scholars, funders, journal editors and reviewers to adopt more stringent and transparent standards to give social science research more credibility, substance and impact.

The authors, led by a University of California, Berkeley, economist, hope to change a set of practices that they contend has contributed to a distorted body of research that tends to exaggerate the effectiveness of programs that deal with important issues affecting millions of people including health, agriculture, education and environmental policy.

They cite as an example of flawed research a 2010 paper by Harvard University economists Carmen Reinhart and Kenneth Rogoff. It concluded that that when gross external debt hits 60 percent of the Gross Domestic Product, a country's annual growth declines 2 percent, and when debt exceeds 90 percent, growth is roughly cut in half. Budget hawks seized on its conclusions until other economists reviewing the work found coding errors, selective exclusion of available data, and unconventional weighting of summary statistics.

To prevent such errors from working their way into public policy making the 19 authors of the Science paper recommend key changes that include:

Documenting and disclosing primary information about data collection and analysis.

Preparing and registering pre-analysis plans to distinguish hypothesis testing from exploratory research. These written plans provide a step-by-step account of how a researcher will analyze data before they have seen the data.

Archiving and sharing research materials, plans and data through open channels that enable independent researchers to test and extend reported results. The materials can be made public when research is completed.

"Even if we believe that we already have enough self-correction in place, our research will be more credible if we institute these three approaches. We need to raise our game," said UC Berkeley economist Edward Miguel, the lead author of the Science article, "Promoting Transparency in Social Science Research."

"Publish or Perish"

The authors largely blame a "publish or perish" reward structure for academics, saying the odds of getting a study paper published improve if a scholar can promise novel, "theoretically tidy" or statistically significant results rather than more nuanced, mixed or perplexing findings. They also blame scholarly journals and funders for lax oversight of mistakes and confusing information.

"The program suggested by our article would not fundamentally change the nature of social science," said David Laitin, a political science professor at Stanford University and a co-author of the article. "Rather, it would have small implications in the way we collect and report our data. It would also invite us to put more attention to the replication of well-known findings rather than investigations of new factors. But these small changes in our practices could have large effects in revising what we thought were well-established findings."

Miguel said the push toward greater social science research transparency also has been influenced by increasing use of better research designs, new "big data" software tools, growing interest by governments and advocacy groups for evidence-based policy making, and public insistence on greater transparency.

Changes underway

A few institutions are already taking similar steps to those proposed in the Science article. The American Political Science Association adopted guidelines in 2012 making it an ethical obligation for researchers to back up their claims by making their data accessible and being clear about how they produce their results. Related measures have been taken by several psychological journals, the U.S. Office of Management and Budget, and the American Economic Association, with its design registry of randomized trials.

Meanwhile, the Center for Open Science has established an online collaboration tool called the Open Science Framework that enables research teams to easily register their hypotheses and pre-analysis plans, and to make public their data.

Several of the Science authors are members of the Berkeley Initiative for Transparency in the Social Sciences (BITSS), a network that launched a year ago at UC Berkeley to promote discussions and on transparency.

"Discover and disseminate the truth"

BITSS members and Science co-authors Leif Nelson of UC Berkeley's Haas School of Business, and Joseph Simmons and Uri Simonsohn of the Wharton School of the University of Pennsylvania wrote a related 2011 paper, "False-positive psychology: Undisclosed flexibility in data collection and analysis allow presenting anything as significant."

"Our goal as scientists is not to publish as many articles as we can, but to discover and disseminate truth. Many of us—and this includes the three authors of this article—often lose sight of this goal, yielding to the pressure to do whatever is justifiable to compile a set of studies that we can publish," they wrote, adding that too often researchers convince themselves that the most publishable outcome must be the best.

The Science article authors maintain that rather than stifle creativity or create undue burdens for researchers, better transparency practices will improve the scientific integrity and impact of their work.

"An open science is a more credible science," said Brian Nosek, a professor of psychology at the University of Virginia, a founder of the Open Science Framework and another of the Science article co-authors.



INFORMATION:



ELSE PRESS RELEASES FROM THIS DATE:

Study: Having Medicaid increases emergency room visits

2014-01-03
Study: Having Medicaid increases emergency room visits Unique study on Oregon's citizens sheds light on critical care in the US CAMBRIDGE, Mass. -- Adults who are covered by Medicaid use emergency rooms 40 percent more than those in similar circumstances ...

Environment affects an organism's complexity

2014-01-03
Environment affects an organism's complexity Press release from PLOS Computational Biology Scientists have demonstrated that organisms with greater complexity are more likely to evolve in complex environments, according to research published this week ...

El Nino tied to melting of Antarctica's Pine Island Glacier

2014-01-03
El Nino tied to melting of Antarctica's Pine Island Glacier Pine Island Glacier is one of the biggest routes for ice to flow from Antarctica into the sea. The floating ice shelf at the glacier's tip has been melting and thinning for the past four decades, causing the ...

Are sweetpotato weevils differentially attracted to certain colors?

2014-01-03
Are sweetpotato weevils differentially attracted to certain colors? Different colors attract sweetpotato weevils, depending on external conditions The sweetpotato weevil, Cylas formicarius (Fabricius), is the most serious pest of sweetpotato ...

Methane hydrates and global warming

2014-01-03
Methane hydrates and global warming Dissolution of hydrates off Svalbard caused by natural processes Methane hydrates are fragile. At the sea floor the ice-like solid fuel composed of water and methane is only stable at high pressure ...

Pine Island Glacier sensitive to climatic variability

2014-01-03
Pine Island Glacier sensitive to climatic variability A new study published in Science this month suggests the thinning of Pine Island Glacier in West Antarctica is much more susceptible to climatic and ocean variability than at first thought. Observations by a ...

Molecule discovered that protects the brain from cannabis intoxication

2014-01-03
Molecule discovered that protects the brain from cannabis intoxication Two INSERM research teams led by Pier Vincenzo Piazza and Giovanni Marsicano (INSERM Unit 862 "Neurocentre Magendie" in Bordeaux) ...

Animal cells can communicate by reaching out and touching, UCSF team discovers

2014-01-03
Animal cells can communicate by reaching out and touching, UCSF team discovers Signaling through direct contact not restricted to neurons, as previously thought In a finding that directly contradicts the standard biological model of animal cell ...

Study explaining parasite gene expression could help fight toxoplasmosis and malaria

2014-01-03
Study explaining parasite gene expression could help fight toxoplasmosis and malaria INDIANAPOLIS -- A newly identified protein and other proteins it interacts with could become effective targets for new drugs to control the parasite that cause toxoplasmosis, researchers ...

Men's and women's soccer: Physical or technical?

2014-01-03
Men's and women's soccer: Physical or technical? A comparative study into the performance of men and women players in UEFA Champions League matches suggests that women and men each play soccer 'in their own way' This news release is available in Spanish. When the ...

LAST 30 PRESS RELEASES:

Pink skies

Monkeys are world’s best yodellers - new research

Key differences between visual- and memory-led Alzheimer’s discovered

% weight loss targets in obesity management – is this the wrong objective?

An app can change how you see yourself at work

NYC speed cameras take six months to change driver behavior, effects vary by neighborhood, new study reveals

New research shows that propaganda is on the rise in China

Even the richest Americans face shorter lifespans than their European counterparts, study finds

Novel genes linked to rare childhood diarrhea

New computer model reveals how Bronze Age Scandinavians could have crossed the sea

Novel point-of-care technology delivers accurate HIV results in minutes

Researchers reveal key brain differences to explain why Ritalin helps improve focus in some more than others

Study finds nearly five-fold increase in hospitalizations for common cause of stroke

Study reveals how alcohol abuse damages cognition

Medicinal cannabis is linked to long-term benefits in health-related quality of life

Microplastics detected in cat placentas and fetuses during early pregnancy

Ancient amphibians as big as alligators died in mass mortality event in Triassic Wyoming

Scientists uncover the first clear evidence of air sacs in the fossilized bones of alvarezsaurian dinosaurs: the "hollow bones" which help modern day birds to fly

Alcohol makes male flies sexy

TB patients globally often incur "catastrophic costs" of up to $11,329 USD, despite many countries offering free treatment, with predominant drivers of cost being hospitalization and loss of income

Study links teen girls’ screen time to sleep disruptions and depression

Scientists unveil starfish-inspired wearable tech for heart monitoring

Footprints reveal prehistoric Scottish lagoons were stomping grounds for giant Jurassic dinosaurs

AI effectively predicts dementia risk in American Indian/Alaska Native elders

First guideline on newborn screening for cystic fibrosis calls for changes in practice to improve outcomes

Existing international law can help secure peace and security in outer space, study shows

Pinning down the process of West Nile virus transmission

UTA-backed research tackles health challenges across ages

In pancreatic cancer, a race against time

Targeting FGFR2 may prevent or delay some KRAS-mutated pancreatic cancers

[Press-News.org] Call for better social science research transparency