PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

To teach scientific reproducibility, start young

Introducing concept to undergrads could lead to more transparency in science

2014-02-28
(Press-News.org) DURHAM, N.C. -- The ability to duplicate an experiment and its results is a central tenet of the scientific method, but recent research has shown an alarming number of peer-reviewed papers are irreproducible.

A team of math and statistics professors has proposed a way to address one root of that problem by teaching reproducibility to aspiring scientists, using software that makes the concept feel logical rather than cumbersome.

Researchers from Smith College, Duke University and Amherst College looked at how introductory statistics students responded to a curriculum modified to stress reproducibility. Their work is detailed in a paper published Feb. 25 in the journal Technological Innovations in Statistics Education.

In 2013, on the heels of several retraction scandals and studies showing reproducibility rates as low as 10 percent for peer-reviewed articles, the prominent scientific journal Nature dedicated a special issue to the concerns over irreproducibility.

Nature's editors announced measures to address the problem in its own pages, and encouraged the science community and funders to direct their attention to better training of young scientists.

"Too few biologists receive adequate training in statistics and other quantitative aspects of their subject," the editors wrote. "Mentoring of young scientists on matters of rigour and transparency is inconsistent at best."

The authors of the present study thus looked to their own classrooms for ways to incorporate the idea of reproducibility.

"Reproducing a scientific study usually has two components: reproducing the experiment, and reproducing the analysis," said Ben Baumer, visiting assistant professor of math and statistics at Smith College. "As statistics instructors, we wanted to emphasize the latter to our students."

The grade school maxim to "show your work" doesn't hold in the average introductory statistics class, said Mine Cetinkaya-Rundel, assistant professor of the practice in the Duke statistics department. In a typical workflow, a college-level statistics student will perform data analysis in one software package, but transfer the results into something better suited to presentation, like Microsoft Word or Microsoft PowerPoint.

Though standard, this workflow divorces the raw data and analysis from the final results, making it difficult for students to retrace their steps. The process can give rise to errors, and in many cases, the authors write, "the copy-and-paste paradigm enables, and even encourages, selective reporting."

"Usually, a data analysis report, even a published paper, isn't going to include the code," Cetinkaya-Rundel said. "But at the intro level, where this is the first time students are exposed to this workflow, it helps to keep intact both the final results and the code used to generate them."

Enter R Markdown, a statistical package that integrates seamlessly with the programming language R. The team chose R Markdown for its ease of use -- students wouldn't have to learn a new computer syntax -- and because it combines the raw data, computing and written analysis into one HTML document. The researchers hoped a single HTML file would give students a start-to-finish understanding of assignments, as well as make studying and grading easier.

The study introduced R Markdown to 417 introductory statistics students (272 from Duke University, 145 from Smith College) during the 2012-2013 school year. Instructors emphasized the lesson of reproducibility throughout each course and surveyed 70 students about their experience using R Markdown for homework assignments.

The survey, conducted once at the beginning of the semester and once at the end, showed gradual gains in student preference for R Markdown. The percentage of respondents who indicated they found R Markdown to be frustrating at first but eventually got the hang of it jumped from 51 to 75 percent. The students vastly preferred it to the alternative, with 70 percent strongly disagreeing that they'd rather use the copy-and-paste method.

The research team also found that even when students had no prior computing experience or expressed negative attitudes toward R Markdown, their grades did not appear to suffer. Future surveys will ask more pointed questions about how much of the lesson on reproducibility students absorb from the modified curricula.

As the use and analysis of big data becomes increasingly sophisticated, the team writes, the ability of researchers to retrace steps and achieve the same statistical outcomes will only grow in significance.

INFORMATION: Other authors on the paper included Andrew Bray and Linda Loi of Smith College and Nicholas Horton of Amherst College.

This researched received partial support from Project MOSAIC and the National Science Foundation (grant DUE-0920350).

CITATION: "R Markdown: Integrating a Reproducible Analysis Tool into Introductory Statistics," Ben Baumer, Mine Cetinkaya-Rundel, et al. Technological Innovations in Statistics Education, Feb. 25, 2014. http://escholarship.org/uc/item/90b2f5xh


ELSE PRESS RELEASES FROM THIS DATE:

Asthma drug aids simultaneous desensitization to several food allergies, study finds

2014-02-28
STANFORD, Calif. — An asthma drug accelerates the process of desensitizing patients with food allergies to several foods at the same time, a new study by researchers at the Stanford University School of Medicine and Lucile Packard Children's Hospital Stanford shows. The findings come on the heels of a recent study by the same team showing that people with multiple food allergies can be desensitized to several foods at once. The two studies, both phase-1 safety trials, provide the first scientific evidence that a promising new method for treating people for multiple food ...

Beneficial anti-inflammatory effects observed when plant extracts fed to sick pigs

2014-02-28
URBANA, Ill. – Porcine reproductive and respiratory syndrome (PRRS) is the most expensive and invasive disease for pig producers on a global scale. Though it is not occurring on every farm, it is the biggest disease problem in the pig industry, said a University of Illinois animal sciences researcher. E. coli has also been a problem historically and continues to be on an industry-wide basis, said James Pettigrew. "Either disease can sweep through a farm so their alleviation would substantially reduce production costs. Even though many management practices have been used ...

Waterloo physicists solve 20-year-old debate surrounding glassy surfaces

Waterloo physicists solve 20-year-old debate surrounding glassy surfaces
2014-02-28
University of Waterloo physicists have succeeded in measuring how the surfaces of glassy materials flow like a liquid, even when they should be solid. A series of simple and elegant experiments were the solution to a problem that has been plaguing condensed matter physicists for the past 20 years. Understanding the mobility of glassy surfaces has implications for the design and manufacture of thin-film coatings and also sets practical limits on how small we can make nanoscale devices and circuitry. The work is the culmination of a project carried out by a research ...

Burmese pythons pose little risk to people in Everglades

2014-02-28
EVERGLADES NATIONAL PARK, Fla. -- The estimated tens of thousands of Burmese pythons now populating the Everglades present a low risk to people in the park, according to a new assessment by U.S. Geological Survey and National Park Service scientists. The human risk assessment looked at five incidents that involved humans and Burmese pythons over a 10-year period in Everglades National Park. All five incidents involved pythons striking at biologists who were conducting research in flooded wetlands. "Visitor and staff safety is always our highest priority at Everglades ...

Kessler Foundation researchers find education attenuates impact of TBI on cognition

Kessler Foundation researchers find education attenuates impact of TBI on cognition
2014-02-28
West Orange, NJ. February 28, 2014. Kessler Foundation researchers have found that higher educational attainment (a proxy of intellectual enrichment) attenuates the negative impact of traumatic brain injury (TBI) on cognitive status. The brief report, Sumowski J, Chiaravalloti N, Krch D, Paxton J, DeLuca J. Education attenuates the negative impact of traumatic brain injury (TBI) on cognitive status, was published in the December issue of Archives of Physical Medicine & Rehabilitation Vol. 94, Issue 12:2562-64. Cognitive outcomes vary post-TBI, even among individuals ...

American Journal of Transplantation reports REGiMMUNE's transplant tolerance results

2014-02-28
Tokyo, Japan – February 28, 2014 – REGiMMUNE Corporation announced that the American Journal of Transplantation (AJT) has published its paper that describes a novel approach to long-term tolerance in organ transplantation with continuous administration of immune suppressants. "A Novel Approach Inducing Transplant Tolerance by Activated Invariant Natural Killer T Cells with Costimulatory Blockade" was published in the AJT March 2014 Issue 3, Volume 14, pages 554-567, and was first made available online as an early view on February 6, 2014. Robust, lifelong, donor-specific ...

Study: Racial bias in pain perception appears among children as young as 7

2014-02-28
A new University of Virginia psychology study has found that a sample of mostly white American children – as young as 7, and particularly by age 10 – report that black children feel less pain than white children. The study, which builds on previous research on bias among adults involving pain perception, is published in the Feb. 28 issue of the British Journal of Developmental Psychology. "Our research shows that a potentially very harmful bias in adults emerges during middle childhood, and appears to develop across childhood," said the study's lead investigator, Rebecca ...

BNI study reveal unexpected findings

2014-02-28
(Phoenix , Ariz. Feb 28, 2014) -- "The results of this study are counter to most expectations," said Dr. Brachman, Director of Radiation Oncology at Barrow and St. Joseph's. "Bevacizuman had been shown in earlier studies to be an effective drug in the treatment of patients with recurrent disease. But, on newly diagnosed patients, it did not, in fact, prolong survival." The randomized, double-blind placebo controlled trial of 621 adults was funded by the National Cancer Institute and the drug manufacturer Genentech from 2009 to2012. Glioblastoma is the most common primary ...

Northern Sumatra dealing with smoke from fires

Northern Sumatra dealing with smoke from fires
2014-02-28
On February 27, 2014, the Wall Street Journal and Southeast Asia Realtime reported that: "the plantation-rich province of Riau on Indonesia's Sumatra Island has declared a state of emergency as fires set for land clearing have sent pollution levels soaring and smoke made breathing difficult for thousands." Tens of thousands of Riau residents are suffering from the effects of the smoke coming from dozens of fires set to clear land in Sumatra. Riau is the center of Indonesia's more than $20 billion palm oil industry—the world's largest. Fires occur with frequency in Riau ...

Food production in the northeastern US may need to change if climate does

2014-02-28
BOSTON (February 28, 2014) — If significant climate change occurs in the United States it may be necessary to change where certain foods are produced in order to meet consumer demand. In a paper published online this week in the journal Renewable Agriculture and Food Systems, researchers at the Friedman School of Nutrition Science and Policy at Tufts University provide an overview of current farmland use and food production in the Northeastern U.S., identifying potential vulnerabilities of the 12-state region*. Led by Tim Griffin, Ph.D., associate professor and director ...

LAST 30 PRESS RELEASES:

Impact of synbiotic supplements on the gut microbiome and overall health of penguins

Promising advances in organosilica membranes for separating organic liquid mixtures

Cell phone video technology unveils new method for analyzing walking and gait

Ancient isolation’s impact on modern ecology

Synaptic protein change during development offers clues on evolution and disease

How commercial rooftop solar power could bring affordable clean energy to low-income homes

Taking a closer look at pulmonary fibrosis genetics

Cats with MDR1 mutation at risk of severe reactions to popular medication

IOP Publishing and IPEM mandate reporting of sex and gender in research 

Dogs trained to detect trauma stress by smelling humans’ breath

Electronic device thermal management made simpler and slightly better!

Study: Dangerous surgical site infections can be reduced with simple prevention protocol

Genetic testing of patients with atrial fibrillation can alert clinicians to potential development of life-threatening conditions

Artificial Intelligence tool successfully predicts fatal heart rhythm

What progress has China made in agriculture green development over the past five years?

ALMA finds new molecular signposts in starburst galaxy

Open waste burning linked to air pollution in Northwestern Greenland

Google Street View reveals how built environment correlates with risk of cardiovascular disease

Connecting the dots to shape growth forces

Parental avoidance of toxic exposures could help prevent autism, ADHD in children, new study shows

Trends in the incidence of renal replacement therapy due to rapidly progressive glomerulonephritis in Japan, 2006–2021

Olympics not likely to swallow up skateboarding’s subversive nature into its corporate spectacle, study says

Looking after the NHS workforce must be a top priority, say experts

Prolonged use of certain hormone drugs linked to increased brain tumor risk

Delirium a ‘strong risk factor’ for dementia among older people

People experiencing homelessness more likely to develop dementia at younger ages, study finds

Can metalens be commercialized at a fraction of the cost?

Reclaim ‘wellness’ from the rich and famous, and restore its political radicalism, new book argues

Curtin research unlocks supernova stardust secrets

New documents reveal patient safety concerns over strike day cover

[Press-News.org] To teach scientific reproducibility, start young
Introducing concept to undergrads could lead to more transparency in science