New research at ESMT Berlin shows potential variance in academic research
(Press-News.org) The research seeks to understand what drives decisions in data analyses and the process through which academics test a hypothesis by comparing the analyses of different researchers who tested the same hypotheses on the same dataset. Analysts reported radically different analyses and dispersed empirical outcomes, including, in some cases, significant effects in opposite directions from each other. Decisions about variable operationalizations explained the lack of consistency in results beyond statistical choices (i.e., which analysis or covariates to use).
"Our findings illustrate the importance of analytical choices and how different statistical methods can lead to different conclusions," says Martin Schweinsberg. "An academic research question can sometimes be investigated in different ways, even if the answers are derived from the same dataset and by analysts without any incentives to find a particular result, and this research highlights this."
To conduct the research, Professor Schweinsberg recruited a crowd of analysts from all over the world to test two hypotheses regarding the effects of scientists' gender and professional status on active participation in group conversations. Using the online academic forum Edge, researchers analyzed group discussion data of scientific discussions from more than two decades (1996-2014). The dataset contained more than 3 million words from 728 contributors and 150 variables related to the conversation, its contributors, or the textual level of the transcript. Then, using the new platform DataExplained, developed by co-authors Michael Feldman, Nicola Staub, and Abraham Bernstein, researchers analyzed the data in R to identify whether there was a link between a scientist's gender or professional status with their levels of verbosity.
Analysts utilized various sets of sample sizes, statistical approaches, and covariates, which led to several different results in relation to the hypotheses. This, therefore, resulted in various, yet defensible findings from the various analysts. By using Data Explained, Professor Schweinsberg and colleagues were able to understand precisely how these analytical choices differed, despite the data and hypotheses being the same. A qualitative study of the R-code used by analysts revealed a process model for the psychology behind data analyses.
Professor Schweinsberg says, "Our study illustrates the benefits of transparent and open science practices. Subjective analytical choices are unavoidable, and we should embrace them because a collection of diverse analytical backgrounds and approaches can reveal the true consistency of an empirical claim."
This research shows the critical role subjective researcher decisions play in influencing reported empirical results. According to the researchers, these findings stress the importance of open data, which is publicly available, systematic robustness checks in academic research, and as much transparency as possible regarding both analytic paths taken and not taken, in order to ensure research is as accurate as possible. They also suggest humility when communicating research findings and caution in applying them to organizational decision-making.
ELSE PRESS RELEASES FROM THIS DATE:
Patients with advanced chronic kidney disease (CKD) typically suffer from impaired bone quality and quantity, with a non-vertebral fracture risk which is 4-to 6-fold higher than the fracture risk of matched controls. However, despite their high risk of fragility fractures, the vast majority of patients with chronic CKD stages 4 to 5D, are not receiving osteoporosis therapy.
A newly published review by the International Osteoporosis Foundation (IOF) and European Renal Association-European Dialysis and Transplant Association (ERA-EDTA) CKD-MBD working group now provides concise recommendations, with a clear management algorithm, to support clinicians' knowledge and confidence in managing ...
BOSTON - New research led by investigators at Massachusetts General Hospital (MGH) and Massachusetts Eye and Ear indicates that the blood pressure drug losartan may benefit patients with neurofibromatosis type 2 (NF2), a hereditary condition associated with vestibular schwannomas, or noncancerous tumors along the nerves in the brain that are involved with hearing and balance. The findings, which are published in Science Translational Medicine, are especially important because vestibular schwannomas are currently treated with surgery and radiation therapy (which carry risks of nerve damage), and no drug is approved by the U.S. Food and Drug Administration to treat these tumors or their associated hearing ...
Amsterdam, July 15, 2021 - Huntington's Disease (HD) is a progressive neurodegenerative condition characterized by motor, cognitive, and psychiatric symptoms, and motor symptoms are often preceded by cognitive changes. Recent evidence indicates that autophagy plays a central role in synaptic maintenance, and the disruption in autophagy may be at the root of these early cognitive changes. Understanding this mechanism better may help researchers develop treatments for patients with HD early in their disease progression, report scientists in a review article published in the Journal of Huntington's Disease.
In this review, experts describe how autophagy, the cellular process responsible ...
We sleep on average one third of our time. But what does the brain do during these long hours? Using an artificial intelligence approach capable of decoding brain activity during sleep, scientists at the University of Geneva (UNIGE), Switzerland, were able to glimpse what we think about when we are asleep. By combining functional magnetic resonance imaging (fMRI) and electroencephalography (EEG), the Geneva team provides unprecedented evidence that the work of sorting out the thousands of pieces of information processed during the day takes place during ...
The COVID-19 pandemic halted the in-person wintertime survey of wolves and moose on the island for the first time in 63 years. Consequently, there are no estimates of wolf or moose abundance for 2021, and the next estimates are scheduled in February 2022. But though the Isle Royale Winter Study didn't happen quite as planned, researchers were still able to visit the remote national park in the spring.
Now, fieldwork has resumed and Michigan Technological University researchers have already uncovered new information about these two iconic wildlife populations. In particular, wolves produced at least two litters of pups, and moose appear poised for decline.
In the Isle Royale Winter Study, Michigan ...
Plants, algae and some bacteria are able to perform photosynthesis, which is the process of transforming sunlight energy into sugar. Animals are generally unable to use this process to acquire energy, but there are a few known exceptions to this. Some sea slugs take up chloroplasts from the algae that they consume into their cells. These chloroplasts retain their ability to perform photosynthetic activity within the animal cells for several months, and thus provide them with photosynthesis-derived nutrition. This process is called "kleptoplasty", and it has attracted much attention due to its amazing uniqueness in making animals photosynthetic for over 50 years.
A pressing question is how these sequestered chloroplasts retains their photosynthetic capability without algal nuclei. ...
Since the Paris Climate Agreement that took effect in 2016, 121 countries have pledged to become carbon neutral by 2050 as the world tries to reduce its fuel consumption. The Korean government also unveiled its 2050 Carbon Neutral Strategy on December 7, 2020 and declared Carbon Zero, making transition to new and renewable energy a topic of conversation. Recently, a joint research team from POSTECH and Korea University has developed a radiative cooling material that can reduce energy consumption by selectively reflecting or transmitting sunlight.
A research team led by Professor Junsuk Rho, Ph.D. candidate Minkyung Kim, and Dr. Dasol Lee of POSTECH's departments of mechanical engineering and chemical engineering, and a team led by Professor Heon Lee and Soomin of the Department of Materials ...
Combined perceptions of the risk and availability of cannabis influence the risk of cannabis use more than perceived risk and perceived availability alone, according to a new study at Columbia University Mailman School of Public Health. Researchers observed that those who perceived cannabis as low-risk and available were more likely to report using the drug in the past year and almost daily compared to those individuals who perceived cannabis as high-risk and unavailable. This is the first study to consider the joint effects of perceived risk and perceived availability. The results are published in the journal Drug and Alcohol Dependence.
"Our study described the evolution of joint perceptions of cannabis risk and availability from 2002-2018 and estimated the relationship between combined ...
Adolescent girls and young women can and will use HIV prevention products with consistency, according to interim results of a study of two different methods: daily use of the antiretroviral (ARV) tablet Truvada® as oral pre-exposure prophylaxis (PrEP) and the monthly END ...
Shining a beam of light into potentially contaminated water samples may hold the key to real-time detection of hydrocarbons and pesticides in water.
UBC Okanagan researchers are testing the use of fluorescence to monitor water quality. The results, they say, show great promise.
When a beam of light is shone into the water, it excites the electrons in molecules of certain compounds and causes them to emit light. The characteristics of the emitted light are like a fingerprint and can be used to identify certain contaminants, explains Nicolas Peleato, an assistant professor at UBCO's School of Engineering.
"The challenge with using this fluorescence approach is that ...
LAST 30 PRESS RELEASES:
[Press-News.org] New research at ESMT Berlin shows potential variance in academic research