- Press Release Distribution

Is it the school, or the students?

Study shows perceptions of “good” schools are heavily dependent on the preparation of the students entering them


Are schools that feature strong test scores highly effective, or do they mostly enroll students who are already well-prepared for success? A study co-authored by MIT scholars concludes that widely disseminated school quality ratings reflect the preparation and family background of their students as much or more than a school’s contribution to learning gains. 

Indeed, the study finds that many schools that receive relatively low ratings perform better than these ratings would imply. Conventional ratings, the research makes clear, are highly correlated with race. Specifically, many published school ratings are highly positively correlated with the share of the student body that is white.

“A school’s average outcomes reflect, to some extent, the demographic mix of the population it serves,” says MIT economist Josh Angrist, a Nobel Prize winner who has long analyzed education outcomes. Angrist is co-author of a newly published paper detailing the study’s results.

The study, which examines the Denver and New York City school districts, has the potential to significantly improve the way school quality is measured. Instead of raw aggregate measures like test scores, the study uses changes in test scores and a statistical adjustment for racial composition to compute more accurate measures of the causal effects that attending a particular school has on students’ learning gains. This methodologically sophisticated research builds on the fact that Denver and New York City both assign students to schools in ways that allow the researchers to mimic the conditions of a randomized trial.

In documenting a strong correlation between currently used rating systems and race, the study finds that white and Asian students tend to attend higher-rated schools, while Black and Hispanic students tend to be clustered at lower-rated schools. 

“Simple measures of school quality, which are based on the average statistics for the school, are invariably highly correlated with race, and those measures tend to be a misleading guide of what you can expect by sending your child to that school,” Angrist says. 

The paper, “Race and the Mismeasure of School Quality,” appears in the latest issue of the American Economic Review: Insights. The authors are Angrist, the Ford Professor of Economics at MIT; Peter Hull, a professor of economics at Brown University; Parag Pathak, the Class of 1922 Professor of Economics at MIT; and Christopher Walters PhD ’13, an associate professor of economics at the University of California at Berkeley. Angrist and Pathak are both professors in the MIT Department of Economics and co-founders of MIT’s Blueprint Labs, a research group that often examines school performance.

The study uses data provided by the Denver and New York City public school districts, where 6th-graders apply for seats at certain middle schools, and the districts use a school-assignment system. In these districts, students can opt for any school in the district, but some schools are oversubscribed. In these circumstances, the district uses a random lottery number to determine who gets a seat where. 

By virtue of the lottery inside the seat-assignment algorithm, otherwise-similar sets of students randomly attend an array of different schools. This facilitates comparisons that reveal causal effects of school attendance on learning gains, as in a randomized clinical trial of the sort used in medical research. Using math and English test scores, the researchers evaluated student progress in Denver from the 2012-2013 through the 2018-2019 school years, and in New York City from the 2016-2017 through 2018-2019 school years. 

Those school-assignment systems, it happens, are mechanisms some of the researchers have helped construct, allowing them to better grasp and measure the effects of school assignment. 

“An unexpected dividend of our work designing Denver and New York City’s centralized choice systems is that we see how students are rationed from [distributed among] schools,” says Pathak. “This leads to a research design that can isolate cause and effect.”

Ultimately, the study shows that much of the school-to-school variation in raw aggregate test scores stems from the types of students at any given school. This is a case of what researchers call “selection bias.” In this case, selection bias arises from the fact that more-advantaged families tend to prefer the same sets of schools. 

“The fundamental problem here is selection bias,” Angrist says. “In the case of schools, selection bias is very consequential and a big part of American life. A lot of decision-makers, whether they’re families or policymakers, are being misled by a kind of naïve interpretation of the data.” 

Indeed, Pathak notes, the preponderance of more simplistic school ratings today (found on many popular websites) not only creates a deceptive picture of how much value schools add for students, but has a self-reinforcing effect — since well-prepared and better-off families bid up housing costs near highly-rated schools.As the scholars write in the paper, “Biased rating schemes direct households to low-minority rather than high-quality schools, while penalizing schools that improve achievement for disadvantaged groups.” 

The research team hopes their study will lead districts to examine and improve the way they measure and report on school quality. To that end, Blueprint Labs is working with the New York City Department of Education to pilot a new ratings system later this year. They also plan additional work examining the way families respond to different sorts of information about school quality.

Given that the researchers are proposing to improve ratings in what they believe is a straightforward way, by accounting for student preparation and improvement, they think more officials and districts may be interested in updating their measurement practices. 

“We’re hopeful that the simple regression adjustment we propose makes it relatively easy for school districts to use our measure in practice,” Pathak says.

The research received support from the Walton Foundation and the National Science Foundation. 


Written by Peter Dizikes, MIT News

Paper: “Race and the mismeasure of school quality”



Exploring the relationship between HIV pre-exposure prophylaxis and the incidence of chlamydia, gonorrhea and syphilis – findings from Denmark

Exploring the relationship between HIV pre-exposure prophylaxis and the incidence of chlamydia, gonorrhea and syphilis – findings from Denmark
In their research article published in Eurosurveillance, von Schreeb et al. challenge existing assumptions regarding the relationship between the use of HIV pre-exposure prophylaxis (PrEP) and the incidence of bacterial sexually transmitted infections (STI). According to the concept of sexual risk compensation, the start of PrEP treatment – a drug regimen which effectively prevents acquiring HIV – is associated with rises in STI as people feel protected against HIV while using it. However, von Schreeb et al. argue that available ...

Music: Song lyrics have become simpler and more repetitive since 1980

We have been alerted to a potential error in some of the coding used by the authors in their analyses and are looking into this as a matter of urgency. The authors are confident that the main findings of the paper will remain unaltered, however some aspects may be affected and we have removed two sentences from the press release to reflect this. We will provide an update if there are further developments. We apologise for any inconvenience caused. The lyrics of English-language songs have become simpler and more repetitive over the past 40 years, according to a study published in Scientific Reports. Eva Zangerle and ...

Environment: More than half of Colorado River’s water used to irrigate crops

Irrigation for agriculture uses more than half of the Colorado River’s total annual water flow, reports a paper published in Communications Earth & Environment. This finding is part of a new comprehensive assessment of how the Colorado River’s water is consumed — including both human usage and natural losses — and provides a more complete understanding of how the river’s water is used along its over 2,300 km (almost 1,500-mile) length. The Colorado River flows through the southwestern United States (including the Grand Canyon) and northwestern Mexico whilst supplying water to more than 40 million people and more than 2 million ...

When inequality is more than “skin-deep”: Social status leaves traces in the epigenome of spotted hyenas in Tanzania

When inequality is more than “skin-deep”: Social status leaves traces in the epigenome of spotted hyenas in Tanzania
A research consortium led by scientists from the Leibniz Institute for Zoo and Wildlife Research (Leibniz-IZW) provide evidence that social behaviour and social status are reflected at the molecular level of gene activation (epigenome) in juvenile and adult free-ranging spotted hyenas. They analysed non-invasively collected gut epithelium samples from both high-ranking and low-ranking female hyenas and showed that rank differences were associated with epigenetic signatures of social inequality, i.e., the pattern of activation or switching off of genes that regulate important physiological processes such as energy conversion and immune response ...

Study explores the future of at-home cancer treatment

Study explores the future of at-home cancer treatment
LOS ANGELES — A clinical trial from Keck Medicine of USC will test the feasibility of treating non-small cell lung cancer with immunotherapy provided at home.    Immunotherapy, medicines that use the body’s immune system to eliminate or control cancer cells, are effective for many cancer patients, but are currently only administered intravenously (into the vein) in a doctor’s office or hospital.  The study will examine if a new formulation of atezolizumab, an immunotherapy approved for treating certain types of non-small cell lung cancer, can instead be safely and effectively ...

First performance standards published to measure the effectiveness of lifestyle medicine treatments

An expert panel has published the first performance measures to identify remission and evaluate the effectiveness of lifestyle medicine treatments, which will allow more objective comparisons between lifestyle behavior interventions and other non-lifestyle treatments. The performance measures are significant because, as interest in the field of lifestyle medicine has grown, it became clear that the lack of standards to document remission or long-term progress following lifestyle medicine treatment was a barrier to the widespread integration of the ...

To keep volunteers, connect them

At a time when America needs volunteers more than ever, to tackle social problems from homelessness to disaster recovery, fewer people have been volunteering. The number of volunteers for nonprofit and community-based organizations declined recently for the first time in decades, from 30% of the population in 2019 to 23% in 2021. That’s according to AmeriCorps and the U.S Census Bureau, which have tracked rates of volunteerism since 2002. New research from Yifan Yu, assistant professor of ...

Suppressing boredom at work hurts future productivity, study shows

Boredom is more common at work than in any other setting, studies show, and employees are bored at work for more than 10 hours per week on average. Even astronauts and police officers get bored on the job. No occupation is immune. Boredom serves an important purpose — it signals the need to stop an action and find an alternative project. But boredom becomes problematic when it’s ignored. New research from the University of Notre Dame shows that trying to stifle boredom prolongs its effects and that alternating boring and meaningful tasks helps to prevent the effects of one boring task from ...

Older brain cells linger unexpectedly before their death

Older brain cells linger unexpectedly before their death
For oligodendrocytes—the central nervous system cells critical for brain function—age may not bring wisdom, but it does come with the power to cling to life for much, much longer than scientists knew. That's according to a new study featured on the March 27 cover of the Journal of Neuroscience. Mature oligodendrocytes took a shocking 45 days to die following a fatal trauma that killed younger cells within the expected 24 hours, Dartmouth researchers report. The findings suggest there's a new pathway for efforts to reverse or prevent the damage that aging and diseases such as multiple sclerosis cause to these important cells. In the brain, ...

Clear shift in arterial diseases in diabetes

Clear shift in arterial diseases in diabetes
There has been a redistribution in the risk of arterial disease in type 1 and 2 diabetes. The risks of heart attack and stroke have decreased significantly, while complications in more peripheral vessels have increased in relative importance, according to studies at the University of Gothenburg. It is well known that type 1 and 2 diabetes increase the risk of heart attack and stroke. Previous research has also identified the clearest cardiometabolic risk factors in this context, such as obesity, lipid disorders, and high blood pressure. How diabetes and cardiometabolic risk factors affect blood ...


Unveiling the mysteries of cell division in embryos with timelapse photography

Survey finds loneliness epidemic runs deep among parents

Researchers develop high-energy-density aqueous battery based on halogen multi-electron transfer

Towards sustainable food systems: global initiatives and innovations

Coral identified as oldest bioluminescent organism, suggesting a new model of ancient ecology

SRI chosen by DARPA to develop next-generation computational design of metallic parts and intelligent testing of alloys

NJIT engineers muffle invading pathogens with a 'molecular mask'

Perinatal transmission of HIV can lead to cognitive deficits

The consumption of certain food additive emulsifiers could be associated with the risk of developing type 2 diabetes

New cancer research made possible as Surrey scientists study lipids cell by cell 

Bioluminescence first evolved in animals at least 540 million years ago

Squids’ birthday influences mating

Star bars show Universe’s early galaxies evolved much faster than previously thought

Critical minerals recovery from electronic waste

The move by Apple Memories to block potentially upsetting content illustrates Big Tech’s reach and limits, writes Chrys Vilvang

Chemical tool illuminates pathways used by dopamine, opioids and other neuronal signals

Asian monsoon lofts ozone-depleting substances to stratosphere

PET scans reveal ‘smoldering’ inflammation in patients with multiple sclerosis

Genetics predict type 2 diabetes risk and disparities in childhood cancer survivors

Health information on TikTok: The good, the bad and the ugly

New study points to racial and social barriers that block treatment for multiple myeloma

Rensselaer researcher finds that frog species evolved rapidly in response to road salts

A new chapter in quantum vortices: Customizing electron vortex beams

Don’t be a stranger – study finds rekindling old friendships as scary as making new ones

There’s no ‘one size fits all’ when it comes to addressing men’s health issues globally

Comparison of the “late catch-up” phenomenon between BuMA Supreme and XIENCE stents through serial optical coherence tomography at 1–2 month and 2 year follow-ups: A multicenter study

Marine plankton communities changed long before extinctions

Research reveals tools to make STEM degrees more affordable

Q&A: UW research shows neural connection between learning a second language and learning to code

Keane wins 2024 Gopal K. Shenoy Excellence in Beamline Science Award

[] Is it the school, or the students?
Study shows perceptions of “good” schools are heavily dependent on the preparation of the students entering them