(Press-News.org) Washington, March 2, 2021--A first-of-its-kind analysis of parents' reviews of U.S. public K-12 schools, posted primarily from 2009 to 2019 on the popular school information site GreatSchools.org, found that most reviews were written by parents at schools in affluent neighborhoods and provided information that correlated strongly with test scores, a measure that closely tracks race and family income. Language associated with school effectiveness, which measures how much students improve in their test scores over time and is less correlated with demographics, was much less used. The research was published today in AERA Open, a peer-reviewed, open access journal of the American Educational Research Association.
"Our results reveal the large weight that parents in this timeframe placed on test scores as a measure of quality," said study coauthor Nabeel Gillani, a doctoral student at the Massachusetts Institute of Technology. "Parents seemed to value schools based on current students' performance, not growth over time, which perhaps reflects the longstanding focus of education policies on test scores as a primary marker of school quality."
"School rating websites have come under scrutiny for ratings systems that overemphasize test scores," said Gillani. "Now we've found that subjective online parent reviews can do the same."
"Further research is needed to understand whether reviews reflecting school demographics have the potential to exacerbate neighborhood segregation or other conditions that impact access to high-quality education," Gillani said.
For their study, Gillani and his coauthors, Eric Chu, Doug Beeferman, and Deb Roy, also at MIT, and Rebecca Eynon, at the University of Oxford, applied recent advances in natural language processing to analyze about 830,000 reviews of more than 110,000 schools that were posted by self-identified parents primarily from 2009 to 2019 on GreatSchools.org. Their analyses identified and measured the prevalence of words and phrases that correlated with different measures of school quality--namely, test scores and student learning progress measures--along with school demographics like race and family income, drawn from the Stanford Education Data Archive.
Schools in urban areas and those serving affluent families were found to be more likely to receive parent reviews, and there were clear differences in the review language used by parents of children at majority-White vs. minority-White, and high-income vs. low-income schools.
The authors found that many of the words and phrases that were statistically associated with test scores also conveyed information about the racial and income makeup of schools. For example, words like "PTA" and "emails" were more often used in descriptions of schools with smaller percentages of students receiving free or reduced-price lunch and those serving a smaller percentage of non-White students, as were reviews using the terms "small school," "special needs," and "IEP" (Individualized Education Plan).
"Overall, parents' reviews tended to focus on topics that are associated with race and income in school systems," said Roy, who directs MIT's Center for Constructive Communication. "Wording such as 'the PTA,' 'emails,' 'private school,' 'we,' and 'us' are predictive of test scores, reflecting the tendency of more affluent, non-minority parents to have dual-parent households, digital connectivity, more schooling options, and more time to be involved and communicate regularly with teachers."
"These results reveal the subtle and sometimes hidden patterns in the words we use, sending signals and encoding biases that pervade our social realities," Roy said. "New techniques from machine learning applied to large data sets describing human behavior can help make those patterns visible."
The findings offer evidence that parents from lower-income, minority schools may have fewer voices to learn from.
"Unfortunately, many of these parents are not always tapped into social networks where they can readily receive guidance that helps them identify and select the best schools for their children," said Gillani.
According to the authors, rating sites should encourage parents and stakeholders to value growth as a measure of school quality. They should also adopt strategies to capture a more inclusive cross-section of parents' perspectives about schools and prompt insights that reflect how well schools help children learn and grow.
The analysis does not explore how parent reviews may have changed as a result of GreatSchools' methodological changes in recent years. GreatSchools updated its rating system in 2017 to include new measures of school quality and again in September 2020, after the study was conducted, to emphasize educational equity and give more weight to student growth. GreatSchools and MIT are pursuing a data and research partnership to continue examining how its site is being used and to explore modifications to mitigate potential inequity issues.
"It is critical to uplift the voices of all parents, especially those in traditionally underserved communities, to highlight their experiences within a school community," said GreatSchools CEO Jon Deane. "As we continue to evolve measures of school quality, including prioritizing academic growth over test scores, we value working alongside researchers to find new ways to more equitably serve all parents."
The authors suggest that parents and the public be mindful of how much weight to place on subjective assessments offered by other parents about any given school--and to be mindful of how ratings sites may factor these subjective assessments into their overall scores for schools. (GreatSchools does not factor subjective assessments into its overall ratings.) The authors also recommend that school administrators foster a culture where all parents' voices are valued and parents are encouraged to share their holistic views about the quality of education their children receive.
"One of the goals of school rating sites is to use available data to democratize access to information about school quality," said Gillani. "However, the school choice market is only as good as the information available to consumers. We need more representative voices talking about a more holistic set of topics if we want to maximize opportunities and outcomes for all students, especially those from less privileged backgrounds."
INFORMATION:
Study citation: Gillani, N., Chu, E., Beeferman, D., Eynon, R., Roy, D. (2021). Parents' online school reviews reflect several racial and socioeconomic disparities in K-12 education. AERA Open. Published March 2, 2021. https://doi.org/10.1177/2332858421992344
About AERA
The American Educational Research Association (AERA) is the largest national interdisciplinary research association devoted to the scientific study of education and learning. Founded in 1916, AERA advances knowledge about education, encourages scholarly inquiry related to education, and promotes the use of research to improve education and serve the public good. Find AERA on Facebook, Twitter, and Instagram.
Eighty percent of Americans over 50 say their primary care doctor hasn't asked about their hearing in the past two years, and nearly as many - 77% -- haven't had their hearing checked by a professional in that same time, according to a new national poll report.
That's despite a growing body of evidence about the importance of hearing to other aspects of life, from dementia and risk of falls to the ability to stay connected to friends and family.
Men were more likely than women to say they'd had a recent hearing screening or test, and so were people ages 65 to 80 compared with those in ...
COLUMBUS, Ohio - Black players in the NBA have 30% greater odds of leaving the league in any given season than white players who have equivalent performance on the court, a new study finds.
The results were driven mostly by bench players, who are the majority of those in the league, but who average less than 20 minutes of action per game.
These findings suggest that even in the NBA - a league in which Black players make up 70-75% of those on the court - African Americans face discrimination, said Davon Norris, lead author of the study and a doctoral student in sociology at The Ohio State University.
"If there is going to be anywhere in America where you would expect there wouldn't be racial ...
TROY, N.Y. -- Envisioning an animal-free drug supply, scientists have -- for the first time -- reprogrammed a common bacterium to make a designer polysaccharide molecule used in pharmaceuticals and nutraceuticals. Published today in Nature Communications, the researchers modified E. coli to produce chondroitin sulfate, a drug best known as a dietary supplement to treat arthritis that is currently sourced from cow trachea.
Genetically engineered E. coli is used to make a long list of medicinal proteins, but it took years to coax the bacteria into producing even ...
Tokyo, Japan - Humans are largely omnivores, and meat in various forms has always featured in the diet of most cultures. However, with the increasing population and pressure on the environment, traditional methods of meeting this fundamental food requirement are likely to fall short. Now, researchers at the University of Tokyo report innovative biofabrication of bovine muscle tissue in the laboratory that may help meet escalating future demands for dietary meat.
With global urbanization, the economics of animal husbandry are becoming unsustainable. From an environmental viewpoint, the land and water costs of modern mega-scale ...
In a world first, an international team of researchers has read an unopened letter from Renaissance Europe - without breaking its seal or damaging it in any way.
The research, published in Nature Communications, describes how an X-ray scanner used in dental research and 'virtual unfolding' allowed the interdisciplinary team to read the contents of a securely and intricately folded letter which has remained unopened for 300 years, while preserving its valuable physical evidence.
A highly sensitive X-ray microtomography scanner, developed at ...
A volcanic eruption in the Galápagos Islands has given scientists a fresh insight into how volcanoes behave and provided vital information that will help to predict future hazards on the islands.
Irish scientists, based at Dublin Institute for Advanced Studies (DIAS) and Trinity College Dublin respectively, were members of an international research team from Ireland, United Kingdom, United States, France and Ecuador that made the discovery.
The research published today (02.03.21) in Nature Communications reveals the first ever detailed description of a volcanic eruption from Sierra Negra - one ...
Hours before the 2018 eruption of Sierra Negra, the Galápagos Islands' largest volcano, an earthquake rumbled and raised the ground more than 6 feet in an instant. The event, which triggered the eruption, was captured in rare detail by an international team of scientists, who said it offers new insights into one of the world's most active volcanoes.
"The power of this study is that it's one of the first times we've been able to see a full eruptive cycle in this detail at almost any volcano," said Peter La Femina, associate professor of geosciences ...
A large proportion of the benefit that a person gets from taking a real drug or receiving a treatment to alleviate pain is due to an individual's mindset, not to the drug itself. Understanding the neural mechanisms driving this placebo effect has been a longstanding question. A meta-analysis published in Nature Communications finds that placebo treatments to reduce pain, known as placebo analgesia, reduce pain-related activity in multiple areas of the brain.
Previous studies of this kind have relied on small-scale studies, so until now, researchers did not know if the neural mechanisms underlying ...
In June 2019, an international team brought the complete skull of the 3.67-million-year-old Little Foot Australopithecus skeleton, from South Africa to the UK and achieved unprecedented imaging resolution of its bony structures and dentition in an X-ray synchrotron-based investigation at the UK's national synchrotron, Diamond Light Source. The X-ray work is highlighted in a new paper in e-Life, published today (2nd March 2021) focusing on the inner craniodental features of Little Foot. The remarkable completeness and great age of the Little Foot skeleton makes it a crucially important ...
Publishing in peer-reviewed scientific journals is crucial for the development of a researcher's career. The scientists that publish the most often in the most prestigious journals generally acquire greater renown, as well as higher responsibilities. However, a team involving two CNRS researchers* has just shown that the vast majority of scientific articles in the fields of ecology and conservation biology are authored by men working in a few Western countries. They represent 90% of the 1,051 authors that have published the most frequently in the 13 major scientific journals in the field since 1945. ...