Study: state VAMS don't reflect content, quality of teachers' instruction

Study: state value-added performance measures do not reflect the content or quality of teachers' instruction

2014-05-13

(Press-News.org) WASHINGTON, D.C., May 13, 2014—New research published online today in Educational Evaluation and Policy Analysis (EEPA), a peer-reviewed journal of the American Educational Research Association, finds weak to nonexistent relationships between state-administered value-added model (VAM) measures of teacher performance and the content or quality of teachers' instruction. Based on their results, the authors question whether VAM data will be useful in evaluating teacher performance and shaping classroom instruction.

VIDEO: Co-author Morgan S. Polikoff discusses key findings http://youtu.be/XFgUmSVNjzU

"Instructional Alignment as a Measure of Teaching Quality," by Morgan S. Polikoff at the University of Southern California and Andrew C. Porter at the University of Pennsylvania, also finds no association between multiple-measure teaching effectiveness ratings—which combine value-added measures with survey and observational ratings of teacher quality—and the content of teachers' instruction in the classroom. http://www.aera.net/Newsroom/RecentAERAResearch/InstructionalAlignmentasaMeasureofTeachingQuality/tabid/15510/Default.aspx

"While value-added measures do provide some useful information, our findings show that they are not picking up the things we think of as being good teaching," said Polikoff. "Given the growing extent to which states are using these measures for a wide array of decisions, our findings are troubling."

Polikoff and Porter's study is the first large-scale analysis of the relationship of instructional alignment (i.e., the degree to which the content of classroom instruction is aligned with state standards and assessments, such as the Common Core standards) and teaching effectiveness with teacher VAM scores and a composite measure of teacher effectiveness.

The authors investigated these relations based on a subsample of 327 fourth- and eighth-grade mathematics and English language arts teachers across all six school districts included in the Measures of Effective Teaching (MET) study, including New York City, Dallas, Denver, Charlotte-Mecklenburg, Memphis, and Hillsborough County, Florida.

"We expected to see that instruction aligned with state standards and assessments would strongly predict value-added teaching performance measures on those assessments, but that wasn't the case," said Polikoff.

Recent policy initiatives such as the Race to the Top Fund and No Child Left Behind waivers have created a push to improve the methods by which teachers are evaluated. Many of these methods focus on teachers' contributions to student learning, often measured by value-added models and multiple-measure evaluation systems.

With the rollout of Common Core State Standards, according to Polikoff, the development of a deeper understanding of the ways effective teachers implement the standards in the classroom is imperative.

"Our results suggest that it's going to be difficult to use these systems to improve teacher performance," said Polikoff.

Their findings, the authors noted, lead to a disconcerting question: "If VAMs are not meaningfully associated with either the content or quality of instruction, what are they measuring?"

INFORMATION: Funding Note Polikoff and Porter's research was supported by a grant from the Bill and Melinda Gates Foundation. About the Authors Morgan S. Polikoff is an assistant professor of education at the Rossier School of Education, University of Southern California. Andrew C. Porter is dean and professor of education at the Graduate School of Education, University of Pennsylvania. About AERA The American Educational Research Association (AERA)is the largest national professional organization devoted to the scientific study of education. Founded in 1916, AERA advances knowledge about education, encourages scholarly inquiry related to education, and promotes the use of research to improve education and serve the public good. Find AERA on Facebook and Twitter. This news release is available online: http://www.aera.net/Newsroom/NewsReleasesandStatements/StudyStateValueAddedPerformanceMeasuresDoNotReflecttheContentorQualityofTeachersInstruction/tabid/15512/Default.aspx

ELSE PRESS RELEASES FROM THIS DATE:

Ultrafast laser technique developed to observe electron action

2014-05-13

University of Central Florida physicist Zenghu Chang has done it again. For a third time this year, his research group has published an article in a Nature journal. This time, Chang and his team have developed a new ultrafast light source for observing electron motion in molecules – made up of nuclei and electrons – at the point before the nuclei start to move. By being able to observe what actually happens, scientists can begin to understand how an electron interacts with other electrons, which may help improve the efficiency of solar cells. "The charge migration that ...

Released prisoners are more likely to suffer early death

2014-05-13

Men who have been incarcerated and released are more than twice as likely to die prematurely as those who have not been imprisoned, according to a new study published by Georgia State University criminologist William Alex Pridemore. Former prisoners are more likely to die early from infectious and respiratory diseases, drug overdoses and homicides. Causes of this "mortality penalty" include increased exposure to diseases like TB and HIV, the prolonged stress of the prison environment, the disruption of important social bonds and, upon release, the struggle to reintegrate ...

Forgiving a wrong may actually make it easier to forget

2014-05-13

We're often told to "forgive and forget" the wrongs that we suffer – it turns out that there may be some scientific truth behind the common saying. A study from researchers at the University of St. Andrews in Scotland shows that the details of a transgression are more susceptible to forgetting when that transgression has been forgiven. The findings are published in Psychological Science, a journal of the Association for Psychological Science. "It is well established that learning to forgive others can have positive benefits for an individual's physical and mental health," ...

Signal Fire in New Mexico

2014-05-13

Firefighters are currently battling the Signal Fire in the Gila National Forest in New Mexico. The fire was reported by the Signal Peak Lookout Tower Sunday (May 11) in the afternoon and is located approximately 15 miles north of Silver City. It is currently estimated to be 4,700 acres. The Southwest Area Incident Management Team assumed command of the fire Monday at 6:00 p.m. The cause of the fire is thought to be human either a careless camper or arson, but the investigation is still ongoing. Residents in the vicinity of Signal Peak have evacuated. The firefighters ...

Screening is 'not effective' in the fight against domestic violence

2014-05-13

One in three women around the world have experienced physical or sexual violence from a partner. Although domestic violence is associated with a range of adverse health impacts, even after the abuse has ended, it is not easily identified by health care professionals, prompting some countries, notably the United States, to introduce screening programmes in healthcare settings. A new study, published online by the BMJ today [13 May], has found no evidence to support domestic violence screening. Researchers from the Universities of Bristol and Melbourne, La Trobe and Columbia ...

Surgery study shows worse health, more problems and higher costs among Medicaid patients

2014-05-13

ANN ARBOR, Mich. — Surgery patients covered by Medicaid come into their operations with worse health, do worse afterward, stay in the hospital longer and find themselves back in the hospital more often than those covered by private insurance, a new analysis by University of Michigan Medical School researchers finds. In fact, people with Medicaid coverage were twice as likely as other patients to have certain health risk factors before they had surgery, the researchers report in JAMA Surgery. They also had many more emergency operations, experienced two-thirds more complications ...

New cancer immunotherapy aims powerful T cells against tumors

2014-05-13

Deadly skin cancers in mice shrank in response to a new treatment that may complement other "immunotherapies" developed recently to boost the body's own defenses against disease threats, according to a new study published by UC San Francisco researchers in the May 2014 edition of the Journal of Experimental Medicine. Using a mouse version of a human drug that is popular for treating osteoporosis, the UCSF researchers discovered a way to manipulate the thymus, a gland situated at the base of the neck above the heart, to alter its activity so that some of the specialized ...

First year student publishes monsoon study

2014-05-13

A first year Environmental Science student at The University of Nottingham Malaysia Campus (UNMC) has had a literature review of the Southeast Asian monsoon published in the academic journal Geoscience Frontiers. Her research concluded that future climate warming could lead to a 15 day delay in the monsoon onset in Southeast Asia by the start of the next century. Yen Yi Loo investigated how global and regional temperature and rainfall anomalies affect rainfall patterns and the South East Asian Monsoon. She also highlighted how increased rainfall intensity in the last ...

New agent may enhance effectiveness of radiotherapy

2014-05-13

Scientists from The University of Manchester – part of the Manchester Cancer Research Centre - have demonstrated the potential of a drug to improve the effectiveness of radiotherapy in stopping tumour growth. There is increasing interest in using the body's own immune system to attack tumour cells – a strategy that can be very effective without the side effects associated with conventional chemotherapy. Skin cancers have been successfully treated using a topical cream, imiquimod, which recruits immune cells through a molecule known as toll-like receptor 7 (TLR7), a ...

Arthroscopy of the knee joint for arthrosis: No benefit detectable

2014-05-13

The benefit of therapeutic arthroscopy with lavage and possible debridement for the treatment of arthrosis of the knee joint (gonarthrosis) is not proven. There was no hint, indication or proof of benefit of therapeutic arthroscopy in comparison with non-active comparator interventions, e.g. sham surgery, for any patient-relevant outcome. From the active comparator therapies, only the injection of glucocorticoids into the knee joint produced worse results than arthroscopy for the outcome "global assessment of the symptoms of gonarthrosis". This was the result of the ...