(Press-News.org) BOSTON (December 22, 2010) -- Is quality in the eye of the beholder?
Researchers at Harvard Medical School and Massachusetts General Hospital have found wide disparities among four common measures of hospital-wide mortality rates, with competing methods yielding both higher- and lower-than-expected rates for the same Massachusetts hospitals during the same year.
The findings, published Dec. 23 in a special article in the New England Journal of Medicine, stoke a simmering debate over the value of hospital-wide mortality rates as a yardstick for health care quality. The measure, which compares a hospital's actual patient death rate to statistical predictions, is reported publicly in countries including England, Canada and Denmark, but some hospitals and policy experts have questioned its value due to the complexity and variability of diagnoses.
"It's troubling that four different methods for calculating hospital mortality rates as a measure of quality should yield such different results," said lead author David M. Shahian, HMS professor of surgery at Massachusetts General Hospital. "Measurement theory—not to mention plain common sense—suggests there is a problem."
The potential of performance evaluation to improve both the quality and the cost of health care has fueled interest in provider "report cards," including mandates by state and federal law.
In 2008, the Massachusetts Division of Health Care Finance and Policy engaged researchers Shahian; Lisa I. Iezzoni, HMS professor of medicine at Mass General; and Sharon-Lise T. Normand, HMS professor of health care policy (biostatistics) and professor in the Department of Biostatistics at Harvard School of Public Health, to evaluate four vendor-created measures of hospital-wide mortality. The state was looking for a means to measure hospital quality for the public report cards mandated under its 2006 health care reform law.
The researchers compared four measures of hospital-wide mortality provided by commercial vendors. These vendors all believed that their hospital-wide mortality measures were an accurate reflection of hospital quality. Each vendor received identical data—three years of patient discharge data from all 83 general acute care hospitals in Massachusetts, representing 2.5 million discharges—and used the data to calculate each hospital's mortality rate. The researchers then compared results.
"The results of the horse race are that it's really not clear who won," said Iezzoni, who also is the director of the Mongan Institute for Health Policy at Mass General. "The problem is that we were measuring the success of each of these measures against a gold standard we simply do not have: an objective measure of hospital quality."
Without that gold standard, the researchers were left to compare vendor tools with one another. Their conclusion: Methods and results varied widely. For example, every tool excluded some discharges from its calculations based on the details of each. But where one tool excluded 5 percent of all discharges, another excluded 72 percent.
Even so, a high degree of convergence—different methods yielding similar final results—could have supported the validity of this approach to estimating hospital quality. But that's not what researchers found. For example: Of 28 hospitals designated by one method as having higher-than-expected hospital-wide mortality in 2006, 12 were simultaneously classified as having lower-than-expected mortality by at least one other method.
In August, the researchers told the state that they could not recommend any of the four vendor-created tools. "But the results should not be interpreted as an indictment of any particular technique," said Normand. "Rather, they call into question the concept of measurement of hospital-wide mortality, as four different methods yielded four different results. Thus, this may not be a good way to assess hospital quality."
The authors are longtime advocates of performance assessment and public reporting to provide transparency and accountability in health care.
Normand developed the statistical models used by Medicare and Medicaid for public reporting of heart attack, heart failure and pneumonia mortality rates. Shahian has been a leader in the public reporting initiative of the Society of Thoracic Surgeons. Together, they were leaders in developing and implementing public report cards for coronary artery bypass grafting (CABG) surgery and percutaneous coronary intervention (PCI) in Massachusetts.
But where mortality rates may reflect clearly the quality of care for some procedures, like coronary bypass, they may reveal less about care for other conditions, such as major trauma or advanced malignancy.
"An alternative to hospital-wide mortality rates would be to construct a more limited portfolio of mortality results for individual common conditions such as heart attack, stroke, pneumonia, CABG surgery and PCI," said Shahian. "These have the advantage of large sample sizes at most hospitals, a generally accepted association between mortality and quality of care, and credible risk models to adjust for patient severity."
Iezzoni, an internationally recognized expert in risk adjustment, has edited Risk Adjustment for Measuring Health Care Outcomes, now in its third edition.
"Underlying this finding is the more fundamental and as yet unanswered question about whether hospital-wide mortality rates provide meaningful insight into hospital quality," she said.
###
This work was funded by a contract with the Division of Health Care Finance & Policy, Executive Office of Health and Human Services (EOHHS), Commonwealth of Massachusetts, Boston, Mass. The views expressed in this article are solely those of the authors and may not reflect the views of the Division, the EOHHS or the Commonwealth.
END
BOSTON, Mass. (December 22, 2010) — The sequencing of the nuclear genome from an ancient finger bone found in a Siberian cave shows that the cave dwellers were neither Neandertals nor modern humans.
An international team of researchers led by Svante Pääbo of the Max Planck Institute for Evolutionary Anthropology in Leipzig (Germany) has sequenced the nuclear genome from a finger bone of an extinct hominin that is at least 30,000 years old and was excavated by archaeologists from the Russian Academy of Sciences in Denisova Cave in southern Siberia, Russia, in 2008. A ...
For most of us, the "placebo effect" is synonymous with the power of positive thinking; it works because you believe you're taking a real drug. But a new study rattles this assumption.
Researchers at Harvard Medical School's Osher Research Center and Beth Israel Deaconess Medical Center (BIDMC) have found that placebos work even when administered without the seemingly requisite deception.
The study published on December 22 in PLoS ONE.
Placebos—or dummy pills—are typically used in clinical trials as controls for potential new medications. Even though they contain ...
Specially designed probiotics can modulate the physiology of host fat cells say scientists writing in Microbiology. The findings could lead to specialised probiotics that have a role in the prevention or treatment of conditions such as obesity.
Scientists from the Alimentary Pharmabiotic Centre (APC), Cork, University College Cork and Teagasc, in Ireland engineered a strain of Lactobacillus to produce a version of a molecule called conjugated linoleic acid (CLA). When this engineered bacterial strain was fed to mice, the researchers found that the composition of the mice's ...
Scientists today published catalogs of the fruit fly and roundworm's functional genomic elements: DNA sequences in the genome that carry the instructions and determine which genes are turned on and off at various times in different cells.
Initially sequenced as part of the Human Genome Project, the genomes of the fruit fly, Drosophila melanogaster, and the roundworm, Caenorhabditis elegans, are powerful models for understanding human biology and disease, as many functional genomic elements have been conserved across the vast evolutionary distances separating each organism. ...
Penn State researchers have found that native pollinators, like wild bees and wasps, are infected by the same viral diseases as honey bees and that these viruses are transmitted via pollen. Their research published on December 22nd in PLoS ONE, an online open-access journal for the communication of all peer-reviewed scientific and medical research.
This multi-institutional study provides new insights into viral infections in native pollinators, suggesting that viral diseases may be key factors impacting pollinator populations.
According to Diana Cox-Foster, co-author ...
In the past decade researchers have made astonishing progress in the rapid and accurate sequencing of genomes from all realms of life. Yet the listing of chemical base pairs has gotten far ahead of understanding how the information they contain becomes functional. Even the best-understood genomes conceal mysteries.
Genetic information carried by DNA and RNA operates together with the patterns and physical organization of chromosomes to produce a working organism. Major advances in understanding these complex relationships are published this week by the "model organism ...
DALLAS – Dec. 22, 2010 – UT Southwestern Medical Center researchers have pinpointed a tiny site in the brain where the hormone leptin may help trigger the onset of puberty.
The findings in mice indicate that a site within the hypothalamus called the ventral premammillary nucleus, or PMV, is the target where the hormone leptin effectively kick starts puberty in females.
Researchers have known that puberty starts when individuals have enough energy stores or fat to meet the demands of reproduction, and that leptin – a hormone produced by fat cells – acts in the brain ...
Australian scientists have discovered that changes to a gene involved in brain development can lead to testis formation and male genitalia in an otherwise female embryo.
Lead Melbourne researcher Professor Andrew Sinclair, of the Murdoch Childrens Research Institute and the University of Melbourne, said the breakthrough would improve diagnosis and clinical management of patients with disorders of sex development (DSD). These conditions occur when the testes or ovaries do not develop properly in the embryo, causing genital abnormalities in one in 4500 babies.
The gene, ...
University of Adelaide researchers are a step closer to unraveling the mysteries of human sexual development, following genetic studies that show male mice can be created without a Y chromosome – through the activation of an ancient brain gene.
Males usually have one Y chromosome and one X chromosome, while females have two X chromosomes. A single gene on the Y, called SRY, triggers testes development in the early embryo, and once these begin to form, the rest of the embryo also becomes male.
However, Adelaide researchers have discovered a way of creating a male mouse ...
Shouldering family demands and worries seems to increase the risk of angina, the precursor to coronary artery disease, reveals research published online in the Journal of Epidemiology and Community Health.
Previous research has indicated that rewarding personal relationships are a boost for heart health, so the authors wanted to know if the reverse might also be true.
They tracked the heart health of more than 4,500 randomly selected men and women in their 40s and 50s for six years. None had any heart problems at the start of the study in 1999.
In 2006 all participants ...
