(Press-News.org) The quality of evidence submitted to the National Institute for Health and Care Excellence (NICE) for informing its decisions to recommend technologies for use in the NHS was poor in more than half of cases, reveals a 20-year analysis, published in the open access journal BMJ Open.
And the data quality submitted for health technology appraisals by manufacturers between 2000 and 2019 was consistently poor, with no improvement during that time, the analysis shows.
NICE advises the NHS on the clinical and cost-effectiveness of both new and existing technologies, through an independent body of specialists, which make up its appraisal committee.
This committee’s decisions are based on reports from its independent technology assessors, plus advice from consultees, clinical, NHS commissioning, and patient experts.
In recent years, NICE has expanded the evidence it considers, to include a broader range of factors that influence health: registry data; national statistics; surveys; clinical practice recommendations; expert opinions; and additional knowledge from manufacturers.
In light of this, the researchers wanted to systematically review all NICE’s active technology appraisals published between 2000 and 2019 to scrutinise the clinical evidence submitted by the manufacturers and assess its quality for decision-making.
They therefore extracted data from the independent assessment group and evidence review group reports and final appraisal determinations on the quality of submitted randomised controlled clinical trials and the overall quality of evidence submitted for decision-making.
For single technology appraisals (STAs), which evaluate a single product, device, or technology for a single indication, and usually involve new drugs or indications, they also extracted data on quality of life evidence and comparative clinical evidence.
Each category was scored for quality—2 for good; 1 for acceptable; 0 for poor; and −1 for unacceptable. The scores were peer reviewed by all the members of the research team to try and minimise bias.
In all, the evidence for 409 technology appraisals was analysed: 104 multiple technology appraisals (MTA), which evaluate technologies that share one or more criteria; and 305 STAs.
The appraisals included 25 non-pharmaceutical products, 14 medical devices, 6 other therapies, 5 surgical procedures, and 384 drugs.
In two thirds of all appraisals, the overall quality of evidence was judged to be either poor (224; 55%) or unacceptable (41;10%). The quality of evidence was judged acceptable in a third (139, 34%) or good in only 1% (5).
In nearly 4 out of 10 (39%; 119) STAs, the quality of comparative evidence was considered poor, and in 17% (51) unacceptable. In 44% (135) the quality of quality of life data was considered poor, and unacceptable in 15% (47). In only a third (102) of STA appraisals was the quality deemed acceptable, and good in only 7% (21).
Based on analysis of the comments from the review group reports, over half of the clinical trials presented in the manufacturers' submissions for all appraisals were deemed to be either poor (166; 41%) or unacceptable (40;10%) quality. Just under half were considered to be of acceptable (173; 42%) or good (30;7%) quality.
Weak or insufficient evidence from poorly conducted clinical trials was often used because it was the only evidence available. But even when the trials had been done well, and the evidence was comprehensive, the comparators were often unsuitable for decision-making in the NHS context, the analysis showed.
And over the entire 20 year period the overall quality of evidence submitted to NICE didn’t change, and was consistently poor, the analysis indicated.
In particular, the researchers noted a lack of clarity on the methodologies used by the manufacturers when carrying out systematic reviews and indirect comparisons.
They found that comparator data often didn’t reflect the UK population and routine treatment pathways. Indirect comparisons were used in over two thirds (68%;207) of STAs to establish the comparative clinical effectiveness of interventions.
And the quality of life data was often of poor or unacceptable quality, even if collected in pivotal trials; and clarity in reporting methodology and details by both manufacturers and assessment bodies varied significantly.
The researchers acknowledge various limitations to their findings, chief among which was the subjective scoring system used for grading the quality of evidence, and the focus on only certain elements of the evidence submitted by manufacturers.
But they nevertheless conclude: “We found that the primary components of clinical evidence (comparative clinical effectiveness, measures of [quality of life] outcomes and overall design of [randomised controlled trials]) that influence patients and are crucial for NICE’s decision making framework are of poor quality.
“Since the evidence bar continues to be lowered, it is essential to have [health technology assessment] bodies and payers’ input to ensure that the generation of evidence submitted to NICE is strengthened.
“However, it is essential that stakeholders are aware of this and that organisations put more effort into generating high-quality evidence premarket and postmarket entry.”
END
Poor quality clinical data informing NICE decisions on treatments in over half of cases
20 year analysis shows no improvement in data quality submitted by manufacturers
2024-02-14
ELSE PRESS RELEASES FROM THIS DATE:
Age when periods first start and early menopause linked to heightened COPD risk
2024-02-14
A range of reproductive factors, including age when periods first start and an early menopause, are all linked to a heightened risk of COPD—the umbrella term for progressive lung conditions that cause breathing difficulties—finds research published online in the journal Thorax.
Miscarriage, stillbirth, infertility, and having 3 or more children are also associated with a heightened risk of COPD, which includes emphysema and chronic bronchitis, the findings show.
Recent evidence indicates substantial gender differences in susceptibility ...
Hostile environment policies linked to prolonged distress in people with Black Caribbean ancestry
2024-02-14
Psychological distress increased among people with Black Caribbean heritage in the UK, relative to the White population, following the 2014 Immigration Act and the Windrush scandal, finds a new study led by UCL researchers.
The researchers say their findings, published in The Lancet Psychiatry, suggest a causal link between government policies and a subsequent decline in mental health.
They were investigating the impact of the Immigration Act 2014, requiring landlords, employers, the NHS, banks and the police to check right-to-stay documentation. This was a key part of a set of measures known as the Home Office hostile environment policy, seeking ...
Clinical trial shows rheumatoid arthritis drug could prevent disease
2024-02-14
A drug used to treat rheumatoid arthritis could also prevent the disease in individuals deemed to be at risk.
Results from a Phase 2b clinical trial, published today in The Lancet by researchers led by King’s College London, provides hope for arthritis sufferers after it was shown that the biologic drug abatacept reduces progression to this agonising chronic inflammatory disease.
Rheumatoid arthritis affects half a million people in the UK and develops when the body’s immune system attacks itself, causing joint pain, swelling and significant disability. The disease most commonly begins in middle age, but much younger age groups can be afflicted, and until ...
Do apes have humor?
2024-02-14
Babies playfully tease others as young as eight months of age. Since language is not required for this behavior, similar kinds of playful teasing might be present in non-human animals. Now cognitive biologists and primatologists from the University of California Los Angeles (UCLA, US), the Max Planck Institute of Animal Behavior (MPI-AB, Germany), Indiana University (IU, US), and the University of California San Diego (UCSD, US) have documented playful teasing in four species of great apes. Like joking behavior in humans, ape teasing is provocative, persistent, and includes elements of surprise and play. Because all four great ape species used playful teasing, it is likely that the ...
New digital therapy reduces anxiety and depression in people living with long-term physical health conditions
2024-02-14
A therapist-guided digital cognitive behavioural therapy reduced distress in 89 per cent of participants living with long-term physical health conditions, a new King’s College London study finds.
Researchers at the Institute of Psychiatry, Psychology & Neuroscience (IoPPN) at King’s College London found that people living with long-term conditions who received the therapist-guided digital programme called COMPASS showed a significant reduction in psychological distress (a combined score of anxiety and depression) 12-weeks after starting the study.
194 patients were recruited via long-term condition charities, including Crohn’s & ...
Researchers edge closer to delivering personalized medicine to cancer patients
2024-02-14
For the first time, Purdue researchers prove that measuring mechanical motions in living cancer tissues is a viable and promising approach for predicting chemoresistance
Chemotherapy can save lives, but often a cancer patient may be resistant to their prescribed chemotherapy, which costs the patient valuable time. Chemoresistance is a topic that researchers need to understand better so that they can match the right type of chemo to the right patient, which is called personalized medicine.
An unusual pairing of veterinary scientists and physicists believe ...
Trail cameras track ‘critically low’ New York bobcat population
2024-02-13
CORNELL UNIVERSITY MEDIA RELATIONS OFFICE
FOR RELEASE: Feb. 13, 2024
Kaitlyn Serrao
607-882-1140
kms465@cornell.edu
Trail cameras track ‘critically low’ New York bobcat population
ITHACA, N.Y. – With thousands of strategically placed cameras covering more than 27,000 square miles in central and western New York, biologists have evidence that bobcat populations remain critically low in central and western New York state.
Despite reports of recent recoveries elsewhere, bobcat populations in New York State displayed low occupancy, ...
Virginia Tech researchers discover that blocking an essential nutrient inhibits malaria parasite growth
2024-02-13
Living organisms often create what is needed for life from scratch.
For humans, this process means the creation of most essential compounds needed to survive. But not every living thing has this capability, such as the parasite that causes malaria, which affected an estimated 249 million people in 2022.
Virginia Tech researchers in the College of Agriculture and Life Sciences found that by preventing the malaria parasite from scavenging fatty acids, a type of required nutrient, it could no longer grow.
“The key to this breakthrough is that we were able to develop a screening method for the malaria ...
Children's Hospital Los Angeles researchers uncover social and economic factors that influence acute liver failure in children—and ways to overcome them
2024-02-13
Imagine your healthy child gets sick—so sick that you take them to the emergency department. You are shocked to find out that their liver is failing, and they will need a transplant to survive. Studies show that their chances of survival are higher the faster they can get to a hospital that performs liver transplants. But what factors affect how quickly that happens?
Pediatric acute liver failure, also called PALF, is a life-threatening condition that emerges with very little warning in previously healthy children. It is rare, affecting about 5,000 children in the United States a year, and can result from viral ...
Uncovering insights about prostate cancer risk and genetic ancestry
2024-02-13
This study included larger groups of people from African, Hispanic and Asian ancestries than many other previous studies.
A recent study involving scientists from the U.S. Department of Energy’s (DOE) Argonne National Laboratory has uncovered insights into the prostate cancer risks of people from a variety of genetic ancestries. The project, which was led by the University of Southern California, included large increases in representation among men of African, Hispanic and Asian ancestries, that were contributed in part by an ongoing collaboration between the U.S. Department of Veterans Affairs (VA) and DOE as ...
LAST 30 PRESS RELEASES:
Opening borders for workers: Abe’s profound influence on Japan’s immigration regime
How skills from hospitality and tourism can propel careers beyond the industry
Research shows managers of firms handling recalls should review media scrutiny before deciding whether to lobby
New model system for the development of potential active substances used in condensate modifying drugs
How to reduce social media stress by leaning in instead of logging off
Pioneering research shows sea life will struggle to survive future global warming
In 10 seconds, an AI model detects cancerous brain tumor often missed during surgery
Burden of RSV–associated hospitalizations in US adults, October 2016 to September 2023
Repurposing semaglutide and liraglutide for alcohol use disorder
IPK-led research team provides insights into the pangenome of barley
New route to fluorochemicals: fluorspar activated in water under mild conditions
Microbial load can influence disease associations
Three galactic “red monsters” in the early Universe
First ever study finds sexual and gender minority physicians and residents have higher levels of burnout, lower professional fulfillment
Astronomers discover mysterious ‘Red Monster’ galaxies in the early Universe
The secrets of fossil teeth revealed by the synchrotron: a long childhood is the prelude to the evolution of a large brain
Obesity-fighting drugs may reduce alcohol consumption in individuals with alcohol use disorder
Does AI improve doctors’ diagnoses? Study puts it to the test
Extreme weather accelerates nitrate pollution in groundwater
Burden of liver cancer attributable to hepatitis B and alcohol globally, in China, and for five sociodemographic index regions from 1990 to 2021
Lehigh partners with North Carolina A&T to enhance flood damage mapping with AI and advanced radar
2024 AAAS Kavli Science Journalism Award winners named
Collaborative of prominent academic institutions launches groundbreaking healthcare AI challenge
American Federation for Aging Research announces 2024 AFAR grants for junior faculty
Potential single-dose smallpox and mpox vaccine moves forward
Mass General Brigham Gene and Cell Therapy Institute names Spark Grant recipients
New discovery may lead to more effective treatment for cardiovascular disease
Developing advanced recycling technology to restore spent battery cathode materials
An advance toward inhalable mRNA medications, vaccines
A step toward safer X-rays with new detector technology
[Press-News.org] Poor quality clinical data informing NICE decisions on treatments in over half of cases20 year analysis shows no improvement in data quality submitted by manufacturers