Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2022 Aug:148:160-169.
doi: 10.1016/j.jclinepi.2022.04.017. Epub 2022 Apr 18.

Most healthcare interventions tested in Cochrane Reviews are not effective according to high quality evidence: a systematic review and meta-analysis

Jeremy Howick  1 , Despina Koletsi  2 , John P A Ioannidis  3 , Claire Madigan  4 , Nikolaos Pandis  5 , Martin Loef  6 , Harald Walach  6 , Sebastian Sauer  7 , Jos Kleijnen  8 , Jadbinder Seehra  9 , Tess Johnson  10 , Stefan Schmidt  11
Affiliations
Free article
Review

Most healthcare interventions tested in Cochrane Reviews are not effective according to high quality evidence: a systematic review and meta-analysis

Jeremy Howick et al. J Clin Epidemiol. 2022 Aug.
Free article

Abstract

Objective: To estimate the proportion of healthcare interventions tested within Cochrane Reviews that are effective according to high-quality evidence.

Methods: We selected a random sample of 2,428 (35%) of all Cochrane Reviews published between 1 January 2008 and 5 March 2021. We extracted data about interventions within these reviews that were compared with placebo, or no treatment, and whose outcome quality was rated using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system. We calculated the proportion of interventions whose benefits were based on high-quality evidence (defined as having high quality GRADE rating for at least one primary outcome, statistically significant positive results, and being judged by review authors as effective. We also calculated the proportion of interventions that suggested harm.

Results: Of 1,567 eligible interventions, 87 (5.6%) had high-quality evidence supporting their benefits. Harms were measured for 577 (36.8%) interventions. There was statistically significant evidence for harm in 127 (8.1%) of these. Our dependence on the reliability of Cochrane author assessments (including their GRADE assessments) was the main potential limitation of our study.

Conclusion: More than 9 in 10 healthcare interventions studied within recent Cochrane Reviews are not supported by high-quality evidence, and harms are under-reported.

Keywords: Epidemiology; Evidence; Harm; Quality; Safety; Systematic review.

PubMed Disclaimer

Similar articles

See all similar articles

Cited by

See all "Cited by" articles