Why most published research findings are false
- PMID: 16060722
- PMCID: PMC1182327
- DOI: 10.1371/journal.pmed.0020124
Why most published research findings are false
Erratum in
-
Correction: Why Most Published Research Findings Are False.PLoS Med. 2022 Aug 25;19(8):e1004085. doi: 10.1371/journal.pmed.1004085. eCollection 2022 Aug. PLoS Med. 2022. PMID: 36007233 Free PMC article.
Abstract
There is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance. Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Moreover, for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias. In this essay, I discuss the implications of these problems for the conduct and interpretation of research.
Conflict of interest statement
Figures
![Figure 1](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/1196463/bin/pmed.0020124.g001.gif)
![Figure 2](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/1196463/bin/pmed.0020124.g002.gif)
Comment in
-
Minimizing mistakes and embracing uncertainty.PLoS Med. 2005 Aug;2(8):e272. doi: 10.1371/journal.pmed.0020272. Epub 2005 Aug 30. PLoS Med. 2005. PMID: 16120013 Free PMC article.
-
Truth, probability, and frameworks.PLoS Med. 2005 Nov;2(11):e361. doi: 10.1371/journal.pmed.0020361. Epub 2005 Nov 29. PLoS Med. 2005. PMID: 16288554 Free PMC article. No abstract available.
-
Power, reliability, and heterogeneous results.PLoS Med. 2005 Nov;2(11):e386; author reply e398. doi: 10.1371/journal.pmed.0020386. Epub 2005 Nov 29. PLoS Med. 2005. PMID: 16288559 Free PMC article.
-
The clinical interpretation of research.PLoS Med. 2005 Nov;2(11):e395. doi: 10.1371/journal.pmed.0020395. Epub 2005 Nov 29. PLoS Med. 2005. PMID: 16288562 Free PMC article. No abstract available.
-
Why most published research findings are false: problems in the analysis.PLoS Med. 2007 Apr;4(4):e168. doi: 10.1371/journal.pmed.0040168. PLoS Med. 2007. PMID: 17456002 Free PMC article. No abstract available.
-
When research evidence is misleading.Virtual Mentor. 2013 Jan 1;15(1):29-33. doi: 10.1001/virtualmentor.2013.15.1.jdsc1-1301. Virtual Mentor. 2013. PMID: 23356804 No abstract available.
-
Modeling and research on research.Clin Chem. 2014 Sep;60(9):1238-9. doi: 10.1373/clinchem.2013.218453. Epub 2014 Jul 18. Clin Chem. 2014. PMID: 25037936 No abstract available.
-
The Value of P.Am J Transplant. 2016 Oct;16(10):2769-2770. doi: 10.1111/ajt.14026. Am J Transplant. 2016. PMID: 27662077 No abstract available.
-
Practical Effects of Lowering the P Value in Neurosurgery: Restricting Evidence-Based Medicine to Big Business.World Neurosurg. 2018 Sep;117:460-462. doi: 10.1016/j.wneu.2018.07.112. Epub 2018 Jul 18. World Neurosurg. 2018. PMID: 30031185 No abstract available.
-
Make quotations great again: a proposal to reduce false-knowledge.BMJ Evid Based Med. 2020 Feb;25(1):12-14. doi: 10.1136/bmjebm-2018-111109. Epub 2019 Feb 25. BMJ Evid Based Med. 2020. PMID: 30804021
-
Benign Prostatic Hyperplasia.J Urol. 2023 Dec;210(6):908-910. doi: 10.1097/JU.0000000000003714. Epub 2023 Sep 25. J Urol. 2023. PMID: 37747152 No abstract available.
Similar articles
-
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
-
The future of Cochrane Neonatal.Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
-
Subgroup analyses in randomised controlled trials: quantifying the risks of false-positives and false-negatives.Health Technol Assess. 2001;5(33):1-56. doi: 10.3310/hta5330. Health Technol Assess. 2001. PMID: 11701102 Review.
-
LFK index does not reliably detect small-study effects in meta-analysis: A simulation study.Res Synth Methods. 2024 Jul;15(4):603-615. doi: 10.1002/jrsm.1714. Epub 2024 Mar 11. Res Synth Methods. 2024. PMID: 38467140
-
Power dressing and meta-analysis: incorporating power analysis into meta-analysis.J Adv Nurs. 2002 May;38(3):274-80. doi: 10.1046/j.1365-2648.2002.02177.x. J Adv Nurs. 2002. PMID: 11972663 Review.
Cited by
-
Seeing more than the Tip of the Iceberg: Approaches to Subthreshold Effects in Functional Magnetic Resonance Imaging of the Brain.Clin Neuroradiol. 2024 Jun 6. doi: 10.1007/s00062-024-01422-2. Online ahead of print. Clin Neuroradiol. 2024. PMID: 38842737 Review.
-
Is waiting for rewards good for you? No association between impulsive choice, psychopathology, and functional outcomes in a large cohort sample.JCPP Adv. 2024 Apr 15;4(2):e12231. doi: 10.1002/jcv2.12231. eCollection 2024 Jun. JCPP Adv. 2024. PMID: 38827985 Free PMC article.
-
Development and Validation of a Prediction Model for 1-Year Mortality in Patients With a Hematologic Malignancy Admitted to the ICU.Crit Care Explor. 2024 May 24;6(6):e1093. doi: 10.1097/CCE.0000000000001093. eCollection 2024 Jun. Crit Care Explor. 2024. PMID: 38813435 Free PMC article.
-
Technical pitfalls when collecting, cryopreserving, thawing, and stimulating human T-cells.Front Immunol. 2024 May 15;15:1382192. doi: 10.3389/fimmu.2024.1382192. eCollection 2024. Front Immunol. 2024. PMID: 38812513 Free PMC article. Review.
-
Cross-Reactivity of N6AMT1 Antibodies with Aurora Kinase A: An Example of Antibody-Specific Non-Specificity.Antibodies (Basel). 2024 Apr 22;13(2):33. doi: 10.3390/antib13020033. Antibodies (Basel). 2024. PMID: 38804301 Free PMC article.
References
-
- Lawlor DA, Davey Smith G, Kundu D, Bruckdorfer KR, Ebrahim S. Those confounded vitamins: What can we learn from the differences between observational versus randomised trial evidence? Lancet. 2004;363:1724–1727. - PubMed
-
- Vandenbroucke JP. When are observational studies as credible as randomised trials? Lancet. 2004;363:1728–1731. - PubMed
-
- Michiels S, Koscielny S, Hill C. Prediction of cancer outcome with microarrays: A multiple random validation strategy. Lancet. 2005;365:488–492. - PubMed
-
- Ioannidis JPA, Ntzani EE, Trikalinos TA, Contopoulos-Ioannidis DG. Replication validity of genetic association studies. Nat Genet. 2001;29:306–309. - PubMed
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources