Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2015 Feb;68(2):163-74.
doi: 10.1016/j.jclinepi.2014.09.004. Epub 2014 Nov 26.

Application of credibility ceilings probes the robustness of meta-analyses of biomarkers and cancer risk

Stefania I Papatheodorou  1 , Konstantinos K Tsilidis  2 , Evangelos Evangelou  2 , John P A Ioannidis  3
Affiliations

Application of credibility ceilings probes the robustness of meta-analyses of biomarkers and cancer risk

Stefania I Papatheodorou et al. J Clin Epidemiol. 2015 Feb.

Abstract

Objectives: Meta-analyses of biomarkers often present spurious significant results and large effects. We applied sensitivity analyses with the use of credibility ceilings to assess whether and how the results of meta-analyses of biomarkers and cancer risk would change.

Study design and setting: We evaluated 98 meta-analyses, 43 (44%) of which had nominally statistically significant results. We assumed that any single study cannot give more than a maximum certainty 100 - c% (c, credibility ceiling) that the effect estimate [odds ratio (OR)] exceeds 1 (null) or 1.2.

Results: Nominal statistical significance was maintained for 21 (21%) meta-analyses, for c = 10% and OR >1, and these proportions changed to 7%, 3%, and 6% with ceilings of 20%, 30%, and 40%, respectively. For ceilings for OR >1.2, the respective proportions were 37%, 21%, 7%, and 3%. Seven meta-analyses on infectious agents retained statistical significance even with a high ceiling of c = 20% for OR >1.00. Meta-analyses without other hints of bias (large between-study heterogeneity, small-study effects, excess significance) were more likely to retain statistical significance than those that had such hints of bias.

Conclusion: Credibility ceilings may be helpful in meta-analyses of biomarkers to understand the robustness of the results to different levels of uncertainty.

Keywords: Biomarkers; Cancer; Credibility ceiling; Meta-analyses; Predictive intervals.

PubMed Disclaimer

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

Publication types

Substances

LinkOut - more resources