Three-level meta-analysis of dependent effect sizes
- PMID: 23055166
- DOI: 10.3758/s13428-012-0261-6
Three-level meta-analysis of dependent effect sizes
Abstract
Although dependence in effect sizes is ubiquitous, commonly used meta-analytic methods assume independent effect sizes. We describe and illustrate three-level extensions of a mixed effects meta-analytic model that accounts for various sources of dependence within and across studies, because multilevel extensions of meta-analytic models still are not well known. We also present a three-level model for the common case where, within studies, multiple effect sizes are calculated using the same sample. Whereas this approach is relatively simple and does not require imputing values for the unknown sampling covariances, it has hardly been used, and its performance has not been empirically investigated. Therefore, we set up a simulation study, showing that also in this situation, a three-level approach yields valid results: Estimates of the treatment effects and the corresponding standard errors are unbiased.
Similar articles
-
A Guide to Conducting a Meta-Analysis with Non-Independent Effect Sizes.Neuropsychol Rev. 2019 Dec;29(4):387-396. doi: 10.1007/s11065-019-09415-6. Epub 2019 Aug 24. Neuropsychol Rev. 2019. PMID: 31446547 Free PMC article. Review.
-
Assessing meta-regression methods for examining moderator relationships with dependent effect sizes: A Monte Carlo simulation.Res Synth Methods. 2017 Dec;8(4):435-450. doi: 10.1002/jrsm.1245. Epub 2017 May 28. Res Synth Methods. 2017. PMID: 28556477
-
Meta-analysis of multiple outcomes: a multilevel approach.Behav Res Methods. 2015 Dec;47(4):1274-1294. doi: 10.3758/s13428-014-0527-2. Behav Res Methods. 2015. PMID: 25361866
-
Estimating intervention effects across different types of single-subject experimental designs: empirical illustration.Sch Psychol Q. 2015 Mar;30(1):50-63. doi: 10.1037/spq0000068. Epub 2014 Jun 2. Sch Psychol Q. 2015. PMID: 24884449 Review.
-
Modeling dependent effect sizes with three-level meta-analyses: a structural equation modeling approach.Psychol Methods. 2014 Jun;19(2):211-29. doi: 10.1037/a0032968. Epub 2013 Jul 8. Psychol Methods. 2014. PMID: 23834422
Cited by
-
Endogenous oxytocin and human social interactions: A systematic review and meta-analysis.Psychol Bull. 2023 Sep-Oct;149(9-10):549-579. doi: 10.1037/bul0000402. Psychol Bull. 2023. PMID: 38713749
-
Gut microbiome is associated with recurrence-free survival in patients with resected Stage IIIB-D or Stage IV melanoma treated with immune checkpoint inhibitors.bioRxiv [Preprint]. 2024 Apr 20:2024.04.16.589761. doi: 10.1101/2024.04.16.589761. bioRxiv. 2024. PMID: 38659744 Free PMC article. Preprint.
-
The Effect of High-Fat Diet on Intramyocellular Lipid Content in Healthy Adults: A Systematic Review, Meta-Analysis, and Meta-Regression.J Nutr. 2024 Apr;154(4):1087-1100. doi: 10.1016/j.tjnut.2024.02.026. Epub 2024 Feb 26. J Nutr. 2024. PMID: 38417551 Free PMC article. Review.
-
Neuropsychological Assessments of Cognitive Impairment in Major Depressive Disorder: A Systematic Review and Meta-Analysis with Meta-Regression.Psychother Psychosom. 2024;93(1):8-23. doi: 10.1159/000535665. Epub 2024 Jan 25. Psychother Psychosom. 2024. PMID: 38272009 Free PMC article.
-
Examining the Efficacy of Culturally Responsive Interventions for Autistic Children and Their Families: A Meta-Analysis.J Autism Dev Disord. 2024 Jan 21. doi: 10.1007/s10803-023-06212-2. Online ahead of print. J Autism Dev Disord. 2024. PMID: 38246962
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources