The relative trustworthiness of inferential tests of the indirect effect in statistical mediation analysis: does method really matter?
- PMID: 23955356
- DOI: 10.1177/0956797613480187
The relative trustworthiness of inferential tests of the indirect effect in statistical mediation analysis: does method really matter?
Abstract
A content analysis of 2 years of Psychological Science articles reveals inconsistencies in how researchers make inferences about indirect effects when conducting a statistical mediation analysis. In this study, we examined the frequency with which popularly used tests disagree, whether the method an investigator uses makes a difference in the conclusion he or she will reach, and whether there is a most trustworthy test that can be recommended to balance practical and performance considerations. We found that tests agree much more frequently than they disagree, but disagreements are more common when an indirect effect exists than when it does not. We recommend the bias-corrected bootstrap confidence interval as the most trustworthy test if power is of utmost concern, although it can be slightly liberal in some circumstances. Investigators concerned about Type I errors should choose the Monte Carlo confidence interval or the distribution-of-the-product approach, which rarely disagree. The percentile bootstrap confidence interval is a good compromise test.
Keywords: Sobel test; bootstrapping; hypothesis testing; indirect effects; mediation analysis; statistical analyses.
Similar articles
-
Assessing Mediational Models: Testing and Interval Estimation for Indirect Effects.Multivariate Behav Res. 2010 Aug 6;45(4):661-701. doi: 10.1080/00273171.2010.498292. Multivariate Behav Res. 2010. PMID: 26735714
-
Constructing Confidence Intervals for Effect Size Measures of an Indirect Effect.Multivariate Behav Res. 2015;50(6):600-13. doi: 10.1080/00273171.2015.1040542. Epub 2015 Nov 17. Multivariate Behav Res. 2015. PMID: 26717121
-
Correcting the Bias Correction for the Bootstrap Confidence Interval in Mediation Analysis.Front Psychol. 2022 May 27;13:810258. doi: 10.3389/fpsyg.2022.810258. eCollection 2022. Front Psychol. 2022. PMID: 35712166 Free PMC article.
-
Effect size, confidence interval and statistical significance: a practical guide for biologists.Biol Rev Camb Philos Soc. 2007 Nov;82(4):591-605. doi: 10.1111/j.1469-185X.2007.00027.x. Biol Rev Camb Philos Soc. 2007. PMID: 17944619 Review.
-
Statistical inference by confidence intervals: issues of interpretation and utilization.Phys Ther. 1999 Feb;79(2):186-95. Phys Ther. 1999. PMID: 10029058 Review.
Cited by
-
Well-Being and Dispositional Hope in a Sample of Portuguese Citizens: The Mediating Role of Mental Health.Eur J Investig Health Psychol Educ. 2024 Jul 22;14(7):2101-2115. doi: 10.3390/ejihpe14070140. Eur J Investig Health Psychol Educ. 2024. PMID: 39056655 Free PMC article.
-
Perceived social fairness and trust in government serially mediate the effect of governance quality on subjective well-being.Sci Rep. 2024 Jul 10;14(1):15905. doi: 10.1038/s41598-024-67124-4. Sci Rep. 2024. PMID: 38987608 Free PMC article.
-
Signal-to-Noise Ratio in Estimating and Testing the Mediation Effect: Structural Equation Modeling versus Path Analysis with Weighted Composites.Psychometrika. 2024 May 28. doi: 10.1007/s11336-024-09975-4. Online ahead of print. Psychometrika. 2024. PMID: 38806853
-
The influence of water safety knowledge on adolescents' drowning risk behaviors: a framework of risk-protect integrated and KAP theory.Front Public Health. 2024 May 10;12:1354231. doi: 10.3389/fpubh.2024.1354231. eCollection 2024. Front Public Health. 2024. PMID: 38799683 Free PMC article.
-
Effect of proactive personality on career adaptability of higher vocational college students: the mediating role of college experience.Front Psychol. 2024 May 9;15:1333677. doi: 10.3389/fpsyg.2024.1333677. eCollection 2024. Front Psychol. 2024. PMID: 38784628 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
