Harmonizing altered measures in integrative data analysis: A methods analogue study
- PMID: 32939683
- PMCID: PMC8462527
- DOI: 10.3758/s13428-020-01472-7
Harmonizing altered measures in integrative data analysis: A methods analogue study
Abstract
In the current study, we used an analogue integrative data analysis (IDA) design to test optimal scoring strategies for harmonizing alcohol- and drug-use consequence measures with varying degrees of alteration across four study conditions. We evaluated performance of mean, confirmatory factor analysis (CFA), and moderated nonlinear factor analysis (MNLFA) scores based on traditional indices of reliability (test-retest, internal, and score recovery or parallel forms) and validity. Participants in the analogue study included 854 college students (46% male; 21% African American, 5% Hispanic/Latino, 56% European American) who completed two versions of the altered measures at two sessions, separated by 2 weeks. As expected, mean, CFA, and MNLFA scores all resulted in scales with lower reliability given increasing scale alteration (with less fidelity to formerly developed scales) and shorter scale length. MNLFA and CFA scores, however, showed greater validity than mean scores, demonstrating stronger relationships with external correlates. Implications for measurement harmonization in the context of IDA are discussed.
Keywords: Alcohol consequences; Data pooling; Drug consequences; Harmonization; Integrative data analysis.
Similar articles
-
Informing Harmonization Decisions in Integrative Data Analysis: Exploring the Measurement Multiverse.Prev Sci. 2023 Nov;24(8):1595-1607. doi: 10.1007/s11121-022-01466-1. Epub 2022 Nov 28. Prev Sci. 2023. PMID: 36441362
-
An application of moderated nonlinear factor analysis to develop a commensurate measure of alcohol problems across four alcohol treatment studies.Drug Alcohol Depend. 2021 Dec 1;229(Pt A):109068. doi: 10.1016/j.drugalcdep.2021.109068. Epub 2021 Sep 24. Drug Alcohol Depend. 2021. PMID: 34628095 Free PMC article.
-
Development and validation of a measurement scale to assess nursing students’ readiness for the flipped classroom in Sri Lanka.J Educ Eval Health Prof. 2020;17:41. doi: 10.3352/jeehp.2020.17.41. Epub 2020 Dec 14. J Educ Eval Health Prof. 2020. PMID: 33307616 Free PMC article. Review.
-
Approaches for creating comparable measures of alcohol use symptoms: Harmonization with eight studies of criminal justice populations.Drug Alcohol Depend. 2019 Jan 1;194:59-68. doi: 10.1016/j.drugalcdep.2018.10.003. Epub 2018 Oct 23. Drug Alcohol Depend. 2019. PMID: 30412898 Free PMC article.
-
Simplifying the implementation of modern scale scoring methods with an automated R package: Automated moderated nonlinear factor analysis (aMNLFA).Addict Behav. 2019 Jul;94:65-73. doi: 10.1016/j.addbeh.2018.10.031. Epub 2018 Oct 25. Addict Behav. 2019. PMID: 30385076 Free PMC article.
Cited by
-
Problematic Substance Use among Sexual Minority and Heterosexual Young Adults during COVID-19.Behav Sci (Basel). 2023 Aug 4;13(8):655. doi: 10.3390/bs13080655. Behav Sci (Basel). 2023. PMID: 37622795 Free PMC article.
-
Future Orientation Among Children Affected by Parental HIV in China: An Exploratory Analysis of Complex Interactions.Front Sociol. 2022 Jul 7;7:899537. doi: 10.3389/fsoc.2022.899537. eCollection 2022. Front Sociol. 2022. PMID: 35874445 Free PMC article.
References
-
- Benjamini Y & Hochberg Y. (2000). On the adaptive control of the false discovery rate in multiple testing with independent statistics. Journal of Educational and Behavioral Statistics, 25(1), 60–83. 10.2307/1165312 - DOI
-
- Bollen KA (1989) Structural Equations with Latent Variables. John Wiley and Sons, Inc., New York. 10.1002/9781118619179 - DOI
-
- Bollen KA & Hoyle RH (2012). Latent variables in structural equation modeling. In Hoyle RH (Ed.), Handbook of Structural Equation Modeling, pp. 56–67. New York: The Guilford Press.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Research Materials