The Thorny Relation Between Measurement Quality and Fit Index Cutoffs in Latent Variable Models
- PMID: 28631976
- DOI: 10.1080/00223891.2017.1281286
The Thorny Relation Between Measurement Quality and Fit Index Cutoffs in Latent Variable Models
Abstract
Latent variable modeling is a popular and flexible statistical framework. Concomitant with fitting latent variable models is assessment of how well the theoretical model fits the observed data. Although firm cutoffs for these fit indexes are often cited, recent statistical proofs and simulations have shown that these fit indexes are highly susceptible to measurement quality. For instance, a root mean square error of approximation (RMSEA) value of 0.06 (conventionally thought to indicate good fit) can actually indicate poor fit with poor measurement quality (e.g., standardized factors loadings of around 0.40). Conversely, an RMSEA value of 0.20 (conventionally thought to indicate very poor fit) can indicate acceptable fit with very high measurement quality (standardized factor loadings around 0.90). Despite the wide-ranging effect on applications of latent variable models, the high level of technical detail involved with this phenomenon has curtailed the exposure of these important findings to empirical researchers who are employing these methods. This article briefly reviews these methodological studies in minimal technical detail and provides a demonstration to easily quantify the large influence measurement quality has on fit index values and how greatly the cutoffs would change if they were derived under an alternative level of measurement quality. Recommendations for best practice are also discussed.
Keywords: .
Similar articles
-
Decomposing model fit: measurement vs. theory in organizational research using latent variables.J Appl Psychol. 2011 Jan;96(1):1-12. doi: 10.1037/a0020539. J Appl Psychol. 2011. PMID: 20718518
-
Dynamic fit index cutoffs for one-factor models.Behav Res Methods. 2023 Apr;55(3):1157-1174. doi: 10.3758/s13428-022-01847-y. Epub 2022 May 18. Behav Res Methods. 2023. PMID: 35585278
-
Masking misfit in confirmatory factor analysis by increasing unique variances: a cautionary note on the usefulness of cutoff values of fit indices.Psychol Methods. 2011 Sep;16(3):319-36. doi: 10.1037/a0024917. Psychol Methods. 2011. PMID: 21843002
-
Construct validity in health behavior research: interpreting latent variable models involving self-report and objective measures.J Behav Med. 2002 Dec;25(6):525-50. doi: 10.1023/a:1020689316518. J Behav Med. 2002. PMID: 12462957 Review.
-
Latent variable mixture modeling in psychiatric research--a review and application.Psychol Med. 2016 Feb;46(3):457-67. doi: 10.1017/S0033291715002305. Epub 2015 Nov 3. Psychol Med. 2016. PMID: 26526221 Review.
Cited by
-
Development and validity evidence on the scale of perceived social support for university students (EPSSEU) during the period of social restrictions.BMC Public Health. 2024 Jun 1;24(1):1474. doi: 10.1186/s12889-024-18882-3. BMC Public Health. 2024. PMID: 38824510 Free PMC article.
-
A Test of the Self-Medication Hypothesis Using a Latent Measurement Model: Are Stress and Impaired Control over Alcohol Mediating Mechanisms of Parenting Styles on Heavy Episodic Drinking and Alcohol-Related Problems among University Students?Behav Sci (Basel). 2024 May 2;14(5):384. doi: 10.3390/bs14050384. Behav Sci (Basel). 2024. PMID: 38785875 Free PMC article.
-
Psychometric properties of the Children's Revised Impact of Event Scale (CRIES-8) among refugee adolescents from Afghanistan, Syria, and Somalia.Eur J Psychotraumatol. 2024;15(1):2349445. doi: 10.1080/20008066.2024.2349445. Epub 2024 May 16. Eur J Psychotraumatol. 2024. PMID: 38753438 Free PMC article.
-
Applicability and clinical utility of the German rivermead post-concussion symptoms questionnaire in proxies of children after traumatic brain injury: an instrument validation study.BMC Neurol. 2024 Apr 19;24(1):133. doi: 10.1186/s12883-024-03587-2. BMC Neurol. 2024. PMID: 38641780 Free PMC article.
-
Handling dependent samples in meta-analytic structural equation models: A Wishart-based approach.Behav Res Methods. 2024 Feb 2. doi: 10.3758/s13428-024-02340-4. Online ahead of print. Behav Res Methods. 2024. PMID: 38308147
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources