Measurement Invariance Conventions and Reporting: The State of the Art and Future Directions for Psychological Research
- PMID: 27942093
- PMCID: PMC5145197
- DOI: 10.1016/j.dr.2016.06.004
Measurement Invariance Conventions and Reporting: The State of the Art and Future Directions for Psychological Research
Abstract
Measurement invariance assesses the psychometric equivalence of a construct across groups or across time. Measurement noninvariance suggests that a construct has a different structure or meaning to different groups or on different measurement occasions in the same group, and so the construct cannot be meaningfully tested or construed across groups or across time. Hence, prior to testing mean differences across groups or measurement occasions (e.g., boys and girls, pretest and posttest), or differential relations of the construct across groups, it is essential to assess the invariance of the construct. Conventions and reporting on measurement invariance are still in flux, and researchers are often left with limited understanding and inconsistent advice. Measurement invariance is tested and established in different steps. This report surveys the state of measurement invariance testing and reporting, and details the results of a literature review of studies that tested invariance. Most tests of measurement invariance include configural, metric, and scalar steps; a residual invariance step is reported for fewer tests. Alternative fit indices (AFIs) are reported as model fit criteria for the vast majority of tests; χ2 is reported as the single index in a minority of invariance tests. Reporting AFIs is associated with higher levels of achieved invariance. Partial invariance is reported for about one-third of tests. In general, sample size, number of groups compared, and model size are unrelated to the level of invariance achieved. Implications for the future of measurement invariance testing, reporting, and best practices are discussed.
Keywords: Comparative psychology; confirmatory factor analysis; measurement invariance; multiple-group analysis; structural equation modeling.
Figures
Similar articles
-
Permutation randomization methods for testing measurement equivalence and detecting differential item functioning in multiple-group confirmatory factor analysis.Psychol Methods. 2018 Dec;23(4):708-728. doi: 10.1037/met0000152. Epub 2017 Nov 27. Psychol Methods. 2018. PMID: 29172611
-
Testing Measurement and Factor Structure Invariance of the Physical Activity and Leisure Motivation Scale for Youth Across Gender.Front Psychol. 2018 Jul 3;9:1096. doi: 10.3389/fpsyg.2018.01096. eCollection 2018. Front Psychol. 2018. PMID: 30018580 Free PMC article.
-
Confirmatory Factor Analysis and Measurement Invariance of the Functional Assessment of Cancer Therapy Lung Cancer Utility Index (FACT-LUI).MDM Policy Pract. 2023 Jul 27;8(2):23814683231186992. doi: 10.1177/23814683231186992. eCollection 2023 Jul-Dec. MDM Policy Pract. 2023. PMID: 37529767 Free PMC article.
-
Measurement invariance in the social sciences: Historical development, methodological challenges, state of the art, and future perspectives.Soc Sci Res. 2023 Feb;110:102805. doi: 10.1016/j.ssresearch.2022.102805. Epub 2022 Oct 31. Soc Sci Res. 2023. PMID: 36796989 Review.
-
An essay on measurement and factorial invariance.Med Care. 2006 Nov;44(11 Suppl 3):S69-77. doi: 10.1097/01.mlr.0000245438.73837.89. Med Care. 2006. PMID: 17060838 Review.
Cited by
-
Comparing RMSEA-Based Indices for Assessing Measurement Invariance in Confirmatory Factor Models.Educ Psychol Meas. 2024 Aug;84(4):716-735. doi: 10.1177/00131644231202949. Epub 2023 Nov 1. Educ Psychol Meas. 2024. PMID: 39055094 Free PMC article.
-
Validation of the extended e-health literacy scale: structural validity, construct validity and measurement invariance.BMC Public Health. 2024 Jul 25;24(1):1991. doi: 10.1186/s12889-024-19431-8. BMC Public Health. 2024. PMID: 39054541 Free PMC article.
-
Using natural language processing to facilitate the harmonisation of mental health questionnaires: a validation study using real-world data.BMC Psychiatry. 2024 Jul 24;24(1):530. doi: 10.1186/s12888-024-05954-2. BMC Psychiatry. 2024. PMID: 39049010 Free PMC article.
-
Stepfamily Variation in Parent-Child Relationship Quality in Later Life.J Marriage Fam. 2024 Jun;86(3):718-737. doi: 10.1111/jomf.12946. Epub 2023 Oct 14. J Marriage Fam. 2024. PMID: 39045223
-
A longitudinal examination of the measurement properties and invariance of the Sleep Condition Indicator in Chinese healthcare students.BMC Psychiatry. 2024 Jul 22;24(1):518. doi: 10.1186/s12888-024-05844-7. BMC Psychiatry. 2024. PMID: 39039484 Free PMC article.
References
-
- Barrett P. Structural equation modelling: Adjudging model fit. Personality and Individual Differences. 2007;42:815–824. doi: 10.1016/j.paid.2006.09.018. - DOI
-
- Bentler PM. On tests and indices for evaluating structural models. Personality and Individual Differences. 2007;42:825–829. doi: 10.1016/j.paid.2006.09.024. - DOI
-
- Bornstein MH. Form and function: Implications for studies of culture and human development. Culture & Psychology. 1995;1:123–137. doi: 10.1177/1354067X9511009. - DOI
-
- Byrne BM, Shavelson RJ, Muthén B. Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin. 1989;105:456–466. doi: 10.1037/0033-2909.105.3.456. - DOI
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources