Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer
- PMID: 29942800
- PMCID: PMC6004510
- DOI: 10.3389/fpubh.2018.00149
Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer
Abstract
Scale development and validation are critical to much of the work in the health, social, and behavioral sciences. However, the constellation of techniques required for scale development and evaluation can be onerous, jargon-filled, unfamiliar, and resource-intensive. Further, it is often not a part of graduate training. Therefore, our goal was to concisely review the process of scale development in as straightforward a manner as possible, both to facilitate the development of new, valid, and reliable scales, and to help improve existing ones. To do this, we have created a primer for best practices for scale development in measuring complex phenomena. This is not a systematic review, but rather the amalgamation of technical literature and lessons learned from our experiences spent creating or adapting a number of scales over the past several decades. We identified three phases that span nine steps. In the first phase, items are generated and the validity of their content is assessed. In the second phase, the scale is constructed. Steps in scale construction include pre-testing the questions, administering the survey, reducing the number of items, and understanding how many factors the scale captures. In the third phase, scale evaluation, the number of dimensions is tested, reliability is tested, and validity is assessed. We have also added examples of best practices to each step. In sum, this primer will equip both scientists and practitioners to understand the ontology and methodology of scale development and validation, thereby facilitating the advancement of our understanding of a range of health, social, and behavioral outcomes.
Keywords: content validity; factor analysis; item reduction; psychometric evaluation; scale development; tests of dimensionality; tests of reliability; tests of validity.
Figures
Similar articles
-
Development and psychometric validation of the hospitalized older adults' dignity scale for measuring dignity during acute hospitalization.J Adv Nurs. 2023 Oct;79(10):4058-4073. doi: 10.1111/jan.15714. Epub 2023 May 24. J Adv Nurs. 2023. PMID: 37226570
-
A systematic review of measures of implementation players and processes: Summarizing the dearth of psychometric evidence.Implement Res Pract. 2021 Apr 6;2:26334895211002474. doi: 10.1177/26334895211002474. eCollection 2021 Jan-Dec. Implement Res Pract. 2021. PMID: 37089997 Free PMC article. Review.
-
The future of Cochrane Neonatal.Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
-
Psychometric properties of self-report concussion scales and checklists.J Athl Train. 2012 Mar-Apr;47(2):221-3. doi: 10.4085/1062-6050-47.2.221. J Athl Train. 2012. PMID: 22488289 Free PMC article.
-
Development and initial validation of an instrument to measure physicians' use of, knowledge about, and attitudes toward computers.J Am Med Inform Assoc. 1998 Mar-Apr;5(2):164-76. doi: 10.1136/jamia.1998.0050164. J Am Med Inform Assoc. 1998. PMID: 9524349 Free PMC article. Review.
Cited by
-
Development and psychometric evaluation of the death risk perception scale for advanced cancer patients.BMC Palliat Care. 2024 May 29;23(1):136. doi: 10.1186/s12904-024-01467-7. BMC Palliat Care. 2024. PMID: 38811953 Free PMC article.
-
Balance function in critical illness survivors and evaluation of psychometric properties of the Mini-BESTest.Sci Rep. 2024 May 27;14(1):12089. doi: 10.1038/s41598-024-61745-5. Sci Rep. 2024. PMID: 38802388 Free PMC article.
-
Assessment of Postpartum Stress Using the Maternal Postpartum Stress Scale (MPSS) in Spanish Women.Healthcare (Basel). 2024 May 16;12(10):1032. doi: 10.3390/healthcare12101032. Healthcare (Basel). 2024. PMID: 38786442 Free PMC article.
-
Path Model of Reality Gap on the Mental Health of Novice School Nurses in Japan.SAGE Open Nurs. 2024 May 22;10:23779608241256510. doi: 10.1177/23779608241256510. eCollection 2024 Jan-Dec. SAGE Open Nurs. 2024. PMID: 38784644 Free PMC article.
-
Usefulness of Current Patient-Reported Outcome Scales for ACL Injury: A Mixed-Methods Evaluation of Stakeholder-Perceived Utility of Specific Constructs and Items Across the Rehabilitation Timeline.Orthop J Sports Med. 2024 May 22;12(3):23259671231218964. doi: 10.1177/23259671231218964. eCollection 2024 Mar. Orthop J Sports Med. 2024. PMID: 38784528 Free PMC article.
References
-
- DeVellis RF. Scale Development: Theory and Application. Los Angeles, CA: Sage; Publications (2012).
-
- Raykov T, Marcoulides GA. Introduction to Psychometric Theory. New York, NY: Routledge, Taylor & Francis Group; (2011).
-
- Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A Practical Guide to Their Development and Use. Oxford University Press; (2015).
-
- McCoach DB, Gable RK, Madura JP. Instrument Development in the Affective Domain. School and Corporate Applications, 3rd Edn. New York, NY: Springer; (2013).
Publication types
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous