Scale development: ten main limitations and recommendations to improve future research practices
- PMID: 32025957
- PMCID: PMC6966966
- DOI: 10.1186/s41155-016-0057-1
Scale development: ten main limitations and recommendations to improve future research practices
Erratum in
-
Erratum to: Scale development: ten main limitations and recommendations to improve future research practices.Psicol Reflex Crit. 2017 Mar 3;30(1):5. doi: 10.1186/s41155-017-0059-7. Psicol Reflex Crit. 2017. PMID: 32026135 Free PMC article. No abstract available.
Abstract
The scale development process is critical to building knowledge in human and social sciences. The present paper aimed (a) to provide a systematic review of the published literature regarding current practices of the scale development process, (b) to assess the main limitations reported by the authors in these processes, and (c) to provide a set of recommendations for best practices in future scale development research. Papers were selected in September 2015, with the search terms "scale development" and "limitations" from three databases: Scopus, PsycINFO, and Web of Science, with no time restriction. We evaluated 105 studies published between 1976 and 2015. The analysis considered the three basic steps in scale development: item generation, theoretical analysis, and psychometric analysis. The study identified ten main types of limitation in these practices reported in the literature: sample characteristic limitations, methodological limitations, psychometric limitations, qualitative research limitations, missing data, social desirability bias, item limitations, brevity of the scale, difficulty controlling all variables, and lack of manual instructions. Considering these results, various studies analyzed in this review clearly identified methodological weaknesses in the scale development process (e.g., smaller sample sizes in psychometric analysis), but only a few researchers recognized and recorded these limitations. We hope that a systematic knowledge of the difficulties usually reported in scale development will help future researchers to recognize their own limitations and especially to make the most appropriate choices among different conceptions and methodological strategies.
Keywords: Assessment; Measurement; Psychometrics; Reliability; Validity.
Conflict of interest statement
The authors declare that they have no competing interest.
Figures
Similar articles
-
The measurement of collaboration within healthcare settings: a systematic review of measurement properties of instruments.JBI Database System Rev Implement Rep. 2016 Apr;14(4):138-97. doi: 10.11124/JBISRIR-2016-2159. JBI Database System Rev Implement Rep. 2016. PMID: 27532315 Review.
-
Health professionals' experience of teamwork education in acute hospital settings: a systematic review of qualitative literature.JBI Database System Rev Implement Rep. 2016 Apr;14(4):96-137. doi: 10.11124/JBISRIR-2016-1843. JBI Database System Rev Implement Rep. 2016. PMID: 27532314 Review.
-
The Effectiveness of Integrated Care Pathways for Adults and Children in Health Care Settings: A Systematic Review.JBI Libr Syst Rev. 2009;7(3):80-129. doi: 10.11124/01938924-200907030-00001. JBI Libr Syst Rev. 2009. PMID: 27820426
-
Faculty development initiatives designed to promote leadership in medical education. A BEME systematic review: BEME Guide No. 19.Med Teach. 2012;34(6):483-503. doi: 10.3109/0142159X.2012.680937. Med Teach. 2012. PMID: 22578043 Review.
-
Scientific basis of the OCRA method for risk assessment of biomechanical overload of upper limb, as preferred method in ISO standards on biomechanical risk factors.Scand J Work Environ Health. 2018 Jul 1;44(4):436-438. doi: 10.5271/sjweh.3746. Scand J Work Environ Health. 2018. PMID: 29961081
Cited by
-
Psychometric Evaluation of the Food Life Questionnaire-Short Form among Brazilian Adult Women.Nutrients. 2024 Mar 23;16(7):927. doi: 10.3390/nu16070927. Nutrients. 2024. PMID: 38612959 Free PMC article.
-
Measuring perceived fitness interdependence between humans and non-humans.Evol Hum Sci. 2024 Feb 27;6:e16. doi: 10.1017/ehs.2024.10. eCollection 2024. Evol Hum Sci. 2024. PMID: 38572224 Free PMC article.
-
Parental Attitudes towards Child Oral Health and Their Structural Analysis.Children (Basel). 2024 Mar 11;11(3):333. doi: 10.3390/children11030333. Children (Basel). 2024. PMID: 38539368 Free PMC article.
-
Development of a Medical Social Media Ethics Scale and Assessment of #IRad, #CardioTwitter, and #MedTwitter Posts: Mixed Methods Study.JMIR Infodemiology. 2024 Mar 27;4:e47770. doi: 10.2196/47770. JMIR Infodemiology. 2024. PMID: 38536206 Free PMC article.
-
The hidden curriculum across medical disciplines: an examination of scope, impact, and context.Can Med Educ J. 2024 Feb 29;15(1):15-25. doi: 10.36834/cmej.75207. eCollection 2024 Feb. Can Med Educ J. 2024. PMID: 38528901 Free PMC article.
References
-
- Aagja JP, Garg R. Measuring perceived service quality for public hospitals (PubHosQual) in the Indian context. International Journal of Pharmaceutical and Healthcare Marketing. 2010;4(10):60–83. doi: 10.1108/17506121011036033. - DOI
-
- Ahmad N, Awan MU, Raouf A, Sparks L. Development of a service quality scale for pharmaceutical supply chains. International Journal of Pharmaceutical and Healthcare Marketing. 2009;3(1):26–45. doi: 10.1108/17506120910948494. - DOI
-
- Akter S, D’Ambra J, Ray P. Development and validation of an instrument to measure user perceived service quality of mHealth. Information and Management. 2013;50:181–195. doi: 10.1016/j.im.2013.03.001. - DOI
-
- Alvarado-Herrera, A, Bigne, E, Aldas-Manzano, J, & Curras-Perez, R. (2015). A scale for measuring consumer perceptions of corporate social responsibility following the sustainable development paradigm. Journal of Business Ethics, 1-20. doi: 10.1007/s10551-015-2654-9 - DOI
-
- Arias, M. R. M., Lloreda, M. J. H., & Lloreda, M. V. H. (2014). Psicometría. S.A.: Alianza Editorial
Publication types
LinkOut - more resources
Full Text Sources