Why We Need a Formal Systematic Approach to Validating Psychological Tests: The Case of the Rorschach Comprehensive System
- PMID: 29723065
- DOI: 10.1080/00223891.2018.1458315
Why We Need a Formal Systematic Approach to Validating Psychological Tests: The Case of the Rorschach Comprehensive System
Abstract
This article documents and discusses the importance of using a formal systematic approach to validating psychological tests. To illustrate, results are presented from a systematic review of the validity findings cited in the Rorschach Comprehensive System (CS; Exner, 2003) test manual, originally conducted during the manuscript review process for Mihura, Meyer, Dumitrascu, and Bombel's (2013) CS meta-analyses. Our review documents (a) the degree to which the CS test manual reports validity findings for each test variable, (b) whether these findings are publicly accessible or unpublished studies coordinated by the test developer, and (c) the presence and nature of data discrepancies between the CS test manual and the cited source. Implications are discussed for the CS in particular, the Rorschach more generally, and psychological tests more broadly. Notably, a history of intensive scrutiny of the Rorschach has resulted in more stringent standards applied to it, even though its scales have more published and supportive construct validity meta-analyses than any other psychological test. Calls are made for (a) a mechanism to correct data errors in the scientific literature, (b) guidelines for test developers' key unpublished studies, and (c) systematic reviews and meta-analyses to become standard practice for all psychological tests.
Similar articles
-
The Rorschach Comprehensive System (CS) Psychometric Validity of Individual Variables.J Pers Assess. 2016 Jul-Aug;98(4):335-42. doi: 10.1080/00223891.2015.1131162. Epub 2016 Jan 30. J Pers Assess. 2016. PMID: 27153465
-
A second look at the validity of widely used Rorschach indices: comment on Mihura, Meyer, Dumitrascu, and Bombel (2013).Psychol Bull. 2015 Jan;141(1):236-49. doi: 10.1037/a0036005. Psychol Bull. 2015. PMID: 25581287
-
The Centrality of the Response Process in Construct Validity: An Illustration via the Rorschach Space Response.J Pers Assess. 2018 May-Jun;100(3):233-249. doi: 10.1080/00223891.2017.1306781. Epub 2017 Apr 27. J Pers Assess. 2018. PMID: 28448159
-
Using the Rorschach properly in practice and research.J Clin Psychol. 2000 Mar;56(3):435-8; discussion 441-8. doi: 10.1002/(sici)1097-4679(200003)56:3<435::aid-jclp17>3.0.co;2-l. J Clin Psychol. 2000. PMID: 10726676 Review.
-
Temporal stability in the Rorschach method: a meta-analytic review.J Pers Assess. 2003 Jun;80(3):272-93. doi: 10.1207/S15327752JPA8003_06. J Pers Assess. 2003. PMID: 12763701 Review.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical