Psychometric properties of self-report concussion scales and checklists
- PMID: 22488289
- PMCID: PMC3418135
- DOI: 10.4085/1062-6050-47.2.221
Psychometric properties of self-report concussion scales and checklists
Abstract
Reference/citation: Alla S, Sullivan SJ, Hale L, McCrory P. Self-report scales/checklists for the measurement of concussion symptoms: a systematic review. Br J Sports Med. 2009;43 (suppl 1):i3-i12.
Clinical question: Which self-report symptom scales or checklists are psychometrically sound for clinical use to assess sport-related concussion?
Data sources: Articles available in full text, published from the establishment of each database through December 2008, were identified from PubMed, Medline, CINAHL, Scopus, Web of Science, SPORTDiscus, PsycINFO, and AMED. Search terms included brain concussion, signs or symptoms, and athletic injuries, in combination with the AND Boolean operator, and were limited to studies published in English. The authors also hand searched the reference lists of retrieved articles. Additional searches of books, conference proceedings, theses, and Web sites of commercial scales were done to provide additional information about the psychometric properties and development for those scales when needed in articles meeting the inclusion criteria.
Study selection: Articles were included if they identified all the items on the scale and the article was either an original research report describing the use of scales in the evaluation of concussion symptoms or a review article that discussed the use or development of concussion symptom scales. Only articles published in English and available in full text were included.
Data extraction: From each study, the following information was extracted by the primary author using a standardized protocol: study design, publication year, participant characteristics, reliability of the scale, and details of the scale or checklist, including name, number of items, time of measurement, format, mode of report, data analysis, scoring, and psychometric properties. A quality assessment of included studies was done using 16 items from the Downs and Black checklist1 and assessed reporting, internal validity, and external validity.
Main results: The initial database search identified 421 articles. After 131 duplicate articles were removed, 290 articles remained and were added to 17 articles found during the hand search, for a total of 307 articles; of those, 295 were available in full text. Sixty articles met the inclusion criteria and were used in the systematic review. The quality of the included studies ranged from 9 to 15 points out of a maximum quality score of 17. The included articles were published between 1995 and 2008 and included a collective total of 5864 concussed athletes and 5032 nonconcussed controls, most of whom participated in American football. The majority of the studies were descriptive studies monitoring the resolution of concussive self-report symptoms compared with either a preseason baseline or healthy control group, with a smaller number of studies (n = 8) investigating the development of a scale. The authors initially identified 20 scales that were used among the 60 included articles. Further review revealed that 14 scales were variations of the Pittsburgh Steelers postconcussion scale (the Post-Concussion Scale, Post-Concussion Scale: Revised, Post-Concussion Scale: ImPACT, Post-Concussion Symptom Scale: Vienna, Graded Symptom Checklist [GSC], Head Injury Scale, McGill ACE Post-Concussion Symptoms Scale, and CogState Sport Symptom Checklist), narrowing down to 6 core scales, which the authors discussed further. The 6 core scales were the Pittsburgh Steelers Post-Concussion Scale (17 items), Post-Concussion Symptom Assessment Questionnaire (10 items), Concussion Resolution Index postconcussion questionnaire (15 items), Signs and Symptoms Checklist (34 items), Sport Concussion Assessment Tool (SCAT) postconcussion symptom scale (25 items), and Concussion Symptom Inventory (12 items). Each of the 6 core scales includes symptoms associated with sport-related concussion; however, the number of items on each scale varied. A 7-point Likert scale was used on most scales, with a smaller number using a dichotomous (yes/no) classification. Only 7 of the 20 scales had published psychometric properties, and only 1 scale, the Concussion Symptom Inventory, was empirically driven (Rasch analysis), with development of the scale occurring before its clinical use. Internal consistency (Cronbach α) was reported for the Post-Concussion Scale (.87), Post-Concussion Scale: ImPACT 22-item (.88-.94), Head Injury Scale 9-item (.78), and Head Injury Scale 16-item (.84). Test-retest reliability has been reported only for the Post-Concussion Scale (Spearman r = .55) and the Post-Concussion Scale: ImPACT 21-item (Pearson r = .65). With respect to validity, the SCAT postconcussion scale has demonstrated face and content validity, the Post-Concussion Scale: ImPACT 22-item and Head Injury Scale 9-item have reported construct validity, and the Head Injury Scale 9-item and 16-item have published factorial validity. Sensitivity and specificity have been reported only with the GSC (0.89 and 1.0, respectively) and the Post-Concussion Scale: ImPACT 21-item when combined with the neurocognitive component of ImPACT (0.819 and 0.849, respectively). Meaningful change scores were reported for the Post-Concussion Scale (14.8 points), Post-Concussion Scale: ImPACT 22item (6.8 points), and Post-Concussion Scale: ImPACT 21-item (standard error of the difference = 7.17; 80% confidence interval = 9.18).
Conclusions: Numerous scales exist for measuring the number and severity of concussion-related symptoms, with most evolving from the neuropsychology literature pertaining to head-injured populations. However, very few of these were created in a systematic manner that follows scale development processes and have published psychometric properties. Clinicians need to understand these limitations when choosing and using a symptom scale for inclusion in a concussion assessment battery. Future authors should assess the underlying constructs and measurement properties of currently available scales and use the ever-increasing prospective data pools of concussed athlete information to develop scales following appropriate, systematic processes.
Comment on
-
Self-report scales/checklists for the measurement of concussion symptoms: a systematic review.Br J Sports Med. 2009 May;43 Suppl 1:i3-12. doi: 10.1136/bjsm.2009.058339. Br J Sports Med. 2009. PMID: 19433422 Review.
Similar articles
-
Self-report scales/checklists for the measurement of concussion symptoms: a systematic review.Br J Sports Med. 2009 May;43 Suppl 1:i3-12. doi: 10.1136/bjsm.2009.058339. Br J Sports Med. 2009. PMID: 19433422 Review.
-
Physical Activity and Intermittent Postconcussion Symptoms After a Period of Symptom-Limited Physical and Cognitive Rest.J Athl Train. 2016 Sep;51(9):739-742. doi: 10.4085/1062-6050-51.12.01. Epub 2016 Nov 4. J Athl Train. 2016. PMID: 27813685 Free PMC article. Review.
-
American Medical Society for Sports Medicine position statement: concussion in sport.Br J Sports Med. 2013 Jan;47(1):15-26. doi: 10.1136/bjsports-2012-091941. Br J Sports Med. 2013. PMID: 23243113 Review.
-
Preliminary Validation of an Abbreviated Acute Concussion Symptom Checklist Using Item Response Theory.Am J Sports Med. 2020 Oct;48(12):3087-3093. doi: 10.1177/0363546520953440. Epub 2020 Sep 14. Am J Sports Med. 2020. PMID: 32924534 Free PMC article.
-
The Sport Concussion Assessment Tool: a systematic review.Neurosurg Focus. 2016 Apr;40(4):E6. doi: 10.3171/2016.1.FOCUS15611. Neurosurg Focus. 2016. PMID: 27032923 Review.
Cited by
-
R2DRV: study protocol for longitudinal assessment of driving after mild TBI in young drivers.Inj Epidemiol. 2024 Mar 13;11(1):10. doi: 10.1186/s40621-024-00493-6. Inj Epidemiol. 2024. PMID: 38481266 Free PMC article.
-
Heart Rate Variability in Concussed College Athletes: Follow-Up Study and Biological Sex Differences.Brain Sci. 2023 Dec 1;13(12):1669. doi: 10.3390/brainsci13121669. Brain Sci. 2023. PMID: 38137117 Free PMC article.
-
Emotional Regulation and Adolescent Concussion: Overview and Role of Neuroimaging.Int J Environ Res Public Health. 2023 Jul 1;20(13):6274. doi: 10.3390/ijerph20136274. Int J Environ Res Public Health. 2023. PMID: 37444121 Free PMC article. Review.
-
Athletic Fear Avoidance in Athletes Receiving Rehabilitation for Sport-Related Concussion: A Preliminary Study.Sports Health. 2024 May-Jun;16(3):457-464. doi: 10.1177/19417381231172513. Epub 2023 May 19. Sports Health. 2024. PMID: 37208905 Free PMC article.
-
Responsiveness of the Post-Concussion Symptom Scale to Monitor Clinical Recovery After Concussion or Mild Traumatic Brain Injury.Orthop J Sports Med. 2022 Oct 12;10(10):23259671221127049. doi: 10.1177/23259671221127049. eCollection 2022 Oct. Orthop J Sports Med. 2022. PMID: 36250029 Free PMC article.
References
-
- Broglio SP, Puetz TW. The effect of sport concussion on neurocognitive function, self-report symptoms and postural control: a meta-analysis. Sports Med. 2008;38(1):53–67. - PubMed
-
- McCrory P, Meeuwisse W, Johnston K. Consensus statement on Concussion in Sport: The 3rd International Conference on Concussion in Sport held in Zurich, November 2008. J Sci Med Sport. 2009;12(3):340–351. et al. - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical
Research Materials
Miscellaneous