Abstract
In orthopedics the importance of patient-reported outcome measures (PROMs) has increased enormously, not only clinically and academically but also with respect to health policy. Many such measurement instruments are available for several areas and joints, so that a uniform application of suitable PROMs is recommended for comparisons under scientific and clinical aspects. A PROM must fulfil certain scientific criteria (e.g., reliability, validity, and responsiveness), should be validated for the pathology of interest, and a validated translated version should be available for the respective language. Furthermore, data should be available to interpret results not only with respect to the statistical significance but also regarding their clinical relevance, e.g., the minimal clinically important difference (MCID).
Zusammenfassung
In der Orthopädie und Unfallchirurgie hat die Bedeutung von PROM („patient-reported outcome measures“) nicht nur klinisch und akademisch, sondern auch gesundheitspolitisch enorm zugenommen. Für die verschiedenen Körperregionen bzw. die jeweiligen Gelenke existieren zahlreiche solcher Messinstrumente, sodass für den Vergleich in Wissenschaft und Klinik eine einheitliche Verwendung geeigneter PROM zu empfehlen ist. Ein PROM sollte wissenschaftliche Kriterien (u. a. Reliabilität, Validität, Responsiveness) erfüllen sowie in der jeweiligen Landessprache und für die jeweilige pathologische Veränderung validiert sein. Zudem sollten geeignete Parameter gemessen werden – z. B. „minimal clinically important difference“ (MCID) –, um Ergebnisse nicht nur hinsichtlich ihrer statistischen Signifikanz, sondern auch der klinischen Relevanz beurteilen zu können.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Clinical studies play a crucial role in assessing the effectiveness and safety of treatments in orthopedics and trauma surgery. For a long time, the focus of scientific follow-up on treatments for orthopedic conditions was primarily on objective outcomes (e.g., range of motion measurements), while in recent years, there has been an increasing emphasis on subjective parameters from the patient’s perspective. Consequently, numerous joint-specific measurement instruments (questionnaires, scores, or patient-reported outcome measures [PROMs]) have been developed.
To achieve meaningful and reliable scientific results, careful selection of appropriate questionnaires for data collection is of great importance. When selecting questionnaires for clinical studies, various aspects need to be considered. Above all, a version validated for the native language should be available, characterized by a clear and compact structure with a manageable number of questions to ensure high participation and a high response rate.
Moreover, questionnaires should meet scientific criteria established by the COSMIN (consensus-based standards for the selection of health measurement instruments) initiative [1], which are divided into three aspects:
-
Reliability: Indicates the precision and reliability of a measurement, i.e., whether the same value is obtained with repeated measurements, ensuring consistency. This includes internal consistency, i.e., whether individual measurement instruments within a questionnaire are consistent regarding the examined pathology.
-
Validity: Refers to the validity of a measurement, determining whether the correct aspect is measured, i.e., whether the desired pathology is comprehensively captured.
-
Responsiveness: Describes whether a questionnaire is capable of assessing changes in the patient’s condition over time or in response to a specific treatment.
Other crucial aspects of a PROM are the ceiling and the floor effects. This means that in a questionnaire, either an unusually high number of patients reach the lowest (floor) or the highest (ceiling) score, making it inadequate to measure relevant changes or differences in these populations at the respective extremes [2].
Furthermore, in the future, study results will increasingly be interpreted not only based on statistical measures such as the p-value but also within their clinical context. Two characteristics will gain more importance in this regard:
-
Minimal clinically important difference (MCID): Represents the smallest change in a score associated with a clinically significant (for the patient detectable) change for the patient, whether it is a difference between different populations or within a group at different timepoints [3].
-
Patient acceptable symptom state (PASS): Represents the score value at which the patient expresses wellbeing [4].
Improvement according to the MCID scale means “feeling better,” while achieving PASS means “feeling good.”
From the multitude of questionnaires used in orthopedics and trauma surgery in clinical studies, depending on the specific question and the particular body region, the following three particularly suitable questionnaires exemplify the aforementioned aspects:
Example scores
Knee
The IKDC-2000 (International Knee Documentation Committee Subjective Knee Form) covers three essential aspects through 18 questions: 1) knee-specific symptoms, 2) physical activity, and 3) functionality of the knee joint before and after an injury [5]. The questionnaire can be completed in about 10 min [6]. The IKDC-2000 is validated for various pathologies of the knee joint (ligamentous and meniscal injuries, patellofemoral pain syndrome, patellofemoral instability, knee osteoarthritis, cartilage damage). Scores can reach a maximum of 100 when a participant has no symptoms or limitations. Normative values have been collected from over 5000 knees and are categorized by different age groups and genders. A clinically relevant difference in the score for anterior cruciate ligament reconstruction, according to the MCID, is a difference of 9 points [4].
Shoulder
For a long time, there was a lack of valid shoulder scores for assessing the symptom of “instability,” until Kirkley et al. published the Western Ontario Shoulder Instability Index (WOSI) in 1998, a questionnaire specifically developed for glenohumeral instability [7]. It includes a total of 21 questions covering four categories (1. physical complaints, 2. sports, leisure, and work, 3. everyday life, and 4. emotion/life quality), with results ranging from 0 (best result) to 2100 points (worst result) [8]. The questionnaire has been assessed as reliable and valid, and a validated German-language version is available [9]. Furthermore, both the MCID (60.7 to 220 points) and PASS (620 points) for WOSI concerning glenohumeral joint instability have been determined in the literature [10].
General quality of life
The EQ-5D (EuroQol 5 Dimensions) is a questionnaire for assessing health-related quality of life. It measures general health in five dimensions: mobility, self-care, usual activities, pain/discomfort, and anxiety/depression. The calculated score ranges from −0.4 (worst score) to 1 (best score). It is used in various medical fields, including orthopedics and trauma surgery. For example, the MCID for assessing quality of life after knee arthroplasty is 0.15. The EQ-5D is applied for all pathologies and is considered the most common instrument for assessing quality of life. Country-, age-, and gender-specific norm values also exist [11].
The above examples illustrate that the mentioned selection criteria should be considered to choose suitable questionnaires for a clinical study. It may also be useful to combine multiple questionnaires to obtain a more comprehensive picture, but feasibility in clinical practice should be considered. In general, joint-/pathology-specific scores should be backed up by a quality of life and activity score. Recommendations regarding shoulder and knee scores are presented in Tables 1 and 2.
However, the choice of questionnaires in clinical studies is not an isolated process but always part of a comprehensive study design. The integration of objective clinical measurements and imaging techniques can complete the overall picture and strengthen the robustness of study results.
Conclusion
-
Study results should be collected using standardized questionnaires to simplify scientific communication and evaluation.
-
Each applied questionnaire should be validated for the investigated injury or condition and meet all scientific quality criteria regarding reliability, responsiveness, and ceiling or floor effects.
-
Regarding general quality of life, the EQ-5D (EuroQol 5 Dimensions) serves as an additional secondary outcome parameter.
-
Questionnaires should be manageable within a reasonable timeframe, with a minimal number of questions to achieve a high response rate.
-
Study results should be interpreted not only in terms of statistical significance but, most importantly, clinical relevance (minimal clinically important difference = MCID and patient acceptable symptom state = PASS).
References
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL et al (2010) The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 63:737–745
Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J et al (2007) Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 60:34–42
Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials 1989;10:407–15.
Kvien TK, Heiberg T, Hagen KB. Minimal clinically important improvement/difference (MCII/MCID) and patient acceptable symptom state (PASS): what do these concepts mean? Ann Rheum Dis 2007;66 Suppl 3.
Irrgang JJ, Anderson AF, Boland AL, Harner CD, Kurosaka M, Neyret P et al (2001) Development and validation of the international knee documentation committee subjective knee form. Am J Sports Med 29:600–613
Herbst E, Günther D, Ackermann J, Lattermann C, Mathis D, Schüttler KF et al (2022) Empfehlung für Fragebögen zur klinischen und subjektiven Untersuchung der Kniegelenksfunktion vom Research-Komitee der AGA. Arthroskopie
Kirkley A, Griffin S, McLintock H, Ng L (1998) The development and evaluation of a disease-specific quality of life measurement tool for shoulder instability. The Western Ontario Shoulder Instability Index (WOSI). Am J Sports Med 26:764–771
Wafaisade A, Akgün D, Günther D, Laky B, Mathis D, Deichsel A et al (2023) Empfehlung für Fragebögen zur Untersuchung der Schultergelenkfunktion vom Research-Komitee der AGA. Arthroskopie 36:194–200
Drerup S, Angst F, Griffin S, Flury MP, Simmen BR, Goldhahn J (2010) Western Ontario shoulder instability index (WOSI): translation and cross-cultural adaptation for use by German speakers. Orthopade 39:711–718
Park I, Lee JH, Hyun HS, Lee TK, Shin SJ (2018) Minimal clinically important differences in Rowe and Western Ontario Shoulder Instability Index scores after arthroscopic repair of anterior shoulder instability. J Shoulder Elb Surg 27:579–584
Hinz A, Kohlmann T, Stöbel-Richter Y, Zenger M, Brähler E (2014) The quality of life questionnaire EQ-5D-5L: psychometric properties and normative values for the general German population. Qual Life Res 23:443–447
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Consortia
Corresponding author
Ethics declarations
Conflict of interest
A. Wafaisade and the AGA Research Committee declare that they have no competing interests.
For this article no studies with human participants or animals were performed by any of the authors. All studies mentioned were in accordance with the ethical standards indicated in each case.
Additional information
Redaktion
D. Günther, Köln
E. Herbst, Münster
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
![figure qr](https://cdn.statically.io/img/media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs00142-024-00687-6/MediaObjects/142_2024_687_Figqr_HTML.png?s=1)
Scan QR code & read article online
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Wafaisade, A., the AGA Research Committee. Selection of questionnaires for clinical studies in orthopedics and trauma surgery. Arthroskopie (2024). https://doi.org/10.1007/s00142-024-00687-6
Accepted:
Published:
DOI: https://doi.org/10.1007/s00142-024-00687-6
Keywords
- Patient-reported outcome measures
- Health policy
- Reproducibility of results
- Clinical trial
- Clinical protocols