The diagnostic and triage accuracy of digital and online symptom checker tools: a systematic review
- PMID: 35977992
- PMCID: PMC9385087
- DOI: 10.1038/s41746-022-00667-w
The diagnostic and triage accuracy of digital and online symptom checker tools: a systematic review
Abstract
Digital and online symptom checkers are an increasingly adopted class of health technologies that enable patients to input their symptoms and biodata to produce a set of likely diagnoses and associated triage advice. However, concerns regarding the accuracy and safety of these symptom checkers have been raised. This systematic review evaluates the accuracy of symptom checkers in providing diagnoses and appropriate triage advice. MEDLINE and Web of Science were searched for studies that used either real or simulated patients to evaluate online or digital symptom checkers. The primary outcomes were the diagnostic and triage accuracy of the symptom checkers. The QUADAS-2 tool was used to assess study quality. Of the 177 studies retrieved, 10 studies met the inclusion criteria. Researchers evaluated the accuracy of symptom checkers using a variety of medical conditions, including ophthalmological conditions, inflammatory arthritides and HIV. A total of 50% of the studies recruited real patients, while the remainder used simulated cases. The diagnostic accuracy of the primary diagnosis was low across included studies (range: 19-37.9%) and varied between individual symptom checkers, despite consistent symptom data input. Triage accuracy (range: 48.8-90.1%) was typically higher than diagnostic accuracy. Overall, the diagnostic and triage accuracy of symptom checkers are variable and of low accuracy. Given the increasing push towards adopting this class of technologies across numerous health systems, this study demonstrates that reliance upon symptom checkers could pose significant patient safety hazards. Large-scale primary studies, based upon real-world data, are warranted to demonstrate the adequate performance of these technologies in a manner that is non-inferior to current best practices. Moreover, an urgent assessment of how these systems are regulated and implemented is required.
© 2022. The Author(s).
Conflict of interest statement
The authors declare no competing interests.
Figures
![Fig. 1](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9385990/bin/41746_2022_667_Fig1_HTML.gif)
![Fig. 2](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9385990/bin/41746_2022_667_Fig2_HTML.gif)
![Fig. 3](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9385990/bin/41746_2022_667_Fig3_HTML.gif)
![Fig. 4](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9385990/bin/41746_2022_667_Fig4_HTML.gif)
Similar articles
-
Digital and online symptom checkers and assessment services for urgent care to inform a new digital platform: a systematic review.Southampton (UK): NIHR Journals Library; 2019 Aug. Southampton (UK): NIHR Journals Library; 2019 Aug. PMID: 31433612 Free Books & Documents. Review.
-
Digital and online symptom checkers and health assessment/triage services for urgent health problems: systematic review.BMJ Open. 2019 Aug 1;9(8):e027743. doi: 10.1136/bmjopen-2018-027743. BMJ Open. 2019. PMID: 31375610 Free PMC article.
-
Online symptom checker diagnostic and triage accuracy for HIV and hepatitis C.Epidemiol Infect. 2019 Jan;147:e104. doi: 10.1017/S0950268819000268. Epidemiol Infect. 2019. PMID: 30869052 Free PMC article.
-
Evaluation of symptom checkers for self diagnosis and triage: audit study.BMJ. 2015 Jul 8;351:h3480. doi: 10.1136/bmj.h3480. BMJ. 2015. PMID: 26157077 Free PMC article.
-
Triage and Diagnostic Accuracy of Online Symptom Checkers: Systematic Review.J Med Internet Res. 2023 Jun 2;25:e43803. doi: 10.2196/43803. J Med Internet Res. 2023. PMID: 37266983 Free PMC article. Review.
Cited by
-
Longitudinal Changes in Diagnostic Accuracy of a Differential Diagnosis List Developed by an AI-Based Symptom Checker: Retrospective Observational Study.JMIR Form Res. 2024 May 17;8:e53985. doi: 10.2196/53985. JMIR Form Res. 2024. PMID: 38758588 Free PMC article.
-
Digitalisation of information and management optimisation in Multiple Victim Incidents. Analytical study.PLoS One. 2024 May 14;19(5):e0303247. doi: 10.1371/journal.pone.0303247. eCollection 2024. PLoS One. 2024. PMID: 38743753 Free PMC article.
-
Enhancing Ophthalmic Triage: identification of new clinical features to support healthcare professionals in triage.Eye (Lond). 2024 Apr 16. doi: 10.1038/s41433-024-03070-9. Online ahead of print. Eye (Lond). 2024. PMID: 38627545
-
Only the anxious ones? Identifying characteristics of symptom checker app users: a cross-sectional survey.BMC Med Inform Decis Mak. 2024 Jan 23;24(1):21. doi: 10.1186/s12911-024-02430-5. BMC Med Inform Decis Mak. 2024. PMID: 38262993 Free PMC article.
-
Assessment of a Digital Symptom Checker Tool's Accuracy in Suggesting Reproductive Health Conditions: Clinical Vignettes Study.JMIR Mhealth Uhealth. 2023 Dec 5;11:e46718. doi: 10.2196/46718. JMIR Mhealth Uhealth. 2023. PMID: 38051574 Free PMC article.
References
-
- Prescott, C. Internet access – households and individuals, Great Britain: 2020. Office for National Statisticshttps://www.ons.gov.uk/peoplepopulationandcommunity/householdcharacteris... (2020).
Publication types
LinkOut - more resources
Full Text Sources
Miscellaneous