Performance of popular pulse oximeters compared with simultaneous arterial oxygen saturation or clinical-grade pulse oximetry: a cross-sectional validation study in intensive care patients
- PMID: 34489238
- PMCID: PMC8423509
- DOI: 10.1136/bmjresp-2021-000939
Performance of popular pulse oximeters compared with simultaneous arterial oxygen saturation or clinical-grade pulse oximetry: a cross-sectional validation study in intensive care patients
Abstract
Objectives: To evaluate the performance of direct-to-consumer pulse oximeters under clinical conditions, with arterial blood gas measurement (SaO2) as reference standard.
Design: Cross-sectional, validation study.
Setting: Intensive care.
Participants: Adult patients requiring SaO2-monitoring.
Interventions: The studied oximeters are top-selling in Europe/USA (AFAC FS10D, AGPTEK FS10C, ANAPULSE ANP 100, Cocobear, Contec CMS50D1, HYLOGY MD-H37, Mommed YM101, PRCMISEMED F4PRO, PULOX PO-200 and Zacurate Pro Series 500 DL). Directly after collection of a SaO2 blood sample, we obtained pulse oximeter readings (SpO2). SpO2-readings were performed in rotating order, blinded for SaO2 and completed <10 min after blood sample collection.
Outcome measures: Bias (SpO2-SaO2) mean, root mean square difference (ARMS), mean absolute error (MAE) and accuracy in identifying hypoxaemia (SaO2 ≤90%). As a clinical index test, we included a hospital-grade SpO2-monitor (Philips).
Results: In 35 consecutive patients, we obtained 2258 SpO2-readings and 234 SaO2-samples. Mean bias ranged from -0.6 to -4.8. None of the pulse oximeters met ARMS ≤3%, the requirement set by International Organisation for Standardisation (ISO)-standards and required for Food and Drug Administration (FDA) 501(k)-clearance. The MAE ranged from 2.3 to 5.1, and five out of ten pulse oximeters met the requirement of ≤3%. For hypoxaemia, negative predictive values were 98%-99%. Positive predictive values ranged from 11% to 30%. Highest accuracy (95% CI) was found for Contec CMS50D1; 91% (86-94) and Zacurate Pro Series 500 DL; 90% (85-94). The hospital-grade SpO2-monitor had an ARMS of 3.0% and MAE of 1.9, and an accuracy of 95% (91%-97%).
Conclusion: Top-selling, direct-to-consumer pulse oximeters can accurately rule out hypoxaemia, but do not meet ISO-standards required for FDA-clearance.
Keywords: COVID-19; respiratory measurement.
© Author(s) (or their employer(s)) 2021. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.
Conflict of interest statement
Competing interests: None declared.
Figures
![Figure 1](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/8423509/bin/bmjresp-2021-000939f01.gif)
![Figure 2](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/8423509/bin/bmjresp-2021-000939f02.gif)
Similar articles
-
Effect of skin tone on the accuracy of the estimation of arterial oxygen saturation by pulse oximetry: a systematic review.Br J Anaesth. 2024 May;132(5):945-956. doi: 10.1016/j.bja.2024.01.023. Epub 2024 Feb 17. Br J Anaesth. 2024. PMID: 38368234 Free PMC article. Review.
-
Impacts of Skin Color and Hypoxemia on Noninvasive Assessment of Peripheral Blood Oxygen Saturation: A Scoping Review.Cureus. 2023 Sep 27;15(9):e46078. doi: 10.7759/cureus.46078. eCollection 2023 Sep. Cureus. 2023. PMID: 37900526 Free PMC article. Review.
-
A multicentre prospective observational study comparing arterial blood gas values to those obtained by pulse oximeters used in adult patients attending Australian and New Zealand hospitals.BMC Pulm Med. 2020 Jan 9;20(1):7. doi: 10.1186/s12890-019-1007-3. BMC Pulm Med. 2020. PMID: 31918697 Free PMC article.
-
The Accuracy of 6 Inexpensive Pulse Oximeters Not Cleared by the Food and Drug Administration: The Possible Global Public Health Implications.Anesth Analg. 2016 Aug;123(2):338-45. doi: 10.1213/ANE.0000000000001300. Anesth Analg. 2016. PMID: 27089002
-
Accuracy of methemoglobin detection by pulse CO-oximetry during hypoxia.Anesth Analg. 2010 Jul;111(1):143-8. doi: 10.1213/ANE.0b013e3181c91bb6. Epub 2009 Dec 10. Anesth Analg. 2010. PMID: 20007731
Cited by
-
An innovative method to prevent infection when measuring the arterial blood gas SpO2 saturation.GMS Hyg Infect Control. 2024 Apr 17;19:Doc18. doi: 10.3205/dgkh000473. eCollection 2024. GMS Hyg Infect Control. 2024. PMID: 38766637 Free PMC article.
-
Effect of skin tone on the accuracy of the estimation of arterial oxygen saturation by pulse oximetry: a systematic review.Br J Anaesth. 2024 May;132(5):945-956. doi: 10.1016/j.bja.2024.01.023. Epub 2024 Feb 17. Br J Anaesth. 2024. PMID: 38368234 Free PMC article. Review.
-
A gender specific risk assessment of coronary heart disease based on physical examination data.NPJ Digit Med. 2023 Jul 31;6(1):136. doi: 10.1038/s41746-023-00887-8. NPJ Digit Med. 2023. PMID: 37524859 Free PMC article.
-
The accuracy of pulse oximetry in measuring oxygen saturation by levels of skin pigmentation: a systematic review and meta-analysis.BMC Med. 2022 Aug 16;20(1):267. doi: 10.1186/s12916-022-02452-8. BMC Med. 2022. PMID: 35971142 Free PMC article.
-
Evaluation of a New Smartphone Powered Low-cost Pulse Oximeter Device.Ethiop J Health Sci. 2022 Jul;32(4):841-848. doi: 10.4314/ejhs.v32i4.22. Ethiop J Health Sci. 2022. PMID: 35950062 Free PMC article.
References
-
- World Health Organization . COVID-19 clinical management. Available: https://www.who.int/publications/i/item/WHO-2019-nCoV-clinical-2021-1 [Accessed 25 Jan 2021].
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Research Materials
Miscellaneous