PSG Validation of minute-to-minute scoring for sleep and wake periods in a consumer wearable device
- PMID: 32941498
- PMCID: PMC7498244
- DOI: 10.1371/journal.pone.0238464
PSG Validation of minute-to-minute scoring for sleep and wake periods in a consumer wearable device
Abstract
Background: Actigraphs are wrist-worn devices that record tri-axial accelerometry data used clinically and in research studies. The expense of research-grade actigraphs, however, limit their widespread adoption, especially in clinical settings. Tri-axial accelerometer-based consumer wearable devices have gained worldwide popularity and hold potential for a cost-effective alternative. The lack of independent validation of minute-to-minute accelerometer data with polysomnographic data or even research-grade actigraphs, as well as access to raw data has hindered the utility and acceptance of consumer-grade actigraphs.
Methods: Sleep clinic patients wore a consumer-grade wearable (Huami Arc) on their non-dominant wrist while undergoing an overnight polysomnography (PSG) study. The sample was split into two, 20 in a training group and 21 in a testing group. In addition to the Arc, the testing group also wore a research-grade actigraph (Philips Actiwatch Spectrum). Sleep was scored for each 60-s epoch on both devices using the Cole-Kripke algorithm.
Results: Based on analysis of our training group, Arc and PSG data were aligned best when a threshold of 10 units was used to examine the Arc data. Using this threshold value in our testing group, the Arc has an accuracy of 90.3%±4.3%, sleep sensitivity (or wake specificity) of 95.5%±3.5%, and sleep specificity (wake sensitivity) of 55.6%±22.7%. Compared to PSG, Actiwatch has an accuracy of 88.7%±4.5%, sleep sensitivity of 92.6%±5.2%, and sleep specificity of 60.5%±20.2%, comparable to that observed in the Arc.
Conclusions: An optimized sleep/wake threshold value was identified for a consumer-grade wearable Arc trained by PSG data. By applying this sleep/wake threshold value for Arc generated accelerometer data, when compared to PSG, sleep and wake estimates were adequate and comparable to those generated by a clinical-grade actigraph. As with other actigraphs, sleep specificity plateaus due to limitations in distinguishing wake without movement from sleep. Further studies are needed to evaluate the Arc's ability to differentiate between sleep and wake using other sources of data available from the Arc, such as high resolution accelerometry and photoplethysmography.
Conflict of interest statement
The authors have declared that no competing interests exist.
Figures
![Fig 1](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/7498244/bin/pone.0238464.g001.gif)
![Fig 2](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/7498244/bin/pone.0238464.g002.gif)
![Fig 3](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/7498244/bin/pone.0238464.g003.gif)
![Fig 4](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/7498244/bin/pone.0238464.g004.gif)
Similar articles
-
Validation of a Consumer Sleep Wearable Device With Actigraphy and Polysomnography in Adolescents Across Sleep Opportunity Manipulations.J Clin Sleep Med. 2019 Sep 15;15(9):1337-1346. doi: 10.5664/jcsm.7932. J Clin Sleep Med. 2019. PMID: 31538605 Free PMC article.
-
Validation of the Sleep-Wake Scoring of a New Wrist-Worn Sleep Monitoring Device.J Clin Sleep Med. 2018 Jun 15;14(6):1057-1062. doi: 10.5664/jcsm.7180. J Clin Sleep Med. 2018. PMID: 29852899 Free PMC article.
-
Detecting sleep using heart rate and motion data from multisensor consumer-grade wearables, relative to wrist actigraphy and polysomnography.Sleep. 2020 Jul 13;43(7):zsaa045. doi: 10.1093/sleep/zsaa045. Sleep. 2020. PMID: 32215550 Free PMC article.
-
Accuracy of Fitbit Charge 4, Garmin Vivosmart 4, and WHOOP Versus Polysomnography: Systematic Review.JMIR Mhealth Uhealth. 2024 Mar 27;12:e52192. doi: 10.2196/52192. JMIR Mhealth Uhealth. 2024. PMID: 38557808 Free PMC article. Review.
-
Consumer sleep tracking devices: a review of mechanisms, validity and utility.Expert Rev Med Devices. 2016 May;13(5):497-506. doi: 10.1586/17434440.2016.1171708. Epub 2016 Apr 18. Expert Rev Med Devices. 2016. PMID: 27043070 Review.
Cited by
-
Ambulatory Smartwatch ECG Monitoring among Patients Undergoing Transcatheter Aortic Valve Replacement Early after Discharge: An Observational Study.Rev Cardiovasc Med. 2023 Jan 4;24(1):11. doi: 10.31083/j.rcm2401011. eCollection 2023 Jan. Rev Cardiovasc Med. 2023. PMID: 39076857 Free PMC article.
-
Validating CircaCP: a generic sleep-wake cycle detection algorithm for unlabelled actigraphy data.R Soc Open Sci. 2024 May 29;11(5):231468. doi: 10.1098/rsos.231468. eCollection 2024 May. R Soc Open Sci. 2024. PMID: 39076818 Free PMC article.
-
COVID-19 surveillance based on consumer wearable devices.Digit Health. 2024 Apr 24;10:20552076241247374. doi: 10.1177/20552076241247374. eCollection 2024 Jan-Dec. Digit Health. 2024. PMID: 38665889 Free PMC article.
-
Three Contactless Sleep Technologies Compared With Actigraphy and Polysomnography in a Heterogeneous Group of Older Men and Women in a Model of Mild Sleep Disturbance: Sleep Laboratory Study.JMIR Mhealth Uhealth. 2023 Oct 25;11:e46338. doi: 10.2196/46338. JMIR Mhealth Uhealth. 2023. PMID: 37878360 Free PMC article.
-
Measuring Sleep Quality in the Hospital Environment with Wearable and Non-Wearable Devices in Adults with Stroke Undergoing Inpatient Rehabilitation.Int J Environ Res Public Health. 2023 Feb 23;20(5):3984. doi: 10.3390/ijerph20053984. Int J Environ Res Public Health. 2023. PMID: 36900995 Free PMC article.
References
Publication types
MeSH terms
Associated data
Grants and funding
LinkOut - more resources
Full Text Sources
Research Materials