Accuracy of Wristband Fitbit Models in Assessing Sleep: Systematic Review and Meta-Analysis
- PMID: 31778122
- PMCID: PMC6908975
- DOI: 10.2196/16273
Accuracy of Wristband Fitbit Models in Assessing Sleep: Systematic Review and Meta-Analysis
Abstract
Background: Wearable sleep monitors are of high interest to consumers and researchers because of their ability to provide estimation of sleep patterns in free-living conditions in a cost-efficient way.
Objective: We conducted a systematic review of publications reporting on the performance of wristband Fitbit models in assessing sleep parameters and stages.
Methods: In adherence with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement, we comprehensively searched the Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane, Embase, MEDLINE, PubMed, PsycINFO, and Web of Science databases using the keyword Fitbit to identify relevant publications meeting predefined inclusion and exclusion criteria.
Results: The search yielded 3085 candidate articles. After eliminating duplicates and in compliance with inclusion and exclusion criteria, 22 articles qualified for systematic review, with 8 providing quantitative data for meta-analysis. In reference to polysomnography (PSG), nonsleep-staging Fitbit models tended to overestimate total sleep time (TST; range from approximately 7 to 67 mins; effect size=-0.51, P<.001; heterogenicity: I2=8.8%, P=.36) and sleep efficiency (SE; range from approximately 2% to 15%; effect size=-0.74, P<.001; heterogenicity: I2=24.0%, P=.25), and underestimate wake after sleep onset (WASO; range from approximately 6 to 44 mins; effect size=0.60, P<.001; heterogenicity: I2=0%, P=.92) and there was no significant difference in sleep onset latency (SOL; P=.37; heterogenicity: I2=0%, P=.92). In reference to PSG, nonsleep-staging Fitbit models correctly identified sleep epochs with accuracy values between 0.81 and 0.91, sensitivity values between 0.87 and 0.99, and specificity values between 0.10 and 0.52. Recent-generation Fitbit models that collectively utilize heart rate variability and body movement to assess sleep stages performed better than early-generation nonsleep-staging ones that utilize only body movement. Sleep-staging Fitbit models, in comparison to PSG, showed no significant difference in measured values of WASO (P=.25; heterogenicity: I2=0%, P=.92), TST (P=.29; heterogenicity: I2=0%, P=.98), and SE (P=.19) but they underestimated SOL (P=.03; heterogenicity: I2=0%, P=.66). Sleep-staging Fitbit models showed higher sensitivity (0.95-0.96) and specificity (0.58-0.69) values in detecting sleep epochs than nonsleep-staging models and those reported in the literature for regular wrist actigraphy.
Conclusions: Sleep-staging Fitbit models showed promising performance, especially in differentiating wake from sleep. However, although these models are a convenient and economical means for consumers to obtain gross estimates of sleep parameters and time spent in sleep stages, they are of limited specificity and are not a substitute for PSG.
Keywords: Fitbit; accuracy; actigraphy; comparison of performance; polysomnography; sleep diary; sleep stages; sleep tracker; validation; wearable.
©Shahab Haghayegh, Sepideh Khoshnevis, Michael H Smolensky, Kenneth R Diller, Richard J Castriotta. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 28.11.2019.
Conflict of interest statement
Conflicts of Interest: None declared.
Figures
![Figure 1](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/6908975/bin/jmir_v21i11e16273_fig1.gif)
![Figure 2](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/6908975/bin/jmir_v21i11e16273_fig2.gif)
![Figure 3](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/6908975/bin/jmir_v21i11e16273_fig3.gif)
![Figure 4](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/6908975/bin/jmir_v21i11e16273_fig4.gif)
![Figure 5](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/6908975/bin/jmir_v21i11e16273_fig5.gif)
Similar articles
-
Accuracy of Fitbit Charge 4, Garmin Vivosmart 4, and WHOOP Versus Polysomnography: Systematic Review.JMIR Mhealth Uhealth. 2024 Mar 27;12:e52192. doi: 10.2196/52192. JMIR Mhealth Uhealth. 2024. PMID: 38557808 Free PMC article. Review.
-
Validation of a Consumer Sleep Wearable Device With Actigraphy and Polysomnography in Adolescents Across Sleep Opportunity Manipulations.J Clin Sleep Med. 2019 Sep 15;15(9):1337-1346. doi: 10.5664/jcsm.7932. J Clin Sleep Med. 2019. PMID: 31538605 Free PMC article.
-
Performance assessment of new-generation Fitbit technology in deriving sleep parameters and stages.Chronobiol Int. 2020 Jan;37(1):47-59. doi: 10.1080/07420528.2019.1682006. Epub 2019 Nov 13. Chronobiol Int. 2020. PMID: 31718308
-
A validation study of Fitbit Charge 2™ compared with polysomnography in adults.Chronobiol Int. 2018 Apr;35(4):465-476. doi: 10.1080/07420528.2017.1413578. Epub 2017 Dec 13. Chronobiol Int. 2018. PMID: 29235907
-
Effectiveness of Portable Monitoring Devices for Diagnosing Obstructive Sleep Apnea: Update of a Systematic Review [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2004 Sep 1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2004 Sep 1. PMID: 26065047 Free Books & Documents. Review.
Cited by
-
Pilot study comparing sleep logs to a commercial wearable device in describing the sleep patterns of physicians-in-training.PLoS One. 2024 Jul 22;19(7):e0305881. doi: 10.1371/journal.pone.0305881. eCollection 2024. PLoS One. 2024. PMID: 39037970 Free PMC article.
-
A clinical-translational review of sleep problems in neurodevelopmental disabilities.J Neurodev Disord. 2024 Jul 20;16(1):41. doi: 10.1186/s11689-024-09559-4. J Neurodev Disord. 2024. PMID: 39033100 Free PMC article. Review.
-
Assessment of Stress and Well-Being of Japanese Employees Using Wearable Devices for Sleep Monitoring Combined With Ecological Momentary Assessment: Pilot Observational Study.JMIR Form Res. 2024 May 2;8:e49396. doi: 10.2196/49396. JMIR Form Res. 2024. PMID: 38696237 Free PMC article.
-
LSD increases sleep duration the night after microdosing.Transl Psychiatry. 2024 Apr 15;14(1):191. doi: 10.1038/s41398-024-02900-4. Transl Psychiatry. 2024. PMID: 38622150 Free PMC article. Clinical Trial.
-
How the Plants for Joints multidisciplinary lifestyle intervention achieved its effects: a mixed methods process evaluation.BMC Public Health. 2024 Apr 13;24(1):1034. doi: 10.1186/s12889-024-18554-2. BMC Public Health. 2024. PMID: 38615001 Free PMC article. Clinical Trial.
References
-
- Hirshkowitz M. SlidePlayer. [2019-06-14]. Assessing sleep wearables and in-bedroom devices: CTA standards work https://slideplayer.com/slide/13756482/
-
- Fitbit. [2018-10-03]. Who we are https://www.fitbit.com/about.
-
- Fitbit. [2019-03-29]. What should I know about sleep stages? https://help.fitbit.com/articles/en_US/Help_article/2163.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources