skip to main content
research-article

Harnessing the Web for Population-Scale Physiological Sensing: A Case Study of Sleep and Performance

Published: 03 April 2017 Publication History
  • Get Citation Alerts
  • Abstract

    Human cognitive performance is critical to productivity, learning, and accident avoidance. Cognitive performance varies throughout each day and is in part driven by intrinsic, near 24-hour circadian rhythms. Prior research on the impact of sleep and circadian rhythms on cognitive performance has typically been restricted to small-scale laboratory-based studies that do not capture the variability of real-world conditions, such as environmental factors, motivation, and sleep patterns in real-world settings. Given these limitations, leading sleep researchers have called for larger in situ monitoring of sleep and performance. We present the largest study to date on the impact of objectively measured real-world sleep on performance enabled through a reframing of everyday interactions with a web search engine as a series of performance tasks. Our analysis includes 3 million nights of sleep and 75 million interaction tasks. We measure cognitive performance through the speed of keystroke and click interactions on a web search engine and correlate them to wearable device-defined sleep measures over time. We demonstrate that real-world performance varies throughout the day and is influenced by both circadian rhythms, chronotype (morning/evening preference), and prior sleep duration and timing. We develop a statistical model that operationalizes a large body of work on sleep and performance and demonstrates that our estimates of circadian rhythms, homeostatic sleep drive, and sleep inertia align with expectations from laboratory-based sleep studies. Further, we quantify the impact of insufficient sleep on real-world performance and show that two consecutive nights with less than six hours of sleep are associated with decreases in performance which last for a period of six days. This work demonstrates the feasibility of using online interactions for large-scale physiological sensing.

    References

    [1]
    S. Abdullah, E. L. Murnane, M. Matthews, M. Kay, J. A. Kientz, G. Gay, and T. Choudhury. Cognitive rhythms: Unobtrusive and continuous sensing of alertness using a mobile phone. In UbiComp, 2016.
    [2]
    P. Achermann and A. A. Borbély. Simulation of daytime vigilance by the additive interaction of a homeostatic and a circadian process. Biol Cybern, 71(2):115--121, 1994.
    [3]
    J. Ackerman. Sex Sleep Eat Drink Dream: A day in the life of your body. Houghton Mifflin Harcourt, 2008.
    [4]
    T. Åkerstedt and S. Folkard. The three-process model of alertness and its extension to performance, sleep latency, and sleep length. Chronobiol Int, 14(2):115--123, 1997.
    [5]
    T. Althoff, K. Clark, and J. Leskovec. Large-scale analysis of counseling conversations: An application of natural language processing to mental health. TACL, 2016.
    [6]
    T. Althoff, E. Horvitz, R. W. White, and J. Zeitzer. Online appendix of this paper. 2017. http://stanford.io/2ejFPhD.
    [7]
    T. Althoff, P. Jindal, and J. Leskovec. Online actions with offline impact: How online social networks influence online and offline user behavior. In WSDM, 2017.
    [8]
    T. Althoff, R. W. White, and E. Horvitz. Influence of Pokémon Go on physical activity: Study and implications. J Med Internet Res, 18(12):e315, 2016.
    [9]
    S. Ancoli-Israel, R. Cole, C. Alessi, M. Chambers, W. Moorcroft, and C. Pollak. The role of actigraphy in the study of sleep and circadian rhythms. Sleep, 26(3):342--392, 2003.
    [10]
    M. Basner, K. M. Fomberstein, F. M. Razavi, S. Banks, J. H. William, R. R. Rosa, and D. F. Dinges. American time use survey: sleep time and its relationship to waking activities. Sleep, 30(9):1085--1095, 2007.
    [11]
    K. Blatter and C. Cajochen. Circadian rhythms in cognitive performance: Methodological constraints, protocols, theoretical underpinnings. Physiology & Behavior, 90(2):196--208, 2007.
    [12]
    M. Böhmer, B. Hecht, J. Schöning, A. Krüger, and G. Bauer. Falling asleep with Angry Birds, Facebook and Kindle: A large scale study on mobile application usage. In MobileHCI, 2011.
    [13]
    A. A. Borbély. A two process model of sleep regulation. Human neurobiology, 1982.
    [14]
    Bureau of Labor Statistics, American Time Use Survey. Average sleep times per day, by age and sex. Archived at: http://www.webcitation.org/6lPcEntyS, 2015.
    [15]
    S. K. Card, T. P. Moran, and A. Newell. The keystroke-level model for user performance time with interactive systems. CACM, 23(7):396--410, 1980.
    [16]
    H. R. Colten and B. M. Altevogt. Sleep disorders and sleep deprivation: An unmet public health problem. 2006.
    [17]
    D.-J. Dijk and C. A. Czeisler. Contribution of the circadian pacemaker and the sleep homeostat to sleep propensity, sleep structure, electroencephalographic slow waves, and sleep spindle activity in humans. J. Neurosci., 15(5):3526--3538, 1995.
    [18]
    D.-J. Dijk, J. F. Duffy, and C. A. Czeisler. Circadian and sleep/wake dependent aspects of subjective alertness and cognitive performance. J Sleep Res, 1(2):112--117, 1992.
    [19]
    D. F. Dinges. Are you awake? Cognitive performance and reverie during the hypnopompic state. In Sleep and Cognition, pages 159--75. 1990.
    [20]
    D. F. Dinges. An overview of sleepiness and accidents. J Sleep Res, 4(s2):4--14, 1995.
    [21]
    Z. Dou, R. Song, and J.-R. Wen. A large-scale evaluation and analysis of personalized search strategies. In WWW, 2007.
    [22]
    J. Fernandez-Mendoza, S. Calhoun, E. O. Bixler, S. Pejovic, M. Karataraki, D. Liao, A. Vela-Bueno, M. J. Ramos-Platon, K. A. Sauder, and A. N. Vgontzas. Insomnia with objective short sleep duration is associated with deficits in neuropsychological performance: A general population study. Sleep, 33(4):459--465, 2010.
    [23]
    S. A. Golder and M. W. Macy. Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. Science, 333(6051):1878--1881, 2011.
    [24]
    P. Hemp. Presenteeism: At work-but out of it. Harvard Business Review, 82(10):49--58, 2004.
    [25]
    M. Juda, C. Vetter, and T. Roenneberg. Chronotype modulates sleep duration, sleep quality, and social jet lag in shift-workers. J Biol Rhythms, 28(2):141--151, 2013.
    [26]
    P. Kelley, S. W. Lockley, R. G. Foster, and J. Kelley. Synchronizing education to adolescent biology: 'let teens sleep, start school later'. Learn Media Technol, 40(2):210--226, 2015.
    [27]
    D. F. Kripke, R. N. Simons, L. Garfinkel, and E. C. Hammond. Short and long sleep and sleeping pills: Is increased mortality associated? Arch Gen Psychiatry, 36(1):103--116, 1979.
    [28]
    D. S. Lauderdale, K. L. Knutson, L. L. Yan, K. Liu, and P. J. Rathouza. Self-reported and measured sleep duration. Epidemiology, 19(6):838--845, 2008.
    [29]
    J. Lim and D. F. Dinges. A meta-analysis of the impact of short-term sleep deprivation on cognitive variables. Psychol Bull, 136(3):375, 2010.
    [30]
    G. Mark, S. T. Iqbal, M. Czerwinski, P. Johns, and A. Sano. Neurotics can't focus: An in situ study of online multitasking in the workplace. In CHI, 2016.
    [31]
    R. L. Matchock and J. T. Mordkoff. Chronotype and time-of-day influences on the alerting, orienting, and executive components of attention. Exp Brain Res, 192(2):189--198, 2009.
    [32]
    F. Monrose and A. Rubin. Authentication via keystroke dynamics. In CCS, pages 48--56, 1997.
    [33]
    E. L. Murnane, S. Abdullah, M. Matthews, T. Choudhury, and G. Gay. Social (media) jet lag: How usage of social technology can modulate and reflect circadian rhythms. In UbiComp, 2015.
    [34]
    E. L. Murnane, S. Abdullah, M. Matthews, M. Kay, J. A. Kientz, T. Choudhury, G. Gay, and D. Cosley. Mobile manifestations of alertness: Connecting biological rhythms with patterns of smartphone app use. In MobileHCI, 2016.
    [35]
    M. T. Orne. On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. Am Psychol, 17(11):776, 1962.
    [36]
    J. Paparrizos, R. W. White, and E. Horvitz. Screening for pancreatic adenocarcinoma using signals from web search logs: Feasibility study and results. J Oncol Pract, pages 737--44, 2016.
    [37]
    J. J. Pilcher and A. J. Huffcutt. Effects of sleep deprivation on performance: A meta-analysis. Sleep, 1996.
    [38]
    K. Purcell. Search and email still top the list of most popular online activities. Pew Research Center. Archived at: http://www.webcitation.org/5I2STSU61, 2011.
    [39]
    T. Roenneberg. Chronobiology: The human sleep project. Nature, 498(7455):427--428, 2013.
    [40]
    T. Roenneberg, A. Wirz-Justice, and M. Merrow. Life between clocks: Daily temporal patterns of human chronotypes. J Biol Rhythms, 18(1):80--90, 2003.
    [41]
    A. Shameli, T. Althoff, A. Saberi, and J. Leskovec. How gamification affects physical activity: Large-scale analysis of walking challenges in a mobile application. In WWW, 2017.
    [42]
    D. A. Sternberg, K. Ballard, J. L. Hardy, B. Katz, P. M. Doraiswamy, and M. Scanlon. The largest human cognitive performance dataset reveals insights into the effects of lifestyle factors and aging. Front Hum Neurosci, 7:292, 2013.
    [43]
    H. P. Van Dongen and D. F. Dinges. Circadian rhythms in fatigue, alertness, and performance. Principles and practice of sleep medicine, 20:391--9, 2000.
    [44]
    L. M. Vizer, L. Zhou, and A. Sears. Automated stress detection using keystroke and linguistic features: An exploratory study. Int J Hum Comput Stud, 67(10):870--886, 2009.
    [45]
    O. J. Walch, A. Cochran, and D. B. Forger. A global quantification of normal right sleep schedules using smartphone data. Sci Adv, 2(5), 2016.
    [46]
    R. West, R. W. White, and E. Horvitz. From cookies to cooks: Insights on dietary patterns via analysis of web usage logs. In WWW, 2013.
    [47]
    R. W. White, S. Wang, A. Pant, R. Harpaz, P. Shukla, W. Sun, W. DuMouchel, and E. Horvitz. Early identification of adverse drug reactions from search log data. J Biomed Inform, 59:42--48, 2016.
    [48]
    J. A. Wise, V. D. Hopkin, and D. J. Garland. Handbook of aviation human factors. CRC Press, 2009.
    [49]
    K. P. Wright Jr, C. A. Lowry, and M. K. LeBourgeois. Circadian and wakefulness-sleep modulation of cognition in humans. Front Hum Neurosci, 5:50, 2012.

    Cited By

    View all
    • (2023)Wellbeing Insights in a Data-Driven Future2023 Fourteenth International Conference on Mobile Computing and Ubiquitous Network (ICMU)10.23919/ICMU58504.2023.10412212(1-7)Online publication date: 29-Nov-2023
    • (2023)Knowledge Discovery in Ubiquitous and Personal Sleep Tracking: Scoping ReviewJMIR mHealth and uHealth10.2196/4275011(e42750)Online publication date: 28-Jun-2023
    • (2023)Understanding the Need for Sleep to Improve CognitionAnnual Review of Psychology10.1146/annurev-psych-032620-03412774:1(27-57)Online publication date: 18-Jan-2023
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    WWW '17: Proceedings of the 26th International Conference on World Wide Web
    April 2017
    1678 pages
    ISBN:9781450349130

    Sponsors

    • IW3C2: International World Wide Web Conference Committee

    In-Cooperation

    Publisher

    International World Wide Web Conferences Steering Committee

    Republic and Canton of Geneva, Switzerland

    Publication History

    Published: 03 April 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. cognitive performance
    2. performance
    3. physiological sensing
    4. search log
    5. sleep
    6. wearable
    7. web search log

    Qualifiers

    • Research-article

    Conference

    WWW '17
    Sponsor:
    • IW3C2

    Acceptance Rates

    WWW '17 Paper Acceptance Rate 164 of 966 submissions, 17%;
    Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)43
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 29 Jul 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Wellbeing Insights in a Data-Driven Future2023 Fourteenth International Conference on Mobile Computing and Ubiquitous Network (ICMU)10.23919/ICMU58504.2023.10412212(1-7)Online publication date: 29-Nov-2023
    • (2023)Knowledge Discovery in Ubiquitous and Personal Sleep Tracking: Scoping ReviewJMIR mHealth and uHealth10.2196/4275011(e42750)Online publication date: 28-Jun-2023
    • (2023)Understanding the Need for Sleep to Improve CognitionAnnual Review of Psychology10.1146/annurev-psych-032620-03412774:1(27-57)Online publication date: 18-Jan-2023
    • (2022)Surf or sleep?ACM SIGKDD Explorations Newsletter10.1145/3510374.351037823:2(3-12)Online publication date: 3-Jan-2022
    • (2022)The Crowd is Made of PeopleProceedings of the 2022 Conference on Human Information Interaction and Retrieval10.1145/3498366.3505815(25-35)Online publication date: 14-Mar-2022
    • (2022)Sleep during travel balances individual sleep needsNature Human Behaviour10.1038/s41562-022-01291-06:5(691-699)Online publication date: 24-Feb-2022
    • (2022)Disparate impacts on online information access during the Covid-19 pandemicNature Communications10.1038/s41467-022-34592-z13:1Online publication date: 19-Nov-2022
    • (2022)Large-scale diet tracking data reveal disparate associations between food environment and dietNature Communications10.1038/s41467-021-27522-y13:1Online publication date: 18-Jan-2022
    • (2021)Effect of Sleep and Biobehavioral Patterns on Multidimensional Cognitive Performance: Longitudinal, In-the-Wild StudyJournal of Medical Internet Research10.2196/2393623:2(e23936)Online publication date: 18-Feb-2021
    • (2021)Gaining Insights Into the Estimation of the Circadian Rhythms of Social Activity in Older Adults From Their Telephone Call Activity With Statistical Learning: Observational StudyJournal of Medical Internet Research10.2196/2233923:1(e22339)Online publication date: 8-Jan-2021
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media