research-article

Lifelogging memory appliance for people with episodic memory impairment

Authors:

Matthew L. Lee and

Anind K. DeyAuthors Info & Claims

UbiComp '08: Proceedings of the 10th international conference on Ubiquitous computing

September 2008

Pages 44 - 53

https://doi.org/10.1145/1409635.1409643

Published: 21 September 2008 Publication History

Abstract

Lifelogging technologies have the potential to provide memory cues for people who struggle with episodic memory impairment (EMI). These memory cues enable the recollection of significant experiences, which is important for people with EMI to regain a sense of normalcy in their lives. However, lifelogging technologies often collect an overwhelmingly large amount of data to review. The best memory cues need to be extracted and presented in a way that best supports episodic recollection. We describe the design of a new lifelogging system that captures photos, ambient audio, and location information and leverages both automated content/context analysis and the expertise of family caregivers to facilitate the extraction and annotation of a salient summary consisting of good cues from the lifelog. The system presents the selected cues for review in a way that maximizes the opportunities for the person with EMI to think deeply about these cues to trigger memory recollection on his own without burdening the caregiver. We compare our system with another review system that requires the caregiver to repeatedly guide the review process. Our self-guided system resulted in better memory retention and imposed a smaller burden on the caregiver whereas the caregiver-guided approach provided more opportunities for caregiver interaction.

References

[1]

Almbert, B., Grafstrom, M. and Winblad, B. (1997). Caring for a demented elderly person - burden and burnout among caregiving relatives. Journal of Advanced Nursing, 25 (1). 109--116.

[2]

American_Health_Assistance_Foundation. http://www.ahaf.org/alzdis/about/adabout.htm.

[3]

Butcher, H. K., Holkup, P. A. and Buckwalter, K. C. (2001). The Experience of Caring for a Family Member with Alzheimer's Disease. West J Nurs Res, 23 (1). 33--55.

[4]

Clare, L. (2003). Managing threats to self: awareness in early stage Alzheimer's disease. Social Science & Medicine, 57 (6). 1017--1029.

[5]

Craik, F. I. M. and Tulving, E. (1975). Depth of processing and the retention of words in episodic memory. Journal of Experimental Psychology: General, 104 (3). 268--294.

[6]

Dixon, R. and Hultsch, D. (1983a). Metamemory and memory for text relationships in adulthood: A cross-validation study. Journal of Gerontology, 38. 689--694.

[7]

Doherty, A. R., Smeaton, A. F., Lee, K. and Ellis, D. (2007). Multimodal Segmentation of Lifelog Data. Proc. RIAO, Pittsburgh, PA, 2007.

Digital Library

[8]

Freeman, E. and Gelernter, D. (1996). Lifestreams: a storage model for personal data. ACM SIGMOD Record, 25 (1). 80--86.

Digital Library

[9]

Gardiner, J. M., Ramponi, C. and Richardson-Klavehn, A. (1998). Experiences of Remembering, Knowing, and Guessing. Consciousness and Cognition, 7 (1). 1--26.

[10]

Gemmell, J., Williams, L., Wood, K., Lueder, R. and Bell, G. (2004). Passive Capture and Ensuing Issues for a Personal Lifetime Store. Proc. CARPE'04. 48--55

Digital Library

[11]

Hawkey, K., Inkpen, K. M., Rockwood, K., McAllister, M. and Slonim, J. (2005). Requirements gathering with Alzheimer's patients and caregivers. Proc. ASSETS 2005. 142--149.

Digital Library

[12]

Hayes, G. R., Patel, S. N., Truong, K. N., Iachello, G., Kientz, J. A., Farmer, R. and Abowd, G. D. (2004). The Personal Audio Loop: Designing a Ubiquitous Audio-Based Memory Aid. Proc. Mobile HCI. 13--16.

[13]

Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Smyth, G., Kapur, N. and Wood, K. (2006). SenseCam: a Retrospective Memory Aid. Proc. UBICOMP 2006. 81--90.

Digital Library

[14]

Lee, M. L. and Dey, A. K. (2007). Providing Good Memory Cues for People with Episodic Memory Impairment. Proc. ASSETS 2007. 131--138

Digital Library

[15]

Sellen, A. J., Fogg, A., Aitken, M., Hodges, S., Rother, C. and Wood, K. (2007). Do life-logging technologies support memory for the past?: an experimental study using sensecam. Proc. CHI 2007. 81--90.

Digital Library

[16]

Silveri, M. C., Reali, G., Jenner, C. and Puopolo, M. (2007). Attention and Memory in the Preclinical Stage of Dementia. Journal of Geriatric Psychiatry and Neurology, 20 (2). 67--75.

[17]

Steeman, E., de, C., Dierckx, B., Godderis, J. and Grypdonck, M. (2006). Living with early-stage dementia: a review of qualitative studies. Journal of Advanced Nursing, 54. 722--738.

[18]

Tancharoen, D., Yamasaki, T. and Aizawa, K. (2005). Practical experience recording and indexing of Life Log video. Proc. CARPE 2006. 61--66.

Digital Library

[19]

Vemuri, S., Schmandt, C. and Bender, W. (2006). iRemember: a personal, long-term memory prosthesis. Proc. CARPE 2006. 65--74.

Digital Library

Cited By

Storm BSoares J(2024)Memory in the Digital AgeThe Oxford Handbook of Human Memory, Two Volume Pack10.1093/oxfordhb/9780190917982.013.82(2351-2375)Online publication date: 18-Jul-2024
https://doi.org/10.1093/oxfordhb/9780190917982.013.82
Xu YWang YKim SKim DSun YMcLaughlin M(2023)Safe at home: Acceptance of surveillance technology among caregivers for persons with dementiaHealth Informatics Journal10.1177/1460458223115218829:1(146045822311521)Online publication date: 20-Jan-2023
https://doi.org/10.1177/14604582231152188
Elagroudy PKhamis MMathis FIrmscher DSood EBulling ASchmidt A(2023)Impact of Privacy Protection Methods of Lifelogs on Remembered MemoriesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581565(1-10)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581565
Show More Cited By

Index Terms

Lifelogging memory appliance for people with episodic memory impairment
1. Human-centered computing

Recommendations

Providing good memory cues for people with episodic memory impairment
Assets '07: Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility

Alzheimer's disease impairs episodic memory and subtly and progressively robs people of their ability to remember their recent experiences. In this paper, we describe two studies that lead to a better understanding of how caregivers use cues to support ...
Read More
Using lifelogging to support recollection for people with episodic memory impairment and their caregivers
HealthNet '08: Proceedings of the 2nd International Workshop on Systems and Networking Support for Health Care and Assisted Living Environments

We designed a lifelogging system to assist people with episodic memory impairment (EMI) to reminisce about recent experiences and reduce the burden on their caregivers. Our system uses a mobile passive capture approach so that the person with EMI does ...
Read More
Exploring Boundaries to the Benefits of Lifelogging for Identity Maintenance for People with Dementia

In the absence of a medical cure for some forms of memory loss caused by dementia, new technologies specialised in pervasive image recording are being incorporated into practical interventions. Lifelogging is the digital capture of life experiences ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

UbiComp '08: Proceedings of the 10th international conference on Ubiquitous computing

September 2008

404 pages

ISBN:9781605581361

DOI:10.1145/1409635

General Chairs:
Hee Yong Youn
Sungkyunkwan University, Korea
,
We-Duke Cho
Ajou University, Korea
,
Program Chairs:
Joe McCarthy,
James Scott,
Woontack Woo

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 September 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UbiComp08

UbiComp08: The 10th International Conference on Ubiquitous Computing

September 21 - 24, 2008

Seoul, Korea

Acceptance Rates

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

82
Total Citations
View Citations
1,263
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)7

Other Metrics

View Author Metrics

Citations

Cited By

Storm BSoares J(2024)Memory in the Digital AgeThe Oxford Handbook of Human Memory, Two Volume Pack10.1093/oxfordhb/9780190917982.013.82(2351-2375)Online publication date: 18-Jul-2024
https://doi.org/10.1093/oxfordhb/9780190917982.013.82
Xu YWang YKim SKim DSun YMcLaughlin M(2023)Safe at home: Acceptance of surveillance technology among caregivers for persons with dementiaHealth Informatics Journal10.1177/1460458223115218829:1(146045822311521)Online publication date: 20-Jan-2023
https://doi.org/10.1177/14604582231152188
Elagroudy PKhamis MMathis FIrmscher DSood EBulling ASchmidt A(2023)Impact of Privacy Protection Methods of Lifelogs on Remembered MemoriesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581565(1-10)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581565
Yang CGamborino EFu LChang Y(2022)A Brain-Inspired Self-Organizing Episodic Memory Model for a Memory Assistance RobotIEEE Transactions on Cognitive and Developmental Systems10.1109/TCDS.2021.306165914:2(617-628)Online publication date: Jun-2022
https://doi.org/10.1109/TCDS.2021.3061659
Martin CHong BNewsome RSavel KMeade MXia AHoney CBarense M(2022)A smartphone intervention that enhances real-world memory and promotes differentiation of hippocampal activity in older adultsProceedings of the National Academy of Sciences10.1073/pnas.2214285119119:51Online publication date: 13-Dec-2022
https://doi.org/10.1073/pnas.2214285119
Kandappu TSubbaraju VXu Q(2021)PrivacyPrimer: Towards Privacy-Preserving Episodic Memory Support For Older AdultsProceedings of the ACM on Human-Computer Interaction10.1145/34760475:CSCW2(1-32)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3476047
Talavera EPetkov NRadeva P(2021)Egocentric vision for lifestyle understandingWearable Sensors10.1016/B978-0-12-819246-7.00015-2(415-433)Online publication date: 2021
https://doi.org/10.1016/B978-0-12-819246-7.00015-2
Selwood ABennett JConway MLoveday CKuchelmeister V(2020)Mnemoscape: Supporting Older Adults’ Event Memory Using Wearable Camera Photographs on an Immersive InterfaceGerontology10.1159/00050584866:4(371-381)Online publication date: 27-Mar-2020
https://doi.org/10.1159/000505848
Aarabi PAarabi P(2020)Dynamic Memory Regeneration2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC42975.2020.9282890(4261-4266)Online publication date: 11-Oct-2020
https://doi.org/10.1109/SMC42975.2020.9282890
Khan IKhusro SUllah NAli S(2020)AutoLog: Towards the Design of a Vehicular Lifelogging Framework for Capturing, Storing, and Visualizing LifeBitsIEEE Access10.1109/ACCESS.2020.3011660(1-1)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3011660
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents