research-article

ProCom: Designing and Evaluating a Mobile and Wearable System to Support Proximity Awareness for People with Autism

Authors:

LouAnne E. Boyd,

Xinlong Jiang, and

Gillian R. HayesAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

Pages 2865 - 2877

https://doi.org/10.1145/3025453.3026014

Published: 02 May 2017 Publication History

Abstract

People with autism are at risk for social isolation due to differences in their perception and engagement with the social world. In this work, we aim to address one specific concern related to socialization the understanding, awareness, and use of interpersonal space. Over the course of a year, we iteratively designed and tested a series of concepts for supporting children with autism in perceiving, understanding, and responding to physical proximity with other people. During this process, we developed ProCom, a prototype system for measuring proximity without requiring instrumentation of the environment or another person. We used a variety of low and high fidelity prototypes, culminating in ProCom, to assess the feasibility, utility, and challenges of this approach. The results of these iterative design engagements indicate that wearable assistive technologies can support people in developing awareness of physical proximity in social settings. However, challenges related to both personal and collective use remain

References

[1]

Bretagne Abirached, Yan Zhang, and Ji Hyun Park. 2012. Understanding User Needs for Serious Games for Teaching Children with Autism Spectrum Disorders Emotions. In EdMedia: World Conference on Educational Media and Technology, vol. 2012, no. 1, pp. 1054--1063.

[2]

Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-aware Environment. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10), 121--130.

Digital Library

[3]

Nirit Bauminger and Connie Kasari. 2000. Loneliness and friendship in high-functioning children with autism. Child development 71, 2: 447--456.

[4]

Scott Bellini. 2007. Building Social Relationships: A Systematic Approach to Teaching Social Interaction Skills to Children And Adolescents With Autism Spectrum Disorders and Other Social Difficulties. AAPC Publishing.

[5]

Sofiane Boucenna, Antonio Narzisi, Elodie Tilmont, Filippo Muratori, Giovanni Pioggia, David Cohen, and Mohamed Chetouani. 2014. Interactive Technologies for Autistic Children: A Review. Cognitive Computation 6, 4: 722--740.

[6]

LouAnne Boyd, Christina McReynolds, and Karen Chanin. 2013. The Social Compass Curriculum: a story-based intervention package for students with autism spectrum disorders. Brookes Publishing Co.

[7]

LouAnne Boyd, Alejandro Rangel, Helen Tomimbang, Andrea Toldeo-Conejo, Kanika Patel, Monica Tentori, and Gillian R. Hayes. 2016. SayWAT: Augmenting Face-to-Face Conversations for Adults with Autism. In Proceedings of the ACM CHI conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA.

[8]

Brandt Chamberlain, Connie Kasari, and Erin Rotheram-Fuller. 2007. Involvement or isolation? The social networks of children with autism in regular classrooms. Journal of Autism and Developmental Disorders 37, 2: 230--242.

[9]

David Dearman, Richard Guy, and Khai Truong. 2012. Determining the Orientation of Proximate Mobile Devices Using Their Back Facing Camera. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 2231--2234.

Digital Library

[10]

Justin A. Ehrlich and James R. Miller. 2009. A Virtual Environment for Teaching Social Skills: AViSSS. IEEE Computer Graphics and Applications 29, 4: 10-- 16.

[11]

Pier L. Emiliani and Constantine Stephanidis. 2005. Universal access to ambient intelligence environments: Opportunities and challenges for people with disabilities. IBM Systems Journal 44, 3: 605--619.

Digital Library

[12]

Lizbeth Escobedo, David H. Nguyen, LouAnne Boyd, Sen Hirano, Alejandro Rangel, Daniel Garcia-Rosas, Monica Tentori, and Gillian Hayes. 2012. MOSOCO: A Mobile Assistive Tool to Support Children with Autism Practicing Social Skills in Real-life Situations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 2589--2598.

Digital Library

[13]

David Feil-Seifer and Maja Mataric. 2011. Automated Detection and Classification of Positive vs. Negative Robot Interactions with Children with Autism Using Distance-based Features. In Proceedings of the 6th International Conference on Human-robot Interaction (HRI '11), 323--330.

Digital Library

[14]

David Feil-Seifer and Maja Mataric. 2012. DistanceBased Computational Models for Facilitating Robot Interaction with Children. Journal of Human-Robot Interaction 1, 1.

[15]

Deborah G. Garfin and Catherine Lord. 1986. Communication as a Social Problem in Autism. In Social Behavior in Autism, Eric Schopler and Gary B. Mesibov (eds.). Springer US, 133--151.

[16]

Daniel Gatica-Perez. 2009. Automatic nonverbal analysis of social interaction in small groups: A review. Image and Vision Computing 27, 12: 1775--1787.

Digital Library

[17]

Peter F. Gerhardt and Ilene Lainer. 2011. Addressing the Needs of Adolescents and Adults with Autism: A Crisis on the Horizon. Journal of Contemporary Psychotherapy 41, 1: 37--45.

[18]

Erica Gessaroli, Erica Santelli, Giuseppe di Pellegrino, and Francesca Frassinetti. 2013. Personal Space Regulation in Childhood Autism Spectrum Disorders. PLOS ONE 8, 9: e74959. DOT:http://dx.doi.org/10.1371/journal.pone.0074959

[19]

Edward T. Hall. 1963. A System for the Notation of Proxemic Behavior1. American Anthropologist 65, 5: 1003--1026.

[20]

Edward T. Hall, Ray L. Birdwhistell, Bernhard Bock, Paul Bohannan, A. Richard Diebold, Marshall Durbin, Munro S. Edmonson, J. L. Fischer, Dell Hymes, Solon T. Kimball, Weston La Barre, S. J. Frank Lynch, J. E. McClellan, Donald S. Marshall, G. B. Milner, Harvey B. Sarles, George L Trager, and Andrew P. Vayda. 1968. Proxemics [and Comments and Replies]. Current Anthropology 9, 2/3: 83--108.

[21]

Edward Twitchell Hall. 1966. The hidden dimension (1st ed.). Doubleday & Co, New York, NY, US.

[22]

Owen Hargie, Christine Saunders, and David Dickson. 1994. Social Skills in Interpersonal Communication. Psychology Press.

[23]

Tina Iachini, Yann Coello, Francesca Frassinetti, and Gennaro Ruggiero. 2014. Body Space in Social Interactions: A Comparison of Reaching and Comfort Distance in Immersive Virtual Reality. PLOS ONE 9, 11: e111511.

[24]

Xinlong Jiang, LouAnne E. Boyd, Yiqiang Chen, and Gillian R. Hayes. 2016. ProCom: Designing a Mobile and Wearable System to Support Proximity Awareness for People with Autism. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16), 93-- 96.

Digital Library

[25]

R. el Kaliouby, A. Teeters, and R. W. Picard. 2006. An exploratory social-emotional prosthetic for autism spectrum disorders. In International Workshop on Wearable and Implantable Body Sensor Networks, 2006. BSN 2006, 2 pp.--4.

Digital Library

[26]

Adam Kendon. 1990. Conducting interaction: Patterns of behavior in focused encounters. CUP Archive.

[27]

Daniel P. Kennedy and Ralph Adolphs. 2014. Violations of Personal Space by Individuals with Autism Spectrum Disorder. PLOS ONE 9, 8: e103369.

[28]

D. P. Kennedy, J. N. Constantino, and R. Adolphs. 2010. Personal space and interpersonal distance in autism: insights from the SRS. In International Meeting for Autism Research (IMFAR). Philadelphia.

[29]

Sara Kiesler and Jonathon N. Cummings. 2002. What do we know about proximity and distance in work groups?: a legacy of research. Distributed work 1 (2002) 57--80.

[30]

Ian Li, Anind Dey, and Jodi Forlizzi. 2010. A stagebased model of personal informatics systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 557--566.

Digital Library

[31]

Jacob Lomranz, Ariela Shapira, Netta Choresh, and Yitzchak Gilat. 1975. Children's personal space as a function of age and sex. Developmental Psychology 11, 5: 541.

[32]

Miriam Madsen, Rana El Kaliouby, Matthew Goodwin, and Rosalind Picard. 2008. Technology for just-in-time in-situ learning of facial affect for persons diagnosed with an autism spectrum disorder. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, 19--26.

Digital Library

[33]

Ross Mead, Amin Atrash, and Maja J. Matarić. 2011. Proxemic Feature Recognition for Interactive Robots: Automating Metrics from the Social Sciences. In Social Robotics, Bilge Mutlu, Christoph Bartneck, Jaap Ham, Vanessa Evers and Takayuki Kanda (eds.). Springer Berlin Heidelberg, 52--61.

Digital Library

[34]

Prasant Misra, Salil S. Kanhere, Sanjat Jha, and Wen Hu. 2015. Sparse representation based acoustic rangefinders: from sensor platforms to mobile devices. IEEE Communications Magazine 53, 1: 249--257.

Digital Library

[35]

Peter R. Monge and Kenneth K. Kirste. 1980. Measuring Proximity in Human Organization. Social Psychology Quarterly 43, 1: 110--115.

[36]

Peter R. Monge, Lynda White Rothman, Eric M. Eisenberg, Katherine I. Miller, and Kenneth K. Kirste. 1985. The Dynamics of Organizational Proximity. Management Science 31, 9: 1129--1141.

Digital Library

[37]

Brenda Smith Myles, Melissa Trautman, and Ronda L Schelvan. 2004. The hidden curriculum: practical solutions for understanding unstated rules in social situations. Autism Asperger Pub. Co., Shawnee Mission, KS.

[38]

Jakob Nielsen and Jan M. Faber. 1996. Improving system usability through parallel design. Computer 29, 2: 29--35.

Digital Library

[39]

Anat Perry, Nikolay Nichiporuk, and Robert T. Knight. 2015. Where does one stand: a biological account of preferred interpersonal distance. Social Cognitive and Affective Neuroscience: nsv115.

[40]

Halley Profita, Reem Albaghli, Leah Findlater, Paul Jaeger, and Shaun K. Kane. 2016. The AT Effect: How Disability Affects the Perceived Social Acceptability of Head-Mounted Display Use. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 4884--4895.

Digital Library

[41]

Dan Saffer. 2013. Microinteractions: Designing with Details. O'Reilly Media, Inc.

Digital Library

[42]

Phoebe Sengers, Kirsten Boehner, Shay David, and Joseph 'Jofish' Kaye. 2005. Reflective Design. In Proceedings of the 4th Decennial Conference on Critical Computing: Between Sense and Sensibility (CC '05), 49--58.

Digital Library

[43]

Kristen Shinohara and Jacob O. Wobbrock. 2011. In the shadow of misperception: assistive technology use and social interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 705--714.

Digital Library

[44]

James Stanfield. Social Boundaries: The Circles Curriculum. Santa Barbara, CA 2017

[45]

Monica Tentori and Gillian R. Hayes. 2010. Designing for interaction immediacy to enhance social skills of children with autism. 51.

Digital Library

[46]

Jorge Torres-Solis, Tiago H. Falk, and Tom Chau. 2010. A review of indoor localization technologies: towards navigational assistance for topographical disorientation. INTECH Open Access Publisher.

[47]

Xianhui Wang, James Laffey, Wanli Xing, Yanfei Ma, and Janine Stichter. 2016. Exploring embodied social presence of youth with Autism in 3D collaborative virtual learning environment: A case study. Computers in Human Behavior 55, Part A: 310--321.

Digital Library

[48]

Susan Williams White, Kathleen Keonig, and Lawrence Scahill. 2006. Social Skills Development in Children with Autism Spectrum Disorders: A Review of the Intervention Research. Journal of Autism and Developmental Disorders 37, 10: 1858--1868.

[49]

Zhengyou Zhang. 2012. Microsoft Kinect Sensor and Its Effect. IEEE MultiMedia 19, 2: 4--10.

Digital Library

Cited By

Kong HYadav SLowy RRuzinov DKim J(2024)Understanding Online Job and Housing Search Practices of Neurodiverse Young Adults to Support Their IndependenceProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642578(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642578
Boyd LBoyd L(2024)From Sensory Perception to Realtime NonVerbal CommunicationThe Sensory Accommodation Framework for Technology10.1007/978-3-031-48843-6_6(85-99)Online publication date: 2-Jan-2024
https://doi.org/10.1007/978-3-031-48843-6_6
Boyd LBoyd L(2024)Technologies Across the Disciplines for Autistic UsersThe Sensory Accommodation Framework for Technology10.1007/978-3-031-48843-6_2(13-26)Online publication date: 2-Jan-2024
https://doi.org/10.1007/978-3-031-48843-6_2
Show More Cited By

Index Terms

ProCom: Designing and Evaluating a Mobile and Wearable System to Support Proximity Awareness for People with Autism
1. Social and professional topics
  1. Professional topics
    1. Computing profession
  2. User characteristics

Recommendations

ProCom: designing a mobile and wearable system to support proximity awareness for people with autism
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct

People with autism are at risk for social isolation due to the differences they experience in how they perceive and engage with the social world. In this work, we aim to address one specific concern related to socialization---the understanding, ...
Read More
SuperpowerGlass: A Wearable Aid for the At-Home Therapy of Children with Autism

We have developed a system for automatic facial expression recognition running on Google Glass, delivering real-time social cues to children with Autism Spectrum Disorder (ASD). The system includes multiple mechanisms to engage children and their parents,...
Read More
Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders

In spite of great improvements in early diagnosis and interventions, most children diagnosed with autism spectrum disorders (ASD) are unlikely to live independently when they reach adulthood. We have been conducting research on novel computer-based ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Funding Sources

Beijing Municipal Science & Technology Commission
Natural Science Foundation of China

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI PLAY '24

Sponsor:
sigchi

The Annual Symposium on Computer-Human Interaction in Play

October 14 - 17, 2024

Tampere , Finland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
1,029
Total Downloads

Downloads (Last 12 months)110
Downloads (Last 6 weeks)4

Other Metrics

View Author Metrics

Citations

Cited By

Kong HYadav SLowy RRuzinov DKim J(2024)Understanding Online Job and Housing Search Practices of Neurodiverse Young Adults to Support Their IndependenceProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642578(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642578
Boyd LBoyd L(2024)From Sensory Perception to Realtime NonVerbal CommunicationThe Sensory Accommodation Framework for Technology10.1007/978-3-031-48843-6_6(85-99)Online publication date: 2-Jan-2024
https://doi.org/10.1007/978-3-031-48843-6_6
Boyd LBoyd L(2024)Technologies Across the Disciplines for Autistic UsersThe Sensory Accommodation Framework for Technology10.1007/978-3-031-48843-6_2(13-26)Online publication date: 2-Jan-2024
https://doi.org/10.1007/978-3-031-48843-6_2
Williams RBoyd LGilbert J(2023)Counterventions: a reparative reflection on interventionist HCIProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581480(1-11)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581480
Trew SBrown S(2023)Towards an Autistic User Experience (aUX) Design for Assistive TechnologiesCultural Robotics: Social Robots and Their Emergent Cultural Ecologies10.1007/978-3-031-28138-9_10(147-162)Online publication date: 12-May-2023
https://doi.org/10.1007/978-3-031-28138-9_10
Wohofsky LScharf PLattacher SKrainer D(2022)Assistive technology to support people with autism spectrum disorder in their autonomy and safety: A scoping reviewTechnology and Disability10.3233/TAD-21035534:1(1-11)Online publication date: 7-Mar-2022
https://doi.org/10.3233/TAD-210355
Pakanen MSørensen MWitt FEichwald J(2022)“Ah That is Cute, I Will Stay Away!” Wearer Experiences of a Backpack with Shape-Changing Accessory for Keeping Social Distance to Others in Public ContextProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3568445(208-217)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3568445
Chung SGhinea G(2022)Towards developing digital interventions supporting empathic ability for children with autism spectrum disorderUniversal Access in the Information Society10.1007/s10209-020-00761-421:1(275-294)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1007/s10209-020-00761-4
Kientz JHayes GGoodwin MGelsomini MAbowd G(2022)Interactive Technologies and Autism, Second EditionundefinedOnline publication date: 18-Mar-2022
https://doi.org/null
Du YGrace TJagannath KSalen-Tekinbas K(2021)Connected Play in Virtual Worlds: Communication and Control Mechanisms in Virtual Worlds for Children and AdolescentsMultimodal Technologies and Interaction10.3390/mti50500275:5(27)Online publication date: 11-May-2021
https://doi.org/10.3390/mti5050027
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents