skip to main content
research-article
Open access

Like My Aunt Dorothy: Effects of Conversational Styles on Perceptions, Acceptance and Metaphorical Descriptions of Voice Assistants during Later Adulthood

Published: 26 April 2024 Publication History
  • Get Citation Alerts
  • Abstract

    Little research has investigated the design of conversational styles of voice assistants (VA) for adults in their later adulthood with varying personalities. In this Wizard of Oz experiment, 34 middle-aged (50 to 64 years old) and 24 older adults (65 to 80 years old) participated in a user study at a simulated home, interacting with a VA using either formal or informal language. Older adults with higher agreeableness perceived VA as being more likable than middle-aged adults. Middle-aged adults showed similar technology acceptance toward the informal and formal VA, and older adults preferred using informal VA, especially those with low agreeableness. Further, while both middle-aged and older adults frequently anthropomorphized VAs by using human metaphors for them, older adults compared formal VA with professionals (e.g., librarians, teachers) and informal VA with their close ones (e.g., spouses, relatives). Overall, the conversational style showed differential effects on the perceptions of middle-aged and older adults, suggesting personalized design implications.

    References

    [1]
    Brooke Auxier. 5 things to know about Americans and their smart speakers. Pew Research Center. Retrieved September 30, 2022 from https://www.pewresearch.org/fact-tank/2019/11/21/5-things-to-know-about-americans-and-their-smart-speakers/
    [2]
    Christoph Bartneck, Takayuki Kanda, Omar Mubin, and Abdullah Al Mahmud. 2009. Does the Design of a Robot Influence Its Animacy and Perceived Intelligence? International Journal of Social Robotics 1, 2: 195--204. https://doi.org/10.1007/s12369-009-0013--7
    [3]
    Christoph Bartneck, Dana Kulic, Elizabeth Croft, and Susana Zoghbi. 2009. Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots. International Journal of Social Robotics 1, 1: 71--81. https://doi.org/10.1007/s12369-008-0001--3
    [4]
    Douglas Bates. 2010. Lme4: Mixed-Effects Modeling With R.
    [5]
    Frank Bentley, Chris Luvogt, Max Silverman, Rushani Wirasinghe, Brooke White, and Danielle Lottridge. 2018. Understanding the Long-Term Use of Smart Speaker Assistants. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3: 91:1--91:24. https://doi.org/10.1145/3264901
    [6]
    Timothy W. Bickmore, Lisa Caruso, Kerri Clough-Gorr, and Tim Heeren. 2005. ?It's just like you talk to a friend' relational agents for older adults. Interacting with Computers 17, 6: 711--735. https://doi.org/10.1016/j.intcom.2005.09.002
    [7]
    Alan F. Blackwell. 2006. The reification of metaphor as a design tool. ACM Transactions on Computer-Human Interaction 13, 4: 490--530. https://doi.org/10.1145/1188816.1188820
    [8]
    Michael Braun, Anja Mainz, Ronee Chadowitz, Bastian Pfleging, and Florian Alt. 2019. At Your Service: Designing Voice Assistant Personalities to Improve Automotive User Interfaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19), 1--11. https://doi.org/10.1145/3290605.3300270
    [9]
    Marc Brysbaert and Michaël Stevens. 2018. Power Analysis and Effect Size in Mixed Effects Models: A Tutorial. 1, 1: 9. https://doi.org/10.5334/joc.10
    [10]
    US Census Bureau. The Population 65 Years and Older in the United States. Census.gov. Retrieved July 14, 2023 from https://www.census.gov/library/publications/2018/acs/acs-38.html
    [11]
    Lynne Cameron and Robert Maslen. 2010. Metaphor Analysis: Research Practice in applied Linguistics, Social Sciences and the Humanities. Equinox, London. Retrieved September 3, 2021 from http://www.equinoxpub.com/books/showbook.asp?bkid=363&keyword=9781845534479
    [12]
    Hyojin Chin, Lebogang Wame Molefi, and Mun Yong Yi. 2020. Empathy Is All You Need: How a Conversational Agent Should Respond to Verbal Abuse. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20), 1--13. https://doi.org/10.1145/3313831.3376461
    [13]
    Jessie Chin and Smit Desai. 2021. Being a Nice Partner: The Effects of Age and Interaction Types on the Perceived Social Abilities of Conversational Agents. In Technology, Mind, and Behavior. https://doi.org/10.1037/tms0000027
    [14]
    Eugene Cho. 2019. Hey Google, Can I Ask You Something in Private? In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19), 1--9. https://doi.org/10.1145/3290605.3300488
    [15]
    Andy Clark. 2012. Embodied, Embedded, and Extended Cognition. In The Cambridge Handbook of Cognitive Science, Keith Frankish and William Ramsey (eds.). Cambridge University Press, 275.
    [16]
    Leigh Clark, Philip Doyle, Diego Garaialde, Emer Gilmartin, Stephan Schlögl, Jens Edlund, Matthew Aylett, João Cabral, Cosmin Munteanu, Justin Edwards, and Benjamin R Cowan. 2019. The State of Speech in HCI: Trends, Themes and Challenges. Interacting with Computers 31, 4: 349--371. https://doi.org/10.1093/iwc/iwz016
    [17]
    Benjamin R. Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017. ?What Can I Help You with?": Infrequent Users' Experiences of Intelligent Personal Assistants. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17), 43:1--43:12. https://doi.org/10.1145/3098279.3098539
    [18]
    Samuel Rhys Cox and Wei Tsang Ooi. 2022. Does Chatbot Language Formality Affect Users' Self-Disclosure? In 4th Conference on Conversational User Interfaces, 1--13. https://doi.org/10.1145/3543829.3543831
    [19]
    Smit Desai and Michael Twidale. 2022. Is Alexa like a computer? A search engine? A friend? A silly child? Yes. In 4th Conference on Conversational User Interfaces (CUI 2022), 1--4. https://doi.org/10.1145/3543829.3544535
    [20]
    Smit Desai and Michael Twidale. 2023. Metaphors in Voice User Interfaces: A Slippery Fish. ACM Transactions on Computer-Human Interaction. https://doi.org/10.1145/3609326
    [21]
    Philip R. Doyle, Justin Edwards, Odile Dumbleton, Leigh Clark, and Benjamin R. Cowan. 2019. Mapping Perceptions of Humanness in Intelligent Personal Assistant Interaction. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, 1--12. https://doi.org/10.1145/3338286.3340116
    [22]
    Franz Faul, Edgar Erdfelder, Albert-Georg Lang, and Axel Buchner. 2007. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods 39, 2: 175--191. https://doi.org/10.3758/bf03193146
    [23]
    Luciano Floridi and J.W. Sanders. 2004. On the Morality of Artificial Agents. Minds and Machines 14, 3: 349--379. https://doi.org/10.1023/B:MIND.0000035461.63578.9d
    [24]
    Zohar Gilad, Ofra Amir, and Liat Levontin. 2021. The Effects of Warmth and Competence Perceptions on Users' Choice of an AI System. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21), 1--13. https://doi.org/10.1145/3411764.3446863
    [25]
    Lewis R. Goldberg. 1993. The structure of phenotypic personality traits. American Psychologist 48: 26--34. https://doi.org/10.1037/0003-066X.48.1.26
    [26]
    Samuel D. Gosling, Peter J. Rentfrow, and William B. Swann Jr. 2003. A very brief measure of the Big-Five personality domains. Journal of Research in Personality 37: 504--528. https://doi.org/10.1016/S0092--6566(03)00046--1
    [27]
    Arthur C. Graesser, Danielle S. McNamara, Zhiqang Cai, Mark Conley, Haiying Li, and James Pennebaker. 2014. Coh-Metrix Measures Text Characteristics at Multiple Levels of Language and Discourse. The Elementary School Journal 115, 2: 210--229. https://doi.org/10.1086/678293
    [28]
    Marcel Heerink, B. Krose, Evers Vanessa, and Bob Wielinga. 2008. The Influence of Social Presence on Acceptance of a Companion Robot by Older People. Journal of Physical Agents 2. https://doi.org/10.14198/JoPha.2008.2.2.05
    [29]
    Francis Heylighen. 1970. Formality of Language: definition, measurement and behavioral determinants.
    [30]
    Douglas Hofstadter. 2007. I am a strange loop. Basic Books, New York, NY, US.
    [31]
    Anne Lise Holm, Anne Lyberg, and Elisabeth Severinsson. 2014. Living with Stigma: Depressed Elderly Persons' Experiences of Physical Health Problems. Nursing Research and Practice 2014: e527920. https://doi.org/10.1155/2014/527920
    [32]
    Yaxin Hu, Yuxiao Qu, Adam Maus, and Bilge Mutlu. 2022. Polite or Direct? Conversation Design of a Smart Display for Older Adults Based on Politeness Theory. In CHI Conference on Human Factors in Computing Systems, 1--15. https://doi.org/10.1145/3491102.3517525
    [33]
    Frank J. Infurna, Denis Gerstorf, and Margie E. Lachman. 2020. Midlife in the 2020s: Opportunities and challenges. American Psychologist 75, 4: 470--485. https://doi.org/10.1037/amp0000591
    [34]
    Judith T. Irvine. 1979. Formality and Informality in Communicative Events. American Anthropologist 81, 4: 773--790. https://doi.org/10.1525/aa.1979.81.4.02a00020
    [35]
    Ryan Blake Jackson and Tom Williams. 2021. A Theory of Social Agency for Human-Robot Interaction. Frontiers in Robotics and AI 8. Retrieved October 14, 2022 from https://www.frontiersin.org/articles/10.3389/frobt.2021.687726
    [36]
    Efraim Jaul and Jeremy Barron. 2017. Age-Related Diseases and Clinical and Public Health Implications for the 85-Years Old and Over Population. Frontiers in Public Health 5. Retrieved October 13, 2022 from https://www.frontiersin.org/articles/10.3389/fpubh.2017.00335
    [37]
    Iris Jestin, Joel Fischer, Maria Jose Galvez Trigo, David Large, and Gary Burnett. 2022. Effects of Wording and Gendered Voices on Acceptability of Voice Assistants in Future Autonomous Vehicles. In Proceedings of the 4th Conference on Conversational User Interfaces (CUI '22), 1--11. https://doi.org/10.1145/3543829.3543836
    [38]
    Ji-Youn Jung, Sihang Qiu, Alessandro Bozzon, and Ujwal Gadiraju. 2022. Great Chain of Agents: The Role of Metaphorical Representation of Agents in Conversational Crowdsourcing. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22), 1--22. https://doi.org/10.1145/3491102.3517653
    [39]
    Pranav Khadpe, Ranjay Krishna, Li Fei-Fei, Jeffrey T. Hancock, and Michael S. Bernstein. 2020. Conceptual Metaphors Impact Perceptions of Human-AI Collaboration. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2: 163:1--163:26. https://doi.org/10.1145/3415234
    [40]
    Soomin Kim, Joonhwan Lee, and Gahgene Gweon. 2019. Comparing Data from Chatbot and Web Surveys: Effects of Platform and Conversational Style on Survey Response Quality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19), 1--12. https://doi.org/10.1145/3290605.3300316
    [41]
    Sunyoung Kim. 2021. Exploring How Older Adults Use a Smart Speaker--Based Voice Assistant in Their First Interactions: Qualitative Study. JMIR mHealth and uHealth 9, 1: e20427. https://doi.org/10.2196/20427
    [42]
    Sunyoung Kim and Abhishek Choudhury. 2021. Exploring older adults' perception and use of smart speaker-based voice assistants: A longitudinal study. Computers in Human Behavior 124: 106914. https://doi.org/10.1016/j.chb.2021.106914
    [43]
    Yelim Kim, Mohi Reza, Joanna McGrenere, and Dongwook Yoon. 2021. Designers Characterize Naturalness in Voice User Interfaces: Their Goals, Practices, and Challenges. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). https://doi.org/10.1145/3411764.3445579
    [44]
    Alexandra Kuznetsova, Per B. Brockhoff, and Rune H. B. Christensen. 2017. lmerTest Package: Tests in Linear Mixed Effects Models. Journal of Statistical Software 82: 1--26. https://doi.org/10.18637/jss.v082.i13
    [45]
    George Lakoff and Mark Johnson. 1980. Metaphors We Live By. University of Chicago Press.
    [46]
    George Lakoff and Mark Turner. 1989. More than Cool Reason: A Field Guide to Poetic Metaphor. University of Chicago Press, Chicago, IL. Retrieved July 13, 2023 from https://press.uchicago.edu/ucp/books/book/chicago/M/bo3774967.html
    [47]
    Haiying Li and Art C. Graesser. 2020. Impact of Conversational Formality on the Quality and Formality of Written Summaries. In Artificial Intelligence in Education (Lecture Notes in Computer Science), 321--332. https://doi.org/10.1007/978--3-030--52237--7_26
    [48]
    Ewa Luger and Abigail Sellen. 2016. ?Like Having a Really Bad PA": The Gulf Between User Expectation and Experience of Conversational Agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 5286--5297. https://doi.org/10.1145/2858036.2858288
    [49]
    A. Mihailidis, B. Carmichael, and J. Boger. 2004. The use of computer vision in an intelligent environment to support aging-in-place, safety, and independence in the home. IEEE Transactions on Information Technology in Biomedicine 8, 3: 238--247. https://doi.org/10.1109/TITB.2004.834386
    [50]
    Clifford Nass, Jonathan Steuer, and Ellen R. Tauber. 1994. Computers are social actors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94), 72--78. https://doi.org/10.1145/191666.191703
    [51]
    Simone Natale. 2021. Deceitful Media: Artificial Intelligence and Social Life after the Turing Test. Oxford University Press, Oxford, New York.
    [52]
    Young Hoon Oh, Kyungjin Chung, and Da Young Ju. 2020. Differences in Interactions with a Conversational Agent. International Journal of Environmental Research and Public Health 17, 9: 3189. https://doi.org/10.3390/ijerph17093189
    [53]
    James L. Peugh. 2010. A practical guide to multilevel modeling. Journal of School Psychology 48, 1: 85--112. https://doi.org/10.1016/j.jsp.2009.09.002
    [54]
    François Portet, Michel Vacher, Caroline Golanski, Camille Roux, and Brigitte Meillon. 2013. Design and evaluation of a smart home voice interface for the elderly: acceptability and objection aspects. Personal and Ubiquitous Computing 17, 1: 127--144. https://doi.org/10.1007/s00779-011-0470--5
    [55]
    Alisha Pradhan, Leah Findlater, and Amanda Lazar. 2019. ?Phantom Friend" or ?Just a Box with Information": Personification and Ontological Categorization of Smart Speaker-based Voice Assistants by Older Adults. Proceedings of the ACM on Human-Computer Interaction 3, CSCW: 214:1--214:21. https://doi.org/10.1145/3359316
    [56]
    Alisha Pradhan, Ben Jelen, Katie A. Siek, Joel Chan, and Amanda Lazar. 2020. Understanding Older Adults' Participation in Design Workshops. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1--15. https://doi.org/10.1145/3313831.3376299
    [57]
    Alisha Pradhan, Amanda Lazar, and Leah Findlater. 2020. Use of Intelligent Voice Assistants by Older Adults with Low Technology Use. ACM Transactions on Computer-Human Interaction 27, 4: 31:1--31:27. https://doi.org/10.1145/3373759
    [58]
    Sihang Qiu, Ujwal Gadiraju, and Alessandro Bozzon. 2020. Improving Worker Engagement Through Conversational Microtask Crowdsourcing. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20), 1--12. https://doi.org/10.1145/3313831.3376403
    [59]
    Wesley R. dos Santos, Ricelli M. S. Ramos, and Ivandré Paraboni. 2019. Computational personality recognition from Facebook text: psycholinguistic features, words and facets. New Review of Hypermedia and Multimedia 25, 4: 268--287. https://doi.org/10.1080/13614568.2020.1722761
    [60]
    Sergio Sayago, Barbara Barbosa Neves, and Benjamin R Cowan. 2019. Voice assistants and older people: some open issues. In Proceedings of the 1st International Conference on Conversational User Interfaces (CUI '19), 1--3. https://doi.org/10.1145/3342775.3342803
    [61]
    Alex Sciuto, Arnita Saini, Jodi Forlizzi, and Jason I. Hong. 2018. ?Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18), 857--868. https://doi.org/10.1145/3196709.3196772
    [62]
    Katie Seaborn and Jacqueline Urakami. 2021. Measuring Voice UX Quantitatively: A Rapid Review. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, 1--8. https://doi.org/10.1145/3411763.3451712
    [63]
    Ameneh Shamekhi, Mary Czerwinski, Gloria Mark, Margeigh Novotny, and Gregory A. Bennett. 2016. An Exploratory Study Toward the Preferred Conversational Style for Compatible Virtual Agents. In Intelligent Virtual Agents (Lecture Notes in Computer Science), 40--50. https://doi.org/10.1007/978--3--319--47665-0_4
    [64]
    Jaisie Sin, Dongqing Chen, Jalena G. Threatt, Anna Gorham, and Cosmin Munteanu. 2022. Does Alexa Live Up to the Hype? Contrasting Expectations from Mass Media Narratives and Older Adults' Hands-on Experiences of Voice Interfaces. In Proceedings of the 4th Conference on Conversational User Interfaces (CUI '22), 1--9. https://doi.org/10.1145/3543829.3543841
    [65]
    Jaisie Sin, Cosmin Munteanu, Numrita Ramanand, and Yi Rong Tan. 2021. VUI Influencers: How the Media Portrays Voice User Interfaces for Older Adults. In CUI 2021 - 3rd Conference on Conversational User Interfaces (CUI '21), 1--13. https://doi.org/10.1145/3469595.3469603
    [66]
    Deborah Tannen. 2005. Conversational Style: Analyzing Talk among Friends. Oxford University Press.
    [67]
    Viswanath Venkatesh, Michael G. Morris, Gordon B. Davis, and Fred D. Davis. 2003. User acceptance of information technology: Toward a unified view. MIS Quarterly 27: 425--478. https://doi.org/10.2307/30036540
    [68]
    Sarah Theres Völkel, Samantha Meindl, and Heinrich Hussmann. 2021. Manipulating and Evaluating Levels of Personality Perceptions of Voice Assistants through Enactment-Based Dialogue Design. In Proceedings of the 3rd Conference on Conversational User Interfaces (CUI '21), 1--12. https://doi.org/10.1145/3469595.3469605
    [69]
    Sarah Theres Völkel, Ramona Schödel, Daniel Buschek, Clemens Stachl, Verena Winterhalter, Markus Bühner, and Heinrich Hussmann. 2020. Developing a Personality Model for Speech-based Conversational Agents Using the Psycholexical Approach. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20), 1--14. https://doi.org/10.1145/3313831.3376210
    [70]
    Jinping Wang, Hyun Yang, Ruosi Shao, Saeed Abdullah, and S. Shyam Sundar. 2020. Alexa as Coach: Leveraging Smart Speakers to Build Social Agents that Reduce Public Speaking Anxiety. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20), 1--13. https://doi.org/10.1145/3313831.3376561
    [71]
    Randall Ziman and Greg Walsh. 2018. Factors Affecting Seniors' Perceptions of Voice-enabled User Interfaces. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, 1--6. https://doi.org/10.1145/3170427.3188575

    Cited By

    View all
    • (2024)Examining Humanness as a Metaphor to Design Voice User InterfacesProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665535(1-15)Online publication date: 8-Jul-2024

    Index Terms

    1. Like My Aunt Dorothy: Effects of Conversational Styles on Perceptions, Acceptance and Metaphorical Descriptions of Voice Assistants during Later Adulthood

            Recommendations

            Comments

            Information & Contributors

            Information

            Published In

            cover image Proceedings of the ACM on Human-Computer Interaction
            Proceedings of the ACM on Human-Computer Interaction  Volume 8, Issue CSCW1
            CSCW
            April 2024
            6294 pages
            EISSN:2573-0142
            DOI:10.1145/3661497
            Issue’s Table of Contents
            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            Published: 26 April 2024
            Published in PACMHCI Volume 8, Issue CSCW1

            Permissions

            Request permissions for this article.

            Check for updates

            Author Tags

            1. aging
            2. conversational agents
            3. conversational style
            4. formality
            5. later adulthood
            6. metaphors
            7. perceived intelligence
            8. personality
            9. technology acceptance
            10. voice agents

            Qualifiers

            • Research-article

            Contributors

            Other Metrics

            Bibliometrics & Citations

            Bibliometrics

            Article Metrics

            • Downloads (Last 12 months)79
            • Downloads (Last 6 weeks)34

            Other Metrics

            Citations

            Cited By

            View all
            • (2024)Examining Humanness as a Metaphor to Design Voice User InterfacesProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665535(1-15)Online publication date: 8-Jul-2024

            View Options

            View options

            PDF

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader

            Get Access

            Login options

            Full Access

            Media

            Figures

            Other

            Tables

            Share

            Share

            Share this Publication link

            Share on social media