An Empathy-Driven, Conversational Artificial Intelligence Agent (Wysa) for Digital Mental Well-Being: Real-World Data Evaluation Mixed-Methods Study
- PMID: 30470676
- PMCID: PMC6286427
- DOI: 10.2196/12106
An Empathy-Driven, Conversational Artificial Intelligence Agent (Wysa) for Digital Mental Well-Being: Real-World Data Evaluation Mixed-Methods Study
Abstract
Background: A World Health Organization 2017 report stated that major depression affects almost 5% of the human population. Major depression is associated with impaired psychosocial functioning and reduced quality of life. Challenges such as shortage of mental health personnel, long waiting times, perceived stigma, and lower government spends pose barriers to the alleviation of mental health problems. Face-to-face psychotherapy alone provides only point-in-time support and cannot scale quickly enough to address this growing global public health challenge. Artificial intelligence (AI)-enabled, empathetic, and evidence-driven conversational mobile app technologies could play an active role in filling this gap by increasing adoption and enabling reach. Although such a technology can help manage these barriers, they should never replace time with a health care professional for more severe mental health problems. However, app technologies could act as a supplementary or intermediate support system. Mobile mental well-being apps need to uphold privacy and foster both short- and long-term positive outcomes.
Objective: This study aimed to present a preliminary real-world data evaluation of the effectiveness and engagement levels of an AI-enabled, empathetic, text-based conversational mobile mental well-being app, Wysa, on users with self-reported symptoms of depression.
Methods: In the study, a group of anonymous global users were observed who voluntarily installed the Wysa app, engaged in text-based messaging, and self-reported symptoms of depression using the Patient Health Questionnaire-9. On the basis of the extent of app usage on and between 2 consecutive screening time points, 2 distinct groups of users (high users and low users) emerged. The study used mixed-methods approach to evaluate the impact and engagement levels among these users. The quantitative analysis measured the app impact by comparing the average improvement in symptoms of depression between high and low users. The qualitative analysis measured the app engagement and experience by analyzing in-app user feedback and evaluated the performance of a machine learning classifier to detect user objections during conversations.
Results: The average mood improvement (ie, difference in pre- and post-self-reported depression scores) between the groups (ie, high vs low users; n=108 and n=21, respectively) revealed that the high users group had significantly higher average improvement (mean 5.84 [SD 6.66]) compared with the low users group (mean 3.52 [SD 6.15]); Mann-Whitney P=.03 and with a moderate effect size of 0.63. Moreover, 67.7% of user-provided feedback responses found the app experience helpful and encouraging.
Conclusions: The real-world data evaluation findings on the effectiveness and engagement levels of Wysa app on users with self-reported symptoms of depression show promise. However, further work is required to validate these initial findings in much larger samples and across longer periods.
Keywords: artificial intelligence; chatbots; conversational agents; coping skills; depression; emotions; empathy; mHealth; mental health; resilience, psychological.
©Becky Inkster, Shubhankar Sarda, Vinod Subramanian. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 23.11.2018.
Conflict of interest statement
Conflicts of Interest: BI is a scientific advisor to Wysa with no fiduciary associations. VS is an independent research consultant at Wysa and draws a consulting fee. SS is a technical lead and a paid employee at Wysa.
Figures
![Figure 1](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/6286427/bin/mhealth_v6i11e12106_fig1.gif)
![Figure 2](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/6286427/bin/mhealth_v6i11e12106_fig2.gif)
![Figure 3](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/6286427/bin/mhealth_v6i11e12106_fig3.gif)
![Figure 4](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/6286427/bin/mhealth_v6i11e12106_fig4.gif)
![Figure 5](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/6286427/bin/mhealth_v6i11e12106_fig5.gif)
Similar articles
-
Understanding the impact of an AI-enabled conversational agent mobile app on users' mental health and wellbeing with a self-reported maternal event: a mixed method real-world data mHealth study.Front Glob Womens Health. 2023 Jun 2;4:1084302. doi: 10.3389/fgwh.2023.1084302. eCollection 2023. Front Glob Womens Health. 2023. PMID: 37332481 Free PMC article.
-
Understanding Digital Mental Health Needs and Usage With an Artificial Intelligence-Led Mental Health App (Wysa) During the COVID-19 Pandemic: Retrospective Analysis.JMIR Form Res. 2023 Jan 26;7:e41913. doi: 10.2196/41913. JMIR Form Res. 2023. PMID: 36540052 Free PMC article.
-
Understanding People With Chronic Pain Who Use a Cognitive Behavioral Therapy-Based Artificial Intelligence Mental Health App (Wysa): Mixed Methods Retrospective Observational Study.JMIR Hum Factors. 2022 Apr 27;9(2):e35671. doi: 10.2196/35671. JMIR Hum Factors. 2022. PMID: 35314422 Free PMC article.
-
Evaluation of the Current State of Chatbots for Digital Health: Scoping Review.J Med Internet Res. 2023 Dec 19;25:e47217. doi: 10.2196/47217. J Med Internet Res. 2023. PMID: 38113097 Free PMC article. Review.
-
The Use of Artificial Intelligence-Based Conversational Agents (Chatbots) for Weight Loss: Scoping Review and Practical Recommendations.JMIR Med Inform. 2022 Apr 13;10(4):e32578. doi: 10.2196/32578. JMIR Med Inform. 2022. PMID: 35416791 Free PMC article. Review.
Cited by
-
AI Hesitancy and Acceptability-Perceptions of AI Chatbots for Chronic Health Management and Long COVID Support: Survey Study.JMIR Hum Factors. 2024 Jul 23;11:e51086. doi: 10.2196/51086. JMIR Hum Factors. 2024. PMID: 39045815 Free PMC article.
-
Exploring the use of ChatGPT as a virtual health coach for chronic disease management.Learn Health Syst. 2024 Jan 11;8(3):e10406. doi: 10.1002/lrh2.10406. eCollection 2024 Jul. Learn Health Syst. 2024. PMID: 39036525 Free PMC article.
-
Evaluating the Potential and Pitfalls of AI-Powered Conversational Agents as Humanlike Virtual Health Carers in the Remote Management of Noncommunicable Diseases: Scoping Review.J Med Internet Res. 2024 Jul 16;26:e56114. doi: 10.2196/56114. J Med Internet Res. 2024. PMID: 39012688 Free PMC article. Review.
-
Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review.Front Psychiatry. 2024 May 7;15:1356773. doi: 10.3389/fpsyt.2024.1356773. eCollection 2024. Front Psychiatry. 2024. PMID: 38774435 Free PMC article.
-
Revealing the source: How awareness alters perceptions of AI and human-generated mental health responses.Internet Interv. 2024 Apr 27;36:100745. doi: 10.1016/j.invent.2024.100745. eCollection 2024 Jun. Internet Interv. 2024. PMID: 38746873 Free PMC article.
References
-
- World Health Organization. Geneva: World Health Organization; 2017. Depression and Other Common Mental Disorders: Global Health Estimates http://www.who.int/mental_health/management/depression/prevalence_global...
-
- Ishak WW, Balayan K, Bresee C, Greenberg JM, Fakhry H, Christensen S, Rapaport MH. A descriptive analysis of quality of life using patient-reported measures in major depressive disorder in a naturalistic outpatient setting. Qual Life Res. 2013 Apr;22(3):585–96. doi: 10.1007/s11136-012-0187-6. - DOI - PubMed
-
- Fried EI, Nesse RM. The impact of individual depressive symptoms on impairment of psychosocial functioning. PLoS One. 2014;9(2):e90311. doi: 10.1371/journal.pone.0090311. http://dx.plos.org/10.1371/journal.pone.0090311 PONE-D-13-42058 - DOI - DOI - PMC - PubMed
-
- Greenberg PE, Fournier A, Sisitsky T, Pike CT, Kessler RC. The economic burden of adults with major depressive disorder in the United States (2005 and 2010) J Clin Psychiatry. 2015 Feb;76(2):155–62. doi: 10.4088/JCP.14m09298. http://www.psychiatrist.com/jcp/article/pages/2015/v76n02/v76n0204.aspx - DOI - PubMed
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous