JMIR Human Factors JMIR Hum Factors JMIR Human Factors 2292-9495 JMIR Publications Toronto, Canada v9i2e35671 35314422 10.2196/35671 Original Paper Original Paper Understanding People With Chronic Pain Who Use a Cognitive Behavioral Therapy–Based Artificial Intelligence Mental Health App (Wysa): Mixed Methods Retrospective Observational Study Kushniruk Andre Wang Yicun Thompson Bronnie Meheli Saha MA, MPhil 1 https://orcid.org/0000-0001-7728-8581 Sinha Chaitali MA 2
Wysa Inc 131 Dartmouth St Boston, MA United States 1 916 753 7824 chaitali@wysa.io
https://orcid.org/0000-0001-8919-7134 Kadaba Madhura MS 2 https://orcid.org/0000-0001-7471-7272 Department of Clinical Psychology National Institute of Mental Health and Neurosciences Bangalore India Wysa Inc Boston, MA United States Corresponding Author: Chaitali Sinha chaitali@wysa.io Apr-Jun 2022 27 4 2022 9 2 e35671 14 12 2021 3 3 2022 16 3 2022 21 3 2022 ©Saha Meheli, Chaitali Sinha, Madhura Kadaba. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 27.04.2022. 2022

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.

 Background

Digital health interventions can bridge barriers in access to treatment among individuals with chronic pain.

 Objective

This study aimed to evaluate the perceived needs, engagement, and effectiveness of the mental health app Wysa with regard to mental health outcomes among real-world users who reported chronic pain and engaged with the app for support.

 Methods

Real-world data from users (N=2194) who reported chronic pain and associated health conditions in their conversations with the mental health app were examined using a mixed methods retrospective observational study. An inductive thematic analysis was used to analyze the conversational data of users with chronic pain to assess perceived needs, along with comparative macro-analyses of conversational flows to capture engagement within the app. Additionally, the scores from a subset of users who completed a set of pre-post assessment questionnaires, namely Patient Health Questionnaire-9 (PHQ-9) (n=69) and Generalized Anxiety Disorder Assessment-7 (GAD-7) (n=57), were examined to evaluate the effectiveness of Wysa in providing support for mental health concerns among those managing chronic pain.

 Results

The themes emerging from the conversations of users with chronic pain included health concerns, socioeconomic concerns, and pain management concerns. Findings from the quantitative analysis indicated that users with chronic pain showed significantly greater app engagement (P<.001) than users without chronic pain, with a large effect size (Vargha and Delaney A=0.76-0.80). Furthermore, users with pre-post assessments during the study period were found to have significant improvements in group means for both PHQ-9 and GAD-7 symptom scores, with a medium effect size (Cohen d=0.60-0.61).

 Conclusions

The findings indicate that users look for tools that can help them address their concerns related to mental health, pain management, and sleep issues. The study findings also indicate the breadth of the needs of users with chronic pain and the lack of support structures, and suggest that Wysa can provide effective support to bridge the gap.

 chronic pain digital mental health mobile health mHealth pain management artificial intelligence cognitive behavioral therapy conversational agent software agent pain conditions depression anxiety Introduction Background

Chronic pain is a debilitating condition that affects over 2 billion people worldwide, with the global weighted mean prevalence estimated to be 30.3% [1,2]. The sequelae of chronic pain are spread across the different aspects of an individual’s life, such as employment, sleep, physical and mental health, and social relationships [3].

The relationship between chronic pain and mental health comorbidities is well documented, with the prevalence of concurrent major depression or anxiety diagnoses ranging between 35% and 50% of the global population, and the presence of pain often doubling the risk of having a mental health diagnosis [4,5]. Mental health concerns can compound the difficulties in gaining access to affordable and accessible treatment for chronic pain. The absence of referral pathways, high costs, and stigma increase barriers to access for treatment and management [6-8]. Increasingly, digital health care apps have been addressing these challenges with cost-effective and accessible solutions, with some evidence to indicate feasibility and efficacy [9,10]; however, adoption, acceptability, and quality still remain challenges for this space [11]. Currently, there is limited user-led research that captures the perspectives and perceived needs (based on the person’s own judgement) of individuals with chronic pain.

This study examined the experiences of users with self-reported chronic pain who were using Wysa, which is an anonymous artificial intelligence (AI) conversational agent app for digital mental health. A previous study showed that the use of Wysa was associated with a significant reduction in depressive symptoms in a high-engagement user group compared with a low-engagement user group [12]. The Wysa app uses a free-text conversational interface to listen and respond to the user and responds to the user’s distress by recommending evidence-based elements from cognitive behavioral therapy (CBT), behavioral reinforcement, and mindfulness, among others. The self-help practices and conversation-based tools and techniques provide support for challenges, including anxiety, sleep, low energy, motivation, loss, and pain.

 Our Study

The purpose of this study was to understand the perceived needs of individuals with chronic pain and their mental health concerns. The study aimed to understand the ways in which individuals find digital health support meaningful, and the potential areas in which it could be developed in order to offer more effective and accessible support for individuals with chronic pain.

This study had the following 3 objectives: (1) to evaluate the perceived needs of users with chronic pain conditions; (2) to evaluate the app engagement and disengagement patterns of users with chronic pain (in terms of the most used tools, most frequented conversational flows, and intensity of engagement and disengagement); and (3) to evaluate the efficacy of the Wysa app and its interventions for improving mental health among a subsample of users who have completed 2 questionnaire assessments (ie, preintervention and postintervention) using the validated Patient Health Questionnaire-9 (PHQ-9) [13] and Generalized Anxiety Disorder Assessment-7 (GAD-7) [14].

 Methods Ethical Considerations

The Wysa app is publicly available as an app on the Android and iOS app stores. It has been designed to prioritize safety, privacy, and security by design. There is no user registration required, and no personally identifiable information is asked at any time during app use. As the study involved analyzing real-world data from an anonymous nonclinical population, it was exempt from registration in a public trial registry (according to OHRP guidelines [15]). The users voluntarily downloaded the app after having consented to the app’s Terms of Service and Privacy Policy. For ethical and privacy reasons, the authors did not have access to all the user messages. Only minimal and limited conversational data extracted based on keywords were used for this research, and no longitudinal data were used. The study data set was deidentified using one-way cryptographic functions. User data were adequately secured according to the organization’s privacy, security, and safety policies. The study participants were informed about how they can exercise their rights to restrict processing of their data for research purposes.

 Study Design

During the study period from October 2020 to October 2021, a total of 2194 users were identified to have reported chronic pain based on selected keywords in ongoing conversations with the conversational agent. We implemented a retrospective observational study with a mixed methods approach, given the objectives of the study and the nature of the data being analyzed. In a retrospective observational study, the sample is defined later and the data are already available [16]. This methodology has been used in multiple health care studies, such as those involving depression and anxiety [17-19], hypertension [20], postpartum mental health concerns [21], COVID-19–related concerns [22], and diabetes [23].

 Outcome Measures and Data Types

The following measures and data types were used: (1) textual snippets from users, (2) tool usage data, (3) usage data indicating the interventions used with the bot, and (4) self-reported PHQ-9 and GAD-7 data.

 Procedure Data Extraction

To extract the data, the first step was to optimize the keywords. For this, the classification of chronic pain by the International Association for the Study of Pain was used as a guide [24] to derive keywords. Additionally, other relevant keywords were derived from literature on pain and the clinical experiences of the researchers in this study. As such, the keywords also included general terms used to describe pain or to describe pain-related experiences, such as “pain,” “painkiller,” “manage pain,” “nerve block,” etc.

User messages that had at least one or more of the keywords were extracted, which resulted in 83,000 messages. The criteria for data extraction and filtration are listed in Textbox 1. These were further filtered by the research team, who read through each of the messages to exclude any pain that did not relate to chronic pain conditions (such as emotional pain or menstrual pain) or pain that the users did not experience themselves. Ambiguous messages that did not clarify the nature of the pain were also excluded. For example, the word “pain” often created false positives or ambiguity, as users could use this word in a context that would not necessarily be related to physical pain or chronic pain (eg, “it is so painful”). These types of messages were excluded from the final set. The stringent exclusion resulted in a final set of 3300 relevant messages from 2194 unique users. Among these, the distribution of the number of mentions of different diagnoses is listed in Table 1.

Criteria and keywords for data extraction.

Selection criteria (inclusion and exclusion) for data extraction

The keywords used were about “chronic pain” or related concerns to capture all mentions of associated conditions, such as “disability,” “loss of limb,” “manage pain,” “injury,” “musculoskeletal,” “neuralgia,” “back pain,” “phantom pain,” “multiple sclerosis,” “osteoarthritis,” “cancer pain,” “sciatica,” “fibromyalgia,” “spinal cord,” “arthritis,” “spondylitis,” “cervical,” “rheumatoid,” “endometriosis,” “surgery,” “ankylosing,” “inflammation,” “inflammatory,” “crohn,” “sclerosis,” “gout,” “nerve block,” “analgesic,” “painkillers,” “pelvic pain,” “cyst,” “migraine,” and “pcos.”

The report of pain should be first-person, that is, the person is talking about their own pain. Any mention of others’ health conditions was excluded.

There was clarity about the mentioned pain being chronic and physical in nature. Ambiguous messages that did not meet this criterion were excluded.

Any message that qualified only as emotional or psychosomatic pain was excluded.

The number of mentions of different conditions of chronic pain.

Condition Number of mentionsa
Migraine 551
Back pain 501
Chronic pain 265
Surgery 212
Fibromyalgia 119
Injury 99
Disability 92
Neck pain 56
Arthritis 30
Crohn 22
Sciatica 19
Inflammation 18
Cervical 9
Rheumatoid 9
Sclerosis 9
Endometriosis 8
Spondylitis 5
Cyst/polycystic ovary syndrome 5
Multiple sclerosis 4
Nerve block 2
Phantom pain 1

aThis is the number of actual mentions of the condition and not the number of users having the condition. Some users reported multiple conditions, and these categories are not mutually exclusive.

 Analyses Objective 1: Perceived Needs of Users With Chronic Pain

Inductive thematic analysis [25] was used to gather information on perceived needs and experiences related to chronic pain. The author SM got familiarized with the data by reading the messages multiple times. This was followed by the generation of preliminary codes, which were then grouped into potential subthemes and themes. The data were then verified for relevance to the respective themes at each level, and the initial set of themes was verified in relation to the coded extracts. The themes were selected and finalized based on their relevance to the objectives of the study and their salience in capturing perceived needs. Though the analysis was led by SM, all the authors met at regular intervals to ensure that the themes were internally consistent and unique, and answered the research question. The themes and subthemes were then reviewed and finalized.

 Objective 2: App Engagement and Disengagement of Users With Chronic Pain

The engagement of users was evaluated at the following 3 different levels: (1) the frequency of usage within Wysa, (2) the intensity of user engagement, and (3) the points of disengagement. Engagement refers to the number of initiated and completed interactions within the app, while the points of disengagement are instances where users stop communicating or engaging further with the conversational agent.

The first level of analysis was the frequency count of the tools (interventions) most utilized by the users with chronic pain (N=2194). To capture the most recurring conversation flows of the users with chronic pain, a network analysis [26] was conducted with cleaned sequential pairs of conversational path units and their frequency of occurrence as weights. The path units were then grouped into higher units based on app elements, and the networks were visualized in Gephi 0.9.2 [27] as a directed weighted network. The directionality of the conversational pathways was then used to identify the tools most used within Wysa, to further validate the findings of the first-level analysis. The visualization of the network analysis was done in Gephi with the Yifan Hu layout, and the appearance of nodes and edges was based on “weighted in-degree,” that is, incoming connections as calculated within the software.

At the second level, to examine the intensity of engagement, the extracted data were analyzed for instances of engagement and disengagement with the bot. Using Python 3.6 code, the first-level engagement of a user was calculated by using the number of conversational pathways per user. The intensity of engagement and disengagement of users with chronic pain was then tested in comparison to users without chronic pain (a randomized sample from the larger user base that had not reported any chronic pain). The data for both samples did not fit the criteria for normality, indicating the need for nonparametric assessments. The data were further tested using R 4.1, and the difference in engagement was assessed using the Mann-Whitney U test between users with chronic pain and those without chronic pain.

To evaluate the disengagement patterns, the ends of conversational flows, which represented the locations where users would stop engaging with the app, were identified for both groups. The top 20 conversational ends were located from path data and compared between the groups (users with chronic pain, n=2194; users without chronic pain, n=1880) for salient differences.

 Objective 3: Efficacy in Improving the Mental Health of Users With Chronic Pain

A subset of the sample was used to examine the efficacy of the app for improving the mental health symptoms of users with chronic pain. This subset was restricted to users who completed at least two self-reported PHQ-9 (n=69) and GAD-7 (n=57) assessments during the study period. The first assessment during the study period was regarded as the baseline, and the last assessment was regarded as the postintervention assessment. This subsample was further restricted to users with a score greater than 5 on either the PHQ-9 or GAD-7 (mild distress or greater) at baseline. A paired t test was performed between the first and last assessments of the study period for this subset of users with chronic pain.

 Results Objective 1: Perceived Needs of Users With Chronic Pain

The thematic analysis yielded themes representative of the perceived needs and concerns of users with chronic pain. The themes (given in Figure 1) are health concerns, socioeconomic concerns, and pain management concerns.

Themes of messages from users with chronic pain (N=2194).

 Health Concerns

This theme indicates the perceived needs, concerns, and experiences of users with regard to their mental and physical health. It includes the subthemes of emotional distress, impact on self-image, and impact on physical health.

Emotional Distress

The users with chronic pain would often write to Wysa about strong emotional difficulties, such as anxiety, feeling low or depressed, panic attacks, frustration, and irritability, among others. Many were often concerned with how chronic pain tended to increase their stress and affect their mental health. Some found themselves “flooded with suicidal thoughts and negative emotions.” This concern for the effect of chronic pain on one’s mental health was clearly demonstrated by a user who reported “it’s taking a big toll on my mental health.” The relationship between emotional distress and pain would often be cyclical or bidirectional, with some reporting how their stress levels often aggravated the pain, for example, “I have lupus, fibromyalgia, and asthma, and they are triggered by my stress levels.”

 Impact on Self-Image

Chronic pain users often reported low self-confidence, with one user stating, “I am still young and having such a condition makes me feel inferior to other teens my age. I feel weak and useless” and others stating that they had “lower self-worth,” with the limitations impacting them deeply. A user said, “I have fibromyalgia, and it makes me feel like a failure at times.” Multiple users also reported having body image concerns, with some feeling “ugly” or feeling ashamed of how they appeared.

 Impact on Physical Health

Apart from the significant pain experienced, this group of users also reported a variety of issues related to their physical health. Many indicated disturbed sleep (“I can never sleep well”) and constant physical discomfort (“which means I can’t sit or stand or sleep properly”). They also worried about the possibility of their pain worsening and further physical distress. Some were “scared” of their upcoming surgeries. An often-reported issue was the limitations felt by users around physical activities and the resulting distress.

 Socioeconomic Concerns

The experiences that users with chronic pain shared with Wysa included their experiences of their social relationships and their experiences related to work and finances. The subthemes under this theme are financial and work-related concerns and social concerns.

Financial and Work-Related Concerns

Users with chronic pain often reported several financial and work-related concerns. While some reported that they were unable to perform to their full potential due to chronic pain, others stated that chronic pain was “increasing work stress” and the possibility of “burnout.” The pain would be so debilitating at times that they would often find themselves unemployed, as highlighted by another user who stated, “made it hard for me to find work.” This work-related concern was also demonstrated in a response from a user.

I had to leave work early because of back pain. I feel inadequate for not being able to work with this body. It's frustrating and I feel like a burden.

This concern was further compounded by worries about the future, for example, a user wrote, “make(s) me worry if I will be able to survive in a capitalist system and if I will be able to sustain myself,” and financial worries about therapy and medical bills. Another user made the below statement.

Nothing I have tried for fibromyalgia has helped. I can't afford therapy. I can't afford food. I'm scared about everything all the time.

 Social Concerns

Users with chronic pain often wrote to Wysa about how the pain limited their social interactions. This was clearly illustrated by a user who wrote, “couldn’t go out with my boyfriend to meet some friends” to portray how chronic pain could restrict someone’s mobility, preventing them from going out and socializing. Some users also reported how the pain and related health issues made them withdraw socially and reported feeling “lonely.” They also felt isolated in their pain and reported the feelings of not being understood, not receiving help in seeking professional help, and not being supported.

Well, I am in a relationship but seriously considering a split; he doesn’t help, he’s more of a hindrance. He argues with me when he's asked to help. I have chronic pain. He picks at the triggers as if it’s a game.

Some also talked about the gratitude they felt for being supported by their family members (“Even though I had a terrible migraine today, my husband just made me feel like I was his whole world. I felt so loved”), which further highlighted the need for social support in individuals with chronic pain. This wish for validation and support was expressed by a user who wrote to Wysa as follows:

I am diagnosed with a bunch of things like compressed disk and pain in my back and I also have arthritis in both of my knees … and a couple more things like neck problems. So, I just want everyone to say I understand how I feel, and everything will be okay and to just take it slow and take one step at a time and not rush or feel overwhelmed and tired.

 Pain Management Concerns

One of the most consistent themes across most of the users was pain management. Users would mention feeling “scared” of recurrence and of “living with it for a lifetime.” They would write about the intensity of pain and the difficulty in managing pain. Many directly asked Wysa for pain relief techniques and tools, for example, “Have you got any coping skills for chronic pain?” Some would state it as a goal for themselves, mentioning that they needed “help learning to live with chronic pain.” The want to learn pain acceptance was portrayed by a user who wrote the following:

I'm trying to be more compassionate with myself, but I have not been compassionate or patient with those parts of myself and the disorder. … But if I can accept it anyway, I might have a chance at relief. ….. I am listening to my body even when it is hard and even when it's not a perfect…. glamorous process. It's usually not.

 Objective 2: App Engagement and Disengagement of Users With Chronic Pain

The frequency of the tools used indicated that across all tool usage by users with chronic pain within the defined time period in Wysa, users used gratitude (22%), sleep meditations (20%), anxiety management and modulation (10%), mindfulness meditations for self-compassion (10%), thought recording (7%), and conflict resolution exercises (3%) most frequently. The frequency of engagement within the app was further validated by examining the conversational flows through a network analysis mapped using cleaned and weighted data points, which depicted similar usage (shown in Figure 2).

To evaluate the intensity of engagement, the number of paths for users was calculated for both groups, along with the length of the interaction in each pathway. For paths of all lengths (any, minimal, and above the threshold), the difference in engagement for users managing chronic pain was found to be significant using the Mann-Whitney U test, with a large effect size, as reported in Table 2.

Additionally, the analysis indicated that the points of disengagement (where users stopped engaging with the intervention) were from the same set of tools where the highest engagement was also noted. Gratitude, sleep, and thought recording were the most prominent in this list.

The most frequently used conversational flows for users with chronic pain (N=2194).

Mann-Whitney U test for the difference in app engagement between users with chronic pain and those without chronic pain.

Variable Users with chronic pain, n Users without chronic pain, n Effect size (Vargha and Delaney A) U P value
Paths of any length 2194 1880 0.803 (large) 3314141 <.001
Paths below the threshold for conversational units 1737 1258 0.760 (large) 1661594 <.001
Paths above the threshold for conversational units 2185 1525 0.791 (large) 2636905 <.001
Objective 3: Efficacy in Improving the Mental Health of Users With Chronic Pain

For both PHQ-9 and GAD-7 analyses, the paired t test indicated that there was a significant difference in the group means of the first and last assessments (PHQ-9: mean 13.22, SD 5.04 vs mean 10.03, SD 5.55; P<.001; GAD-7: mean 12.02, SD 4.47 vs mean 9.04, SD 5.15; P<.001) at the 95% confidence level, with medium effect sizes (PHQ-9: Cohen d=0.600; GAD-7: Cohen d=0.616).

 Discussion

This study aimed to evaluate the perceived needs of users, the engagement of users, and the effectiveness of Wysa for mental health outcomes among users who reported chronic pain and engaged with the CBT-based digital health app for support.

The thematic analysis indicated a number of mental health concerns that chronic pain users have, including emotional difficulties and self-image–related concerns. This observational study captured the experience of these difficulties through messages. The findings are consistent with the existing literature, which highlights the association of negative emotional experiences, such as anxiety and depression, with chronic pain [28,29]. Consistent with the literature, this study highlights the bidirectional relationship between pain and health (including physical health and mental health). The emerging themes from the qualitative analysis indicate that factors, such as stress, sleep disturbances, and anxiety about health, appear to influence the physical and mental health of users with chronic pain and also affect its relationship with pain. This relationship between mental health and chronic pain highlights the importance of the treatment of mental health conditions in chronic pain [30,31].

The conversational pathways frequented and the tools used reflected the needs that clients expressed to the AI conversational agent. For instance, the users expressed their distress regarding disturbed sleep, difficulty in managing negative thoughts, difficulty in interpersonal relationships, and self-image issues. Consistent with the perceived needs and the distress that users with chronic pain reported, the tools most used and conversational pathways most frequented involved techniques and tools that address these concerns, such as exercises for cognitive reframing, thought recording, gratitude, mindful compassion, sleep and mindfulness meditations, mindful compassion meditation, and conflict resolution exercises.

The user messages also depicted the isolating nature of pain, and how chronic pain users often found themselves with limited social interaction, and scarce understanding and support from family. It is thus not surprising that one of the most common conversational flows for need fulfillment was thought recording, where the users could openly write to Wysa about their thoughts and dilemmas. Being able to offer a space for disclosure is also perhaps indicative that AI apps are able to have authentic and human-level therapeutic bonds [32], which is perhaps reinforced because of the nonjudgemental atmosphere, complete anonymity, accessibility, and constant availability that the app provides.

An analysis of the in-app engagement of chronic pain users depicted a high need for support, evidenced by the number of sessions and the length of each session, which was significantly higher compared to nonchronic pain users on the app. The qualitative analysis further elaborated on the needs of the users by capturing the immense impact of chronic pain on their lives, which extended from their physical and mental health to the socioeconomic aspects of their lives. The themes revealed that the users have concerns far beyond medical services that are generally provided. Such needs have been documented in previous studies [33-35], and the findings of this study further reinforce this.

It is also important to note that while these are the most common conversational flows and most used tools, some of these app elements and tools also represent points at which some users disengaged with Wysa. This disengagement highlights that while there is a strong need, perhaps these users who disengage do not have the necessary resources or energy levels to engage with the app, given the overwhelming number of concerns that the users with chronic pain have to deal with, as indicated in the themes. Additionally, processes, such as catastrophizing and low frustration tolerance, have been found to be involved in the cognitive processes of chronic pain patients [36]. It is possible that low frustration tolerance along with an overwhelming number of concerns caused some chronic pain users to want quick relief solutions, as often evidenced in clinical practice [37], leading them to disengage with these tools due to frustration.

The findings of this study also indicate that users not only expressed the need for learning the skills of acceptance (as indicated in the theme pain management concerns), but also used the tools of CBT and Mindfulness, such as cognitive reframing exercises, gratitude exercises, mindful compassion, sleep meditations, and mindfulness meditations, as observed through path analyses. This perhaps indicates that users with chronic pain not only found these tools useful, but also continued to take these conversational paths multiple times because of the perceived usefulness. Our study further revealed significant improvements in both anxiety and depression in a subsample of users who completed the preassessment and postassessment. This evidence suggests that individuals with chronic pain can benefit from the CBT and acceptance-based tools present in Wysa. The value of these findings is highlighted when examined in light of prior literature where approaches, such as CBT, mindfulness, and acceptance-based interventions (eg, mindfulness-based stress reduction), have been found to be efficacious in the treatment of chronic pain [30,38,39] and are recommended lines of treatment.

This study has several limitations, and the findings should be interpreted in light of these limitations. This study is limited by the retrospective observational design. As such, the sample was nonrandomized, and this approach also precluded any conclusions of the causality of the effectiveness of interventions. The study was further limited because users were not required to complete assessments, limiting the study of efficacy to a small subsample. A major limitation of this study is that the data extraction keywords used were based on the guidelines of the International Association for the Study of Pain, extant literature, and the clinical experiences of the study researchers. However, despite efforts to have multiple sources for these keywords, these may not have included relevant terms or descriptions of pain. Another limitation is that the repeated measurements for efficacy, without a control group, could have raised the risk of regression to the mean [40]. The nonrandomized sampling of the design also limits the generalizability of the findings. Additionally, the third objective of the study was based on small samples, which further limits the generalizability of the findings of effectiveness, and the results should be interpreted as preliminary outcomes.

Despite the limitations, the findings of this study have important implications. This study, through its unique approach of user-led research, has highlighted the perceived needs and digital engagement patterns of users with chronic pain. Having a comprehensive understanding of the perceived needs and most frequented conversational paths of the users with chronic pain will help toward developing specific interventions, with improved product design and user experience. This could further help to study the effects of the interventions on a larger sample, with control groups (to account for effects such as regression to the mean), and to draw more generalizable conclusions. The study shows promising preliminary results for the use of AI in ameliorating mental health concerns among people with chronic pain. The findings suggest that digital interventions involving acceptance, CBT, and mindfulness-based therapies could be effective in meeting the needs, and could begin to bridge the gap between the demand for mental health support and the lack of adequate resources or personnel.

The findings of this retrospective study help in understanding the pervasive concerns and perceived needs of chronic pain users, and the patterns of their engagement and disengagement with the CBT-based AI mental health app Wysa. The results indicated clinically meaningful and significant improvements in the anxiety and depression scores of users with chronic pain. Though this study is limited by its retrospective design, it provides promising results for filling the gap within available treatments and supporting the needs of users with chronic pain through the use of digital mental health interventions.

 Abbreviations AI

artificial intelligence

 CBT

cognitive behavioral therapy

 GAD-7

Generalized Anxiety Disorder Assessment-7

 PHQ-9

Patient Health Questionnaire-9

CS and MK are employees of Wysa Inc and own equity in the company. SM has no conflict of interest to report.

 Goldberg DS McGee SJ Pain as a global public health priority BMC Public Health 2011 10 06 11 1 770 10.1186/1471-2458-11-770 21978149 1471-2458-11-770 PMC3201926 Elzahaf RA Tashani OA Unsworth BA Johnson MI The prevalence of chronic pain with an analysis of countries with a Human Development Index less than 0.9: a systematic review without meta-analysis Curr Med Res Opin 2012 07 28 7 1221 9 10.1185/03007995.2012.703132 22697274 Mills SE Nicolson KP Smith BH Chronic pain: a review of its epidemiology and associated factors in population-based studies Br J Anaesth 2019 08 123 2 e273 e283 10.1016/j.bja.2019.03.023 31079836 S0007-0912(19)30227-2 PMC6676152 Tunks ER Crook J Weir R Epidemiology of chronic pain with psychological comorbidity: prevalence, risk, course, and prognosis Can J Psychiatry 2008 04 01 53 4 224 34 10.1177/070674370805300403 18478825 Bair MJ Robinson RL Katon W Kroenke K Depression and pain comorbidity: a literature review Arch Intern Med 2003 11 10 163 20 2433 45 10.1001/archinte.163.20.2433 14609780 163/20/2433 Brennan F Lohman D Gwyther L Access to Pain Management as a Human Right Am J Public Health 2019 01 109 1 61 65 10.2105/ajph.2018.304743 Becker WC Dorflinger L Edmond SN Islam L Heapy AA Fraenkel L Barriers and facilitators to use of non-pharmacological treatments in chronic pain BMC Fam Pract 2017 03 20 18 1 41 10.1186/s12875-017-0608-2 28320337 10.1186/s12875-017-0608-2 PMC5359906 Phillips CJ The Cost and Burden of Chronic Pain Rev Pain 2009 06 3 1 2 5 10.1177/204946370900300102 26526940 10.1177_204946370900300102 PMC4590036 Hewitt S Sephton R Yeowell G The Effectiveness of Digital Health Interventions in the Management of Musculoskeletal Conditions: Systematic Literature Review J Med Internet Res 2020 06 05 22 6 e15617 10.2196/15617 32501277 v22i6e15617 PMC7305565 Basavarajappa C Chand PK Digital Platforms for Mental Health-care Delivery Indian J Psychol Med 2017 39 5 703 706 10.4103/IJPSYM.IJPSYM_209_17 29200576 IJPsyM-39-703 PMC5688907 de la Vega R Miró J mHealth: a strategic field without a solid scientific soul. a systematic review of pain-related apps PLoS One 2014 7 9 7 e101312 10.1371/journal.pone.0101312 24999983 PONE-D-14-09323 PMC4085095 Inkster B Sarda S Subramanian V An Empathy-Driven, Conversational Artificial Intelligence Agent (Wysa) for Digital Mental Well-Being: Real-World Data Evaluation Mixed-Methods Study JMIR Mhealth Uhealth 2018 11 23 6 11 e12106 10.2196/12106 30470676 v6i11e12106 PMC6286427 Kroenke K Spitzer RL Williams JBW The PHQ-9: validity of a brief depression severity measure J Gen Intern Med 2001 09 16 9 606 13 10.1046/j.1525-1497.2001.016009606.x 11556941 jgi01114 PMC1495268 Spitzer RL Kroenke K Williams JBW Löwe B A brief measure for assessing generalized anxiety disorder: the GAD-7 Arch Intern Med 2006 05 22 166 10 1092 7 10.1001/archinte.166.10.1092 16717171 166/10/1092 Revised Common Rule The U.S. Department of Health & Human Services 2022-04-10 https://www.hhs.gov/ohrp/regulations-and-policy/regulations/finalized-revisions-common-rule/index.html Keogh B Stenson K Hammond F Malec J Nick T Buschbacher R Observational Studies: Retrospective Versus Prospective Handbook for Clinical Research: Design, Statistics, and Implementation 2014 New York, NY, USA Demos Medical Publishing 23 26 Pérez-Sola V Roca M Alonso J Gabilondo A Hernando T Sicras-Mainar A Sicras-Navarro A Herrera B Vieta E Economic impact of treatment-resistant depression: A retrospective observational study J Affect Disord 2021 12 01 295 578 586 10.1016/j.jad.2021.08.036 34509073 S0165-0327(21)00841-7 Venkatesan A Rahimi L Kaur M Mosunic C Digital Cognitive Behavior Therapy Intervention for Depression and Anxiety: Retrospective Study JMIR Ment Health 2020 08 26 7 8 e21304 10.2196/21304 32845246 v7i8e21304 PMC7481876 Kunkle S Yip M Ξ W Hunt J Evaluation of an On-Demand Mental Health System for Depression Symptoms: Retrospective Observational Study J Med Internet Res 2020 06 18 22 6 e17902 10.2196/17902 32554387 v22i6e17902 PMC7333067 Douma S Petidis K Doumas M Papaefthimiou P Triantafyllou A Kartali N Papadopoulos N Vogiatzis K Zamboulis C Prevalence of primary hyperaldosteronism in resistant hypertension: a retrospective observational study The Lancet 2008 06 371 9628 1921 1926 10.1016/s0140-6736(08)60834-x Sagayadevan V Lee SP Abdin E Vaingankar J Chen H Chong SA Subramaniam M Retrospective observation of mental disorders during postpartum period: Results from the Singapore mental health study BMC Womens Health 2015 12 16 15 1 119 10.1186/s12905-015-0279-x 26674202 10.1186/s12905-015-0279-x PMC4682228 Perlman A Vodonos Zilberg A Bak P Dreyfuss M Leventer-Roberts M Vurembrand Y Jeffries HE Fisher E Steuerman Y Namir Y Goldschmidt Y Souroujon D Characteristics and Symptoms of App Users Seeking COVID-19-Related Digital Health Information and Remote Services: Retrospective Cohort Study J Med Internet Res 2020 10 20 22 10 e23197 10.2196/23197 32961527 v22i10e23197 PMC7609191 Zimmermann G Venkatesan A Rawlings K Scahill MD Improved Glycemic Control With a Digital Health Intervention in Adults With Type 2 Diabetes: Retrospective Study JMIR Diabetes 2021 06 02 6 2 e28033 10.2196/28033 34075880 v6i2e28033 PMC8209528 Treede R Rief W Barke A Aziz Q Bennett MI Benoliel R Cohen M Evers S Finnerup NB First MB Giamberardino MA Kaasa S Kosek E Lavand'homme P Nicholas M Perrot S Scholz J Schug S Smith BH Svensson P Vlaeyen JWS Wang S A classification of chronic pain for ICD-11 Pain 2015 06 156 6 1003 1007 10.1097/j.pain.0000000000000160 25844555 00006396-201506000-00006 PMC4450869 Braun V Clarke V Using thematic analysis in psychology Qualitative Research in Psychology 2006 01 3 2 77 101 10.1191/1478088706qp063oa Cherven K Network Graph Analysis and Visualization with Gephi 2013 Birmingham, UK Packt Publishing Ltd Bastian M Heymann S Jacomy M Gephi: An Open Source Software for Exploring and Manipulating Networks Proceedings of the International AAAI Conference on Web and Social Media 2009 Third International AAAI Conference on Weblogs and Social Media May 17–20, 2009 San Jose, CA 361 362 Sheng J Liu S Wang Y Cui R Zhang X The Link between Depression and Chronic Pain: Neural Mechanisms in the Brain Neural Plast 2017 2017 9724371 10.1155/2017/9724371 28706741 PMC5494581 Woo AK Depression and Anxiety in Pain Rev Pain 2010 03 4 1 8 12 10.1177/204946371000400103 26527193 10.1177_204946371000400103 PMC4590059 Hooten WM Chronic Pain and Mental Health Disorders: Shared Neural Mechanisms, Epidemiology, and Treatment Mayo Clin Proc 2016 07 91 7 955 70 10.1016/j.mayocp.2016.04.029 27344405 S0025-6196(16)30182-3 Goesling J Lin LA Clauw DJ Psychiatry and Pain Management: at the Intersection of Chronic Pain and Mental Health Curr Psychiatry Rep 2018 03 05 20 2 12 10.1007/s11920-018-0872-4 29504088 10.1007/s11920-018-0872-4 Bickmore T Gruber A Picard R Establishing the computer-patient working alliance in automated health behavior change interventions Patient Educ Couns 2005 10 59 1 21 30 10.1016/j.pec.2004.09.008 16198215 S0738-3991(04)00307-6 Chou L Cicuttini FM Urquhart DM Anthony SN Sullivan K Seneviwickrama M Briggs AM Wluka AE People with low back pain perceive needs for non-biomedical services in workplace, financial, social and household domains: a systematic review J Physiother 2018 04 64 2 74 83 10.1016/j.jphys.2018.02.011 29574167 S1836-9553(18)30018-3 Dewar A White M Posade S Dillon W Using nominal group technique to assess chronic pain, patients' perceived challenges and needs in a community health region Health Expect 2003 03 6 1 44 52 10.1046/j.1369-6513.2003.00208.x 12603627 208 PMC5060167 Hadi MA Alldred DP Briggs M Marczewski K Closs SJ 'Treated as a number, not treated as a person': a qualitative exploration of the perceived barriers to effective pain management of patients with chronic pain BMJ Open 2017 06 12 7 6 e016454 10.1136/bmjopen-2017-016454 28606909 bmjopen-2017-016454 PMC5541634 Suso-Ribera C Jornet-Gibert M Ribera Canudas MV McCracken LM Maydeu-Olivares A Gallardo-Pujol D There's More Than Catastrophizing in Chronic Pain: Low Frustration Tolerance and Self-Downing Also Predict Mental Health in Chronic Pain Patients J Clin Psychol Med Settings 2016 06 19 23 2 192 206 10.1007/s10880-016-9454-y 26995738 10.1007/s10880-016-9454-y Taylor D Managing Patients with Chronic Pain and Opioid Addiction 2015 Cham Springer International Publishing Morley S Eccleston C Williams A Systematic review and meta-analysis of randomized controlled trials of cognitive behaviour therapy and behaviour therapy for chronic pain in adults, excluding headache Pain 1999 03 80 1-2 1 13 10.1016/s0304-3959(98)00255-3 10204712 Veehof MM Trompetter HR Bohlmeijer ET Schreurs KMG Acceptance- and mindfulness-based interventions for the treatment of chronic pain: a meta-analytic review Cogn Behav Ther 2016 01 28 45 1 5 31 10.1080/16506073.2015.1098724 26818413 Yu R Chen L The need to control for regression to the mean in social psychology studies Front Psychol 2014 01 08 5 1574 10.3389/fpsyg.2014.01574 25620951 PMC4287101