Predicting therapy outcome in a digital mental health intervention for depression and anxiety: A machine learning approach.

OBJECTIVE: Predicting the outcomes of individual participants for treatment interventions appears central to making mental healthcare more tailored and effective. However, little work has been done to investigate the performance of machine learning-based predictions within digital mental health interventions. Therefore, this study evaluates the performance of machine learning in predicting treatment response in a digital mental health intervention designed for treating depression and anxiety. METHODS: Several algorithms were trained based on the data of 970 participants to predict a significant reduction in depression and anxiety symptoms using clinical and sociodemographic variables. As a random forest classifier performed best over cross-validation, it was used to predict the outcomes of 279 new participants. RESULTS: The random forest achieved an accuracy of 0.71 for the test set (base rate: 0.67, area under curve (AUC): 0.60, p = 0.001, balanced accuracy: 0.60). Additionally, predicted non-responders showed less average reduction of their Patient Health Questionnaire-9 (PHQ-9) (-2.7, p = 0.004) and General Anxiety Disorder Screener-7 values (-3.7, p < 0.001) compared to responders. Besides pre-treatment Patient Health Questionnaire-9 and General Anxiety Disorder Screener-7 values, the self-reported motivation, type of referral into the programme (self vs. healthcare provider) as well as Work Productivity and Activity Impairment Questionnaire items contributed most to the predictions. CONCLUSIONS: This study provides evidence that social-demographic and clinical variables can be used for machine learning to predict therapy outcomes within the context of a therapist-supported digital mental health intervention. Despite the overall moderate performance, this appears promising as these predictions can potentially improve the outcomes of non-responders by monitoring their progress or by offering alternative or additional treatment.

Significant reduction in depressive symptoms among patients with moderately-severe to severe depressive symptoms after participation in a therapist-supported, evidence-based mobile health program delivered via a smartphone app.

Depression is a debilitating disorder associated with poor health outcomes, including increased comorbidity and early mortality. Despite the advent of new digital health interventions, few have been tested among patients with more severe forms of depression. As such, in an intent-to-treat study we examined whether 218 patients with at least moderately severe depressive symptoms (PHQ-9 ≥ 15) experienced significant reductions in depressive symptoms after participation in a therapist-supported, evidence-based mobile health (mHealth) program, Meru Health Program (MHP). Patients with moderately severe and severe depressive symptoms at pre-program assessment experienced significant decreases in depressive symptoms at end-of treatment (mean [standard deviation] PHQ-9 reduction = 8.30 [5.03], Hedges' g = 1.64, 95% CI [1.44, 1.85]). Also, 34% of patients with at least moderately severe depressive symptoms at baseline and 29.9% of patients with severe depressive symptoms (PHQ-9 ≥ 20) at baseline responded to the intervention at end-of-treatment, defined as experiencing ≥50% reduction in PHQ-9 score and a post-program PHQ-9 score lower than 10. Limitations include use lack of a control group and no clinical diagnostic information. Future randomized trials are warranted to test the MHP as a scalable solution for patients with more severe depressive symptoms.

Effects of Mobile App-Based Intervention for Depression in Middle-Aged and Older Adults: Mixed Methods Feasibility Study.

BACKGROUND: Digital mental health interventions may help middle-aged and older adults with depression overcome barriers to accessing traditional care, but few studies have investigated their use in this population. OBJECTIVE: This pilot study examines the feasibility, acceptability, and potential efficacy of the Meru Health Program, an 8-week mobile app-delivered intervention. METHODS: A total of 20 community-dwelling middle-aged and older adults (age: mean 61.7 years, SD 11.3) with elevated depressive symptoms participated in a single-arm pilot study investigating the Meru Health Program, an app-delivered intervention supported by remote therapists. The program primarily uses mindfulness and cognitive behavioral skills to target depressive symptoms. A semistructured interview was completed at the baseline to establish current psychiatric diagnoses. Depressive symptoms were measured using the Patient Health Questionnaire and Patient-Reported Outcomes Measurement Information System (PROMIS) depression measures. Anxiety symptoms were measured using the Generalized Anxiety Disorder Scale and the PROMIS Anxiety measure. User experience and acceptability were examined through surveys and qualitative interviews. RESULTS: In total, 90% (18/20) of the participants completed the program, with 75% (15/20) completing at least 7 of the 8 introductory weekly lessons. On average, participants completed 60 minutes of practice and exchanged 5 messages with their therapists every week. The app was rated as helpful by 89% (17/19) participants. Significant decreases in depressive (P=.03) and anxiety symptom measures (P=.01) were found; 45% (9/20) of participants showed clinically significant improvement in either depressive symptoms or anxiety symptoms. CONCLUSIONS: The findings suggest that the commercially available Meru Health Program may be feasible, acceptable, and potentially beneficial to middle-aged and older adults. Although larger controlled trials are needed to demonstrate efficacy, these findings suggest that digital health interventions may benefit adults of all ages.

Feasibility and Efficacy of the Addition of Heart Rate Variability Biofeedback to a Remote Digital Health Intervention for Depression.

A rise in the prevalence of depression underscores the need for accessible and effective interventions. The objectives of this study were to determine if the addition of a treatment component showing promise in treating depression, heart rate variability-biofeedback (HRV-B), to our original smartphone-based, 8-week digital intervention was feasible and whether patients in the HRV-B ("enhanced") intervention were more likely to experience clinically significant improvements in depressive symptoms than patients in our original ("standard") intervention. We used a quasi-experimental, non-equivalent (matched) groups design to compare changes in symptoms of depression in the enhanced group (n = 48) to historical outcome data from the standard group (n = 48). Patients in the enhanced group completed a total average of 3.86 h of HRV-B practice across 25.8 sessions, and were more likely to report a clinically significant improvement in depressive symptom score post-intervention than participants in the standard group, even after adjusting for differences in demographics and engagement between groups (adjusted OR 3.44, 95% CI [1.28-9.26], P = .015). Our findings suggest that adding HRV-B to an app-based, smartphone-delivered, remote intervention for depression is feasible and may enhance treatment outcomes.

Long-Term Outcomes of a Therapist-Supported, Smartphone-Based Intervention for Elevated Symptoms of Depression and Anxiety: Quasiexperimental, Pre-Postintervention Study.

BACKGROUND: Depression is one of the most common mental health disorders and severely impacts one's physical, psychological, and social functioning. To address access barriers to care, we developed Ascend-a smartphone-delivered, therapist-supported, 8-week intervention based on several evidence-based psychological treatments for depression and anxiety. A previous feasibility study with 102 adults with elevated depression reported that Ascend is associated with a postintervention reduction in depression symptoms. OBJECTIVE: We aimed to examine whether Ascend is associated with a reduction in symptoms of anxiety, and importantly, whether reductions in symptoms of depression and anxiety are maintained up to 12-months postintervention. METHODS: We assessed whether the previously reported, end-of-treatment improvements seen in the 102 adults with elevated symptoms of depression extended up to 12 months posttreatment for depression symptoms (measured by the Patient Health Questionnaire-9 [PHQ-9]) and up to 6 months posttreatment for anxiety symptoms (added to the intervention later and measured using the Generalized Anxiety Disorder-7 [GAD-7] scale). We used linear mixed effects models with Tukey contrasts to compare time points and reported intention-to-treat statistics with a sensitivity analysis. RESULTS: The intervention was associated with reductions in symptoms of depression that were maintained 12 months after the program (6.67-point reduction in PHQ-9 score, 95% CI 5.59-7.75; P<.001; Hedges g=1.14, 95% CI 0.78-1.49). A total of 60% of the participants with PHQ-9 scores above the cutoff for major depression at baseline (PHQ≥10) reported clinically significant improvement at the 12-month follow-up (at least 50% reduction in PHQ-9 score and postprogram score <10). Participants also reported reductions in symptoms of anxiety that were maintained for at least 6 months after the program (4.26-point reduction in GAD-7 score, 95% CI 3.14-5.38; P<.001; Hedges g=0.91, 95% CI 0.54-1.28). CONCLUSIONS: There is limited evidence on whether outcomes associated with smartphone-based interventions for common mental health problems are maintained posttreatment. Participants who enrolled in Ascend experienced clinically significant reductions in symptoms of depression and anxiety that were maintained for up to 1 year and 6 months after the intervention, respectively. Future randomized trials are warranted to test Ascend as a scalable solution to the treatment of depression and anxiety.

Feasibility of a Therapist-Supported, Mobile Phone-Delivered Online Intervention for Depression: Longitudinal Observational Study.

BACKGROUND: Depression is a very common condition that impairs functioning and is often untreated. More than 60% of the treatments for depressive disorder are administered in primary care settings by care providers who lack the time and expertise to treat depression. To address this issue, we developed Ascend, a therapist-supported, mobile phone-delivered 8-week intervention administered at the Meru Health Online Clinic in Finland. OBJECTIVE: We conducted two pilot studies to examine the feasibility of the Ascend intervention, specifically, dropout rates, daily practice, weekly group chat use, and changes in depression symptoms. We also explored whether daily practice and weekly group chat use were associated with changes in depression symptoms. METHODS: A total of 117 Finnish adults with elevated depressive symptoms enrolled in Ascend, a program that included daily cognitive behavioral and mindfulness meditation exercises delivered through a mobile phone app, anonymous group chat with other users, and chat/phone access to a licensed therapist. Eight weekly themes were delivered in a fixed, sequential format. Depression symptoms were measured at baseline, every second week during the intervention, immediately after the intervention, and 4 weeks after completion of the intervention. Data were analyzed using intent-to-treat repeated-measures analysis of variance and linear regression models. RESULTS: For studies 1 and 2, we observed dropout rates of 27% and 15%, respectively, decreasing daily practice and group chat use, and decreased depression symptoms from baseline to immediately and 4 weeks after the intervention (P<.001). We found that both more daily practice and chat group use predicted the occurrence of fewer depressive symptoms at 4 weeks postintervention (Study 1: ∆R2=.38, P=.004 and ∆R2=.38, P=.002, respectively; Study 2: ∆R2=.16, P<.001 and ∆R2=.08, P=.002, respectively). CONCLUSIONS: This therapist-supported, mobile phone-delivered treatment for depression is feasible and associated with reduced depression symptoms. Design features that enhance daily practice and group chat use are areas of future investigation. Validation of these results using a controlled study design is needed to establish the evidence base for the Ascend intervention.