Voice Assistants for Mental Health Services: Designing Dialogues with Homebound Older Adults.

The number of older adults who are homebound with depressive symptoms is increasing. Due to their homebound status, they have limited access to trained mental healthcare support, which leaves this support often to untrained family caregivers. To increase access, a growing interest is placed on using technology-mediated solutions, such as voice-assisted intelligent personal assistants (VIPAs), to deliver mental health services to older adults. To better understand how older adults and family caregivers intend to interact with a VIPA for mental health interventions, we conducted a participatory design study during which 6 older adults and 7 caregivers designed VIPA-human dialogues for various scenarios. Using conversation style preferences as a starting point, we present aspects of human-likeness older adults and family caregivers perceived as helpful or uncanny, specifically in the context of the delivery of mental health interventions, which helps inform potential roles VIPAs can play in mental healthcare for older adults.

Developing Social Enhancements for a Web-Based, Positive Emotion Intervention for Alzheimer Disease Caregivers: Qualitative Focus Group and Interview Study.

BACKGROUND: Alzheimer disease is a degenerative neurological condition that requires long-term care. The cost of these responsibilities is often borne by informal caregivers, who experience an elevated risk of negative physical and psychological outcomes. Previously, we designed a positive emotion regulation intervention that was shown to improve well-being among dementia caregivers when delivered through one-on-one videoconferencing lessons with a trained facilitator. However, the format required significant resources in terms of logistics and facilitator time. To broaden the reach of the intervention, we aimed to develop the Social Augmentation of Self-Guided Electronic Delivery of the Life Enhancing Activities for Family Caregivers (SAGE LEAF) program, an iteration of the intervention in a self-guided, web-based format with enhanced opportunities for social connection. OBJECTIVE: The aim of this study was to gather feedback to inform the design of social features for the SAGE LEAF intervention. In the absence of a facilitator, our goal with the self-guided SAGE LEAF intervention was to integrate various social features (eg, discussion board, automated support, and profiles) to maximize engagement among participants. METHODS: Qualitative data were collected from 26 individuals through (1) interviews with participants who completed a previous version of the intervention via videoconferencing with a facilitator, (2) focus groups with dementia caregivers who had not previously experienced the intervention, and (3) focus groups with Alzheimer disease clinical care providers. We conducted a qualitative thematic analysis to identify which social features would be the most helpful and how they could be implemented in a way that would be best received by caregivers. RESULTS: Interview and focus group feedback indicated that participants generally liked the potential features suggested, including the discussion boards, multimedia content, and informational support. They had valuable suggestions for optimal implementation. For example, participants liked the idea of a buddy system where they would be matched up with another caregiver for the duration of the study. However, they expressed concern about differing expectations among caregivers and the possibility of matched caregivers not getting along. Participants also expressed interest in giving caregivers access to a podcast on the skills, which would allow them to review additional content when they wished. CONCLUSIONS: Taken together, the discussions with caregivers and providers offered unique insights into the types of social features that may be integrated into the SAGE LEAF intervention, as well as implementation suggestions to improve the acceptability of the features among caregivers. These insights will allow us to design social features for the intervention that are optimally engaging and helpful for caregivers.

"Our Job is to be so Temporary": Designing Digital Tools that Meet the Needs of Care Managers and their Patients with Mental Health Concerns.

Digital tools have potential to support collaborative management of mental health conditions, but we need to better understand how to integrate them in routine healthcare, particularly for patients with both physical and mental health needs. We therefore conducted interviews and design workshops with 1) a group of care managers who support patients with complex health needs, and 2) their patients whose health needs include mental health concerns. We investigate both groups' views of potential applications of digital tools within care management. Findings suggest that care managers felt underprepared to play an ongoing role in addressing mental health issues and had concerns about the burden and ambiguity of providing support through new digital channels. In contrast, patients envisioned benefiting from ongoing mental health support from care managers, including support in using digital tools. Patients' and care managers' needs may diverge such that meeting both through the same tools presents a significant challenge. We discuss how successful design and integration of digital tools into care management would require reconceptualizing these professionals' roles in mental health support.

From formative design to service-ready therapeutic: A pragmatic approach to designing digital mental health interventions across domains.

As digital mental health interventions (DMHIs) proliferate, there is a growing need to understand the complexities of moving these tools from concept and design to service-ready products. We highlight five case studies from a center that specializes in the design and evaluation of digital mental health interventions to illustrate pragmatic approaches to the development of digital mental health interventions, and to make transparent some of the key decision points researchers encounter along the design-to-product pipeline. Case studies cover different key points in the design process and focus on partnership building, understanding the problem or opportunity, prototyping the product or service, and testing the product or service. We illustrate lessons learned and offer a series of questions researchers can use to navigate key decision points in the digital mental health intervention (DMHI) development process.

Acceptability and Feasibility of a Socially Enhanced, Self-Guided, Positive Emotion Regulation Intervention for Caregivers of Individuals With Dementia: Pilot Intervention Study.

BACKGROUND: The responsibilities of being a primary caregiver for a loved one with dementia can produce significant stress for the caregiver, leading to deleterious outcomes for the caregiver's physical and psychological health. Hence, researchers are developing eHealth interventions to provide support for caregivers. Members of our research team previously developed and tested a positive emotion regulation intervention that we delivered through videoconferencing, in which caregiver participants would meet one-on-one with a trained facilitator. Although proven effective, such delivery methods have limited scalability because they require significant resources in terms of cost and direct contact hours. OBJECTIVE: This study aimed to conduct a pilot test of a socially enhanced, self-guided version of the positive emotion regulation intervention, Social Augmentation of Self-Guided Electronic Delivery of the Life Enhancing Activities for Family Caregivers (SAGE LEAF). Studies have shown that social presence or the perception of others in a virtual space is associated with enhanced learning and user satisfaction. Hence, the intervention leverages various social features (eg, discussion boards, podcasts, videos, user profiles, and social notifications) to foster a sense of social presence among participants and study team members. METHODS: Usability, usefulness, feasibility, and acceptability data were collected from a pilot test in which participants (N=15) were given full access to the SAGE LEAF intervention over 6 weeks and completed preintervention and postintervention assessments (10/15, 67%). Preliminary outcome measures were also collected, with an understanding that no conclusions about efficacy could be made, because our pilot study did not have a control group and was not sufficiently powered. RESULTS: The results suggest that SAGE LEAF is feasible, with participants viewing an average of 72% (SD 42%) of the total available intervention web pages. In addition, acceptability was found to be good, as demonstrated by participants' willingness to recommend the SAGE LEAF program to a friend or other caregiver. Applying Pearson correlational analyses, we found moderate, positive correlation between social presence scores and participants' willingness to recommend the program to others (r9=0.672; P=.03). We also found positive correlation between social presence scores and participants' perceptions about the overall usefulness of the intervention (r9=0.773; P=.009). This suggests that participants' sense of social presence may be important for the feasibility and acceptability of the program. CONCLUSIONS: In this pilot study, the SAGE LEAF intervention demonstrates potential for broad dissemination for dementia caregivers. We aim to incorporate participant feedback about how the social features may be improved in future iterations to enhance usability and to further bolster a sense of social connection among participants and study staff members. Next steps include partnering with dementia clinics and other caregiver-serving organizations across the United States to conduct a randomized controlled trial to evaluate the effectiveness of the intervention.

Preparing a Workforce of Care Coordinators to Address Patient Mental Health Needs in the Digital Age: Training and Needs Identification.

Introduction: Care coordinators (CCs) are specialized healthcare providers and often the primary point of contact for patients with multiple medical and mental health comorbidities in integrated healthcare settings. Prior work shows CCs have lower comfort addressing mental health than physical health concerns. Digital mental health interventions can support CCs' management of patient mental health needs, but training gaps must be addressed prior to a digital mental health intervention's implementation. Methods: As part of a quality improvement initiative, a 1-hour training focused on the assessment and management of depression and suicide-related thoughts and behaviors was delivered to CCs within a large midwestern healthcare system's Division of Ambulatory Care Coordination. CCs completed online surveys prior to and following the training. Conclusion: Training resulted in increased comfort working with clinical populations, including patients who experience suicide-related thoughts and behaviors. Gains around screening for suicide risk were modest. Brief trainings for CCs can address training gaps, however, ongoing training and case consultation may also be indicated.

Remote Cognitive Screening Of Healthy Older Adults for Primary Care With the MyCog Mobile App: Iterative Design and Usability Evaluation.

BACKGROUND: Annual cognitive screening in adults aged >65 years can improve early detection of cognitive impairment, yet less than half of all cases are identified in primary care. Time constraints in primary care settings present a major barrier to routine screening. A remote cognitive screener completed on a patient's own smartphone before a visit has the potential to save primary care clinics time, encourage broader screening practices, and increase early detection of cognitive decline. OBJECTIVE: We described the iterative design and proposed the implementation of a remote cognitive screening app, MyCog Mobile, to be completed on a patient's smartphone before an annual wellness visit. The research questions were as follows: What would motivate primary care clinicians and clinic administrators to implement a remote cognitive screening process? How might we design a remote cognitive screener to fit well with existing primary care workflows? What would motivate an older adult patient to complete a cognitive screener on a smartphone before a primary care visit? How might we optimize the user experience of completing a remote cognitive screener on a smartphone for older adults? METHODS: To address research questions 1 and 2, we conducted individual interviews with clinicians (n=5) and clinic administrators (n=3). We also collaborated with clinic administrators to create user journey maps of their existing and proposed MyCog Mobile workflows. To address research questions 3 and 4, we conducted individual semistructured interviews with cognitively healthy older adults (n=5) and solicited feedback from a community stakeholder panel (n=11). We also tested and refined high-fidelity prototypes of the MyCog Mobile app with the older adult interview participants, who rated the usability on the Simplified System Usability Scale and After-Scenario Questionnaire. RESULTS: Clinicians and clinic administrators were motivated to adopt a remote cognitive screening process if it saved time in their workflows. Findings from interviews and user journey mapping informed the proposed implementation and core functionality of MyCog Mobile. Older adult participants were motivated to complete cognitive screeners to ensure that they were cognitively healthy and saw additional benefits to remote screening, such as saving time during their visit and privacy. Older adults also identified potential challenges to remote smartphone screening, which informed the user experience design of the MyCog Mobile app. The average rating across prototype versions was 91 (SD 5.18) on the Simplified System Usability Scale and 6.13 (SD 8.40) on the After-Scenario Questionnaire, indicating above-average usability. CONCLUSIONS: Through an iterative, human-centered design process, we developed a viable remote cognitive screening app and proposed an implementation strategy for primary care settings that was optimized for multiple stakeholders. The next steps include validating the cognitive screener in clinical and healthy populations and piloting the finalized app in a community primary care clinic.

The Perceived Utility of Smartphone and Wearable Sensor Data in Digital Self-tracking Technologies for Mental Health.

Mental health symptoms are commonly discovered in primary care. Yet, these settings are not set up to provide psychological treatment. Digital interventions can play a crucial role in stepped care management of patients' symptoms where patients are offered a low intensity intervention, and treatment evolves to incorporate providers if needed. Though digital interventions often use smartphone and wearable sensor data, little is known about patients' desires to use these data to manage mental health symptoms. In 10 interviews with patients with symptoms of depression and anxiety, we explored their: symptom self-management, current and desired use of sensor data, and comfort sharing such data with providers. Findings support the use digital interventions to manage mental health, yet they also highlight a misalignment in patient needs and current efforts to use sensors. We outline considerations for future research, including extending design thinking to wraparound services that may be necessary to truly reduce healthcare burden.

Insights Into Needs and Preferences for Mental Health Support on Social Media and Through Mobile Apps Among Black Male University Students: Exploratory Qualitative Study.

BACKGROUND: Black college-aged men are less likely than their peers to use formal, therapeutic in-person services for mental health concerns. As the use of mobile technologies and social media platforms is steadily increasing, it is important to conduct work that examines the future utility of digital tools and technologies to improve access to and uptake of mental health services for Black men and Black men in college. OBJECTIVE: The aim of this study was to identify and understand college-attending Black men's needs and preferences for using digital health technologies and social media for stress and mental health symptom management. METHODS: Interviews were conducted with Black male students (N=11) from 2 racially diverse universities in the Midwestern United States. Participants were asked questions related to their current mental health needs and interest in using social media platforms and mobile-based apps for their mental health concerns. A thematic analysis was conducted. RESULTS: Four themes emerged from the data: current stress relief strategies, technology-based support needs and preferences (subthemes: mobile-based support and social media-based support), resource information dissemination considerations (subthemes: information-learning expectations and preferences and information-sharing preferences and behaviors), and technology-based mental health support design considerations (subtheme: relatability and representation). Participants were interested in using social media and digital technologies for their mental health concerns and needs, for example, phone notifications and visual-based mental health advertisements that promote awareness. Relatability in the context of representation was emphasized as a key factor for participants interested in using digital mental health tools. Examples of methods for increasing relatability included having tools disseminated by minority-serving organizations and including components explicitly portraying Black men engaging in mental health support strategies. The men also discussed wanting to receive recommendations for stress relief that have been proven successful, particularly for Black men. CONCLUSIONS: The findings from this study provide insights into design and dissemination considerations for future work geared toward developing mental health messaging and digital interventions for young Black men.

Examining Hashtag Use of #blackboyjoy and #theblackmancan and Related Content on Instagram: Descriptive Content Analysis.

BACKGROUND: Social media is widely accessible and increasingly utilized. Social media users develop hashtags and visual, text-based imagery to challenge misrepresentations, garner social support, and discuss a variety of mental health issues. Understanding how Black men are represented on social media and are using social media may be an avenue for promoting their engagement with and uptake of digital mental health interventions. OBJECTIVE: The aim of this study was to conduct a content analysis of posts containing visual and text-based components related to representations of Black men's race, gender, and behaviors. METHODS: An exploratory, descriptive content analysis was conducted for 500 Instagram posts to examine characteristics, content, and public engagement of posts containing the hashtags #theblackmancan and #blackboyjoy. Posts were selected randomly and extracted from Instagram using a social network mining tool during Fall 2018 and Spring 2019. A codebook was developed, and all posts were analyzed by 2 independent coders. Analyses included frequency counts and descriptive analysis to determine content and characteristics of posts. Mann-Whitney U tests and Kruskal-Wallis H tests were conducted to assess engagement associated with posts via likes, comments, and video views. RESULTS: Of the 500 posts extracted, most were image based (368/500, 73.6%), 272/500 (54.4%) were posted by an individual and 135/500 (27.0%) by a community organization, 269/500 (53.8%) were posted by individuals from Black populations, and 177/500 (35.4%) posts contained images of only males. Posts depicted images of Black men as fathers (100/500, 20.0%), Black men being celebrated (101/500, 20.2%), and Black men expressing joy (217/500, 43.4%). Posts (127/500, 25.4%) also depicted Black men in relation to gender atypical behavior, such as caring for children or styling their children's hair. Variables related to education and restrictive affection did not show up often in posts. Engagement via likes (median 1671, P<.001), comments (P<.001), and views (P<.001) for posts containing #theblackmancan was significantly higher compared with posts containing #blackboyjoy (median 140). Posts containing elements of celebrating Black men (P=.02) and gender atypical behavior (P<.001) also had significantly higher engagement. CONCLUSIONS: This is one of the first studies to look at hashtag use of #blackboyjoy and #theblackmancan. Posts containing #blackboyjoy and #theblackmancan promoted positive user-generated visual and text-based content on Instagram and promoted positive interactions among Black and diverse communities. With the popularity of social media and hashtag use increasing, researchers and future interventional research should investigate the potential for such imagery to serve as culturally relevant design components for digital mental health prevention efforts geared towards Black men and the communities they exist and engage with.

Involving Crowdworkers with Lived Experience in Content-Development for Push-Based Digital Mental Health Tools: Lessons Learned from Crowdsourcing Mental Health Messages.

Digital tools can support individuals managing mental health concerns, but delivering sufficiently engaging content is challenging. This paper seeks to clarify how individuals with mental health concerns can contribute content to improve push-based mental health messaging tools. We recruited crowdworkers with mental health symptoms to evaluate and revise expert-composed content for an automated messaging tool, and to generate new topics and messages. A second wave of crowdworkers evaluated expert and crowdsourced content. Crowdworkers generated topics for messages that had not been prioritized by experts, including self-care, positive thinking, inspiration, relaxation, and reassurance. Peer evaluators rated messages written by experts and peers similarly. Our findings also suggest the importance of personalization, particularly when content adaptation occurs over time as users interact with example messages. These findings demonstrate the potential of crowdsourcing for generating diverse and engaging content for push-based tools, and suggest the need to support users in meaningful content customization.

Remote-delivered services during COVID-19: A mixed-methods survey of college counseling center clinicians.

OBJECTIVE: The COVID-19 pandemic has drastically increased use of remote-delivered mental health services. This study identifies advantages and limitations of remote-delivered services on college campuses to inform mental health delivery post-pandemic. Methods: Clinicians (n = 30) were asked to evaluate COVID-19's impact on their work, environment, and wellness in an online survey. Qualitative data was coded using a thematic analysis approach, while quantitative data was analyzed using descriptive statistics. Results: Many clinicians reported benefits of remote services, including increased accessibility, greater convenience, no change in therapeutic alliance, and decreased stress for clinicians. Clinicians also experienced challenges such as social isolation, technological difficulties, and personal/family concerns. Clinicians envisioned a hybrid service combining online and in-person activities post-pandemic. Conclusions: Overall, remote-delivered mental health services on college campuses have potential in increasing treatment quality while highlighting a necessity for further research in hybrid mental health delivery.Supplemental data for this article can be accessed online at https://doi.org/10.1080/07448481.2022.2038178 .

Uptake and effectiveness of a self-guided mobile app platform for college student mental health.

BACKGROUND: College students endorse high rates of mental health problems. While many colleges offer on-campus services, many students who could benefit from mental health services do not receive care. Indeed, nearly half of students who screen positive for depression, for example, do not receive treatment. Digital mental health programs, such as those delivered via mobile apps, may help expand access to mental health care and resources. This mixed-methods study aims to examine the uptake and effectiveness of an implementation of IntelliCare for College Students, a self-guided app-based mental health platform, on two university campuses. METHODS: Data on counseling center utilization was collected prior to the implementation of the app (pre-implementation phase) and while the app was available on campus (implementation phase). Data on app usage was collected throughout the implementation phase. A subset of participants (n = 20), along with counseling center staff members (n = 10), completed feedback interviews. RESULTS: Overall, uptake of the app platform was low. A total of 117 participants downloaded the app and registered their study ID during the implementation phase. Approximately 24% (28/117) of participants used the app only once. The number of days between the first and last day of app use ranged from 0 to 299, with a mean of 35.01 days and a median of 14 days. A relatively small portion of the sample (26.5%; 31/117) downloaded one or more of the IntelliCare interactive apps. In examining counseling center utilization, there were no significant changes in intake appointments, individual therapy sessions, or crisis appointments observed from the pre-implementation phase to the implementation phase of the study. Feedback interviews highlighted the significant level of disruption caused by the COVID-19 pandemic and shift to remote learning, including challenges disseminating information to students and a preference to spend less time with digital devices outside of class time. CONCLUSIONS: Findings from this study indicate that there is an ongoing need to identify ways to reach college students and support student mental health and wellness for the remainder of the COVID-19 pandemic and beyond.

Aligning students and counseling centers on student mental health needs and treatment resources.

ObjectiveTo recognize gaps between students' expectations of college counseling centers and centers' current practices and to identify strategies to improve care from both clinicians and students. Participants: As part of an ongoing study on mobile technologies for stress management, we gathered data from counseling center clinicians and students at two large Midwestern universities. Methods: Clinicians completed online questionnaires on their current practices and interest in digital mental health tools. Students and clinicians completed co-design workshops. In subsequent individual interviews, students identified barriers to care. Results: Both students and clinicians recognized a need for stress management and mental health support outside of counseling sessions. Conclusions: Students and clinicians recognize barriers to face-to-face therapy and are eager to collaborate to identify opportunities to address barriers to mental health services. We discuss digital mental health tools as a potential opportunity for support and benefits of including students in discussions of treatment resources.

An overview of and recommendations for more accessible digital mental health services.

Mental health concerns are common, and various evidence-based interventions for mental health conditions have been developed. However, many people have difficulty accessing appropriate mental health care and this has been exacerbated by the COVID-19 pandemic. Digital mental health services, such as those delivered by mobile phone or web-based platforms, offer the possibility of expanding the reach and accessibility of mental health care. To achieve this goal, digital mental health interventions and plans for their implementation must be designed with the end users in mind. In this Review, we describe the evidence base for digital mental health interventions across various diagnoses and treatment targets. Then, we explain the different formats for digital mental health intervention delivery, and offer considerations for their use across key age groups. We discuss the role that the COVID-19 pandemic has played in emphasizing the value of these interventions, and offer considerations for ensuring equity in access to digital mental health interventions among diverse populations. As healthcare providers continue to embrace the role that technology can play in broadening access to care, the design and implementation of digital mental healthcare solutions must be carefully considered to maximize their effectiveness and accessibility.

Accessibility of mental health support in China and preferences on web-based services for mood disorders: A qualitative study.

BACKGROUND: The fast development of mobile technologies provides promising opportunities to fulfill the largely unmet needs of treatment and recovery for mood disorders in China. However, with limited research from China, the development of acceptable and usable web-based mental health services that are based on preference of patients from China still remains a challenge. OBJECTIVE: The aims of this paper were to (1) understand the experience of patients with mood disorders on current accessibility of mental health support in China; and (2) to get insights on patients' preferences on web-based mental health services, so as to provide suggestions for the future development of web-based mental health services for mood disorders in China. METHODS: Semi-structured interviews were conducted with 10 female participants diagnosed with depression and 7 with bipolar disorder (5 female and 2 male) via the audio chat function of WeChat. The interviews were 60-90 min long and were audio-recorded and transcribed verbatim. Thematic analysis was conducted using QSR NVivo 12 to identify and establish themes and sub-themes. RESULTS: Two major sections of results with a total of 5 themes were identified. The first section was participants' treatment and recovery experience, which included three main themes: (1) professional help seeking experience; (2) establishment of self-help strategies; and (3) complex experiences from various source of social support. The second section was focused on preferences for web-based services, which were divided into two themes: (1) preferred support and features, with three sub-themes: as channels to access professionals, as databases for self-help resources, and as sources of social support; and (2) preferred modality. CONCLUSIONS: The access to mental health support for personal recovery of mood disorders in China was perceived by participants as not sufficient. Web-based mental health services that include professional, empathetic social support from real humans, and recovery-oriented, personalized self-help resources are promising to bridge the gap. The advantages of social media like WeChat were emphasized for patients in China. More user-centered research based on social, economic and cultural features are needed for the development of web-based mental health services in China.

The effect of depression and anxiety symptom severity on clinical outcomes and app use in digital mental health treatments: Meta-regression of three trials.

A large number of trials have consistently shown that guided digital mental health treatments (DMHTs) are effective for depression and anxiety. As DMHTs are adopted by healthcare organizations, payers, and employers, they are often considered most appropriate for people with mild-to-moderate levels of symptom severity. Thus, the aim of this study was to examine the effects of symptom severity on depression and anxiety outcomes and app use across three trials of a guided DMHT, IntelliCare. Participants were categorized into mild, moderate, moderately severe, and severe symptom severity groups on depression and anxiety. All symptom severity groups showed significant reductions in depression and anxiety in a clear ordinal pattern, with the mild symptom severity group showing the smallest changes and the severe symptom group showing the largest improvements. Those with the lowest levels of educational attainment showed the largest symptom improvement. Baseline symptom severity was not significantly related to app use. App use was significantly related to depression and anxiety outcomes. These findings suggest that depression and anxiety symptom severity is not useful in determining who should be referred to a guided DMHT.

Integration of Digital Tools Into Community Mental Health Care Settings That Serve Young People: Focus Group Study.

BACKGROUND: Digital mental health tools have substantial potential to be easily integrated into people's lives and fundamentally impact public health. Such tools can extend the reach and maximize the impact of mental health interventions. Before implementing digital tools in new settings, it is critical to understand what is important to organizations and individuals who will implement and use these tools. Given that young people are highly familiar with technology and many mental health concerns emerge in childhood and adolescence, it is especially crucial to understand how digital tools can be integrated into settings that serve young people. OBJECTIVE: This study aims to learn about considerations and perspectives of community behavioral health care providers on incorporating digital tools into their clinical care for children and adolescents. METHODS: Data were analyzed from 5 focus groups conducted with clinicians (n=37) who work with young people at a large community service organization in the United States. This organization provides care to more than 27,000 people annually, most of whom are of low socioeconomic status. The transcripts were coded using thematic analysis. RESULTS: Clinicians first provided insight into the digital tools they were currently using in their treatment sessions with young people, such as web-based videos and mood-tracking apps. They explained that their main goals in using these tools were to help young people build skills, facilitate learning, and monitor symptoms. Benefits were expressed, such as engagement of adolescents in treatment, along with potential challenges (eg, accessibility and limited content) and developmental considerations (eg, digital devices getting taken away as punishment). Clinicians discussed their desire for a centralized digital platform that securely connects the clinician, young person, and caregivers. Finally, they offered several considerations for integrating digital tools into mental health care, such as setting up expectations with clients and the importance of human support. CONCLUSIONS: Young people have unique considerations related to complex accessibility patterns and technology expectations that may not be observed when adults are the intended users of mental health technologies. Therefore, these findings provide critical insights to inform the development of future tools, specifically regarding connectivity, conditional restraints (eg, devices taken away as punishment and school restrictions), expectations of users from different generations, and the blended nature in which digital tools can support young people.

Targeting subjective engagement in experimental therapeutics for digital mental health interventions.

Engagement is a multifaceted construct and a likely mechanism by which digital interventions achieve clinical improvements. To date, clinical research on digital mental health interventions (DMHIs) has overwhelmingly defined engagement and assessed its association with clinical outcomes through the objective/behavioral metrics of use of or interactions with a DMHI, such as number of log-ins or time spent using the technology. However, engagement also entails users' subjective experience. Research is largely lacking that tests the relationship between subjective metrics of engagement and clinical outcomes. The purpose of this study is to present a proof-of-concept exploratory evaluation of the association between subjective engagement measures of a mobile DMHI with changes in depression and anxiety. Adult primary care patients (N = 146) who screened positive for depression or anxiety were randomized to receive a DMHI, IntelliCare, immediately or following an 8-week waitlist. Subjective engagement was measured via the Usefulness, Satisfaction, and Ease of Use (USE) Questionnaire. Across both conditions, results showed that individuals who perceived a mobile intervention as more useful, easy to use and learn, and satisfying had greater improvements in depression and anxiety over eight weeks. Findings support our proposed experimental therapeutics framework that hypothesizes objective/behavioral and subjective engagement metrics as mechanisms that lead to changes in clinical outcomes, as well as support directing intervention design efforts for DMHIs to target the user experience.