Veteran Experiences With an mHealth App to Support Measurement-Based Mental Health Care: Results From a Mixed Methods Evaluation.

BACKGROUND: Mental health conditions are highly prevalent among US veterans. The Veterans Health Administration (VHA) is committed to enhancing mental health care through the integration of measurement-based care (MBC) practices, guided by its Collect-Share-Act model. Incorporating the use of remote mobile apps may further support the implementation of MBC for mental health care. OBJECTIVE: This study aims to evaluate veteran experiences with Mental Health Checkup (MHC), a VHA mobile app to support remote MBC for mental health. METHODS: Our mixed methods sequential explanatory evaluation encompassed mailed surveys with veterans who used MHC and follow-up semistructured interviews with a subset of survey respondents. We analyzed survey data using descriptive statistics. We then compared responses between veterans who indicated having used MHC for ≥3 versus <3 months using χ2 tests. We analyzed interview data using thematic analysis. RESULTS: We received 533 surveys (533/2631, for a 20% response rate) and completed 20 interviews. Findings from these data supported one another and highlighted 4 key themes. (1) The MHC app had positive impacts on care processes for veterans: a majority of MHC users overall, and a greater proportion who had used MHC for ≥3 months (versus <3 months), agreed or strongly agreed that using MHC helped them be more engaged in their health and health care (169/262, 65%), make decisions about their treatment (157/262, 60%), and set goals related to their health and health care (156/262, 60%). Similarly, interviewees described that visualizing progress through graphs of their assessment data over time motivated them to continue therapy and increased self-awareness. (2) A majority of respondents overall, and a greater proportion who had used MHC for ≥3 months (versus <3 months), agreed/strongly agreed that using MHC enhanced their communication (112/164, 68% versus 51/98, 52%; P=.009) and rapport (95/164, 58% versus 42/98, 43%; P=.02) with their VHA providers. Likewise, interviewees described how MHC helped focus therapy time and facilitated trust. (3) However, veterans also endorsed some challenges using MHC. Among respondents overall, these included difficulty understanding graphs of their assessment data (102/245, 42%), not receiving enough training on the app (73/259, 28%), and not being able to change responses to assessment questions (72/256, 28%). (4) Interviewees offered suggestions for improving the app (eg, facilitating ease of log-in, offering additional reminder features) and for increasing adoption (eg, marketing the app and its potential advantages for veterans receiving mental health care). CONCLUSIONS: Although experiences with the MHC app varied, veterans were positive overall about its use. Veterans described associations between the use of MHC and engagement in their own care, self-management, and interactions with their VHA mental health providers. Findings support the potential of MHC as a technology capable of supporting the VHA's Collect-Share-Act model of MBC.

Understanding pathways from implementation to sustainment: a longitudinal, mixed methods analysis of promising practices implemented in the Veterans Health Administration.

BACKGROUND: The Veterans Health Administration (VHA) is the United States largest learning health system. The Diffusion of Excellence (DoE) program is a large-scale model of diffusion that identifies and diffuses evidence-informed practices across VHA. During the period of 2016-2021, 57 evidence-informed practices were implemented across 82 VHA facilities. This setting provides a unique opportunity to understand sustainment determinants and pathways. Our objective was to characterize the longitudinal pathways of practices as they transition from initial implementation to long-term sustainment at each facility. METHODS: A longitudinal, mixed-methods evaluation of 82 VHA facilities. Eighty-two facility representatives, chosen by leadership as points-of-contact for 57 DoE practices, were eligible for post-implementation interviews and annual sustainment surveys. Primary outcomes (implementation, sustainment), and secondary outcomes (institutionalization, effectiveness, anticipated sustainment) at four time-points were collected. We performed descriptive statistics and directed content analysis using Hailemariam et al.'s factors influencing sustainment. RESULTS: After approximately five years post-implementation (e.g., 2021 sustainment outcomes), of the 82 facilities, about one-third fully sustained their practice compared to one-third that did not fully sustain their practice because it was in a "liminal" stage (neither sustained nor discontinued) or permanently discontinued. The remaining one-third of facilities had missing 2021 sustainment outcomes. A higher percentage of facilities (70%) had inconsistent primary outcomes (changing over time) compared to facilities (30%) with consistent primary outcomes (same over time). Thirty-four percent of facilities with sustained practices reported resilience since they overcame implementation and sustainment barriers. Facilities with sustained practices reported more positive secondary outcomes compared to those that did not sustain their practice. Key factors facilitating practice sustainment included: demonstrating practice effectiveness/benefit, sufficient organizational leadership, sufficient workforce, and adaptation/alignment with local context. Key factors hindering practice sustainment included: insufficient workforce, not able to maintain practice fidelity/integrity, critical incidents related to the COVID-19 pandemic, organizational leadership did not support sustainment of practice, and no ongoing support. CONCLUSIONS: We identified diverse pathways from implementation to sustainment, and our data underscore that initial implementation outcomes may not determine long-term sustainment outcomes. This longitudinal evaluation contributes to understanding impacts of the DoE program, including return on investment, achieving learning health system goals, and insights into achieving high-quality healthcare in VHA.

Improving Veteran Engagement with Virtual Care Technologies: a Veterans Health Administration State of the Art Conference Research Agenda.

Although the availability of virtual care technologies in the Veterans Health Administration (VHA) continues to expand, ensuring engagement with these technologies among Veterans remains a challenge. VHA Health Services Research & Development convened a Virtual Care State of The Art (SOTA) conference in May 2022 to create a research agenda for improving virtual care access, engagement, and outcomes. This article reports findings from the Virtual Care SOTA engagement workgroup, which comprised fourteen VHA subject matter experts representing VHA clinical care, research, administration, and operations. Workgroup members reviewed current evidence on factors and strategies that may affect Veteran engagement with virtual care technologies and generated key questions to address evidence gaps. The workgroup agreed that although extensive literature exists on factors that affect Veteran engagement, more work is needed to identify effective strategies to increase and sustain engagement. Workgroup members identified key priorities for research on Veteran engagement with virtual care technologies through a series of breakout discussion groups and ranking exercises. The top three priorities were to (1) understand the Veteran journey from active service to VHA enrollment and beyond, and when and how virtual care technologies can best be introduced along that journey to maximize engagement and promote seamless care; (2) utilize the meaningful relationships in a Veteran's life, including family, friends, peers, and other informal or formal caregivers, to support Veteran adoption and sustained use of virtual care technologies; and (3) test promising strategies in meaningful combinations to promote Veteran adoption and/or sustained use of virtual care technologies. Research in these priority areas has the potential to help VHA refine strategies to improve virtual care user engagement, and by extension, outcomes.

Factors Associated with Veteran Self-Reported Use of Digital Health Devices.

BACKGROUND: Digital health devices (DHDs), technologies designed to gather, monitor, and sometimes share data about health-related behaviors or symptoms, can support the prevention or management of chronic conditions. DHDs range in complexity and utility, from tracking lifestyle behaviors (e.g., pedometer) to more sophisticated biometric data collection for disease self-management (e.g., glucometers). Despite these positive health benefits, supporting adoption and sustained use of DHDs remains a challenge. OBJECTIVE: This analysis examined the prevalence of, and factors associated with, DHD use within the Veterans Health Administration (VHA). DESIGN: National survey. PARTICIPANTS: Veterans who receive VHA care and are active secure messaging users. MAIN MEASURES: Demographics, access to technology, perceptions of using health technologies, and use of lifestyle monitoring and self-management DHDs. RESULTS: Among respondents, 87% were current or past users of at least one DHD, and 58% were provided a DHD by VHA. Respondents 65 + years were less likely to use a lifestyle monitoring device (AOR 0.57, 95% CI [0.39, 0.81], P = .002), but more likely to use a self-management device (AOR 1.69, 95% [1.10, 2.59], P = .016). Smartphone owners were more likely to use a lifestyle monitoring device (AOR 2.60, 95% CI [1.42, 4.75], P = .002) and a self-management device (AOR 1.83, 95% CI [1.04, 3.23], P = .037). CONCLUSIONS: The current analysis describes the types of DHDs that are being adopted by Veterans and factors associated with their adoption. Results suggest that various factors influence adoption, including age, access to technology, and health status, and that these relationships may differ based on the functionalities of the device. VHA provision of devices was frequent among device users. Providing Veterans with DHDs and the training needed to use them may be important factors in facilitating device adoption. Taken together, this knowledge can inform future implementation efforts, and next steps to support patient-team decision making about DHD use.

Utilization of whole health services among veterans with spinal cord injuries and disorders (SCI/D): Early insights from the VA SCI/D system of care.

CONTEXT/OBJECTIVE: Our objective was to describe early participation in Whole Health programs across the Veterans Health Administration (VHA) Spinal Cord Injuries and Disorders (SCI/D) System of Care. DESIGN: Retrospective analysis of VHA administrative data. SETTING: The VHA SCI/D System of Care. PARTICIPANTS: Veterans with SCI/D included in the FY2019 cumulative VHA SCI/D Registry cohort with living status during FY2017, FY2018, and FY2019. INTERVENTIONS: N/A. OUTCOME MEASURES: We assessed the number of encounters and unique Veterans with SCI/D, and the percent of Veterans with SCI/D, who utilized each Whole Health (WH) program available in VA. RESULTS: Utilization of WH Pathway and well-being Programs increased from 62 encounters to 1703 encounters between FY2017 and FY2019 (representing 0.09% to 3.13% of Veterans with SCI/D). Utilization of chiropractic care rose from 130 encounters to 418 encounters during the same time period. Similarly, utilization of complementary and integrative health programs increased from 886 encounters to 2655 encounters (representing 1.09% to 3.11% of Veterans; FY2017 to 2019). We also report utilization of specific WH programs. CONCLUSION: Participation in WH services has been increasing among Veterans with SCI/D who receive health care from the VHA SCI/D System of Care. However, utilization among Veterans with SCI/D remains low overall, and targeted efforts to increase WH program reach are needed. Additional information about the relative effectiveness of different strategies to support WH implementation is also needed, to ensure strategies likely to have the most impact are prioritized.

Supporting Veteran's Administration Medical Center Directors' Decisions When Adopting Innovative Practices: Development and Implementation of the "QuickView" and "WishList" Tools.

Background Since 2015, the Veterans Health Administration (VHA) Diffusion of Excellence Program has supported spread of practices developed by frontline employees. Shark Tank-style competitions encourage "Sharks" nationwide (VHA medical center/regional directors) to bid for the opportunity to implement practices at their institutions. Methods The authors evaluated bidding strategies (2016-2020), developing the "QuickView" practice comparator to promote informed bidding. Program leaders distributed QuickView and revised versions in subsequent competitions. Our team utilized in-person observation, online chats after the competition, bidder interviews, and bid analysis to evaluate QuickView use. Bids were ranked based on demonstrated understanding of resources required for practice implementation. Results Sharks stated that QuickView supported preparation before the competition and suggested improvements. Our revised tool reported necessary staff time and incorporated a "WishList" from practice finalists detailing minimum requirements for successful implementation. Bids from later years reflected increased review of facilities' current states before the competition and increased understanding of the resources needed for implementation. Percentage of bids describing local need for the practice rose from 2016 to 2020: 4.7% (6/127); 62.1% (54/87); 78.3% (36/46); 80.6% (29/36); 89.7% (26/29). Percentage of bids committing specific resources rose following QuickView introduction: 81.1% (103/127) in 2016, 69.0% (60/87) in 2017, then 73.9% (34/46) in 2018, 88.9% (32/36) in 2019, and 89.7% (26/29) in 2020. Discussion In the years following QuickView/WishList implementation, bids reflected increased assessment before the competition of both local needs and available resources. Conclusion Selection of a new practice for implementation requires an understanding of local need, necessary resources, and fit. QuickView and WishList appear to support these determinations.

VHA Whole Health Services and Complementary and Integrative Health Therapies: a Gateway to Evidence-Based Mental Health Treatment.

BACKGROUND: Engagement in evidence-based psychotherapy (EBP) among veterans with behavioral health conditions is often low. The Veterans Health Administration (VHA) is implementing a "Whole Health (WH)" system of care, to identify veteran personal health goals, align care with those goals, and offer services designed to engage and empower veterans to achieve well-being. OBJECTIVE: To examine the relationship between veteran WH utilization and subsequent engagement in EBP. DESIGN: Retrospective analysis of VHA administrative records from 18 facilities implementing WH. SUBJECTS: Veterans (n = 265,364) with a diagnosis of depression, post-traumatic stress disorder (PTSD), and/or anxiety who had a mental healthcare encounter but no EBP use in fiscal year (FY) 2018. Among this cohort, 33,146 (12.5%) began using WH in FY2019. MAIN MEASURES: We examined use of an EBP for depression, anxiety, and/or PTSD within 1 year of the index date of WH use compared to use of an EBP anytime during FY2019 for veterans not identified as using WH. We used multiple logistic regression to examine the association between veteran WH use and EBP engagement. KEY RESULTS: Approximately 3.0% (n = 7,860) of the veterans in our overall cohort engaged in an EBP in the year following their index date. Controlling for key demographic, health, and utilization variables, WH users had 2.4 (95% CI: 2.2-2.5) times higher odds of engaging in an EBP the following year than those with no WH utilization. Associations between utilization of specific WH services (vs. no utilization of that service) and engagement in an EBP in the subsequent year ranged from 1.6 (95% CI: 1.0-2.6) to 3.5 (95% CI: 3.2-3.9) across the different types of WH services used. CONCLUSIONS: WH use was associated with increased engagement in EBPs among veterans with depression, anxiety, and/or PTSD. Future interventions intended to promote veteran engagement in EBPs may benefit from leveraging WH services and therapies.

An Online Acceptance and Mindfulness Intervention for Chronic Pain in Veterans: Development and Protocol for a Pilot Feasibility Randomized Controlled Trial.

BACKGROUND: In the veteran community, chronic pain is particularly prevalent and often debilitating. Until recently, veterans with chronic pain were offered primarily pharmacological intervention options, which rarely suffice and can also have negative health consequences. To better address chronic pain in veterans, the Veterans Health Administration has invested in novel, nonpharmacological behavior interventions that target both pain management and chronic pain-related functional issues. One approach, acceptance and commitment therapy (ACT) for chronic pain, is supported by decades of efficacy evidence for improving pain outcomes; however, ACT can be difficult to obtain owing to issues such as a lack of trained therapists or veterans having difficulty committing to the time and resources needed for the full clinician-led ACT protocol. Given the strong ACT evidence base combined with access limitations, we set out to develop and evaluate Veteran ACT for Chronic Pain (VACT-CP), an online program guided by an embodied conversational agent to improve pain management and functioning. OBJECTIVE: The aims of this study are to develop, iteratively refine, and then conduct a pilot feasibility randomized controlled trial (RCT) of a VACT-CP group (n=20) versus a waitlist and treatment-as-usual control group (n=20). METHODS: This research project includes 3 phases. In phase 1, our research team consulted with pain and virtual care experts, developed the preliminary VACT-CP online program, and conducted interviews with providers to obtain their feedback on the intervention. In phase 2, we incorporated feedback from phase 1 into the VACT-CP program and completed initial usability testing with veterans with chronic pain. In phase 3, we are conducting a small pilot feasibility RCT, with the primary outcome being assessment of usability of the VACT-CP system. RESULTS: This study is currently in phase 3; recruitment for the RCT began in April 2022 and is expected to continue through April 2023. Data collection is expected to be completed by October 2023, with full data analysis completed by late 2023. CONCLUSIONS: The findings from this research project will provide information on the usability of the VACT-CP intervention, as well as secondary outcomes related to treatment satisfaction, pain outcomes (pain-related daily functioning and pain severity), ACT processes (pain acceptance, behavioral avoidance, and valued living), and mental and physical functioning. TRIAL REGISTRATION: ClinicalTrials.gov NCT03655132; https://clinicaltrials.gov/ct2/show/NCT03655132. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/45887.

Leveraging Organizational Conditions for Innovation: A Typology of Facility Engagement in the Veterans Health Administration Shark Tank-Style Competition.

Introduction The development and spread of innovation are known challenges in health care. The US Veterans Health Administration (VHA) created a "Shark Tank"-style competition directed at frontline employees. In this annual, systemwide competition, employees submit innovations to the competition, and winning innovations receive support for implementation in other facilities. Method A multiple case study design was used to understand facility engagement in the competition, and the relationship between engagement and organizational conditions. The authors created a typology to describe the relationship between facility engagement in the competition and organizational conditions for innovation. Results Overall, there was high participation in the VHA's competition across all 130 facilities. The authors identified 7 mutually exclusive types of facility engagement. Discussion As expected, facilities with the most established conditions for innovation were the most engaged in the competition. Additionally, other facilities had various ways to be involved. Consequently, there may be benefit to the VHA tailoring how they work with facilities, based on organizational conditions. Larger facilities with ongoing research and more resources may be more suited to develop innovations, whereas smaller facilities could benefit from a focus on adoption. Conclusion These insights are valuable to the VHA and can be used by other health care systems to tailor innovation programs and allocate resources based on diverse needs across a vast health care system.

Secure Messaging for Diabetes Management: Content Analysis.

BACKGROUND: Secure messaging use is associated with improved diabetes-related outcomes. However, it is less clear how secure messaging supports diabetes management. OBJECTIVE: We examined secure message topics between patients and clinical team members in a national sample of veterans with type 2 diabetes to understand use of secure messaging for diabetes management and potential associations with glycemic control. METHODS: We surveyed and analyzed the content of secure messages between 448 US Veterans Health Administration patients with type 2 diabetes and their clinical teams. We also explored the relationship between secure messaging content and glycemic control. RESULTS: Explicit diabetes-related content was the most frequent topic (72.1% of participants), followed by blood pressure (31.7% of participants). Among diabetes-related conversations, 90.7% of patients discussed medication renewals or refills. More patients with good glycemic control engaged in 1 or more threads about blood pressure compared to those with poor control (37.5% vs 27.2%, P=.02). More patients with good glycemic control engaged in 1 more threads intended to share information with their clinical team about an aspect of their diabetes management compared to those with poor control (23.7% vs 12.4%, P=.009). CONCLUSIONS: There were few differences in secure messaging topics between patients in good versus poor glycemic control. Those in good control were more likely to engage in informational messages to their team and send messages related to blood pressure. It may be that the specific topic content of the secure messages may not be that important for glycemic control. Simply making it easier for patients to communicate with their clinical teams may be the driving influence between associations previously reported in the literature between secure messaging and positive clinical outcomes in diabetes.

The engagement problem: A review of engagement with digital mental health interventions and recommendations for a path forward.

Purpose of the review: Digital mental health interventions (DMHIs) are an effective and accessible means of addressing the unprecedented levels of mental illness worldwide. Currently, however, patient engagement with DMHIs in real-world settings is often insufficient to see clinical benefit. In order to realize the potential of DMHIs, there is a need to better understand what drives patient engagement. Recent findings: We discuss takeaways from the existing literature related to patient engagement with DMHIs and highlight gaps to be addressed through further research. Findings suggest that engagement is influenced by patient-, intervention- and systems-level factors. At the patient-level, variables such as sex, education, personality traits, race, ethnicity, age and symptom severity appear to be associated with engagement. At the intervention-level, integrating human support, gamification, financial incentives and persuasive technology features may improve engagement. Finally, although systems-level factors have not been widely explored, the existing evidence suggests that achieving engagement will require addressing organizational and social barriers and drawing on the field of implementation science. Summary: Future research clarifying the patient-, intervention- and systems-level factors that drive engagement will be essential. Additionally, to facilitate improved understanding of DMHI engagement, we propose the following: (a) widespread adoption of a minimum necessary 5-element engagement reporting framework; (b) broader application of alternative clinical trial designs; and (c) directed efforts to build upon an initial parsimonious conceptual model of DMHI engagement.

Diffusion of excellence: evaluating a system to identify, replicate, and spread promising innovative practices across the Veterans health administration.

Introduction: The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program provides a system to identify, replicate, and spread promising practices across the largest integrated healthcare system in the United States. DoE identifies innovations that have been successfully implemented in the VHA through a Shark Tank style competition. VHA facility and regional directors bid resources needed to replicate promising practices. Winning facilities/regions receive external facilitation to aid in replication/implementation over the course of a year. DoE staff then support diffusion of successful practices across the nationwide VHA. Methods: Organized around the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) Framework, we summarize results of an ongoing long-term mixed-methods implementation evaluation of DoE. Data sources include: Shark Tank application and bid details, tracking practice adoptions through a Diffusion Marketplace, characteristics of VHA facilities, focus groups with Shark Tank bidders, structured observations of DoE events, surveys of DoE program participants, and semi-structured interviews of national VHA program office leaders, VHA healthcare system/facility executives, practice developers, implementation teams and facilitators. Results: In the first eight Shark Tanks (2016-2022), 3,280 Shark Tank applications were submitted; 88 were designated DoE Promising Practices (i.e., practices receive facilitated replication). DoE has effectively spread practices across the VHA, with 1,440 documented instances of adoption/replication of practices across the VHA. This includes 180 adoptions/replications in facilities located in rural areas. Leadership decisions to adopt innovations are often based on big picture considerations such as constituency support and linkage to organizational goals. DoE Promising Practices that have the greatest national spread have been successfully replicated at new sites during the facilitated replication process, have close partnerships with VHA national program offices, and tend to be less expensive to implement. Two indicators of sustainment indicate that 56 of the 88 Promising Practices are still being diffused across the VHA; 56% of facilities originally replicating the practices have sustained them, even up to 6 years after the first Shark Tank. Conclusion: DoE has developed a sustainable process for the identification, replication, and spread of promising practices as part of a learning health system committed to providing equitable access to high quality care.

Factors Associated With Self-reported Use of Web and Mobile Health Apps Among US Military Veterans: Cross-sectional Survey.

BACKGROUND: Despite their prevalence and reported patient interest in their use, uptake of health-related apps is limited. The Veterans Health Administration (VHA) has developed a variety of apps to support veterans; however, uptake remains low nationally. OBJECTIVE: We examined the prevalence of VHA health-related app use and how veterans learned about these apps in order to identify factors associated with their use. METHODS: As part of a VHA quality improvement initiative, we recruited a national cohort of veterans to obtain feedback on their use of technology for health and collected data from them via a cross-sectional survey. The survey data were supplemented with VHA administrative data. We used descriptive statistics to examine demographic and health characteristics, health-related technology use, and how veterans learned about apps. We assessed factors associated with app use using bivariate analyses and multiple logistic regression models. RESULTS: We had complete data on 1259 veterans. A majority of the sample was male (1069/1259, 84.9%), aged older than 65 years (740/1259, 58.8%), White (1086/1259, 86.3%), and non-Hispanic (1218/1259, 96.7%). Most respondents (1125/1259, 89.4%) reported being very comfortable and confident using computers, over half (675/1259, 53.6%) reported being an early adopter of technology, and almost half (595/1259, 47.3%) reported having used a VHA health-related app. Just over one-third (435/1259, 34.6%) reported that their VHA care team members encouraged them to use health-related apps. Respondents reported learning about available VHA health-related apps by reading about them on the VHA's patient portal (468/1259, 37.2%), being told about them by their VHA health care team (316/1259, 25.1%), and reading about them on the VHA's website (139/1259, 11%). Veterans who self-reported having used VHA health-related apps were more likely to receive care at the VHA (OR [odds ratio] 1.3, 95% CI 1.0-1.7), be in worse health (as assessed by Hierarchical Condition Community score; OR 1.1, 95% CI 1.0-1.2), report owning a desktop or laptop computer (OR 1.8, 95% CI 1.1-3.1), have posttraumatic stress disorder (OR 1.4, 95% CI 1.1-1.9), and report having VHA health care team members encourage them to use the apps (OR 2.7, 95% CI 2.1-3.4). CONCLUSIONS: We found strong associations between self-reported use by veterans of VHA health-related apps and multiple variables in our survey. The strongest association was observed between a veteran self-reporting app use and having received encouragement from their VHA health care team to use the apps. Veterans who reported receiving encouragement from their VHA care team members had nearly 3 times higher odds of using VHA apps than veterans who did not report receiving such encouragement. Our results add to growing evidence suggesting that endorsement of apps by a health care system or health care team can positively impact patient uptake and use.

Digital Mental Health Interventions for Depression: Scoping Review of User Engagement.

BACKGROUND: While many digital mental health interventions (DMHIs) have been found to be efficacious, patient engagement with DMHIs has increasingly emerged as a concern for implementation in real-world clinical settings. To address engagement, we must first understand what standard engagement levels are in the context of randomized controlled trials (RCTs) and how these compare with other treatments. OBJECTIVE: This scoping review aims to examine the state of reporting on intervention engagement in RCTs of mobile app-based interventions intended to treat symptoms of depression. We sought to identify what engagement metrics are and are not routinely reported as well as what the metrics that are reported reflect about standard engagement levels. METHODS: We conducted a systematic search of 7 databases to identify studies meeting our eligibility criteria, namely, RCTs that evaluated use of a mobile app-based intervention in adults, for which depressive symptoms were a primary outcome of interest. We then extracted 2 kinds of information from each article: intervention details and indices of DMHI engagement. A 5-element framework of minimum necessary DMHI engagement reporting was derived by our team and guided our data extraction. This framework included (1) recommended app use as communicated to participants at enrollment and, when reported, app adherence criteria; (2) rate of intervention uptake among those assigned to the intervention; (3) level of app use metrics reported, specifically number of uses and time spent using the app; (4) duration of app use metrics (ie, weekly use patterns); and (5) number of intervention completers. RESULTS: Database searching yielded 2083 unique records. Of these, 22 studies were eligible for inclusion. Only 64% (14/22) of studies included in this review specified rate of intervention uptake. Level of use metrics was only reported in 59% (13/22) of the studies reviewed. Approximately one-quarter of the studies (5/22, 23%) reported duration of use metrics. Only half (11/22, 50%) of the studies reported the number of participants who completed the app-based components of the intervention as intended or other metrics related to completion. Findings in those studies reporting metrics related to intervention completion indicated that between 14.4% and 93.0% of participants randomized to a DMHI condition completed the intervention as intended or according to a specified adherence criteria. CONCLUSIONS: Findings suggest that engagement was underreported and widely varied. It was not uncommon to see completion rates at or below 50% (11/22) of those participants randomized to a treatment condition or to simply see completion rates not reported at all. This variability in reporting suggests a failure to establish sufficient reporting standards and limits the conclusions that can be drawn about level of engagement with DMHIs. Based on these findings, the 5-element framework applied in this review may be useful as a minimum necessary standard for DMHI engagement reporting.

Common procedures of remote measurement-based care in an integrated behavioural health context: protocol for a scoping review.

INTRODUCTION: Integrated behavioural health, a model of care that embeds mental health services in primary care, can potentially increase access to mental healthcare. With the increase in health information technologies, remote measurement-based care (RMBC) presents an opportunity to improve support of integrated care. This scoping review will comprehensively examine what common procedures are followed when RMBC for mental health is tested in integrated care settings. METHODS AND ANALYSIS: Based on an established six-step framework for conducting scoping reviews, we will search PubMed, Embase, PsycINFO, Cochrane, EBSCOhost and Web of Science with search terms related to 'integrated care' and 'RMBC'. Articles published from 2015 onwards, in English, including an intervention that meets our definition of RMBC, and are conducted in collaboration with primary care or in a primary care setting will be included. After data extraction, we will categorise key findings along the following dimensions: (1) common delivery practices of RMBC; (2) common technologies and instruments used and (3) most common barriers and facilitators when implementing RMBC in an integrated care model. ETHICS AND DISSEMINATION: Ethics approval is not required for this scoping review. For maximum impact, we will disseminate the findings to the scientific community (via publication in a peer-reviewed journal and at national conferences) and to the broader healthcare community. We will share findings with the broader healthcare community through our research centre's existing stakeholder communication structures and through guidance from our multidisciplinary research team. These key stakeholder relationships will continue to guide our subsequent RMBC research following the review.

Understanding Adoption and Preliminary Effectiveness of a Mobile App for Chronic Pain Management Among US Military Veterans: Pre-Post Mixed Methods Evaluation.

BACKGROUND: The Veterans Health Administration Pain Coach mobile health app was developed to support veterans with chronic pain. OBJECTIVE: Our objective was to evaluate early user experiences with the Pain Coach app and preliminary impacts of app use on pain-related outcomes. METHODS: Following a sequential, explanatory, mixed methods design, we mailed surveys to veterans at 2 time points with an outreach program in between and conducted semistructured interviews with a subsample of survey respondents. We analyzed survey data using descriptive statistics among veterans who completed both surveys and examined differences in key outcomes using paired samples t tests. We analyzed semistructured interview data using thematic analysis. RESULTS: Of 1507 veterans invited and eligible to complete the baseline survey, we received responses from 393 (26.1%). These veterans received our outreach program; 236 (236/393, 60.1%) completed follow-up surveys. We conducted interviews with 10 app users and 10 nonusers. Among survey respondents, 10.2% (24/236) used Pain Coach, and 58% (14/24) reported it was easy to use, though interviews identified various app usability issues. Veterans who used Pain Coach reported greater pain self-efficacy (mean 23.1 vs mean 16.6; P=.01) and lower pain interference (mean 34.6 vs mean 31.8; P=.03) after (vs before) use. The most frequent reason veterans reported for not using the app was that their health care team had not discussed it with them (96/212, 45.3%). CONCLUSIONS: Our findings suggest that future efforts to increase adoption of Pain Coach and other mobile apps among veterans should include health care team endorsement. Our findings regarding the impact of Pain Coach use on outcomes warrant further study.

Effect of the Affordable Care Act on healthcare utilization for Veterans with spinal cord injuries and disorders.

Context/Objective: Provisions of the Affordable Care Act (ACA) potentially increase insurance options for Veterans with disabilities. We examined Veterans with spinal cord injuries and disorders (SCI/D) to assess whether the ACA was associated with changes in healthcare utilization from Department of Veterans Affairs (VA) healthcare facilities.Design: Using national VA data, we investigated impacts on VA healthcare utilization pre- (2012/13) and post-ACA (2014/15) implementation with negative binomial regression models.Setting: VA healthcare facilities.Participants: 8,591 VA users with SCI/D. Veterans with acute myelitis, Guillain-Barré syndrome, multiple sclerosis, or amyotrophic lateral sclerosis were excluded as were patients who died during the study period.Interventions: We assessed VA healthcare utilization before and after ACA implementation.Outcome Measures: Total numbers of VA visits for SCI/D care, diagnostic care, primary care, specialty care, and mental health care, and VA admissions.Results: The number of VA admissions was 7% higher in the post than pre-ACA implementation period (P < 0.01). The number of VA visits post-implementation increased for SCI/D care (8%; P < 0.01) and specialty care (12%; P < 0.001). Conversely, the number of mental health visits was 17% lower in the post-ACA period (P < 0.001). Veterans with SCI/D who live <5 miles from their nearest VA facility received VA care more frequently than those ≥40 miles from VA (P < 0.001).Conclusion: Counter to expectations, results suggest that Veterans with SCI/D sought more frequent VA care after ACA implementation, indicating Veterans with SCI/D continue to utilize the lifelong, comprehensive care provided at VA.

Uncertainty as a critical determinant of antibiotic prescribing in patients with an asthma exacerbation: a qualitative study.

OBJECTIVE: To identify factors that influence providers' decisions to prescribe antibiotics in patients presenting to the hospital with an asthma exacerbation. METHODS: We performed semi-structured interviews with a purposive sample of providers including sixteen hospitalists, emergency room providers, or pulmonologists, and one focus group with internal medicine residents recruited from one large, urban, teaching hospital and one small, rural, community hospital. Questions were informed by the Theoretical Domains Framework to determine factors that may influence behaviors. Directed content analysis was used to code and analyze transcripts of the interviews. RESULTS: Uncertainty regarding the diagnostic (asthma vs. COPD) and the cause of exacerbation (bacterial vs. viral infection) emerged as the main driver for prescribing behavior. Provider response to uncertainty included: "watchful waiting" or immediate antibiotic prescribing. The following factors played important roles in providers' prescribing decision: 1) awareness/agreement with existing guidelines 2) confidence in their ability to apply the guidelines in challenging cases; 3) perceived risk of patient deterioration without antibiotics; 4) fear of litigation; 5) habit and clinical inertia 6) prescribing within the group 7) lack of information of antibiotic prescribing rates and 8) lack of time and/or resources. CONCLUSIONS: We identified diagnostic uncertainty as the primary determinant of antibiotic prescribing in asthma exacerbations and developed a conceptual model to explain provider responses and factors that influenced their responses. These results enhance our understanding of the factors that can contribute to low-value and wasteful practices like superfluous antibiotic prescribing and will support the development of interventions to de-implement such practices.

Health Insurance Coverage Among Veterans Receiving Care From VA Health Care Facilities.

Reasons for acquiring insurance outside Department of Veterans Affairs (VA) health care coverage among VA enrollees are incompletely understood. To assess Veterans' decision-making and acquisition of non-VA health care insurance in the Affordable Care Act era, we used mailed questionnaires and semistructured interviews in a stratified random sample of VA enrollees <65 years in the Midwest. Of the 3,666 survey participants, 32.1% reported non-VA insurance. Frequently reported reasons included wanting coverage for emergency situations or family members. Those without non-VA insurance cited unaffordability as the main obstacle. Analysis of the semistructured interview data revealed similar findings. In multivariable logistic regression analyses, characteristics associated with non-VA insurance included higher income (>$50,000 vs. <$10,000, odds ratio [OR] = 5.95, 95% confidence interval [CI]: 3.45-10.3, p < .001). As financial barriers exist for acquisition of non-VA insurance and hence community care, it is critically important that VA enrollees' health care needs are met through VA or community providers financed through VA.