Adopting the RE-AIM analytic framework for rural program evaluation: experiences from the Advance Care Planning via Group Visits (ACP-GV) national evaluation.

Introduction: To support rigorous evaluation across a national portfolio of grants, the United States Department of Veterans Affairs (VA) Office of Rural Health (ORH) adopted an analytic framework to guide their grantees' evaluation of initiatives that reach rural veterans and to standardize the reporting of outcomes and impacts. Advance Care Planning via Group Visits (ACP-GV), one of ORH's Enterprise-Wide Initiatives, also followed the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. ACP-GV is a national patient-centered intervention delivered in a large, veterans integrated healthcare system. This manuscript describes how RE-AIM was used to evaluate this national program and lessons learned from ORH's annual reporting feedback to ACP-GV on their use of the framework to describe evaluation impacts. Methods: We used patient, provider, and site-level administrative health care data from the VA Corporate Data Warehouse and national program management databases for federal fiscal years (FY) spanning October 1, 2018-September 30, 2023. Measures included cumulative and past FY metrics developed to assess program impacts. Results: RE-AIM constructs included the following cumulative and annual program evaluation results. ACP-GV reached 54,167 unique veterans, including 19,032 unique rural veterans between FY 2018 to FY 2023. During FY 2023, implementation adherence to the ACP-GV model was noted in 91.7% of program completers, with 55% of these completers reporting a knowledge increase and 14% reporting a substantial knowledge increase (effectiveness). As of FY 2023, 66 ACP-GV sites were active, and 1,556 VA staff were trained in the intervention (adoption). Of the 66 active sites in FY 2023, 27 were sites previously funded by ORH and continued to offer ACP-GV after the conclusion of three years of seed funding (maintenance). Discussion: Lessons learned developing RE-AIM metrics collaboratively with program developers, implementers, and evaluators allowed for a balance of clinical and scientific input in decision-making, while the ORH annual reporting feedback provided specificity and emphasis for including both cumulative, annual, and rural specific metrics. ACP-GV's use of RE-AIM metrics is a key step towards improving rural veteran health outcomes and describing real world program impacts.

"Advancing" Advance Care Planning to Veterans in the Veterans Health Administration.

INTRODUCTION: The completion rate of Advance Directive (ADs) in the Veterans Health Administration (VHA) is unknown. There is substantial literature on the need for effective Advance Care Planning (ACP) that leads to an AD to ensure that health care preferences for patients are known. Advance Directive are essential to consider since ACP, which explains and plans Advance Directive, does not reach all individuals. Health inequities, such as those experienced in rural areas, continue to exist. While ACP may disproportionately affect rural-residing veterans and their providers, a VHA program was specifically designed to increase ACP engagement with rural veterans and to address several systemic barriers to ACP. MATERIALS AND METHODS: This descriptive analysis seeks to identify patient, provider, and geographic characteristics associated with higher rates of ACP participation in VHA. An observational examination of the profile of veterans and the types of ACP (e.g., individual or in groups) using administrative data for all beneficiaries receiving VHA health care services in federal fiscal year (FY) 2020 was conducted as part of a national program evaluation. The measures include patient-level data on demographics (e.g., race, ethnicity, gender), unique patient identifiers (e.g., name, social security number), geographic characteristics of patient's location (e.g., rurality defined as Rural-Urban Commuting Areas [RUCA]), VHA priority group; provider-level data (e.g., type of document definition, clinic stop codes, visit date used to verify Advance Care Planning via Group Visits [ACP-GV] attendance; data not shown), and electronic health record note titles that indicated the presence of ACP in VHA (e.g., "Advance Directive [AD] Discussion" note title, "ACP-GV CHAR 4 code"). Pearson's chi-square statistics were used for between-group comparisons based on a two-sided test with a significance level of 0.05. RESULTS: The overall rate of AD discussions among unique VHA users in FY2020 was 5.2% (95% CI: 5.2%-5.2%) and for Advance Care Planning via Group Visits, which targets rural veterans using groups, it was 1.8% (95% CI: 1.8%-1.9%). Advance Directive discussions in VHA are more successful at reaching middle age (M = 64; SD = 16), African Americans, males, veterans living in urban areas, and veterans with a VA disability (Priority Group 1-4). Advance Care Planning delivered in groups is reaching slightly younger veterans under the age of 75 years (M = 62; SD = 15), African Americans, females, disabled veterans (e.g., Priority Group 1-4), and more veterans residing in rural communities compared to the national population of VHA users. CONCLUSION: Advance Directive discussion rates are low across VHA, yet intentional efforts with ACP via group visits are reaching veterans who are considered underserved owing to residing in rural areas. Advance Care Planning needs to be a well-informed clinical priority for VHA to engage with the entire veteran population and to support the completion of ADs.

Trajectories of Opioid Coverage After Long-Term Opioid Therapy Initiation Among a National Cohort of US Veterans.

PURPOSE: The objective of this study was to identify the trajectories that patients take after initiating long-term opioid therapy (LTOT). MATERIALS AND METHODS: Using a retrospective cohort design, veterans with chronic non-cancer pain (CNCP) initiating LTOT were identified. Group-based trajectory models were used to identify opioid therapy trajectories based on days of opioid supply (primary outcome) and average daily morphine milligram equivalent dose (AMME; secondary outcome) in each 180-day period following initiation of LTOT. RESULTS: A total of 438,398 veterans with CNCP initiated LTOT. Nine trajectories were identified: 33.7% with persistent, high days covered, 17.7% with persistent, moderate days covered, 16.6% with slow, persistent days-covered reduction, 2.4% with days-covered reduction followed by increase, 4.6% with delayed days-covered reduction, 4.1% with rapid days-covered reduction, 10.9% with moderate-paced discontinuation, 3.4% with delayed discontinuation, and 6.5% with rapid discontinuation. Patients following discontinuation trajectories were more likely to be younger, persons of color, use more supportive services (eg, physical therapy), and received less opioid days' supply and lower doses prior to initiating LTOT as compared to patients following persistent opioid days-covered trajectories. AMME trajectories were similar to days-covered trajectories. CONCLUSION: Among persons initiating LTOT, nine opioid trajectories emerged which can be broadly characterized into three main trajectory groups: persistent opioid therapy (2 trajectories), reductions in opioid therapy (4 trajectories), and discontinuation (3 trajectories). A majority of patients (51.4%) maintained persistent opioid therapy. Further research is needed to assess the risks of opioid-related adverse outcomes among the identified trajectories.

Impact of Attitudes and Rurality on Veterans' Use of Veterans Health Administration Mental Health Services.

OBJECTIVE: Veterans, especially those residing in rural areas, continue to underutilize mental health care. This longitudinal study assessed attitudes relevant to seeking mental health care services from the Veterans Health Administration (VHA) over 12 months, adjusting for residence. METHODS: A questionnaire addressing attitudes, sociodemographic factors, residence, place identity, perceived health status and needs, and structural barriers was administered by telephone to 752 veterans with previous VHA service use. Service use data were obtained from a VHA database. RESULTS: In adjusted models, four attitudes were significantly associated with underuse of VHA mental health care (no use vs. any use; no use vs. nonsustained use vs. sustained use). Higher levels of mistrust of others (adjusted odds ratio [AOR]=1.06, p=0.046), emotional stoicism (AOR=1.08, p=0.003), belief in the self-resolving nature of mental health problems (AOR=1.91, p=0.015), and belief in the efficacy of religious counseling for such problems (AOR=1.09, p=0.022) were associated with no subsequent service use versus any use. Place identity (suburban), older age, and greater need were associated with greater odds of VHA use. For the comparison of no use versus sustained use, women had lower odds of no use (AOR=0.49, p<0.001); similarly, women had lower odds of nonsustained use versus sustained use (AOR=0.45, p<0.001). CONCLUSIONS: The association of potentially modifiable attitudes with underuse of VHA mental health services suggests that attitudes offer useful targets for efforts to increase mental health care use. That these attitudes were influential regardless of residence suggests that programs addressing attitudinal barriers can be broadly targeted.

Factors Associated with Opioid Initiation in OEF/OIF/OND Veterans with Traumatic Brain Injury.

Objective: These analyses examined opioid initiation and chronic use among Iraq (OIF) and Afghanistan (OEF/OND) veterans with a new diagnosis of traumatic brain injury (TBI) in the Veterans Health Administration (VHA). Methods: Data were obtained from national VHA data repositories. Analyses included OEF/OIF/OND veterans with a new TBI diagnosis in 2010-2012 who used the VHA at least twice, had not received a VHA opioid prescription in the 365 days before diagnosis, and had at least 365 days of data available after TBI diagnosis. Results: Analyses included 35,621 veterans. Twenty-one percent initiated opioids; among new initiators, 23% used chronically. The mean dose was 24.0 mg morphine equivalent dose (MED) daily (SD = 24.26); mean days supplied was 60.52 (SD = 74.69). Initiation was significantly associated with age 36-45 years (odds ratio [OR] = 1.09, 95% CI = 1.01-1.17, P = 0.04), female gender (OR = 1.22, P < 0.001), having back pain (OR = 1.38, P < 0.0001), arthritis/joint pain (OR = 1.24, P < 0.0001), or neuropathic pain (OR = 1.415, P < 0.02). In veterans age 36-45 years, those living in small rural areas had higher odds of chronic opioid use (OR = 1.31, P < 0.0001, and OR = 1.33, P = 0.006, respectively) and back pain (OR = 1.36, P = 0.003). Headache/migraine pain was associated with decreased odds of chronic opioid use (OR = 0.639, P = 0.003). Conclusions: Prevalence of opioid use is relatively low among OEF/OIF/OND veterans with newly diagnosed TBI who are using VHA. Among those who initiated opioids, about 25% use them chronically. Prescribing was mostly limited to moderate doses, with most veterans using opioids for approximately two months of the 12-month study period.

A Web-based clinical decision support system for depression care management.

OBJECTIVE: To inform the design of future informatics systems that support the chronic care model. STUDY DESIGN: We describe the development and functionality of a decision support system for the chronic care model of depression treatment, known as collaborative care. Dissemination of evidence-based collaborative care models has been slow, and fidelity to the evidence base has been poor during implementation initiatives. Implementation could be facilitated by a decision support system for depression care managers, the cornerstone of the collaborative care model. The Net Decision Support System (https://www.netdss.net/) is a free Web-based system that was developed to support depression care manager activities and to facilitate the dissemination of collaborative care models that maintain high fidelity to the evidence base. METHODS: The NetDSS was based on intervention materials used for a randomized trial of depression care management that improved clinical outcomes compared with usual care. The NetDSS was developed jointly by a cross-functional design team of psychiatrists, depression care managers, information technology specialists, technical writers, and researchers. RESULTS: The NetDSS has the following functional capabilities: patient registry, patient encounter scheduler, trial management, clinical decision support, progress note generator, and workload and outcomes report generator. The NetDSS guides the care manager through a self-documenting patient encounter using evidence-based scripts and self-scoring instruments. The NetDSS has been used to provide evidence-based depression care management to more than 1700 primary care patients. CONCLUSION: Intervention protocols can be successfully converted to Web-based decision support systems that facilitate the implementation of evidence-based chronic care models into routine care with high fidelity.