Understanding pathways from implementation to sustainment: a longitudinal, mixed methods analysis of promising practices implemented in the Veterans Health Administration.

BACKGROUND: The Veterans Health Administration (VHA) is the United States largest learning health system. The Diffusion of Excellence (DoE) program is a large-scale model of diffusion that identifies and diffuses evidence-informed practices across VHA. During the period of 2016-2021, 57 evidence-informed practices were implemented across 82 VHA facilities. This setting provides a unique opportunity to understand sustainment determinants and pathways. Our objective was to characterize the longitudinal pathways of practices as they transition from initial implementation to long-term sustainment at each facility. METHODS: A longitudinal, mixed-methods evaluation of 82 VHA facilities. Eighty-two facility representatives, chosen by leadership as points-of-contact for 57 DoE practices, were eligible for post-implementation interviews and annual sustainment surveys. Primary outcomes (implementation, sustainment), and secondary outcomes (institutionalization, effectiveness, anticipated sustainment) at four time-points were collected. We performed descriptive statistics and directed content analysis using Hailemariam et al.'s factors influencing sustainment. RESULTS: After approximately five years post-implementation (e.g., 2021 sustainment outcomes), of the 82 facilities, about one-third fully sustained their practice compared to one-third that did not fully sustain their practice because it was in a "liminal" stage (neither sustained nor discontinued) or permanently discontinued. The remaining one-third of facilities had missing 2021 sustainment outcomes. A higher percentage of facilities (70%) had inconsistent primary outcomes (changing over time) compared to facilities (30%) with consistent primary outcomes (same over time). Thirty-four percent of facilities with sustained practices reported resilience since they overcame implementation and sustainment barriers. Facilities with sustained practices reported more positive secondary outcomes compared to those that did not sustain their practice. Key factors facilitating practice sustainment included: demonstrating practice effectiveness/benefit, sufficient organizational leadership, sufficient workforce, and adaptation/alignment with local context. Key factors hindering practice sustainment included: insufficient workforce, not able to maintain practice fidelity/integrity, critical incidents related to the COVID-19 pandemic, organizational leadership did not support sustainment of practice, and no ongoing support. CONCLUSIONS: We identified diverse pathways from implementation to sustainment, and our data underscore that initial implementation outcomes may not determine long-term sustainment outcomes. This longitudinal evaluation contributes to understanding impacts of the DoE program, including return on investment, achieving learning health system goals, and insights into achieving high-quality healthcare in VHA.

Validating a tool to measure spiritual beliefs, needs and resources in serious illness: The I-SPIRIT.

BACKGROUND: Seriously ill patients rely on spiritual and existential beliefs to support coping and approach crucial treatment and healthcare decisions. Yet, we lack gold standard, validated approaches to gathering information on those spiritual beliefs. Therefore, we developed I-SPIRIT, a spiritual needs and beliefs inventory for those with serious illness (IIR-10-050). METHODS: In prior work to develop measure content, we interviewed a total of 74 participants: 20 patients (veterans with Stage IV cancer, CHF, COPD, ESRD), 19 caregivers, 14 chaplains, 10 social workers, 12 nurses, and 5 physicians. Using directed content analyses, we identified over 50 attributes of spiritual experience comprising five domains: overall importance of spirituality; affiliations and practices; impact on decisions; spiritual needs; and spiritual resources. We then translated these attributes into individual items with Likert response scales. In the quantitative validation of I-SPIRIT, we administered the instrument and a battery of comparison measures to 249 seriously ill veterans. The comparison measures captured general spiritual well-being, religious coping, and emotional functioning. Convergent and discriminant validity was examined with the FACIT-sp (faith, meaning, and purpose), BMMRS (religious/spirituality), POMS and PHQ-8 (emotional function), and FACT-G (quality of life). We administered the I-SPIRIT a week later, for test-retest reliability. RESULTS: Psychometric analyses yielded a final I-SPIRIT Tool including 30 items. Results demonstrated reliability and validity and yielded a tool with three main components: Spiritual Beliefs (seven items); Spiritual Needs (nine items); and Spiritual Resources (14 items). The Spiritual Beliefs items include key practices and affiliations, and impact of beliefs on healthcare. Higher levels of Spiritual Needs were associated with higher anxiety and depression. CONCLUSION: The I-Spirit measures relevance of spirituality, spiritual needs and spiritual resources and demonstrates validity, reliability, and acceptability for patients with serious illness.

Understanding veterans' experiences with lung cancer and psychological distress: A multimethod approach.

Psychological distress while coping with cancer is a highly prevalent and yet underrecognized and burdensome adverse effect of cancer diagnosis and treatment. Left unaddressed, psychological distress can further exacerbate poor mental health, negatively influence health management behaviors, and lead to a worsening quality of life. This multimethod study primarily focused on understanding veterans' psychological distress and personal experiences living with lung cancer (an underrepresented patient population). In a sample of 60 veterans diagnosed with either nonsmall cell lung cancer (NSCLC) or small cell lung cancer (SCLC), we found that distress is common across clinical psychology measures of depression (37% [using the Patient Health Questionnaire, PHQ-9 measure]), anxiety (35% [using the Generalized Anxiety Disorder, GAD-7 measure]), and cancer-related posttraumatic stress (13% [using the Posttraumatic Stress Symptom Checklist measure]). A total of 23% of the sample endorsed distress scores on two or more mental health screeners. Using a broader cancer-specific distress measure (National Comprehensive Cancer Network), 67% of our sample scored above the clinical cutoff (i.e., ≥ 3), and in the follow-up symptom checklist of the National Comprehensive Cancer Network measure, a majority endorsed feeling sadness (75%), worry (73%), and depression (60%). Qualitative analysis with a subset of 25 veterans highlighted that psychological distress is common, variable in nature, and quite bothersome. Future research should (a) identify veterans at risk for distress while living with lung cancer and (b) test supportive mental health interventions to target psychological distress among this vulnerable veteran population. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Factors influencing support for the implementation of community-based out-of-hospital cardiac arrest interventions in high- and low-performing counties.

Aim of the study: Survival to hospital discharge from out-of-hospital cardiac arrest (OHCA) after receiving treatment from emergency medical services (EMS) is less than 10% in the United States. Community-focused interventions improve survival rates, but there is limited information on how to gain support for new interventions or program activities within these populations. Using data from the RAndomized Cluster Evaluation of Cardiac ARrest Systems (RACE-CARS) trial, we aimed to identify the factors influencing emergency response agencies' support in implementing an OHCA intervention. Methods: North Carolina counties were stratified into high-performing or low-performing counties based on the county's cardiac arrest volume, percent of bystander-cardiopulmonary resuscitation (CPR) performed, patient survival to hospital discharge, cerebral performance in patients after cardiac arrest, and perceived engagement in the RACE-CARS project. We randomly selected 4 high-performing and 3 low-performing counties and conducted semi-structured qualitative interviews with emergency response stakeholders in each county. Results: From 10/2021 to 02/2022, we completed 29 interviews across the 7 counties (EMS (n = 9), telecommunications (n = 7), fire/first responders (n = 7), and hospital representatives (n = 6)). We identified three themes salient to community support for OHCA intervention: (1) initiating support at emergency response agencies; (2) obtaining support from emergency response agency staff (senior leadership and emergency response teams); and (3) and maintaining support. For each theme, we described similarities and differences by high- and low-performing county. Conclusions: We identified techniques for supporting effective engagement of emergency response agencies in community-based interventions for OHCA improving survival rates. This work may inform future programs and initiatives around implementation of community-based interventions for OHCA.

Implementation of Direct-to-Patient Mobile Teledermatology in VA.

BACKGROUND: Innovative technology can enhance patient access to healthcare but must be successfully implemented to be effective. OBJECTIVE: We evaluated Department of Veterans Affairs' (VA's) implementation of My VA Images, a direct-to-patient asynchronous teledermatology mobile application enabling established dermatology patients to receive follow-up care remotely instead of in-person. DESIGN /PARTICIPANTS/APPROACH: Following pilot testing at 3 facilities, the app was introduced to 28 facilities (4 groups of 7) every 3 months using a stepped-wedge cluster-randomized design. Using the Organizational Theory of Implementation Effectiveness, we examined the app's implementation using qualitative and quantitative data consisting of encounter data from VA's corporate data warehouse; app usage from VA's Mobile Health database; bi-monthly reports from facility representatives; phone interviews with clinicians; and documented communications between the operational partner and facility staff. KEY RESULTS: Implementation policies and practices included VA's vision to expand home telehealth and marketing/communication strategies. The COVID-19 pandemic dominated the implementation climate by stressing staffing, introducing competing demands, and influencing stakeholder attitudes to the app, including its fit to their values. These factors were associated with mixed implementation effectiveness, defined as high quality consistent use. Nineteen of 31 exposed facilities prepared to use the app; 10 facilities used it for actual patient care, 7 as originally intended. Residents, nurse practitioners, and physician assistants were more likely than attendings to use the app. Facilities exposed to the app pre-pandemic were more likely to use and sustain the new process. CONCLUSIONS: Considerable heterogeneity existed in implementing mobile teledermatology, despite VA's common mission, integrated healthcare system, and stakeholders' broad interest. Identifying opportunities to target favorable facilities and user groups (such as teaching facilities and physician extenders, respectively) while addressing internal implementation barriers including incomplete integration with the electronic health record as well as inadequate staffing may help optimize the initial impact of direct-to-patient telehealth. The COVID pandemic was a notable extrinsic barrier. CLINICAL TRIALS REGISTRATION: NCT03241589.

Implementation evaluation of a teledermatology virtual clinic at an academic medical center.

BACKGROUND: Teledermatology (TD) is an evidence-based practice that may increase access to dermatologic care. We sought to use the Exploration, Preparation, Implementation, and Sustainment (EPIS) and the Reach, Efficacy, Adoption, Implementation, and Maintenance (RE-AIM) frameworks to evaluate implementation of TD at Duke. METHODS: The EPIS and RE-AIM frameworks were deployed to design and implement a TD program that leveraged the strengths of the Duke University Health System and addressed previously reported barriers to implementation of store-and-forward and synchronous TD models. In the resultant hybrid TD model, trained primary care providers (PCPs) sent e-comm referrals with clinical and dermatoscopic images to dermatology. These e-consults were reviewed asynchronously and patients were scheduled for a synchronous video visit with dermatology within days. Dermatologists managed the patient plan. This hybrid TD model was piloted at four primary care clinics. Pertinent outcomes from a TD-adapted RE-AIM framework were tracked using electronic health record data. Patient satisfaction was assessed using a post-video visit survey (n = 18). Implementation barriers and facilitators were also collected through provider surveys (n = 24 PCPs, n = 10 dermatologists, n = 10 dermatology residents). RESULTS: At four PCP clinics throughout 9/1/2021-4/30/2022, there were 218 TD referrals. Video visits occurred on average 7.5 ± 0.5 days after referral and 18/18 patients completing the post-visit survey were satisfied. Adoption varied between clinics, with one placing 22% of all dermatology referrals as TD and another placing 2%. The primary PCP barriers to TD were time burdens, lack of fit in clinic flow, and discomfort with image taking. Top-endorsed potential facilitating interventions included allowing for rash referrals without dermoscopy and assurance for clinical evaluation within 3 days. CONCLUSIONS: The use of implementation science frameworks allowed for identification of system and contextual strengths which informed the hybrid TD pilot. Barriers and facilitating interventions will provide guidance for expansion and ongoing maintenance of TD.

The Future Ain't What It Used to Be Out With the Old In With the Better: Antibacterial Resistance Leadership Group Innovations.

Clinical research networks conduct important studies that would not otherwise be performed by other entities. In the case of the Antibacterial Resistance Leadership Group (ARLG), such studies include diagnostic studies using master protocols, controlled phage intervention trials, and studies that evaluate treatment strategies or dynamic interventions, such as sequences of empiric and definitive therapies. However, the value of a clinical research network lies not only in the results from these important studies but in the creation of new approaches derived from collaborative thinking, carefully examining and defining the most important research questions for clinical practice, recognizing and addressing common but suboptimal approaches, and anticipating that the standard approaches of today may be insufficient for tomorrow. This results in the development and implementation of new methodologies and tools for the design, conduct, analyses, and reporting of research studies. These new methodologies directly impact the studies conducted within the network and have a broad and long-lasting impact on the field, enhancing the scientific value and efficiency of generations of research studies. This article describes innovations from the ARLG in diagnostic studies, observational studies, and clinical trials evaluating interventions for the prevention and treatment of antibiotic-resistant bacterial infections.

Feasibility of Implementation of a Mobile Digital Personal Health Record to Coordinate Care for Children and Youth With Special Health Care Needs in Primary Care: Protocol for a Mixed Methods Study.

BACKGROUND: Electronic health record (EHR)-integrated digital personal health records (PHRs) via Fast Healthcare Interoperability Resources (FHIR) are promising digital health tools to support care coordination (CC) for children and youth with special health care needs but remain widely unadopted; as their adoption grows, mixed methods and implementation research could guide real-world implementation and evaluation. OBJECTIVE: This study (1) evaluates the feasibility of an FHIR-enabled digital PHR app for CC for children and youth with special health care needs, (2) characterizes determinants of implementation, and (3) explores associations between adoption and patient- or family-reported outcomes. METHODS: This nonrandomized, single-arm, prospective feasibility trial will test an FHIR-enabled digital PHR app's use among families of children and youth with special health care needs in primary care settings. Key app features are FHIR-enabled access to structured data from the child's medical record, families' abilities to longitudinally track patient- or family-centered care goals, and sharing progress toward care goals with the child's primary care provider via a clinician dashboard. We shall enroll 40 parents or caregivers of children and youth with special health care needs to use the app for 6 months. Inclusion criteria for children and youth with special health care needs are age 0-16 years; primary care at a participating site; complex needs benefiting from CC; high hospitalization risk in the next 6 months; English speaking; having requisite technology at home (internet access, Apple iOS mobile device); and an active web-based EHR patient portal account to which a parent or caregiver has full proxy access. Digital prescriptions will be used to disseminate study recruitment materials directly to eligible participants via their existing EHR patient portal accounts. We will apply an intervention mixed methods design to link quantitative and qualitative (semistructured interviews and family engagement panels with parents of children and youth with special health care needs) data and characterize implementation determinants. Two CC frameworks (Pediatric Care Coordination Framework; Patient-Centered Medical Home) and 2 evaluation frameworks (Consolidated Framework for Implementation Research; Technology Acceptance Model) provide theoretical foundations for this study. RESULTS: Participant recruitment began in fall 2022, before which we identified >300 potentially eligible patients in EHR data. A family engagement panel in fall 2021 generated formative feedback from family partners. Integrated analysis of pretrial quantitative and qualitative data informed family-centered enhancements to study procedures. CONCLUSIONS: Our findings will inform how to integrate an FHIR-enabled digital PHR app for children and youth with special health care needs into clinical care. Mixed methods and implementation research will help strengthen implementation in diverse clinical settings. The study is positioned to advance knowledge of how to use digital health innovations for improving care and outcomes for children and youth with special health care needs and their families. TRIAL REGISTRATION: ClinicalTrials.gov NCT05513235; https://clinicaltrials.gov/study/NCT05513235. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/46847.

Supporting Veteran's Administration Medical Center Directors' Decisions When Adopting Innovative Practices: Development and Implementation of the "QuickView" and "WishList" Tools.

Background Since 2015, the Veterans Health Administration (VHA) Diffusion of Excellence Program has supported spread of practices developed by frontline employees. Shark Tank-style competitions encourage "Sharks" nationwide (VHA medical center/regional directors) to bid for the opportunity to implement practices at their institutions. Methods The authors evaluated bidding strategies (2016-2020), developing the "QuickView" practice comparator to promote informed bidding. Program leaders distributed QuickView and revised versions in subsequent competitions. Our team utilized in-person observation, online chats after the competition, bidder interviews, and bid analysis to evaluate QuickView use. Bids were ranked based on demonstrated understanding of resources required for practice implementation. Results Sharks stated that QuickView supported preparation before the competition and suggested improvements. Our revised tool reported necessary staff time and incorporated a "WishList" from practice finalists detailing minimum requirements for successful implementation. Bids from later years reflected increased review of facilities' current states before the competition and increased understanding of the resources needed for implementation. Percentage of bids describing local need for the practice rose from 2016 to 2020: 4.7% (6/127); 62.1% (54/87); 78.3% (36/46); 80.6% (29/36); 89.7% (26/29). Percentage of bids committing specific resources rose following QuickView introduction: 81.1% (103/127) in 2016, 69.0% (60/87) in 2017, then 73.9% (34/46) in 2018, 88.9% (32/36) in 2019, and 89.7% (26/29) in 2020. Discussion In the years following QuickView/WishList implementation, bids reflected increased assessment before the competition of both local needs and available resources. Conclusion Selection of a new practice for implementation requires an understanding of local need, necessary resources, and fit. QuickView and WishList appear to support these determinations.

Partner engagement for planning and development of non-pharmacological care pathways in the AIM-Back trial.

BACKGROUND/AIMS: Embedded pragmatic clinical trials are increasingly recommended for non-pharmacological pain care research due to their focus on examining intervention effectiveness within real-world settings. Engagement with patients, health care providers, and other partners is essential, yet there is limited guidance for how to use engagement to meaningfully inform the design of interventions to be tested in pain-related pragmatic clinical trials. This manuscript aims to describe the process and impacts of partner input on the design of two interventions (care pathways) for low back pain currently being tested in an embedded pragmatic trial in the Veterans Affairs health care system. METHODS: Sequential cohort design for intervention development was followed. Engagement activities were conducted with 25 participants between November 2017 and June 2018. Participants included representatives from multiple groups: clinicians, administrative leadership, patients, and caregivers. RESULTS: Partner feedback led to several changes in each of the care pathways to improve patient experience and usability. Major changes to the sequenced care pathway included transitioning from telephone-based delivery to a flexible telehealth model, increased specificity about pain modulation activities, and reduction of physical therapy visits. Major changes to the pain navigator pathway included transitioning from a traditional stepped care model to one that offers care in a feedback loop, increased flexibility regarding pain navigator provider type, and increased specificity for patient discharge criteria. Centering patient experience emerged as a key consideration from all partner groups. CONCLUSION: Diverse input is important to consider before implementing new interventions in embedded pragmatic trials. Partner engagement can increase acceptability of new care pathways to patients and providers and enhance uptake of effective interventions by health systems. TRIAL REGISTRATION: NCT#04411420. Registered on 2 June 2020.

Impact of COVID-19 pandemic on nonpharmacological pain management trials in military and veteran healthcare settings: an evaluation informed by implementation science.

The coronavirus disease (COVID-19) pandemic disrupted healthcare and clinical research, including a suite of 11 pragmatic clinical trials (PCTs), across clinics within the Department of Veterans Affairs (VA) and the Department of Defense (DOD). These PCTs were designed to evaluate an array of nonpharmacological treatments and models of care for treatment of patients with pain and co-occurring conditions. The aims of the study are to (a) describe modifications to PCTs and interventions to address the evolving pandemic and (b) describe the application of implementation science methods for evaluation of those PCT modifications. The project used a two-phase, sequential, mixed-methods design. In Phase I, we captured PCT disruptions and modifications via a Research Electronic Data Capture questionnaire, using Periodic Reflections methods as a guide. In Phase II, we utilized the Framework for Reporting Adaptations and Modifications-Expanded (FRAME) taxonomy to develop a focus group interview guide and checklist that would provide more in-depth data than Phase I. Data were analyzed using directed content analysis. Phase I revealed that all PCTs made between two and six trial modifications. Phase II, FRAME-guided analyses showed that the key goals for modifying interventions were increasing treatment feasibility and decreasing patient exposure to COVID-19, while preserving intervention core elements. Context (format) modifications led eight PCTs to modify parts of the interventions for virtual delivery. Content modifications added elements to enhance patient safety; tailored interventions for virtual delivery (counseling, exercise, mindfulness); and modified interventions involving manual therapies. Implementation science methods identified near-real-time disruptions and modifications to PCTs focused on pain management in veteran and military healthcare settings.

Active-duty personnel and veterans often report pain and seek treatment in military and veteran healthcare settings. Nondrug treatments, such as self-care, counseling, exercise, and manual therapy, are recommended for most patients with chronic pain. The COVID-19 pandemic has affected clinical trials of these nondrug treatments in military and veteran populations. In this study, we explored how 11 research teams adapted study trials on pain to address COVID-19. Team members completed online questions, brief checklists, and a one-time focus group about how they modified their trials. Each of the 11 trials made 2 to 6 changes to their studies. Most paused or delayed recruitment efforts. Many shifted parts of the study to a virtual format. Goals for adapting treatments included improved feasibility and decreased patient exposure to COVID-19. Context or format changes increased virtual delivery of study treatments. Content changes focused on patient safety, tailoring treatments for virtual delivery, and offering varied manual therapies. Provider concerns about technology and patient willingness to seek in-person care during the pandemic also were factors driving changes. These findings may support the increased use of virtual care for pain management in military and veteran health settings.

Implementation Evaluation of a Teledermatology Virtual Clinic at an Academic Medical Center.

Background: Teledermatology (TD) is an evidence-based practice that may increase access to dermatologic care. We sought to evaluate implementation of TD at four Duke primary care practices. Methods: We implemented a hybrid TD program where trained primary care providers (PCPs) sent referrals with clinical and dermatoscopic images to dermatology. Patients were seen by dermatologists over video visit within days, and dermatologists managed the patient plan. We evaluated implementation using the Reach, Efficacy, Adoption, Implementation, and Maintenance (RE-AIM) framework using electronic health record data. Implementation barriers and facilitators were collected through surveys (n = 24 PCPs, n = 10 dermatologists, n = 10 dermatology residents). Results: At four PCP clinics throughout 9/1/2021-4/30/2022 there were 218 TD referrals. Video visits occurred on average 7.5 days after referral and 18/18 patients completing the post-visit survey were satisfied. Adoption varied between clinics, with one placing 22% of all dermatology referrals as TD and another placing 2%. The primary PCP barriers to TD were time burdens, lack of fit in clinic flow, and discomfort with image taking. Top-endorsed potential facilitating interventions included allowing for rash referrals without dermoscopy and assurance for clinical evaluation within 3 days. Conclusions: Addressing TD process fit into PCP clinic flow and reducing time burdens may increase PCP uptake of TD.

Veterans Health Administration National TeleOncology Service.

PURPOSE: As the largest integrated health care system in the United States, the Veterans Health Administration (VA) is a leader in telehealth-delivered care. All 10 million Veterans cared for within the VA are eligible for telehealth. The VA cares for approximately 46,000 Veteran patients with newly diagnosed cancer and an estimated 400,000 prevalent cases annually. With nearly 38% of VA health care system users residing in rural areas and only 44% of rural counties having an oncologist, many Veterans lack local access to specialized cancer services. METHODS: We describe the VA's National TeleOncology (NTO) Service. NTO was established to provide Veterans with the opportunity for specialized treatment regardless of geographical location. Designed as a hub-and-spoke model, VA oncologists from across the country can provide care to patients at spoke sites. Spoke sites are smaller and rural VA medical centers that are less able to independently provide the full range of services available at larger facilities. In addition to smaller rural spoke sites, NTO also provides subspecialized oncology care to Veterans located in larger VA medical facilities that do not have subspecialties available or that have limited capacity. RESULTS: As of fiscal year 2021, 23 clinics are served by or engaged in planning for delivery of NTO and there are 24 physicians providing care through the NTO virtual hub. Most NTO physicians continue to provide patient care in separate traditional in-person clinics. Approximately 4,300 unique Veterans have used NTO services. Approximately half (52%) of Veterans using NTO lived in rural areas. Most of these Veterans had more than one remote visit through NTO. CONCLUSION: NTO is a state-of-the-art model that has the potential to revolutionize the way cancer care is delivered, which should improve the experience of Veterans receiving cancer care.

Sustainment of diverse evidence-informed practices disseminated in the Veterans Health Administration (VHA): initial development and piloting of a pragmatic survey tool.

BACKGROUND: There are challenges associated with measuring sustainment of evidence-informed practices (EIPs). First, the terms sustainability and sustainment are often falsely conflated: sustainability assesses the likelihood of an EIP being in use in the future while sustainment assesses the extent to which an EIP is (or is not) in use. Second, grant funding often ends before sustainment can be assessed. The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program is one of few large-scale models of diffusion; it seeks to identify and disseminate practices across the VHA system. The DoE sponsors "Shark Tank" competitions, in which leaders bid on the opportunity to implement a practice with approximately 6 months of implementation support. As part of an ongoing evaluation of the DoE, we sought to develop and pilot a pragmatic survey tool to assess sustainment of DoE practices. METHODS: In June 2020, surveys were sent to 64 facilities that were part of the DoE evaluation. We began analysis by comparing alignment of quantitative and qualitative responses; some facility representatives reported in the open-text box of the survey that their practice was on a temporary hold due to COVID-19 but answered the primary outcome question differently. As a result, the team reclassified the primary outcome of these facilities to Sustained: Temporary COVID-Hold. Following this reclassification, the number and percent of facilities in each category was calculated. We used directed content analysis, guided by the Consolidated Framework for Implementation Research (CFIR), to analyze open-text box responses. RESULTS: A representative from forty-one facilities (64%) completed the survey. Among responding facilities, 29/41 sustained their practice, 1/41 partially sustained their practice, 8/41 had not sustained their practice, and 3/41 had never implemented their practice. Sustainment rates increased between Cohorts 1-4. CONCLUSIONS: The initial development and piloting of our pragmatic survey allowed us to assess sustainment of DoE practices. Planned updates to the survey will enable flexibility in assessing sustainment and its determinants at any phase after adoption. This assessment approach can flex with the longitudinal and dynamic nature of sustainment, including capturing nuances in outcomes when practices are on a temporary hold. If additional piloting illustrates the survey is useful, we plan to assess the reliability and validity of this measure for broader use in the field.

Organizational Readiness for Patient-Facing Mobile Teledermatology to Care for Established Veteran Patients in the United States.

Purpose: To improve patient access to skin care, the Department of Veterans Affairs (VA) developed a patient-facing asynchronous mobile teledermatology application (app), which allows patients to follow up remotely with dermatologists. To understand how the app would be received in VA, we examined Organizational Readiness for Change (ORC), an important prelude to effective implementation, which includes the shared resolve and collective ability of organizational members to implement a change. Methods: We used a mixed-methods multiple case study approach to assess ORC at three VA facilities. Data derived from a site process call, surveys, and semistructured telephone interviews of VA staff, field notes, and administrative data. Results: Participants at all three facilities supported the intervention and recognized the value of using the app to increase patients' access to dermatologists, but expressed concerns largely related to disruption of the pre-existing clinical workflow. Participants at the facility most actively using the app had the highest overall ORC score and reported the most facilitators. Facility leadership support when guided by a clinical champion minimized barriers by recognizing the complexities of health care provision at specialty clinics. Discussion: While provider buy-in remained a barrier, leadership, guided by the clinical champion, played a critical role instituting implementation strategies. The strong association between the ORC survey score and the presence of facilitators and barriers suggests that the ORC survey may be a rapid, convenient, and effective tool for health care systems to identify favorable sites for wider implementation of mobile telehealth care. Clinical Trials Identifier: NCT03241589.

Diffusion of excellence: evaluating a system to identify, replicate, and spread promising innovative practices across the Veterans health administration.

Introduction: The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program provides a system to identify, replicate, and spread promising practices across the largest integrated healthcare system in the United States. DoE identifies innovations that have been successfully implemented in the VHA through a Shark Tank style competition. VHA facility and regional directors bid resources needed to replicate promising practices. Winning facilities/regions receive external facilitation to aid in replication/implementation over the course of a year. DoE staff then support diffusion of successful practices across the nationwide VHA. Methods: Organized around the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) Framework, we summarize results of an ongoing long-term mixed-methods implementation evaluation of DoE. Data sources include: Shark Tank application and bid details, tracking practice adoptions through a Diffusion Marketplace, characteristics of VHA facilities, focus groups with Shark Tank bidders, structured observations of DoE events, surveys of DoE program participants, and semi-structured interviews of national VHA program office leaders, VHA healthcare system/facility executives, practice developers, implementation teams and facilitators. Results: In the first eight Shark Tanks (2016-2022), 3,280 Shark Tank applications were submitted; 88 were designated DoE Promising Practices (i.e., practices receive facilitated replication). DoE has effectively spread practices across the VHA, with 1,440 documented instances of adoption/replication of practices across the VHA. This includes 180 adoptions/replications in facilities located in rural areas. Leadership decisions to adopt innovations are often based on big picture considerations such as constituency support and linkage to organizational goals. DoE Promising Practices that have the greatest national spread have been successfully replicated at new sites during the facilitated replication process, have close partnerships with VHA national program offices, and tend to be less expensive to implement. Two indicators of sustainment indicate that 56 of the 88 Promising Practices are still being diffused across the VHA; 56% of facilities originally replicating the practices have sustained them, even up to 6 years after the first Shark Tank. Conclusion: DoE has developed a sustainable process for the identification, replication, and spread of promising practices as part of a learning health system committed to providing equitable access to high quality care.

Health and social care of home-dwelling frail older adults in Switzerland: a mixed methods study.

BACKGROUND: Home-dwelling frail older adults are often faced with multimorbidity and complex care needs, requiring health and social care systems that support frail older adults to age in place. The objective of this paper was to investigate the types of formal health and social care as well as informal care and social support used by home-dwelling frail older adults; whether they perceive their support as sufficient; and their experience with and preferences for care and support. METHODS: Using an explanatory sequential mixed methods design, we first conducted a secondary analysis of a subset of cross-sectional data from the ImplemeNtation of a community-baSed care Program for home dwelling senIoR citizEns (INSPIRE) population survey using descriptive analysis. Subsequently, we analyzed existing data from interviews in the parent study to help explain the survey results using applied thematic analysis. Results were organized according to adapted domains and concepts of the SELFIE framework and integrated via a joint display table. RESULTS: Of the parent population survey respondents, 2314 older adults indicating frailty were included in the quantitative arm of this study. Interview data was included from 7 older adults who indicated frailty. Support from health and social, formal and informal caregivers is diverse and anticipated to increase (e.g., for 'care and assistance at home' and 'meal services'). Informal caregivers fulfilled various roles and while some older adults strongly relied on them for support, others feared burdening them. Most participants (93.5%) perceived their overall support to meet their needs; however, findings suggest areas (e.g., assessment of overall needs) which merit attention to optimize future care. CONCLUSIONS: Given the anticipated demand for future care and support, we recommend efforts to prevent fragmentation between health and social as well as formal and informal care.

Patients' Experiences With Staphylococcus aureus and Gram-Negative Bacterial Bloodstream Infections: Results From Cognitive Interviews to Inform Assessment of Health-Related Quality of Life.

BACKGROUND: We previously conducted a concept elicitation study on the impact of Staphylococcus aureus and gram-negative bacterial bloodstream infections (SAB/GNB) on health-related quality of life (HRQoL) from the patient's perspective and found significant impacts on HRQoL, particularly in the physical and functional domains. Using this information and following guidance on the development of patient-reported outcome (PRO) measures, we determined which combination of measures and items (ie, specific questions) would be most appropriate in a survey assessing HRQoL in bloodstream infections. METHODS: We selected a variety of measures/items from the Patient-Reported Outcomes Measurement Information System (PROMIS) representing different domains. We purposefully sampled patients ~6-12 weeks post-SAB/GNB and conducted 2 rounds of cognitive interviews to refine the survey by exploring patients' understanding of items and answer selection as well as relevance for capturing HRQoL. RESULTS: We interviewed 17 SAB/GNB patients. Based on the first round of cognitive interviews (n = 10), we revised the survey. After round 2 of cognitive interviewing (n = 7), we finalized the survey to include 10 different PROMIS short forms/measures of the most salient HRQoL domains and 2 adapted questions (41 items total) that were found to adequately capture HRQoL. CONCLUSIONS: We developed a survey from well-established PRO measures that captures what matters most to SAB/GNB patients as they recover. This survey, uniquely tailored to bloodstream infections, can be used to assess these meaningful, important HRQoL outcomes in clinical trials and in patient care. Engaging patients is crucial to developing treatments for bloodstream infections.

eConsults' Impact on Care Access and Wait Times in Rheumatology.

BACKGROUND/OBJECTIVE: A growing number of health systems have implemented eConsults to improve access to specialty advice, but few studies have described their use in rheumatology or impact on visit wait times. We evaluated the uptake of an eConsult program and its impact on wait times for in-person rheumatology visits. METHODS: In this quality improvement project, we analyzed electronic health record data from 4 intervention clinics and 4 comparison clinics, 12 months before and after implementation of an eConsult program. We compared median wait time for rheumatology appointments using a pre-post difference-in-differences analysis and quantile regression, adjusting for patient age, race, sex, clinic pair, and primary insurance payer. We also interviewed 11 primary care providers from the intervention clinics and conducted a rheumatology provider focus group (n = 4) to elucidate experiences with the program. RESULTS: Rheumatologists recommended management in primary care or referral to another specialty for 41% of eConsults, reducing initial demand for in-person visits. The median wait times dropped in the intervention and the comparison clinics (42 and 25 days, respectively). Intervention clinic median wait time dropped 17 days more than comparison clinics, and this was nonstatistically significant (p = 0.089). eConsults fit provider care tasks best for triage or initial workup for diagnosis, and less well when tests required interpretation, or when back and forth communication was needed to manage the patient's condition. CONCLUSIONS: Implementation of eConsults for rheumatology was associated with reduced wait times for rheumatology appointments and supported primary care providers in the triage and workup for a substantial portion of patients.

Use of motivational techniques to enhance unpaid caregiver engagement in a tailored skills training intervention.

OBJECTIVES: The Helping Invested Families Improve Veterans' Experiences Study (HI-FIVES) evaluated a skills training program to support family caregivers of cognitively or functionally impaired persons. HI-FIVES demonstrated sustained improvements in caregivers' and patients' experiences of VA care. The aim of this distinct, secondary qualitative study was to explore the potential processes related to the individual tailored skills-based telephone training underpinning HI-FIVES intervention effects. We explored topics caregivers selected, characteristics of action items created, patterns of action or inaction, and barriers to action item completion across topics. METHODS: Qualitative data was analysed from 118 dyads randomized into the HI-FIVES intervention which included three weekly facilitated training calls covering five education topics and action items developed by caregivers for each topic. Qualitative analysis of text responses to questions from the training calls was used. RESULTS: Three of the top four most selected topics were caregiver-oriented and caregivers created an action item most often for self-care topics. Caregiver-oriented topics also had the highest action item completion rates. The majority of action items created met SMART guidelines for goal setting and simple structure. With regard to barriers to action item completion, caregivers commonly reported still contemplating/pending. CONCLUSION: Our findings identify motivational interviewing as an effective technique to identify critical intervention content and address barriers to achieving caregiving goals. We suggest that caregivers felt more empowered to create and complete an action item when they had more control over completing the action item, such as in topics related to their own self-care.