Coaching the coaches: exploring the effectiveness of the 'Move Well Be strong' youth injury prevention programme for grassroot coaches and PE teachers.

INTRODUCTION: Coaches play a major role in developing movement in their performers, especially at grassroots levels. However, there are significant knowledge gaps amongst grassroots coaches and physical education (PE) teachers regarding movement competency and injury prevention programs. This study aimed to explore the effectiveness of knowledge gain, adoption and implementation following a youth injury prevention workshop for grassroots coaches and PE teachers. METHODS: 56 grassroots coaches and PE teachers completed a validated questionnaire exploring use, knowledge, attitude towards and confidence to deliver youth movement competency training before and after an online workshop. Bayesian Wilcoxon signed-rank tests were used to assess the knowledge, attitude, and confidence to deliver an injury prevention programme following the workshop. For all the Bayesian inference tests run, the Bayesian factor (BF10) was interpreted using the evidence categories ranging from extreme evidence (BF10 > 100) to anecdotical evidence (BF10 < 1). RESULTS: Post-workshop there was a 34% increase in respondents indicating that they had greater knowledge of injury prevention issues (55% pre-workshop vs 89% post-workshop) with statistically positive and moderate effects (BF10 > 100 [extreme evidence]). There was also a 25% increase in respondents indicating that they had a more sympathetic attitude towards injury prevention (67% sympathetic pre-workshop vs 93% sympathetic post-workshop) with statistically moderate effects (BF10 = 87.4 [very strong evidence]). A 19% increase in attendees' confidence to deliver an injury prevention programme was observed (69% high pre-workshop vs. 89% high post-workshop) with statistically moderate effects (BF10 = 85.9 [very strong evidence]). 100% of participants indicated an intent to adopt the injury prevention programme. CONCLUSIONS: An online workshop increased knowledge and confidence in grassroots coaches and PE teachers to deliver a youth injury prevention programme. Knowledge gained from training and upskilling created a positive attitude and confidence to deliver movement competency into coaching. Appropriate resources need to be developed and delivered in an accessible way to grassroots coaches and PE teachers via workshops and should be included in governing body coaching awards or as continuing professional development for youth coaches and PE teachers.

Evaluating the implementation of weekly rifapentine-isoniazid (3HP) for tuberculosis prevention among people living with HIV in Uganda: A qualitative evaluation of the 3HP Options Trial.

Three months of isoniazid-rifapentine (3HP) is being scaled up for tuberculosis (TB) preventive treatment (TPT) among people living with HIV (PLHIV) in high-burden settings. More evidence is needed to identify factors influencing successful 3HP delivery. We conducted a qualitative assessment of 3HP delivery nested within the 3HP Options Trial, which compared three optimized strategies for delivering 3HP: facilitated directly observed therapy (DOT), facilitated self-administered therapy (SAT), and patient choice between facilitated DOT and facilitated SAT at the Mulago HIV/AIDS clinic in Kampala, Uganda. We conducted 72 in-depth interviews among PLHIV purposively selected to investigate factors influencing 3HP acceptance and completion. We conducted ten key informant interviews with healthcare providers (HCPs) involved in 3HP delivery to identify facilitators and barriers at the clinic level. We used post-trial 3HP delivery data to assess sustainability. We conducted an inductive thematic analysis and aligned the emergent themes with the RE-AIM framework dimensions to report implementation outcomes. Understanding the need for TPT, once-weekly dosing, shorter duration, and perceived 3HP safety enhanced acceptance overall. Treatment monitoring by HCPs and reduced risk of HIV status disclosure enabled DOT acceptance. Dosing autonomy enabled SAT acceptance. Switching between DOT and SAT as required enabled acceptance for patient choice. Dosing reminders, reimbursement for clinical visits, and social support enabled 3HP completion; pill burden, side effects, and COVID-19-related treatment restrictions hindered completion. All HCPs were trained and participated in 3HP delivery with high fidelity. Training, care integration, and collaboration among HCPs enabled, whereas initial concerns about 3HP safety among HCPs delayed 3HP adoption and implementation. SAT was maintained post-trial; DOT was discontinued due to inadequate ongoing financial support beyond the study period. Facilitated delivery strategies made 3HP treatment convenient for PLHIV and were feasible and implemented with high fidelity by HCPs. However, the costs of 3HP facilitation may limit wider scale-up.

Tracking implementation strategies in real-world settings: VA Office of Rural Health enterprise-wide initiative portfolio.

OBJECTIVE: To use a practical approach to examining the use of Expert Recommendations for Implementing Change (ERIC) strategies by Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) dimensions for rural health innovations using annual reports on a diverse array of initiatives. DATA SOURCES AND STUDY SETTING: The Veterans Affairs (VA) Office of Rural Health (ORH) funds initiatives designed to support the implementation and spread of innovations and evidence-based programs and practices to improve the health of rural Veterans. This study draws on the annual evaluation reports submitted for fiscal years 2020-2022 from 30 of these enterprise-wide initiatives (EWIs). STUDY DESIGN: Content analysis was guided by the RE-AIM framework conducted by the Center for the Evaluation of Enterprise-Wide Initiatives (CEEWI), a Quality Enhancement Research Initiative (QUERI)-ORH partnered evaluation initiative. DATA COLLECTION AND EXTRACTION METHODS: CEEWI analysts conducted a content analysis of EWI annual evaluation reports submitted to ORH. Analysis included cataloguing reported implementation strategies by Reach, Adoption, Implementation, and Maintenance (RE-AIM) dimensions (i.e., identifying strategies that were used to support each dimension) and labeling strategies using ERIC taxonomy. Descriptive statistics were conducted to summarize data. PRINCIPAL FINDINGS: A total of 875 implementation strategies were catalogued in 73 reports. Across these strategies, 66 unique ERIC strategies were reported. EWIs applied an average of 12 implementation strategies (range 3-22). The top three ERIC clusters across all 3 years were Develop stakeholder relationships (21%), Use evaluative/iterative strategies (20%), and Train/educate stakeholders (19%). Most strategies were reported within the Implementation dimension. Strategy use among EWIs meeting the rurality benchmark were also compared. CONCLUSIONS: Combining the dimensions from the RE-AIM framework and the ERIC strategies allows for understanding the use of implementation strategies across each RE-AIM dimension. This analysis will support ORH efforts to spread and sustain rural health innovations and evidence-based programs and practices through targeted implementation strategies.

Innovate! Accelerate! Evaluate! Harnessing the RE-AIM framework to examine the global dissemination of parenting resources during COVID-19 to more than 210 million people.

BACKGROUND: Parents were at the forefront of responding to the needs of children during the COVID-19 pandemic. This study used the RE-AIM framework to examine the Reach, Effectiveness, Adoption, Implementation, and Maintenance of a global inter-agency initiative that adapted evidence-based parenting programs to provide immediate support to parents. METHODS: Data were collected via short surveys sent via email, online surveys, and analysis of social media metrics and Google Analytics. Retrospective surveys with 1,303 parents and caregivers in 11 countries examined impacts of the resources on child maltreatment, positive relationship building, parenting efficacy, and parenting stress. RESULTS: The parenting resources were translated into over 135 languages and dialects; reached an estimated minimum 212.4 million people by June 2022; were adopted by 697 agencies, organizations, and individuals; and were included in 43 national government COVID-19 responses. Dissemination via social media had the highest reach (n = 144,202,170, 67.9%), followed by radio broadcasts (n = 32,298,525, 15.2%), text messages (n = 13,565,780, 6.4%), and caseworker phone calls or visits (n = 8,074,787, 3.8%). Retrospective surveys showed increased parental engagement and play, parenting self-efficacy, confidence in protecting children from sexual abuse, and capacity to cope with stress, as well as decreased physical and emotional abuse. Forty-four organizations who responded to follow-up surveys in April 2021 reported sustained use of the resources as part of existing services and other crisis responses. CONCLUSION: This study highlights the importance of a) establishing an international collaboration to rapidly adapt and disseminate evidence-based content into easily accessible resources that are relevant to the needs of parents; b) creating open-source and agile delivery models that are responsive to local contexts and receptive to further adaptation; and c) using the best methods available to evaluate a rapidly deployed global emergency response in real-time. Further research is recommended to empirically establish the evidence of effectiveness and maintenance of these parenting innovations.

Evaluation of implementation of evidence-based public health training in sub-Saharan Africa.

Background: The Collaboration for Evidence-based Healthcare and Public Health in Africa (CEBHA+) developed and offered a course on evidence-based public health (EBPH) in five sub-Saharan African (SSA) countries to enhance individual and institutional capacity. Aim: This study aims to assess, compare and learn from implementing the CEBHA+ EBPH course using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework and Practical, Robust, Implementation and Sustainability Model (PRISM). Setting: This study involved CEHBA+ partner universities in five countries in SSA. Methods: We developed a framework that draws on signalling questions for RE-AIM and PRISM dimensions. Country teams reflected on, discussed and mapped unique experiences. Using this framework, we then elicited common themes across countries and distilled country-specific experiences through virtual discussions. Results: Across countries, 130 public health practitioners, researchers and students completed the course (Reach). The course increased EBPH knowledge and skills and the capacity to teach EBPH and resulted in immediate opportunities for applying skills (Effectiveness). Hybrid offering in two countries presented challenges regarding Internet connectivity and hybrid discussions. Facilitators had previous training in teaching EBPH. While learning material was the same across countries, the content was adapted to represent local public health priorities (Implementation, Adoption). Course materials have informed other related training leading to spin-offs (Maintenance). Institutionalisation is dependent on external funding. Conclusion: Strengthening EBPH capacity across contexts is feasible. Curricula containing both core and contextualised elements create an authentic learning environment. Formal evaluations should be embedded within capacity-strengthening initiatives. Contribution: This is the first study evaluating EBPH training in SSA using an implementation science lens, offering learning about context-relevant adaptations that assist with plans for sustainability and scale.

Effects and implementation of an intervention to improve sleep, fatigue and recovery among healthcare workers with night shifts: A pre- and post-test study.

BACKGROUND: Previous intervention studies among night workers mainly focused on single interventions and found inconclusive evidence for effectiveness. A comprehensive intervention approach that includes individual and environmental components has been argued as important. Gaining insight into contributing factors for the implementation of interventions for night workers and effectiveness is important to distinguish between theory and programme failure. OBJECTIVES: To evaluate the effects and implementation of the PerfectFit@Night intervention to improve sleep, fatigue and recovery of night workers in healthcare, using the RE-AIM framework, which assesses reach, effectiveness, adoption, implementation and maintenance of interventions. DESIGN: A prospective pre-post study design, with two measurements before and three and six months after the intervention. SETTING: Twelve different departments of a university hospital in the Netherlands. PARTICIPANTS: Healthcare workers working night shifts (n = 210). METHODS: PerfectFit@Night consisted of environmental (provision of a powernap bed and healthy food, and workshop healthy rostering) and individual elements (e-learning and sleep coaching) and was implemented for three months in a phased manner. Questionnaires, logbooks and interview data were used. Effects of the intervention on sleep, fatigue and recovery were evaluated with mixed-effects models, and implementation factors of reach, adoption, implementation and maintenance were evaluated. RESULTS: Night shift-related insomnia (-11 %-points, 95 % CI: -19 %, -4 % at three months), need for recovery (ß: -2.45, 95 % CI: -4.86, -0.03 at six months) and fatigue (OR: 0.46, 95 % CI: 0.25, 0.86 at six months) decreased significantly after the intervention. No changes were found for subjective sleep quality and sleep duration. Barriers and facilitators for implementation were identified for each intervention element at individual (e.g., dietary preferences), organisational (e.g., responsibilities at work) and workplace levels (e.g., location of power nap bed), and for the intervention itself (e.g., useful information in e-learning). Although satisfaction was high and continuation was preferred, embedding of the intervention in the daily routine was limited. Facilitators for future implementation include a positive attitude towards the intervention, clear guidelines regarding intervention elements, appointment of night workers as ambassadors, and suitable conditions in terms of work demands and for the intervention elements. CONCLUSIONS: The multi-faceted PerfectFit@Night intervention reduced insomnia, fatigue and need for recovery in night workers in healthcare. The most important facilitators to improve the implementation of PerfectFit@Night exist at the organisational level (e.g., positive attitude within the culture and suitable work demands). Combining effect and implementation evaluation is crucial to identify barriers and facilitators that hamper or enhance intervention effects. TRIAL REGISTRATION: The study was registered in the Netherlands Trial Register on 17 January 2021 (trial number NL9224).

An evaluation of the best practices and barriers for the Nagasaki acute myocardial infarction secondary prevention clinical pathway.

AIMS: The Nagasaki Acute Myocardial Infarction Secondary Prevention Clinical Pathway (NASP), a guideline-based regional clinical pathway, was developed to manage low-density lipoprotein cholesterol levels for patients with acute myocardial infarction (AMI) in the Nagasaki prefecture in Japan. This study aimed to summarize the perceived best practices and barriers for the dissemination and operation of the NASP. METHODS: This exploratory sequential mixed methods study was developed around the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework. Focus group interviews were conducted with 24 physicians with experience treating AMI in alignment with the NASP at foundation hospitals. The identified themes and insights were integrated into the development of the questionnaire. The web-based, self-administered questionnaire with a cross-sectional study design was given to 62 physicians in the Nagasaki prefecture. Mixed-method data integration of the results from both study phases was conducted through meta-inferences made from the qualitative and quantitative data. RESULTS: The best practices included the development of multi-disciplinary operation teams at medical facilities in preparation for the implementation of the NASP, the simplification of the document preparation process, and the establishment of an additional medical fees policy for the utilization of the NASP instead of patient referral documents. Practices tailored to the type of medical institute such as instructing patients on the NASP regimen during index hospitalization for acute-care hospitals, and the development of NASP instructions and manuals for primary care hospitals/outpatient clinics were also recommended. In addition, barriers to the implementation of the NASP such as missed eligible AMI patients for the NASP and the inconsistent implementation to eligible AMI patients were identified. CONCLUSIONS: This study identified the perceived best practices and barriers for the NASP. This knowledge should be considered when expanding the NASP to other institutions across Japan.

Implementation of COVID-19 infection control best practices in nursing homes amid the pandemic.

BACKGROUND: The COVID-19 pandemic has claimed around 170,000 lives among nursing home residents and staff in the United States through April 2023. In a cluster randomized controlled trial (RCT) with 136 nursing homes, we delivered training to improve COVID-19 infection control best practices. We sought to assess the implementation of infection control practices in participating nursing homes. METHODS: Concurrent with the delivery of the RCT (January-November 2021), we surveyed nursing home administrators (NHAs, n = 38) at baseline and 6-month follow-up. Using validated items from the Centers for Disease Control and Prevention (CDC), the surveys inquired about 80 infection control best-practice activities (yes/no). The survey also asked seven scales corresponding to inner setting factors that may have impacted implementation. We assessed changes in infection control practices and inner setting factors between baseline and 6-month follow-up. RESULTS: Overall, the implementation of 11 best practices changed over time. NHAs reported an increase in the availability of informational materials for residents and families (84% vs. 100%, p = 0.031), the use of alcohol-based hand sanitizer over soap (76% vs. 97%, p = 0.008), and the development of contingency plans for increased postmortem care (53% vs. 82%, p = 0.013). The implementation of four best-practice visitation policies and three communal restrictions decreased between baseline and 6-month follow-up (all p < 0.05). Regarding inner setting factors, only culture stress (perceived strain, stress, and role overload) increased between surveys (mean scores: 3.14 vs. 3.58, p = 0.004). CONCLUSION: This study was among the first to report changes in implementing COVID-19 infection control best practices in nursing homes amid the pandemic. Culture stress was an important inner setting factor that may have impacted implementation activities. TRIAL REGISTRATION: NCT04499391 DATE OF REGISTRATION: August 3rd, 2020.

Experiences with implementing advance care planning (ACP-GP) in Belgian general practice in the context of a cluster RCT: a process evaluation using the RE-AIM framework.

BACKGROUND: General practice is often recommended as an ideal setting to initiate advance care planning (ACP), but uptake of ACP in this setting is low. ACP-GP is a complex intervention to facilitate ACP for patients with chronic, life-limiting illness in Belgian general practice. It aims to increase patient ACP engagement and general practitioner (GP) ACP self-efficacy. In a cluster-randomized controlled trial, the intervention was not superior to control in increasing these outcomes. A parallel process evaluation aimed to enhance understanding of how the intervention was implemented, and which factors might have influenced trial results. METHODS: We conducted a mixed-methods process evaluation following the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework. Data sources include recruitment and implementation monitoring, questionnaires for patients and GPs, and semi-structured (focus group) interviews with patients and GPs. Questionnaire data were analyzed descriptively. Qualitative data were first analyzed inductively; themes were then assigned deductively to RE-AIM dimensions. RESULTS: Thirty-five GPs and 95 patients were recruited to the trial; GP reach was low. Sixteen GPs and 46 patients provided questionnaire data at 3 months post-baseline; qualitative data were transcribed for 14 GPs and 11 patients. Adoption of intervention components was moderate to good, with the exception of the documentation template for GPs. Interviews revealed varying patient attitudes towards ACP, but patients nonetheless emphasized that conversations made them feel reassured. GPs especially valued a positive framing of ACP. When adopted, the intervention was well-implemented and participant satisfaction was high. However, intention for maintenance was moderate, with GPs raising questions of how to sustainably implement ACP conversations in the future. CONCLUSIONS: Implementing the complex ACP-GP intervention in general practice is feasible, and can be successful. However, the implementation process is challenging and the sustainability is suboptimal. Our findings will guide future research and recommendations for facilitating and implementing ACP in general practice. TRIAL REGISTRATION: ISRCTN12995230; prospectively registered on 19/06/2020.

Fostering Digital Life Skills Through Social Media With Adolescents in 6 German States: Protocol for an Accessibility Study According to the RE-AIM Framework.

BACKGROUND: Social media is essential in the lives of adolescents, with 97% of US teenagers engaging daily. While it facilitates communication, learning, and identity development, it also poses risks like harmful content exposure and psychological distress, particularly for adolescents in their critical developmental stage. Teaching digital life skills innovatively counters these risks, adapting traditional competencies such as decision-making, problem-solving, creative and critical thinking, communication, interpersonal skills, self-awareness, empathy, and emotional and stress management to digital challenges. OBJECTIVE: This study evaluates the accessibility of the "leduin" program, a novel intervention designed to impart digital life skills through Instagram. The program aims to leverage social media's educational potential, focusing on effective strategies to engage adolescents. Emphasizing accessibility is crucial, as it determines the program's overall impact. METHODS: The leduin program, developed through intervention mapping, applies behavior change techniques via social media for 9th and 10th graders. It is a 14-week spaced learning curriculum with daily sessions <5 minutes. Emphasizing the "reach" aspect of the reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) model, the recruitment targets diverse educational settings across 6 German states, aiming for inclusivity. Recruitment will involve schools, youth centers, and therapeutic facilities. The study seeks at least 128 participants, a calculated minimum to detect medium-sized effects in the quasi-experimental design and explore varying engagement levels and program responses. Data collection includes preintervention, postintervention, and 6-month follow-up surveys, using multilevel regression, latent growth models, and qualitative analysis to extensively assess reach and gain first insights on effectiveness, acceptance, implementation, and maintenance. The study aims to reveal key factors influencing program participation and interaction; a detailed analysis of engagement patterns will reveal the effectiveness of the recruitment strategies and barriers to participation. Additionally, initial indications of the program's impact on life skills, social media-related skills, health status, risk behaviors, and academic performance will be analyzed. RESULTS: Recruitment was planned from May 2023 until the beginning of the leduin program in October 2023. As of March 2024, we have recruited 283 participants. CONCLUSIONS: The leduin program stands as an innovative and essential initiative in adolescent health promotion, harnessing the power of social media to teach important digital life skills. This study highlights the critical role of accessibility in the success of social media interventions. Effective adolescent engagement strategies are imperative, as they dictate the overall impact of such interventions. The insights gained from this study will be instrumental in shaping future programs, laying groundwork for a subsequent, more comprehensive cluster-randomized controlled trial. The study's design acknowledges the limitations of the current quasi-experimental approach, including the anticipated sample size and the absence of a control group, and aims to provide a foundational understanding for future research in this field. TRIAL REGISTRATION: Deutsches Register Klinischer Studien DRKS00032308; https://drks.de/search/de/trial/DRKS00032308. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/51085.

RE-AIM for rural health innovations: perceptions of (mis) alignment between the RE-AIM framework and evaluation reporting in the Department of Veterans Affairs Enterprise-Wide Initiatives program.

Background: The Department of Veterans Affairs (VA) Office of Rural Health (ORH) supports national VA program offices' efforts to expand health care to rural Veterans through its Enterprise-Wide Initiatives (EWIs) program. In 2017, ORH selected Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), an implementation science framework, to structure the EWI evaluation and reporting process. As part of its mandate to improve EWI program evaluation, the Center for the Evaluation of Enterprise-Wide Initiatives conducted a qualitative evaluation to better understand EWI team' perceptions of, and barriers and facilitators to, the EWI evaluation process. Methods: We conducted 43 semi-structured interviews with 48 team members (e.g., evaluators, program office leads, and field-based leads) representing 21 EWIs from April-December 2020. Questions focused on participants' experiences using strategies targeting each RE-AIM dimension. Interviews were inductively analyzed in MAXQDA. We also systematically reviewed 51 FY19-FY20 EWI annual reports to identify trends in misapplications of RE-AIM. Results: Participants had differing levels of experience with RE-AIM. While participants understood ORH's rationale for selecting a common framework to structure evaluations, the perceived misalignment between RE-AIM and EWIs' work emerged as an important theme. Concerns centered around 3 sub-themes: (1) (Mis)Alignment with RE-AIM Dimensions, (2) (Mis)Alignment between RE-AIM and the EWI, and (3) (Mis)Alignment with RE-AIM vs. other Theories, Models, or Frameworks. Participants described challenges differentiating between and operationalizing dimensions in unique contexts. Participants also had misconceptions about RE-AIM and its relevance to their work, e.g., that it was meant for established programs and did not capture aspects of initiative planning, adaptations, or sustainability. Less commonly, participants shared alternative models or frameworks to RE-AIM. Despite criticisms, many participants found RE-AIM useful, cited training as important to understanding its application, and identified additional training as a future need. Discussion: The selection of a shared implementation science framework can be beneficial, but also challenging when applied to diverse initiatives or contexts. Our findings suggest that establishing a common understanding, operationalizing framework dimensions for specific programs, and assessing training needs may better equip partners to integrate a shared framework into their evaluations.

Adopting the RE-AIM analytic framework for rural program evaluation: experiences from the Advance Care Planning via Group Visits (ACP-GV) national evaluation.

Introduction: To support rigorous evaluation across a national portfolio of grants, the United States Department of Veterans Affairs (VA) Office of Rural Health (ORH) adopted an analytic framework to guide their grantees' evaluation of initiatives that reach rural veterans and to standardize the reporting of outcomes and impacts. Advance Care Planning via Group Visits (ACP-GV), one of ORH's Enterprise-Wide Initiatives, also followed the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. ACP-GV is a national patient-centered intervention delivered in a large, veterans integrated healthcare system. This manuscript describes how RE-AIM was used to evaluate this national program and lessons learned from ORH's annual reporting feedback to ACP-GV on their use of the framework to describe evaluation impacts. Methods: We used patient, provider, and site-level administrative health care data from the VA Corporate Data Warehouse and national program management databases for federal fiscal years (FY) spanning October 1, 2018-September 30, 2023. Measures included cumulative and past FY metrics developed to assess program impacts. Results: RE-AIM constructs included the following cumulative and annual program evaluation results. ACP-GV reached 54,167 unique veterans, including 19,032 unique rural veterans between FY 2018 to FY 2023. During FY 2023, implementation adherence to the ACP-GV model was noted in 91.7% of program completers, with 55% of these completers reporting a knowledge increase and 14% reporting a substantial knowledge increase (effectiveness). As of FY 2023, 66 ACP-GV sites were active, and 1,556 VA staff were trained in the intervention (adoption). Of the 66 active sites in FY 2023, 27 were sites previously funded by ORH and continued to offer ACP-GV after the conclusion of three years of seed funding (maintenance). Discussion: Lessons learned developing RE-AIM metrics collaboratively with program developers, implementers, and evaluators allowed for a balance of clinical and scientific input in decision-making, while the ORH annual reporting feedback provided specificity and emphasis for including both cumulative, annual, and rural specific metrics. ACP-GV's use of RE-AIM metrics is a key step towards improving rural veteran health outcomes and describing real world program impacts.

A scoping review of the role of policy in mitigating childhood obesity in underserved populations using the RE-AIM framework.

BACKGROUND: Childhood obesity is an escalating crisis in the United States. Health policy may impact this epidemic which disproportionally affects underserved populations. AIM: The aim was to use the reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework to assess health policy impact on preventing or treating school-aged children (5 > 18 years) with obesity in underserved populations. METHODS: A scoping review of 842 articles was conducted. Twenty-four articles met the inclusion criteria and underwent data extraction. RESULTS: Twelve studies included subgroup analysis, with four suggesting an impact of policy on at-risk groups. None of the 24 studies fully applied the RE-AIM framework. Policies positively impacted childhood obesity in 12 studies across the sample. LINKING EVIDENCE TO ACTION: Our review revealed inconsistent evidence for the effectiveness of policy on childhood obesity, perhaps due to the lack of focus on the social determinants of health. In addition, many studies did not evaluate the outcomes for underserved populations. Therefore, we propose more attention to social determinants in future legislation and evaluation of policy effectiveness on underserved populations. Findings identify an urgent need for the design, implementation, and evaluation of policies specifically directed to address the inequities of racism, social injustices, and social determinants of health that impact childhood obesity in the United States. Future work needs to identify who was reached by the policy, who benefitted from the policy, and how policies were implemented to address obesity-related health disparities. Nurses should advocate for the evaluation of childhood obesity policies, particularly in underserved populations, to determine effectiveness. Nurses, particularly those trained in population and community health and research, should advocate for policy research that considers inequities rather than controls for these variables. Multi-layered interventions can then be tailored to sub-populations and evaluated more effectively.

Evaluation of the Effectiveness of a Bilingual Nutrition Education Program in Partnership with a Mobile Health Unit.

There are limited reports of community-based nutrition education with culinary instruction that measure biomarkers, particularly in low-income and underrepresented minority populations. Teaching kitchens have been proposed as a strategy to address social determinants of health, combining nutrition education, culinary demonstration, and skill building. The purpose of this paper is to report on the development, implementation, and evaluation of Journey to Health, a program designed for community implementation using the RE-AIM planning and evaluation framework. Reach and effectiveness were the primary outcomes. Regarding reach, 507 individuals registered for the program, 310 participants attended at least one nutrition class, 110 participants completed at least two biometric screens, and 96 participants attended at least two health coaching appointments. Participants who engaged in Journey to Health realized significant improvements in body mass index, blood pressure, and triglycerides. For higher risk participants, we additionally saw significant improvements in total and LDL cholesterol. Regarding dietary intake, we observed a significant increase in cups of fruit and a decrease in sugar sweetened beverages consumed per day. Our findings suggest that Journey to Health may improve selected biometrics and health behaviors in low-income and underrepresented minority participants.

Implementation of remote home care: assessment guided by the RE-AIM framework.

BACKGROUND: Welfare technology interventions have become increasingly important in home-based palliative care for facilitating safe, time-efficient, and cost-effective methods to support patients living independently. However, studies evaluating the implementation of welfare technology innovations are scarce, and the empirical evidence for sustainable models using technology in home-based palliative care remains low. This study aimed to report on the use of the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework to assess the implementation of remote home care (RHC) a technology-mediated service for home-living patients in the palliative phase of cancer. Furthermore, it aimed to explore areas of particular importance determining the sustainability of technologies for remote palliative home-based care. METHODS: A secondary analysis of data collected by semi-structured interviews with patients with cancer in the palliative phase, focus groups, and semi-structured interviews with healthcare professionals (HCPs) experienced with RHC was performed. A deductive reflexive thematic analysis using RE-AIM dimensions was conducted. RESULTS: Five themes illustrating the five RE-AIM dimensions were identified: (1) Reach: protective actions in recruitment - gatekeeping, (2) Effectiveness: potential to offer person-centered care, (3) Adoption: balancing high touch with high tech, (4) Implementation: moving towards a common understanding, and (5) Maintenance: adjusting to what really matters. The RE-AIM framework highlighted that RHC implementation for patients in the palliative phase of cancer was influenced by HCP gatekeeping behavior, concerns regarding abandoning palliative care as a high-touch specialty, and a lack of competence in palliative care. Although RHC facilitated improved routines in patients' daily lives, it was perceived as a static service unable to keep pace with disease progression. CONCLUSIONS: A person-centered approach that prioritizes individual needs and preferences is necessary for providing optimal care. Although technologies such as RHC are not a panacea, they can be integrated as support for increasingly strained health services.

The influence of organizational models on the implementation of internet-based cognitive behavior therapy in primary care: A mixed methods study using the RE-AIM framework.

Background: Internet-Based Cognitive Behavioral Therapy (iCBT) holds great potential in addressing mental health issues, yet its real-world implementation poses significant challenges. While prior research has predominantly focused on centralized care models, this study explores the implementation of iCBT in the context of decentralized organizational structures within the Swedish primary care setting, where all interventions traditionally are delivered at local Primary Care Centers (PCCs). Aim: This study aims to enhance our understanding of iCBT implementation in primary care and assess the impact of organizational models on the implementation's outcome using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework. Method: A mixed-methods research design was employed to identify the factors influencing iCBT implementation across different levels, involving patients, therapists and managers. Data spanning two years was collected and analyzed through thematic analysis and statistical tests. The study encompassed 104 primary care centers, with patient data (n = 1979) sourced from the Swedish National Quality Register for Internet-Based Psychological Treatment (SibeR). Additionally, 53 iCBT therapists and 50 PCC managers completed the Normalization Measure Development Questionnaire, and 15 leaders participated in interviews. Results: Our investigation identified two implementation approaches, one concentrated and one decentralized. Implementation effectiveness was evident through adherence rates suggesting that iCBT is a promising approach for treating mental ill-health in primary care, although challenges were observed concerning patient assessment and therapist drift towards unstructured treatment. Mandatory implementation, along with managerial and organizational support, positively impacted adoption. Results vary in terms of adherence to established protocols, with therapists working in concentrated model showing a significantly higher percentage of registration in the quality register SibeR (X2 (1, N = 2973) = 430.5774, p = 0.001). They also showed significantly higher means in cognitive participation (Z = -2.179, p = 0.029) and in reflective monitoring (Z = -2.548, p = 0.011). Discussion: Overall, the study results demonstrate that iCBT, as a complex and qualitatively different intervention from traditional psychological treatment, can be widely implemented in primary care settings. The study's key finding highlights the substantial advantages of the concentrated organizational model. This model has strengths in sustainability, encourages reflective monitoring among therapists, the use of quality registers, and enforces established protocols. Conclusion: In conclusion, this study significantly contributes to the understanding of the practical aspects associated with the implementation of complex internet interventions, particularly in the context of internet-based cognitive-behavioral therapy (iCBT). The study highlights that effective iCBT integration into primary care requires a multifaceted approach, taking into account organizational models, robust support structures, and a commitment to maintaining quality standards. By emphasizing these factors, our research aims to provide actionable insights that can enhance the practicability and real-world applicability of implementing iCBT in primary care settings.

Clinical decision support systems for chronic obstructive pulmonary disease (COPD) in hospitals: A systematic review.

Objectives: To synthesise the literature on clinical decision support (CDS) systems for chronic obstructive pulmonary disease (COPD). We aimed to (1) describe existing COPD CDS systems that have been designed, developed or are being used in practice, (2) describe the impact of COPD CDS systems on outcomes and (3) identify barriers and facilitators to implementation of COPD CDS systems. Methods: Five databases were searched to identify relevant studies. All studies in English that described clinician-facing COPD CDS systems designed for, or implemented in, hospitals and hospital-in-the-home settings were included. A qualitative narrative synthesis was undertaken, guided by the RE-AIM framework (Reach, Effectiveness, Adoption, Implementation and Maintenance). Results: Twelve studies reporting the use of CDS in hospital (n = 7) and hospital-in-the-home (n = 5) settings were included. Implementation efforts to reach target users were scantly reported, and low-to-medium adoption rates were observed. The reported effectiveness of the CDS systems was mixed. Only one study reported facilitators to the implementation of CDS systems, none reported on barriers to the implementation of CDS systems, and none reported any information on successful strategies to maintain implementation of CDS systems. Conclusion: The use of CDS systems in the management of patients with COPD in hospital-related settings is an important emerging field of research. Evidence suggests that the field has largely focused on systems targeted at physicians, often with incomplete descriptions and limited evaluations. Many opportunities to optimise and evaluate the implementation and use of COPD CDS systems in hospital settings remain, including robust evaluation of their impact on patient, clinician and health service outcomes.

Increasing the delivery of upper limb constraint-induced movement therapy programs for stroke and brain injury survivors: evaluation of the ACTIveARM project.

PURPOSE: To increase the number of constraint-induced movement therapy (CIMT) programs provided by rehabilitation services. METHODS: A before-and-after implementation study involving nine rehabilitation services. The implementation package to help change practice included file audit-feedback cycles, 2-day workshops, poster reminders, a community-of-practice and drop-in support. File audits were conducted at baseline, every three months for 1.5 years, and once after support ceased to evaluate maintenance of change. CIMT participant outcomes were collected to evaluate CIMT effectiveness and maintenance (Action Research Arm Test and Motor Activity Log). Staff focus groups explored factors influencing CIMT delivery. RESULTS: CIMT adoption improved from baseline where only 2% of eligible people were offered and/or received CIMT (n = 408 files) to more than 50% over 1.5 years post-implementation (n = 792 files, 52% to 73% offered CIMT, 27%-46% received CIMT). Changes were maintained at 6-month follow-up (n = 172 files, 56% offered CIMT, 40% received CIMT). CIMT participants (n = 74) demonstrated clinically significant improvements in arm function and occupational performance. Factors influencing adoption included interdisciplinary collaboration, patient support needs, intervention adaptations, a need for continued training, and clinician support. CONCLUSIONS: The implementation package helped therapists overcome an evidence-practice gap and deliver CIMT more routinely.

Constraint induced movement therapy (CIMT) is a highly effective intervention for arm recovery after acquired brain injury, recommended in multiple clinical practice guidelines yet delivery of CIMT in practice remains rare.A multifaceted implementation package including clinician training workshops, a community of practice, drop in support and regular audit and feedback cycles improved delivery of CIMT programs in practice by neurorehabilitation teams.Stroke survivors and people with brain injury who received a CIMT program in usual practice demonstrated clinically important improvements in arm function, dexterity and occupational performance.

Community-engaged optimization of COVID-19 rapid evaluation and testing experiences: roll-out implementation optimization trial.

BACKGROUND: There continues to be a need for COVID-19 testing that is pragmatic, community-centered, and sustainable. This study will refine and test implementation strategies prioritized by community partners: (1) walk-up no-cost testing, (2) community health worker (promotores)-facilitated testing and preventive care counseling, (3) vending machines that dispense no-cost, self-testing kits. METHODS: A co-designed Theory of Change from an earlier study phase and the Practical, Robust Implementation and Sustainment Model (PRISM) will guide the study design, measures selection, and evaluation. The first aim is to refine and operationalize a multi-component implementation strategy bundle and outcome measures for COVID-19 testing. A Community and Scientific Advisory Board (CSAB) will be established and include community members, clinical providers/staff from the partnering Federally Qualified Health Center (FQHC), public health researchers, policymakers, and a county health department ambassador. Engagement of CSAB members will be assessed through structured ethnography and a survey about the quality and quantity of engagement practices. The second aim is to implement and evaluate the impact of the implementation strategy bundle to optimize COVID-19 testing in communities using a roll-out implementation optimization (ROIO) design. Seven thousand and five hundred community members will be enrolled across four FQHC clinics over 18 months. Participants will be invited to complete an electronic survey about their demographics, health, and COVID-19 testing results and experiences. CSAB members and clinic partners will participate in PRISM fit and determinant assessments prior to each clinic rollout and post-trial. Interviews will be conducted with 60 community participants and 12 providers/staff following a 3-month rollout period at each clinic, inquiring about their experiences with the implementation strategies. Quantitative data will be analyzed using hierarchical multilevel models to determine the impact of implementation strategies. Qualitative data will be analyzed using rapid qualitative approaches to summarize implementation experiences and identify necessary changes prior to subsequent rollouts. A matrix approach will be used to triangulate data from quantitative and qualitative sources based on PRISM domains. DISCUSSION: This is one of the first pragmatic implementation trials to use a ROIO design and aims to co-create a sustainable and equitable COVID-19 testing program. Findings are likely to generalize to other public health prevention efforts. TRIAL REGISTRATION: NCT05894655 March 2, 2023.

The VA National TeleNeurology Program implementation: a mixed-methods evaluation guided by RE-AIM framework.

Introduction: The Veteran Affairs (VA) Office of Rural Health (ORH) funded the Veterans Health Administration (VHA) National TeleNeurology Program (NTNP) as an Enterprise-Wide Initiative (EWI). NTNP is an innovative healthcare delivery model designed to fill the patient access gap for outpatient neurological care especially for Veterans residing in rural communities. The specific aim was to apply the RE-AIM framework in a pragmatic evaluation of NTNP services. Materials and methods: We conducted a prospective implementation evaluation. Guided by the pragmatic application of the RE-AIM framework, we conceptualized a mixed-methods evaluation for key metrics: (1) reach into the Veteran patient population assessed as total NTNP new patient consult volume and total NTNP clinical encounters (new and return); (2) effectiveness through configurational analysis of conditions leading to high Veteran satisfaction and referring providers perceived effectiveness; (3) adoption and implementation by VA sites through site staff and NTNP interviews; (4) implementation success through perceived management, implementation barriers, facilitators, and adaptations and through rapid qualitative analysis of multiple stakeholders' assessments; and (5) maintenance of NTNP through monitoring quarterly TeleNeurology consultation volume. Results: NTNP was successfully implemented in 13 VA Medical Centers over 2 years. The total NTNP new patient consult volume in fiscal year 2021 (FY21) was 836 (58% rurally residing); this increased to 1,706 in fiscal year 2022 (FY22) (55% rurally residing). Total (new and follow-up) NTNP clinical encounters were 1,306 in FY21 and 3,730 in FY22. Overall, the sites reported positive experiences with program implementation and perceived that the program was serving Veterans with little access to neurological care. Veterans also reported high satisfaction with the NTNP program. We identified the patient level of perceived excellent teleneurologist-patient communications, reduced need to drive to get care, and that NTNP provided care that the Veteran otherwise could not access as key factors related to high Veteran satisfaction. Conclusions: The VA NTNP demonstrated substantial reach, adoption, effectiveness, implementation success, and maintenance over the first 2 years of the program. The NTNP was highly acceptable to both the clinical providers making the referrals and the Veterans receiving the referred video care. The pragmatic application of the RE-AIM framework to guide implementation evaluations is appropriate, comprehensive, and recommended for future applications.