Implementation science and psycho-oncology: Advancing the translation of evidence into practice.

OBJECTIVES: This Special issue of Psycho-Oncology highlights examples of the application of implementation science to research in psycho-oncology. The aim is to demonstrate the different ways that implementation science is being used to generate evidence that can more readily translate evidence into changes in clinical practice. We hope this issue fosters greater interest in using the tools of implementation science to improve the lives of people affected by cancer. METHODS: The papers in the issue were selected from among those that responded to a call for submissions on the application of implementation science frameworks and methods to issues in psycho-oncology. The focus included but was not limited to research on: understanding barriers and facilitators of intervention/practice adoption; assessing implementation outcomes, evaluating implementation strategies, and improving behavioural and/or clinical outcomes. RESULTS: The 11 papers in this issue were grouped for presentation purposes into four common topics: barriers and facilitators to implementation; feasibility as a key implementation outcome; the design, selection and adaptation of implementation strategies; and building the foundation for psycho-oncology research translation via systematic reviews that focus on implementation strategy design. CONCLUSION: These papers demonstrate the breadth of current applications of implementation science to research in psycho-oncology. Alongside the studies featured in this issue, including cost-effectiveness analyses, tests of nationally-focused strategies and proactive planning for adaptation, we look forward to other innovations that will promote further growth of both disciplines to improve the integration of psycho-oncology interventions across healthcare systems.

The value of health service-based research to health service organisations: a qualitative study with senior health service executives.

BACKGROUND: Research evidence has demonstrably improved health care practices and patient outcomes. However, systemic translation of evidence into practice is far from optimal. The reasons are complex, but often because research is not well aligned with health service priorities. The aim of this study was to explore the experiences and perspectives of senior health service executives on two issues: (1) the alignment between local research activity and the needs and priorities of their health services, and (2) the extent to which research is or can be integrated as part of usual health care practice. METHODS: In this qualitative study, semi-structured interviews were conducted with senior health leaders from four large health service organisations that are members of Sydney Health Partners (SHP), one of Australia's nationally accredited research translation centres committed to accelerating the translation of research findings into evidence-based health care. The interviews were conducted between November 2022 and January 2023, and were either audio-recorded and transcribed verbatim or recorded in the interviewer field notes. A thematic analysis of the interview data was conducted by two researchers, using the framework method to identify common themes. RESULTS: Seventeen health executives were interviewed, including chief executives, directors of medical services, nursing, allied health, research, and others in executive leadership roles. Responses to issue (1) included themes on re-balancing curiosity- and priority-driven research; providing more support for research activity within health organisations; and helping health professionals and researchers discuss researchable priorities. Responses to issue (2) included identification of elements considered essential for embedding research in health care; and the need to break down silos between research and health care, as well as within health organisations. CONCLUSIONS: Health service leaders value research but want more research that aligns with their needs and priorities. Discussions with researchers about those priorities may need some facilitation. Making research a more integrated part of health care will require strong and broad executive leadership, resources and infrastructure, and investing in capacity- and capability-building across health clinicians, managers and executive staff.

The Use of Health Equity Impact Assessments to Modify Evidence Based Strategies within Local Health Departments in North Carolina.

BACKGROUND: Health equity impact assessments (HEIAs) inform the reduction of health inequities by evaluating programs or policies that affect target populations. Local health departments (LHD) receiving funding through the Improving Community Outcomes for Maternal and Child Health (ICO4MCH) Program conducted HEIAs for evidence-based strategies (EBSs). This paper describes the impact of HEIAs on the implementation of EBSs and highlights lessons learned during implementation of HEIA modifications. METHODS: We conducted a content analysis using data from the HEIA Modification Tracker and focus groups to identify themes and lessons learned. RESULTS: Fifteen HEIAs were conducted by five LHDs between 2016 and 2020. The most common modifications to EBS implementation were 1) increasing education and training for community members and 2) altering messaging mediums and language to reach intended audiences. DISCUSSION: Health equity impact assessments serve as a systematic and tangible way to center health equity, reflect on past processes, and inform improvements.

Best Practices in Clinical Education: A Site Visit Decision-Making Model in Physical Therapist Education.

Stakeholders in health science education engage in site visits during student clinical education experiences, which may occur in person or remotely via videoconference, telephone, or email. Significant variability in practice highlights the need for a more consistent approach to conducting site visits based on evidence-based best practices. Site visits can be burdensome to both clinical and academic stakeholders considering the significant time and resources needed to conduct them effectively. Despite these obstacles, site visits have been shown to add value to the clinical experience for all parties involved. This paper presents the available literature in health science education regarding clinical site visits and describes how it was used to develop and implement a model of best practice for conducting clinical site visits in physical therapist education. The Site Visit Decision-Making Model is based upon findings from contemporary research exploring the interests of each stakeholder, as well as the multifaceted and purposeful decision-making process that takes place when conducting site visits in physical therapist clinical education. Implementation of this model may assist academic stakeholders in health science education in prioritizing which methods of communication for conducting site visits are most effective and efficient.

The use of evidence to guide decision-making during the COVID-19 pandemic: divergent perspectives from a qualitative case study in British Columbia, Canada.

BACKGROUND: The challenges of evidence-informed decision-making in a public health emergency have never been so notable as during the COVID-19 pandemic. Questions about the decision-making process, including what forms of evidence were used, and how evidence informed-or did not inform-policy have been debated. METHODS: We examined decision-makers' observations on evidence-use in early COVID-19 policy-making in British Columbia (BC), Canada through a qualitative case study. From July 2021- January 2022, we conducted 18 semi-structured key informant interviews with BC elected officials, provincial and regional-level health officials, and civil society actors involved in the public health response. The questions focused on: (1) the use of evidence in policy-making; (2) the interface between researchers and policy-makers; and (3) key challenges perceived by respondents as barriers to applying evidence to COVID-19 policy decisions. Data were analyzed thematically, using a constant comparative method. Framework analysis was also employed to generate analytic insights across stakeholder perspectives. RESULTS: Overall, while many actors' impressions were that BC's early COVID-19 policy response was evidence-informed, an overarching theme was a lack of clarity and uncertainty as to what evidence was used and how it flowed into decision-making processes. Perspectives diverged on the relationship between 'government' and public health expertise, and whether or not public health actors had an independent voice in articulating evidence to inform pandemic governance. Respondents perceived a lack of coordination and continuity across data sources, and a lack of explicit guidelines on evidence-use in the decision-making process, which resulted in a sense of fragmentation. The tension between the processes involved in research and the need for rapid decision-making was perceived as a barrier to using evidence to inform policy. CONCLUSIONS: Areas to be considered in planning for future emergencies include: information flow between policy-makers and researchers, coordination of data collection and use, and transparency as to how decisions are made-all of which reflect a need to improve communication. Based on our findings, clear mechanisms and processes for channeling varied forms of evidence into decision-making need to be identified, and doing so will strengthen preparedness for future public health crises.

Development of a stepped care intervention model of evidence-based interventions for the management of posttraumatic stress in the Belgian Police.

Background: Police officers are frequently exposed to a wide variety of potentially traumatic events (PTE) and are therefore at a considerable risk of developing posttraumatic stress disorder (PTSD). Previous research estimated the point prevalence of PTSD in Belgian police officers at 7.4%, significantly higher than in the general population. An effective organisational strategy to manage posttraumatic stress is essential.Objective: We aimed to develop a novel organisational approach regarding traumatic stress for Belgian police, combining evidence-based strategies for the prevention and treatment of posttraumatic stress in a stepped care intervention model.Method: In a broad development process, we combined scientific literature, case studies of best practices from other police organisations with insights gathered from a number of expert panels, thematic working groups and feedback groups.Results: A comprehensive stepped care intervention model was developed, consisting of evidence-based interventions for the prevention and treatment of posttraumatic stress.Conclusions: The intervention model is a promising organisational strategy for the management of posttraumatic stress in police organisations based on evidence-based interventions. Its effectiveness will be studied in the coming years.

Police officers are at considerable risk of developing PTSD as they are consistently exposed to a wide array of PTE.An adequate organisational response to manage the consequences of this exposure as much as possible is essential.We developed a comprehensive stepped care intervention model consisting of evidence-based interventions, based on scientific literature, best practices in other police organisations, and thorough expert review.

Informing evidence-based policy during the COVID-19 pandemic and recovery period: learning from a national evidence centre.

BACKGROUND: The COVID-19 pandemic demonstrated the vital need for research to inform policy decision-making and save lives. The Wales COVID-19 Evidence Centre (WCEC) was established in March 2021 and funded for two years, to make evidence about the impact of the pandemic and ongoing research priorities for Wales available and actionable to policy decision-makers, service leads and the public. OBJECTIVES: We describe the approaches we developed and our experiences, challenges and future vision. PROGRAM IMPLEMENTATION: The centre operated with a core team, including a public partnership group, and six experienced research groups as collaborating partners. Our rapid evidence delivery process had five stages: 1. Stakeholder engagement (continued throughout all stages); 2. Research question prioritisation; 3. Bespoke rapid evidence review methodology in a phased approach; 4. Rapid primary research; and 5. Knowledge Mobilisation to ensure the evidence was available for decision-makers. MAIN ACHIEVEMENTS: Between March 2021-23 we engaged with 44 stakeholder groups, completed 35 Rapid Evidence Reviews, six Rapid Evidence Maps and 10 Rapid Evidence Summaries. We completed four primary research studies, with three published in peer reviewed journals, and seven ongoing. Our evidence informed policy decision-making and was cited in 19 Welsh Government papers. These included pandemic infection control measures, the Action Plan to tackle gender inequalities, and Education Renew and Reform policy. We conducted 24 Welsh Government evidence briefings and three public facing symposia. POLICY IMPLICATIONS: Strong engagement with stakeholder groups, a phased rapid evidence review approach, and primary research to address key gaps in current knowledge enabled high-quality efficient, evidence outputs to be delivered to help inform Welsh policy decision-making during the pandemic. We learn from these processes to continue to deliver evidence from March 2023 as the Health and Care Research Wales Evidence Centre, with a broader remit of health and social care, to help inform policy and practice decisions during the recovery phase and beyond.

Improving the efficacy and effectiveness of evidence-based psychosocial interventions for attention-deficit/hyperactivity disorder (ADHD) in children and adolescents.

Attention-deficit/hyperactivity disorder (ADHD) is a prevalent, chronic, and impairing mental health disorder of childhood. Decades of empirical research has established a strong evidence-based intervention armamentarium for ADHD; however, limitations exist in regards to efficacy and effectiveness of these interventions. We provide an overview of select evidence-based interventions for children and adolescents, highlighting potential approaches to further improving the efficacy and effectiveness of these interventions. We conclude with broader recommendations for interventions, including considerations to moderators and under-explored intervention target areas as well as avenues to improve access and availability of evidence-based interventions through leveraging underutilized workforces and leveraging technology.

Scientific approach, attitudes, and perspectives on research among Swedish physiotherapy students-a cross-sectional study.

BACKGROUND: Scientific evidence is important to evidence-based practice. Hence, the application of evidence-based practice requires relevant skills and an understanding of science, which therefore need to be learned and trained during the undergraduate program in physiotherapy. The aim of this study was to investigate attitudes, perceived competence, and conditions for a scientific approach among physiotherapy students in Sweden, and to compare attitudes and perceived competence between students in different program years. METHODS: Physiotherapy students from six universities (n = 1499) were invited to respond to a digital survey. The survey contained questions regarding attitudes toward science, perceived competence in research interpretations and open comments regarding requirements for a strengthened scientific approach during education. Comparisons between education years were performed with ANOVA/Kruskal‒Wallis test (scale outcomes) and logistic regression (binary outcomes). RESULTS: A total of 466 students responded to the survey. In total, 57% (n = 266) of the students had a high interest in science. No significant difference in interest in science was found between students in the three program years, but 75% (n = 347) reported increased interest during the program. A perceived high ability to understand the structure and performance of scientific studies was reported by 31% (n = 144), to evaluate the methodology by 16% (n = 72) and to interpret statistical results from scientific studies by 12% (n = 55). The lowest perceived competence was reported among students in their second year (p < 0.05). A majority of the students (88%; n = 410) reported a perceived personal need for strengthened conditions for a scientific approach, with suggested prerequisites during education via increased theoretical and applied understanding of the research. CONCLUSION: Even though this study does not fully cover physiotherapy students at all undergraduate programmes in Sweden, the results support that a scientific approach and training should be strengthened during education to enable physiotherapists to understand and interpret science and to fully apply an evidence-based approach in upcoming clinical practice. Both theoretical and applied knowledge and understanding are needed.

Understanding pathways from implementation to sustainment: a longitudinal, mixed methods analysis of promising practices implemented in the Veterans Health Administration.

BACKGROUND: The Veterans Health Administration (VHA) is the United States largest learning health system. The Diffusion of Excellence (DoE) program is a large-scale model of diffusion that identifies and diffuses evidence-informed practices across VHA. During the period of 2016-2021, 57 evidence-informed practices were implemented across 82 VHA facilities. This setting provides a unique opportunity to understand sustainment determinants and pathways. Our objective was to characterize the longitudinal pathways of practices as they transition from initial implementation to long-term sustainment at each facility. METHODS: A longitudinal, mixed-methods evaluation of 82 VHA facilities. Eighty-two facility representatives, chosen by leadership as points-of-contact for 57 DoE practices, were eligible for post-implementation interviews and annual sustainment surveys. Primary outcomes (implementation, sustainment), and secondary outcomes (institutionalization, effectiveness, anticipated sustainment) at four time-points were collected. We performed descriptive statistics and directed content analysis using Hailemariam et al.'s factors influencing sustainment. RESULTS: After approximately five years post-implementation (e.g., 2021 sustainment outcomes), of the 82 facilities, about one-third fully sustained their practice compared to one-third that did not fully sustain their practice because it was in a "liminal" stage (neither sustained nor discontinued) or permanently discontinued. The remaining one-third of facilities had missing 2021 sustainment outcomes. A higher percentage of facilities (70%) had inconsistent primary outcomes (changing over time) compared to facilities (30%) with consistent primary outcomes (same over time). Thirty-four percent of facilities with sustained practices reported resilience since they overcame implementation and sustainment barriers. Facilities with sustained practices reported more positive secondary outcomes compared to those that did not sustain their practice. Key factors facilitating practice sustainment included: demonstrating practice effectiveness/benefit, sufficient organizational leadership, sufficient workforce, and adaptation/alignment with local context. Key factors hindering practice sustainment included: insufficient workforce, not able to maintain practice fidelity/integrity, critical incidents related to the COVID-19 pandemic, organizational leadership did not support sustainment of practice, and no ongoing support. CONCLUSIONS: We identified diverse pathways from implementation to sustainment, and our data underscore that initial implementation outcomes may not determine long-term sustainment outcomes. This longitudinal evaluation contributes to understanding impacts of the DoE program, including return on investment, achieving learning health system goals, and insights into achieving high-quality healthcare in VHA.

Exploring evidence use and capacity for health services management and planning in Swiss health administrations: A mixed-method interview study.

BACKGROUND: Health administrations require evidence, meaning robust information, data, and research, on health services and systems. Little is known about the resources and processes available within administrations to support evidence-informed policymaking. This study assessed Swiss health administrations' capacity for evidence use and investigated civil servants' needs and perspectives regarding the role and use of evidence in health services management and planning. METHODS: In this mixed-method study, we interviewed civil servants from Swiss German-speaking cantonal health administrations. We quantitatively assessed administrations' organization-level capacity by applying six structured interviews using an existing measurement tool (ORACLe). Individual-level needs and perspectives regarding evidence use and capacity were qualitatively explored with twelve in-depth interviews that were analyzed using the framework method. FINDINGS: Respondents indicated moderate evidence-use capacity in all administrations. Administrations displayed a similar pattern of high and low capacity in specific capacity areas, generally with considerable variation within administrations. Most administrations indicated high capacity for producing or commissioning evidence and close relationships with research. They showed limited capacity in the documentation of processes and availability of tools, programs, or training opportunities. Administrations place the responsibility for engagement with evidence at the level of individual civil servants rather than at the organizational level. Although administrations highly value evidence-informed policymaking and consider it vital to effective health services management and planning, they face significant constraints in accessing evidence-specific resources and receive little organizational support. Administrations rely on external capacity to compensate for these limitations and engage with evidence pragmatically. CONCLUSION: Our findings indicate moderate and improvable capacity for evidence use in Swiss health administrations that place limited value on organizational support. Besides strengthening organizational support, leadership buy-in, particular staff needs, and balancing the implementation of specific measures with the provision of more general resources should be considered to unlock the potential of strengthened engagement with evidence.

Bridging the gap between research evidence and its implementation in public health practice: case studies of embedded research model.

AIM: To investigate the potential of embedded research in bridging the gap between research evidence and its implementation in public health practice. METHODS: Using a case study methodology, semi-structured interviews were conducted with 4 embedded researchers, 9 public health practitioners, and 4 other stakeholders (2 teachers and 2 students) across four case study sites. Sites and individuals were purposively selected. Sites included two local authorities, one secondary school, and one sports organisation. Thematic data analysis was adopted to analyse the qualitative data. RESULTS: Four themes were identified: (1) building and maintaining relationships, (2) working with stakeholders, (3) informing practice, and (4) critical reflection. CONCLUSIONS: Embedded researchers build and maintain relationships with practitioners and other stakeholders to produce research. Evidence from the co-produced research informs future practice and research to improve service and delivery rendered to the public. Thus, embedded researchers use their role to bridge the research evidence - implementation gap in public health practice.

Evaluator's alignment as an important indicator of adequacy of the criteria and assessment procedure for recognizing the good practice in public health.

Background: Public health interventions aim to reduce the burden of chronic non-communicable diseases. Implementing evidence-based interventions that are proven to be successful and effective is widely recognized as the best approach to addressing public health challenges. To avoid the development and implementation of less effective or successful or even harmful practices, clear criteria for the assessment of practices, that consider different dimensions of the interventions in public health, are needed. The main aim of the research was to test our Criteria and assessment procedure for recognizing good practices in the field of public health by estimating the consistency between the evaluators and thereby gaining insight into the adequacy and reliability of the criteria as well as to check how the evaluators understand the criteria and methodology and if it is properly used in assessing the interventions. Methods: The assessment of the interventions took place from 2021 to 2022. The individual evaluator's scores on the scale from 1 to 5 for each specific sub-criterion were collected, which was followed by a panel discussion to reach a final score for each sub-criterion. The inter-rater agreement was measured using percent overall agreement and Fleiss' kappa coefficient. Results: We found moderate inter-rater agreement on the level of the assessment criteria group. The lowest agreement was observed for the effectiveness and efficiency sub-criteria group, which also received the lowest scores from the evaluators. Challenges identified with the scoring process were due to the descriptive 1 to 5 scale and the varying specificity of the criteria. Conclusion: The results showed that studying consistency between evaluators can highlight areas for improvement or adjustment in the assessment criteria and enhance the quality of the assessment instrument. Therefore, such analysis would be useful part of both newly and well-established health promotion and prevention program registries.

Chiropractic attitude and utilisation of evidence-based practice in South Africa: a secondary analysis.

BACKGROUND: Evidence-Based Practice (EBP) is a model utilised by the majority of healthcare professionals and is a clinical framework that assists with decision-making related to patient care, to improve outcomes and patient satisfaction. The study aimed to analyse the attitudes, skills, and utilization of evidence-based practice (EBP) among South African chiropractors, focusing on perceived skill levels, training, use and identifying facilitators and barriers to EBP application. METHODS: A descriptive cross-sectional quantitative secondary analysis was conducted by inviting registered chiropractors in South Africa (n = 920) to participate in an anonymous online questionnaire using the Evidence-Based Practice Attitude and Utilisation Survey (EBASE). RESULTS: A total of 132 chiropractors completed the survey, yielding a response rate of 14.4%. Of the respondents, 59.9% were female, 52.3% were between 26 and 35 years old, and 63.3% had graduated from the University of Johannesburg. A third of respondents stated they have poor clinical research skills. Over half of the respondents (56.8%) indicated that EBP constituted a significant part of their education except for completing systematic reviews or meta-analyses. Published clinical evidence was ranked 6th as a source of information for clinical decisions. The obstacles indicated were time constraints and a lack of clinical research in complementary and alternative medicine. Access to the internet, databases and research tools were facilitators that were deemed to be "very useful" in promoting EBP. CONCLUSION: The majority of South African chiropractors are generally favourable towards EBP, and this practice therefore appears to be utilised and embraced, with the requisite skills.

Effectiveness of an Evidence-Based Practice Education Program for Undergraduate Nursing Students: A Systematic Review and Meta-Analysis.

This systematic review and meta-analysis examined the impact of evidence-based practice (EBP) education programs on undergraduate nursing students, focusing on enhancing EBP competency, critical thinking, and problem-solving ability. METHODS: The search, conducted through PubMed, Cochrane Library, EMBASE, CINAHL, and Web of Science up to December 2023, included studies published in English and Korean and adhered to PRISMA guidelines. Qualitative appraisal of the studies was conducted using the revised ROB II for randomized trials and the ROBINS-I for non-randomized trials. For the meta-analysis, the effect size of the intervention was calculated as a standardized mean difference. RESULTS: In our study, 11 studies met our inclusion criteria, and 8 studies of those were included in the meta-analysis. The effect sizes for EBP competency, critical thinking, and problem-solving ability were 1.55, 1.29, and 0.65, respectively. The meta-regression analysis indicated that tailored education programs of 4-7 weeks and being in the 4th grade significantly enhanced EBP competency. CONCLUSION: These findings support the development of a customizable and applied EBP education actively for students, preparing nursing students to effectively implement EBP in clinical settings after graduation. Despite the significant effect size of the outcome variables, the high heterogeneity suggests the need for further investigation to validate the EBP educational outcomes for nursing students.

Technical Assistance for Systemic Change: Lessons Learned From a National Technical Assistance Center.

Despite the millions of dollars awarded annually by the United States Department of Education to build implementation capacity through technical assistance (TA), data on TA effectiveness are severely lacking. Foundational to the operationalization and consistent research on TA effectiveness is the development and use of standardized TA core competencies, practices, and structures. Despite advances toward a consistent definition of TA, a gap still exists in understanding how these competencies are used within an operationalized set of TA practices to produce targeted outcomes at both individual and organizational levels to facilitate implementation of evidence-based practices. The current article describes key insights derived from the evaluation of an operationalized set of TA practices used by a nationally funded TA center, the State Implementation & Scaling Up of Evidence Based Practices (SISEP) Center. The TA provided by the Center supports the uptake of evidence-based practices in K-12 education for students with disabilities. Lessons learned include: (1) the need to understand the complexities and dependencies of operationalizing TA both longitudinally and at multiple levels of the system (state, regional, local); (2) the relative importance of building general and innovation-specific capacity for implementation success; (3) the value of using a co-design and participatory approach for effective TA delivery; (4) the need to develop TA providers' educational and implementation fluency across areas and levels of the system receiving TA; and (5) the need to ensure coordination and alignment of TA providers from different centers. Gaining an understanding into optimal TA practices will not only provide clarity of definition fundamental to TA research, but it will also inform the conceptual framing and practice of TA.

Supporting Implementation Through Online Learning Communities: Lessons Learned From a National Training and Technical Assistance Network.

Recent implementation science frameworks highlight the role of training and technical assistance (TTA) in building workforce capacity to implement evidence-based practices (EBPs). However, evaluation of TTA is limited. We describe three case examples that highlight TTA by three regional centers in the national Mental Health Technology Transfer Center (MHTTC) network. Each MHTTC formed Learning Communities (LCs) to facilitate connections among behavioral health professionals with the goals of sharing implementation strategies, discussing best-practices, and developing problem solving techniques. Data on outcomes were collected through a combination of self-report surveys and qualitative interviews. LC participants reported strong connectedness, gains in knowledge and skills, improvements in implementation capacity, and intentions to advocate for organizational and systems-level change. Furthermore, across the case examples, we identified LC characteristics that are associated with participant perceptions of outcomes, including tailoring LC content to workforce needs, providing culturally relevant information, engaging leaders, forming connections among participants and trainers, and challenging participants' current workplace practices. These findings are interpreted through the lens of the Interactive Systems Framework, which focuses on how TTA, such as LCs, can facilitate connections between the theoretical and empirical foundations of interventions and the practices of implementing interventions in real-world settings to advance workforce capacity.

The Role of Cooperative Extension in Delivering Training and Technical Assistance to Support Evidence-Based Behavioral Health Practices in Rural Communities.

The opioid epidemic in the United States continues to disproportionately affect those in rural, compared to urban, areas due to a variety of treatment and recovery barriers. One mechanism to increase capacity of rural-serving providers is through delivery of training and technical assistance (TTA) for evidence-based programs by leveraging the Cooperative Extension System. Guided by the Interactive Systems Framework, the current study evaluates TTA delivered by the Northwest Rural Opioid Technical Assistance Collabroative to opioid prevention, treatment, and recovery providers on short- (satisfaction, anticipated benefit), medium-, (behavioral intention to change current practice), and long-term goals (changes toward adoption of evidence-based practices). We also evaluated differences in short- and medium-term goals by intensity of TTA event and rurality of provider. Surveys of 351 providers who received TTA indicated high levels of satisfaction with TTA events attended, expressed strong agreement that they would benefit from the event, intended to make a professional practice change, and preparation toward implementing changes. Compared to urban-based providers, rural providers reported higher intention to use TTA information to change current practice. We conclude with a review of remaining gaps in the research to practice pipeline and recommendations for moving forward.

Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers.

Hundreds of millions of dollars are spent each year by U.S. federal agencies for training and technical assistance (TTA) to be delivered by training and technical assistance centers (TTACs) to "delivery system organizations" (e.g., federally qualified health centers, state departments of health, substance abuse treatment centers, schools, and healthcare organizations). TTACs are often requested to help delivery system organizations implement evidence-based interventions. Yet, counterintuitively, TTACs are rarely required to use evidence-based approaches when supporting delivery systems (in the use of evidence-based programs). In fact, evaluations of TTAC activities tend to be minimal; evaluation of technical assistance (if conducted at all) often emphasizes outputs (number of encounters), satisfaction, and self-reports of knowledge gained-more substantive outcomes are not evaluated. The gap between (a) the volume of TTA services being funded and provided and (b) the evaluation of those services is immense and has the potential to be costly. The basic question to be answered is: how effective are TTA services? This article introduces the special issue on Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers. The special issue promotes 1) knowledge of the state of the art of evaluation of TTACs and 2) advances in what to evaluate in TTA. A major goal of the issue is to improve the science and practice of implementation support, particularly in the areas of TTA.

How a System Is Closing the Evidence-Based Data Management Gap.

To translate raw data into information that is understandable and actionable, healthcare leaders must leverage decision-making tools that can drive strategic innovation, improve processes, and shape the future of healthcare. Continuous changes in healthcare delivery require constant monitoring of an expanding range of data. Population demographics, psychographics, and availability of care all must be considered, as well as provider practice patterns, patient utilization, clinical and service quality, costs, and many other key variables over time. RWJBarnabas Health is navigating significant changes in its approach to managing data. A unified operating model is driving standardization, continuous quality improvement, and cost reductions across the system. The solution is based on an electronic health record system designed to meet the needs of the entire system, an array of carefully selected external data sources, and a business intelligence tool to enable leaders to quickly draw insights from all the available data.