Barriers and facilitators to implementing evidence-based interventions in the context of a randomized clinical trial in the United States: a qualitative study.

BACKGROUND: Evidence-based interventions, which are typically supported by data from randomized controlled trials (RCTs), are highly valued by providers of human services like child welfare. However, implementing such interventions in the context of a randomized clinical trial is a complex process, as conducting an RCT adds extra tasks for providers and complicating factors for provider organizations. Utilizing the Exploration, Preparation, Implementation, and Sustainment Framework, this study examines factors that facilitate or impede success in the implementation of evidence-based interventions in the context of a largescale trial of SafeCare,® a child maltreatment intervention. METHODS: Qualitative data were obtained as part of a larger mixed-methods study involving a cluster randomized trial comparing SafeCare to usual services for caregivers within nine child welfare agencies across four states. Between May and October 2017, individual interviews were conducted with a purposive sample of 21 child welfare administrators and 24 supervisors, and 19 focus groups were conducted with 84 providers. Data were coded iteratively and grouped into themes. RESULTS: Several interconnected themes centered on facilitators and barriers to SafeCare implementation in the context of a randomized clinical trial. Facilitators included: (1) Benefits afforded through RCT participation; (2) Shared vision and sustained buy-in across system and organizational levels; and (3) Ongoing leadership support for SafeCare and the RCT. Barriers that hindered SafeCare were: (1) Insufficient preparation to incorporate SafeCare into services; (2) Perceived lack of fit, leading to mixed support for SafeCare and the RCT; and (3) Requirements of RCT participation at the provider level. CONCLUSIONS: These data yield insight into an array of stakeholder perspectives on the experience of implementing a new intervention in the context of a largescale trial. This research also sheds light on how the dynamics of conducting an RCT may affect efforts to implement interventions in complex and high-pressure contexts. Findings highlight the importance of aligning knowledge and expectations among researchers, administrators of organizations, and supervisors and providers. Researchers should work to alleviate the burdens of study involvement and promote buy-in among frontline staff not only for the program but also for the research itself.

Evaluation of the Child Safety Matters Curriculum for Improving Knowledge about Victimization among Elementary School Children: A Randomized Trial.

This project employed a randomized-control design to evaluate the effectiveness of the MBF Child Safety Matters® (CSM) curriculum. Six Georgia schools across 3 counties agreed to participate, and 136 K - 5th grade classrooms were randomized to either receive the CSM curriculum or be a wait-list control and to receive the curriculum after the evaluation. In total, 2,414 students participated at pretest (1195 CSM and 1219 control) and 2,260 participated at posttest (1159 CSM and 1101 control). Pre/posttests were collected from all students prior to the delivery of the CSM curriculum and again approximately a month later to measure knowledge gains related to child safety. Intervention students displayed a greater increase in knowledge for the information taught in the CSM program as compared to students who did not receive the intervention (d = .29).

Adaptation and implementation of a parenting curriculum in a refugee/immigrant community using a task-shifting approach: a study protocol.

BACKGROUND: Delivering evidence-based interventions to refugee and immigrant families is difficult for several reasons, including language and cultural issues, and access and trust issues that can lead to an unwillingness to engage with the typical intervention delivery systems. Adapting both the intervention and the delivery system for evidence-based interventions can make those interventions more appropriate and palatable for the targeted population, increasing uptake and effectiveness. This study focuses on the adaptation of the SafeCare© parenting model, and its delivery through either standard implementation methods via community-based organizations (CBO) and a task-shifted implementation in which members of the Afghans, Burmese, Congolese community will be trained to deliver SafeCare. METHOD: An adaptation team consisting of community members, members of CBO, and SafeCare experts will engage a structured process to adapt the SafeCare curriculum for each targeted community. Adaptations will focus on both the model and the delivery of it. Data collection of the adaptation process will focus on documenting adaptations and team member's engagement and satisfaction with the process. SafeCare will be implemented in each community in two ways: standard implementation and task-shifted implementation. Standard implementation will be delivered by CBOs (n = 120), and task-shifted implementation will be delivered by community members (n = 120). All interventionists will be trained in a standard format, and will receive post-training support. Both implementation metrics and family outcomes will be assessed. Implementation metrics will include ongoing adaptations, delivery of services, fidelity, skill uptake by families, engagement/completion, and satisfaction with services. Family outcomes will include assessments at three time points (pre, post, and 6 months) of positive parenting, parent-child relationship, parenting stress, and child behavioral health. DISCUSSION: The need for adapting of evidence-based programs and delivery methods for specific populations continues to be an important research question in implementation science. The goal of this study is to better understand an adaptation process and delivery method for three unique populations. We hope the study will inform other efforts to deliver health intervention to refugee communities and ultimately improve refugee health.

Effect of the SafeCare© intervention on parenting outcomes among parents in child welfare systems: A cluster randomized trial.

Child maltreatment has long-lasting negative impacts, and interventions are needed to improve caregiver's parenting skills to prevent maltreatment. This paper reports on a randomized trial comparing the SafeCare© model to services as usual (SAU) for child-welfare referred caregivers. SafeCare is an 18-session behavioral parenting program that teaches skills in positive parent-child interactions, home safety, and child health. SAU is generally unstructured and includes support, crisis management, referrals for need, and parenting education. Teams of providers at nine sites were randomized to implement SafeCare (19 teams; 119 providers) or continue SAU (17 teams; 118 providers). Two-hundred eighty eight caregivers (193 SafeCare; 95 SAU) with children aged 0-5 who were receiving services agreed to complete a baseline and 6-month assessment. Assessments measured positive parenting behaviors, parenting stress, protective factors, and neglectful behaviors using validated scales. Participants were primarily white (74.6%), female (87.0%), and low-income (68.6%), and had a mean age of 29. Latent change score models (LCSM) using a sandwich estimator consistent with the trial design were used to examine changes in 13 outcomes. Results indicated that SafeCare had small to medium effects for improving several parenting outcomes including supporting positive child behaviors (d = 0.46), proactive parenting (d = 0.25), and two aspects of parenting stress (d = 0.28 and .30). No differential change between groups was found for other indicators, including all indicators of neglect. Parenting programs such as SafeCare offer a promising mode of intervention for child welfare systems. Scale-up of parenting programs can improve parenting, improve child outcomes, and potentially reduce maltreatment. CLINICALTRIAL.GOV REGISTRATION NUMBER: NCT02549287.

Does adoption of an evidence-based practice lead to job turnover? Results from a randomized trial.

It is important to understand the impact of implementation of evidence-based practices (EBPs) on the workforce. EBP implementation can increase job demands, stress, and burnout, and may thereby exacerbate turnover. This study examined the effects of implementation of an EBP on turnover among staff at nine child welfare agencies. A total of 102 providers were randomized to either adopt an EBP, SafeCare© , or continue providing services as usual. Participants completed a baseline survey assessing demographics, attitudes toward EBPs, and organizational functioning, and provider turnover was recorded for up to 18 months following implementation. The overall turnover rate was 35%, but did not differ by EBP assignment (odds ratio [OR] = 1.27; 95% confidence interval [0.66, 2.45]). Variables associated with turnover included age (OR = 0.92), years since degree completion (OR = 0.94), prior exposure to EBP (OR = 3.91), believing that adopting an EBP was burdensome (OR = 0.52), and motivation for change (OR = 0.89). EBP assignment moderated two aspects of negative attitudes toward EBP (divergence and monitoring) to predict turnover; those attitudes were only positively related to turnover for individuals assigned to the EBP (OR = 1.46, 1.16). Implications of the findings for implementation are discussed.