What Really Matters in the Implementation of Evidence-based Practices in Community Mental Health? Insight and Recommendations from Experts, Providers, and Clients.

Perceptions of evidence-based practices (EBPs) and implementation are inherent drivers of implementation outcomes. Most studies on implementation perceptions have focused on direct service providers, but clients and EBP experts may offer additional meaningful information about implementing EBPs in community settings. EBP providers (n = 21), EBP experts (n = 12), and clients who received EBPs (n = 6) participated in focus groups to ascertain their perceptions of and experiences with EBP implementation, as part of a program evaluation. Thematic analysis indicated that provider and expert perceptions of EBP implementation in community settings converged around themes of implementation supports and training and client outcomes, along with several subthemes. Client perceptions centered on themes regarding the importance of their personal experiences, their impressions of EBPs, as well as their recommendation for increasing public awareness and use of EBPs. Findings suggest that the perspectives of EBP providers and experts are closely aligned, focusing on system-level, individual-level, and training issues that impact EBP implementation within a public mental health system. The themes that were important to clients were primarily related to their experiences as recipients of an EBP which produced insightful recommendations for promoting EBPs in the community.

Trauma Exposure and PTSD in Philadelphia Community Mental Health.

OBJECTIVE: Based on feedback received during post-training consultation within a Prolonged Exposure (PE) implementation initiative, additional assessment training was added to help community providers identify patients who met criteria for posttraumatic stress disorder (PTSD) symptom severity and were considered appropriate for PTSD treatment. The current study investigated the rates of trauma exposure and PTSD in the community sample, as well as the percentage of individuals deemed "appropriate" for PE by community therapists. METHOD: Clinicians involved in the PE Initiative administered the Post-traumatic Diagnostic Scale for DSM-5 (PDS-5) to 10,260 individuals across 13 community agencies. Clinicians were also asked to report whether patients were perceived as appropriate for PE. RESULTS: Consistent with our hypothesis, the rates of potential PTSD in Philadelphia community mental health (58.2% of our total sample) far exceeded national averages (8.3%). Contrary to our hypothesis, 100% of patients who scored above the clinical cutoff for PTSD were considered appropriate for PE by their community clinician. CONCLUSIONS: The results of this study emphasize the high prevalence of PTSD among individuals presenting for treatment to community mental health centers. Despite common misconceptions that patients are often perceived as ineligible or not appropriate for PE, 100% of patients in the PE Initiative who scored above the clinical cutoff for PTSD were considered good candidates for treatment according to their clinicians. This suggests that with sufficient training and post-training consultation, as provided in this community initiative, community clinicians may be more likely to perceive PE as an appropriate treatment option.

Understanding therapists' perceived determinants of trauma narrative use.

BACKGROUND: Trauma narratives are a critical, exposure-based component of trauma-focused cognitive-behavioral therapy, yet community therapists rarely use them. Given evidence that intentions to deliver elements of cognitive behavioral therapy vary by component, and that intentions to deliver exposure are the weakest, this study focused specifically on trauma narratives. We drew on a social psychology causal theory (Theory of Planned Behavior (TPB)) and an implementation science framework (the Consolidated Framework for Implementation Research (CFIR)) to glean insight into multilevel influences on trauma narrative use. While the CFIR offers a broad list of factors potentially affecting implementation, the TPB offers causal pathways between individual-level constructs that predict behavior, including the uptake of an evidence-based intervention. The integration of these approaches may provide a more complete understanding of factors affecting therapists' use of TNs. METHODS: Therapists (n=65) trained in trauma-focused cognitive behavioral therapy completed a survey about their use of and beliefs about trauma narratives. Content analysis was used to identify common beliefs about trauma narratives. A subset of participants (n=17) completed follow-up qualitative interviews, which were analyzed using an integrated approach informed by the CFIR. RESULTS: While most participants reported high intentions to use TNs, nearly half reported that they did not use TNs in the last 6 months. Survey data indicate a number of TPB-related determinants related to using trauma narratives. Qualitative interviews identified CFIR-relevant contextual factors that may influence constructs central to TPB. CONCLUSIONS: These results highlight the importance of integrating approaches that address multiple theoretical determinants of therapist behavior, including therapist, organizational, and client factors with causal explanations to explain implementation behavior.

Community stakeholder preferences for evidence-based practice implementation strategies in behavioral health: a best-worst scaling choice experiment.

BACKGROUND: Community behavioral health clinicians, supervisors, and administrators play an essential role in implementing new psychosocial evidence-based practices (EBP) for patients receiving psychiatric care; however, little is known about these stakeholders' values and preferences for implementation strategies that support EBP use, nor how best to elicit, quantify, or segment their preferences. This study sought to quantify these stakeholders' preferences for implementation strategies and to identify segments of stakeholders with distinct preferences using a rigorous choice experiment method called best-worst scaling. METHODS: A total of 240 clinicians, 74 clinical supervisors, and 29 administrators employed within clinics delivering publicly-funded behavioral health services in a large metropolitan behavioral health system participated in a best-worst scaling choice experiment. Participants evaluated 14 implementation strategies developed through extensive elicitation and pilot work within the target system. Preference weights were generated for each strategy using hierarchical Bayesian estimation. Latent class analysis identified segments of stakeholders with unique preference profiles. RESULTS: On average, stakeholders preferred two strategies significantly more than all others-compensation for use of EBP per session and compensation for preparation time to use the EBP (P < .05); two strategies were preferred significantly less than all others-performance feedback via email and performance feedback via leaderboard (P < .05). However, latent class analysis identified four distinct segments of stakeholders with unique preferences: Segment 1 (n = 121, 35%) strongly preferred financial incentives over all other approaches and included more administrators; Segment 2 (n = 80, 23%) preferred technology-based strategies and was younger, on average; Segment 3 (n = 52, 15%) preferred an improved waiting room to enhance client readiness, strongly disliked any type of clinical consultation, and had the lowest participation in local EBP training initiatives; Segment 4 (n = 90, 26%) strongly preferred clinical consultation strategies and included more clinicians in substance use clinics. CONCLUSIONS: The presence of four heterogeneous subpopulations within this large group of clinicians, supervisors, and administrators suggests optimal implementation may be achieved through targeted strategies derived via elicitation of stakeholder preferences. Best-worst scaling is a feasible and rigorous method for eliciting stakeholders' implementation preferences and identifying subpopulations with unique preferences in behavioral health settings.

Using behavioral insights to design implementation strategies in public mental health settings: a qualitative study of clinical decision-making.

BACKGROUND: Trauma-focused cognitive behavioral therapy (TF-CBT) is an evidence-based intervention for youth with posttraumatic stress disorder. An important component of TF-CBT is the trauma narrative (TN), a phase in the intervention in which youth are guided to process the memories, thoughts, and feelings associated with their traumatic experience(s). Previous work has shown that TF-CBT clinicians complete TNs with only half of their clients, yet little is known about what determines TF-CBT clinicians' use of TNs. The behavioral insights literature-an interdisciplinary field studying judgment and decision-making-offers theoretical and empirical tools to conceptualize what drives complex human behaviors and decisions. Drawing from the behavioral insights literature, the present study seeks to understand what determines clinician use of TNs and to generate strategies that target these determinants. METHODS: Through semi-structured qualitative interviews, we sought the perspectives of trained TF-CBT clinicians working in public mental health settings across the city of Philadelphia (N = 17) to understand their decisions to use TNs with clients. We analyzed the qualitative data using a coding approach informed by the behavioral insights literature. We used an iterative process of structured hypothesis generation, aided by a behavioral insights guide, and rapid validation informed by behavioral insights to uncover the determinants of TN use. We then generated implementation strategies that targeted these determinants using the "Easy Attractive Social Timely" framework, a behavioral insights design approach. RESULTS: We generated and validated three broad themes about what determines clinician implementation of TNs: decision complexity, clinician affective experience, and agency norms. We hypothesized behavioral insights that underlie these implementation determinants and designed a list of nine corresponding behavioral insights strategies that may facilitate TN implementation. CONCLUSIONS: Our study investigated why an effective component of an evidence-based intervention is difficult to implement. We leveraged robust scientific theories and empirical regularities from the behavioral insights literature to understand clinician perspectives on TN implementation. These factors were theoretically linked to implementation strategies. Our work revealed the potential for using behavioral insights in the diagnosis of evidence-based intervention determinants and the design of implementation strategies.