What Really Matters in the Implementation of Evidence-based Practices in Community Mental Health? Insight and Recommendations from Experts, Providers, and Clients.

Perceptions of evidence-based practices (EBPs) and implementation are inherent drivers of implementation outcomes. Most studies on implementation perceptions have focused on direct service providers, but clients and EBP experts may offer additional meaningful information about implementing EBPs in community settings. EBP providers (n = 21), EBP experts (n = 12), and clients who received EBPs (n = 6) participated in focus groups to ascertain their perceptions of and experiences with EBP implementation, as part of a program evaluation. Thematic analysis indicated that provider and expert perceptions of EBP implementation in community settings converged around themes of implementation supports and training and client outcomes, along with several subthemes. Client perceptions centered on themes regarding the importance of their personal experiences, their impressions of EBPs, as well as their recommendation for increasing public awareness and use of EBPs. Findings suggest that the perspectives of EBP providers and experts are closely aligned, focusing on system-level, individual-level, and training issues that impact EBP implementation within a public mental health system. The themes that were important to clients were primarily related to their experiences as recipients of an EBP which produced insightful recommendations for promoting EBPs in the community.

Learning from Adolescents and Caregivers to Enhance Acceptability and Engagement Within Virtual Dialectical Behavior Therapy for Adolescents Skills Groups: A Qualitative Study.

Despite the significant increase in adolescent mental health challenges in recent years, structural barriers continue to limit access to and engagement in mental health services. As such, opportunities to learn directly from adolescents and their families on how to best structure and deliver services are paramount. The current study assumes a multi-informant approach and reports on adolescents' and caregivers' (N = 33) experiences in an adapted telehealth/hybrid Dialectical Behavior Therapy for Adolescents (DBT-A) program. Focus groups were conducted across two cohorts of families who participated in DBT-A skills groups, to collect family-centered data on the acceptability of program modifications, engagement in the adapted telehealth/hybrid DBT-A, and recommendations for improvement. Participants were predominately Latine White and were from a broad range of socioeconomic backgrounds. Additionally, 45.5% of the adolescents identified as LGBTQ + . Focus group findings emphasized how the telehealth platform was both convenient and disengaging, and how in-person sessions offered improved group connection and content engagement. Participants underscored the importance of balancing multi-family group sessions with adolescent- and caregiver-only group sessions in the program, and adolescents emphasized a need for the DBT-A program to better center adolescents' unique experiences and voices throughout sessions. Both adolescents and caregivers suggested modifications to synthesize the content and improve generalizability of the DBT-A skills to their real lives. Overall, these findings add to a new and evolving branch of DBT-A qualitative inquiry, as well as the growing body of work that recommends incorporating the voices of people with lived experiences into the development and modification of psychological services.

Mixed-Methods Examination of Adolescent-Reported Barriers to Accessing Mental Health Services.

PURPOSE: Many adolescents struggle to access the mental healthcare they need. To increase access to mental health services, we must have a clear understanding of the barriers adolescents face from their own perspectives. This online mixed-methods study aimed to enhance understanding of access barriers by centering the perspectives of diverse adolescents who had recently tried and failed to access mental health support. METHODS: In this convergent parallel mixed-methods study, adolescents responded to a preintervention, open-ended question about barriers they have faced to accessing mental health services when they needed them and shared information about their background and depressive symptoms. Barriers were assessed using inductive, conventional content analysis. Quantitative analyses examined barrier differences across sociodemographic groups. RESULTS: All adolescents (aged 11-17 years, 50% racially minoritized youth, 15% gender diverse youth, 64% LGBTQ + youth; 78% with clinically elevated depressive symptoms) reported at least one barrier to accessing mental health support, and 20% reported multiple barriers. Content analysis revealed 13 barrier categories, with parent-related barriers (three different categories) accounting for 32% of all barriers. The most common barrier categories related to personal and financial constraints. Asian adolescents, adolescents who were aged 17 years or more, and adolescents who reported uncertainty of their gender identity endorsed the numerically highest mean number of barriers to accessing mental health support. DISCUSSION: High-symptom adolescents reported myriad barriers to accessing mental health support, with 32% of all barriers related to parents.

Clinical Consultation During a Trauma-Focused Cognitive Behavioral Therapy Community-Based Learning Collaborative: Examination of Consultation Content, Consultative Strategies, and Provider Engagement.

Consultation following evidence-based practice (EBP) training enhances the uptake of EBPs. Yet, little is known about what occurs during consultation, and it is often difficult for providers to engage in consultation. This study examined provider engagement in consultation and the content and strategies used during consultation following training in Trauma-focused Cognitive Behavioral Therapy (TF-CBT) as part of a community-based learning collaborative (CBLC). Minute-to-minute live coding of consultation calls revealed most content was clinically-oriented and the most common strategies used by consultants were didactic in nature. Providers with more years of professional experience and those with greater TF-CBT knowledge attended significantly more consultation calls. Providers with a greater average weekly caseload and providers who were supervisors presented significantly more cases on calls. Providers with greater TF-CBT knowledge spoke significantly more minutes on calls. Consistent with previous work, findings highlight difficulties with provider engagement in consultation and that providers with more baseline expertise are most likely to be engaged. Findings suggest tailoring EBP training efforts to better engage providers at greatest risk for low engagement.

Using Mechanical Turk to Study Parents and Children: An Examination of Data Quality and Representativeness.

OBJECTIVE: Mechanical Turk (MTurk) is a popular data collection tool that is increasingly used to study parents and children. We examined the quality of data obtained via MTurk, the representativeness of parents on MTurk, and whether the wording of MTurk recruitment materials is related to sample characteristics. METHOD: Participants were 650 parents with children aged 4 to 17 recruited for two separate studies (64.6% female, 83.8% Caucasian, mean age = 37.6 years). The Mental Health Survey (N = 322) recruitment materials described a study about mental health and the Health Survey (N = 328) materials only referenced health; both surveys restricted participation to parents in the United States (U.S.). Parents completed measures about demographics, mental health service seeking history, and parent and youth psychopathology. RESULTS: Participants provided reliable responses on study measures, with low rates of missing data. Participants were more female, less racially/ethnically diverse, and more educated than the U.S. population, and also had more children per household. Over 40% of parents and 30% of children had previously received mental health services and many scored in the clinical range on measures of psychopathology. Contrary to hypotheses, mental health help seeking was higher in the Health Survey than the Mental Health survey. CONCLUSIONS: MTurk is a feasible method for child and adolescent clinical psychology research, although participants may not be fully demographically representative of the general population and could possibly be better considered an at-risk or clinical sample than a community sample.

Understanding of evidence-based mental health care and the perceived importance of scientific information in a sample of U.S. adults.

OBJECTIVES: This online survey sought to qualitatively ascertain the extent to which a sample of U.S. adults understood the concept of evidence-based mental health care (EBMHC). Additional goals included assessing the perceived importance of scientific information in EBMHC, and examining whether understanding EBMHC and science values varied as a function of participant factors. METHOD: Participants (N = 221) defined EBMHC and rated the importance of scientific information. Open-ended EBMHC definitions were content-coded, and binomial logistic and linear regressions examined predictors of accurately defining EBMHC and of the perceived importance of scientific information. RESULTS: Participants endorsed seven definitions of EBMHC, and only 20% defined it accurately. Having greater knowledge about mental health conditions was associated with understanding EBMHC and with the higher perceived importance of scientific information. Greater help-seeking efficacy also predicted higher perceived importance of scientific information. CONCLUSIONS: Results support customized strategies to promote basic EBMHC education among U.S. adults.

Preaching to the Choir? Predictors of Engagement in a Community-Based Learning Collaborative.

This study examined predictors of engagement among 283 professionals from 34 agencies participating in three community-based learning collaboratives (CBLCs) on trauma-focused cognitive-behavioral therapy (TF-CBT). Only 50.2% of participants completed the CBLC, primarily due to not attending consultation calls or completing training cases. While higher engagement was associated with being trauma-informed and using more of the TF-CBT components prior to the CBLC, most predictors were not significant, perhaps due to ceiling effects. Positive attitudes and high organizational support were not sufficient to ensure engagement. Future research using longitudinal measurement of a wider range of predictors is needed.

Patterns and predictors of compliance with utilization management guidelines supporting a state policy to improve the quality of youth mental health services.

Despite a need to improve community mental health services for youths, little is known about compliance with state policies created to improve the quality of services in these settings. This study examined rates, patterns, and predictors of compliance with utilization management guidelines developed by the state of Texas to support a public health policy based on empirical evidence of effective mental health services (i.e., an evidence-based policy). Compliance was defined as authorizing policy-recommended service packages, whereas policy "overrides" occurred when recommended service packages were not authorized. The study sample consisted of 688 youths from ethnically and economically diverse backgrounds. Clinics reported that forty-six percent of youths were not authorized the policy-recommended service package. Overrides were primarily based on level of intensity. Most often, authorized services were less intensive than those recommended by the state guidelines. Higher severity at intake across multiple indicators was associated with authorizing less intensive services than what the policy guidelines recommended. Future studies evaluating system-level efforts such as state mental health policies should pay close attention to levels of service intensity, and their relation to the needs of youth in community settings.

Individualized Progress Measures Are More Acceptable to Clinicians Than Standardized Measures: Results of a National Survey.

Despite research supporting measurement-based care grounded in standardized progress measures, such measures are underutilized by clinicians. Individualized measures of client-specific targets present an alternative, but little is known about their acceptability or use. We compared attitudes toward and use of standardized and individualized progress measures in a national sample of 504 clinicians. Clinicians reported neutral to positive attitudes toward both types of measures, but strongly preferred and were more likely to use individualized measures. Clinician attitudes, theoretical orientation, and work setting predicted assessment preferences and practices. Implications for dissemination and implementation of measurement-based care are discussed.

Examining adherence to components of cognitive-behavioral therapy for youth anxiety after training and consultation.

The present study examined 115 service providers' adherence to components of cognitive-behavioral therapy (CBT) for youth anxiety prior to training, post workshop training, and after three months of weekly consultation. Adherence was measured using a role-play with a trained actor. We examined differences in individual adherence to CBT components across time and the relationship between number of consultation sessions attended and adherence ratings following consultation. Findings indicated that somatic arousal identification and relaxation were the most used treatment components prior to training. Adherence to all components of CBT increased following workshop training, except the usage of problem-solving. Adherence to problem-solving, positive reinforcement, the identification of anxious self-talk, and the creation of coping thoughts increased following consultation but usage of problem-solving remained low compared to other treatment components. Overall adherence remained less than optimal at the final measurement point. Number of consultation sessions attended predicted post-consultation adherence to identification of somatic arousal, identification of anxious self-talk, and positive reinforcement. Implications include tailoring future training based on baseline levels of adherence and spending more time during training and consultation on underutilized CBT components, such as problem-solving. Limitations of the present study, including how adherence was measured, are discussed. This study adds to the implementation science literature by providing more nuanced information on changes in adherence over the course of training and consultation of service providers.

Implementing a Measurement Feedback System in Community Mental Health Clinics: A Case Study of Multilevel Barriers and Facilitators.

Measurement feedback systems (MFSs) have been proposed as a means of improving practice. The present study examined the implementation of a MFS, the Contextualized Feedback System (CFS), in two community-based clinic sites. Significant implementation differences across sites provided a basis for examining factors that influenced clinician uptake of CFS. Following the theoretical implementation framework of Aarons et al. (Adm Policy Mental Health Mental Health Serv Res 38(1):4-23, 2011), we coded qualitative data collected from eighteen clinicians (13 from Clinic U and 5 from Clinic R) who participated in semi-structured interviews about their experience with CFS implementation. Results suggest that clinicians at both clinics perceived more barriers than facilitators to CFS implementation. Interestingly, clinicians at the higher implementing clinic reported a higher proportion of barriers to facilitators (3:1 vs. 2:1); however, these clinicians also reported a significantly higher level of organizational and leadership supports for CFS implementation. Implications of these findings are discussed.

De-adoption of an evidence-based trauma intervention in schools: A retrospective report from an urban school district.

The de-adoption of evidence-based practices (EBPs) is a largely understudied topic. The present study examined factors related to the de-adoption of an EBP for students exposed to traumatic events in a large urban school district. Qualitative interviews conducted with school clinicians and district administrators two years after the district embarked on a large-scale roll-out of the EBP distinguished between factors that impacted partial de-adoption after one year (phase 1) and complete de-adoption by the district after two years (phase 2). Phase 1 factors included organizational consistency, workforce stability, prior success, positive student outcomes, school- and district- level supports, innovation-setting fit, and innovation-related issues. Phase 2 factors included district-level leadership changes, financial and workforce instability, and shifting priorities. Study results suggest that sustainment-enhancing strategies should be included in the early stages of program implementation to most effectively adapt to school- and system- level changes.

Barriers to and Facilitators in the Implementation of Cognitive-Behavioral Therapy for Youth Anxiety in the Community.

OBJECTIVE: The study examined, from the perspective of therapists, the barriers to and facilitators in implementing cognitive-behavioral therapy (CBT) for anxious youths in community settings. METHODS: Fifty therapists (43% of the original training sample of 115 providers) participated in a follow-up interview two years after training and consultation. They reported on barriers to and facilitators in implementation of CBT for youths with anxiety. RESULTS: Qualitative analyses identified numerous barriers and facilitators, including client factors (for example, motivated clients facilitated the use of CBT, whereas clients with complex issues and numerous psychosocial stressors hindered its use), intervention factors (the structure of CBT helped facilitate its use for some providers, whereas others reported feeling constrained by such structure), and organizational factors (for example, the absence of support within one's institution served as a barrier, whereas supervision supporting the use of CBT facilitated implementation). CONCLUSIONS: Findings of this implementation trial align with conceptual implementation frameworks and may guide the tailoring of future implementation efforts in order to overcome barriers and maximize facilitators.

Sustaining clinician penetration, attitudes and knowledge in cognitive-behavioral therapy for youth anxiety.

BACKGROUND: Questions remain regarding the sustainment of evidence-based practices following implementation. The present study examined the sustainment of community clinicians' implementation (i.e., penetration) of cognitive-behavioral therapy, attitudes toward evidence-based practices, and knowledge of cognitive-behavioral therapy for youth anxiety two years following training and consultation in cognitive-behavioral therapy for youth anxiety. METHODS: Of the original 115 participants, 50 individuals (43%) participated in the two-year follow-up. A t- test examined sustainment in penetration over time. Hierarchical linear modeling examined sustainment in knowledge and attitudes over time. Time spent in consultation sessions was examined as a potential moderator of the change in knowledge and attitudes. RESULTS: Findings indicated sustained self-reported penetration of cognitive-behavioral therapy for anxious youth, with low fidelity to some key CBT components (i.e., exposure tasks). Follow-up knowledge was higher than at baseline but lower than it had been immediately following the consultation phase of the study. Belief in the utility of evidence-based practices was sustained. Willingness to implement an evidence-based practice if required to do so, appeal of evidence-based practices, and openness toward evidence-based practices were not sustained. Participation in consultation positively moderated changes in knowledge and some attitudes. CONCLUSIONS: Sustainment varied depending on the outcome examined. Generally, greater participation in consultation predicted greater sustainment. Implications for future training include higher dosages of consultation.

An examination of behavioral rehearsal during consultation as a predictor of training outcomes.

The training literature suggests that ongoing support following initial therapist training enhances training outcomes, yet little is known about what occurs during ongoing support and what accounts for its effectiveness. The present study examined consultation sessions provided to 99 clinicians following training in cognitive-behavioral therapy for youth anxiety. Recorded consultation sessions (N = 104) were coded for content and consultative methods. It was hypothesized that behavioral rehearsal (an active learning technique) would predict therapist adherence, skill, self-efficacy, and satisfaction at post-consultation. Regression analyses found no significant relation, however, clinician involvement during consultation sessions positively moderated the relationship between behavioral rehearsals and skill. Implications, limitations, and future directions are discussed.