Implementation fidelity, student outcomes, and cost-effectiveness of train-the-trainer strategies for Masters-level therapists in urban schools: results from a cluster randomized trial.

BACKGROUND: Little is known about the effectiveness and cost-effectiveness of train-the-trainer implementation strategies in supporting mental health evidence-based practices in schools, and about the optimal level of support needed for TT strategies. METHODS: The current study is part of a larger type 2 hybrid cluster randomized controlled trial. It compares two train-the-trainer strategies, Train-the-Trainer (TT) and Train-the-Trainer plus ongoing consultation for trainers (TT +) on the delivery of a group cognitive behavioral treatment protocol for anxiety disorders. Participants were 33 therapists, 29 supervisors, and 125 students who were at risk for anxiety disorders from 22 urban schools. Implementation outcomes were implementation fidelity and treatment dosage. Student outcomes were child- and parent-reported symptoms of anxiety, child-reported symptoms of depression, and teacher-reported academic engagement. We estimated the cost of implementing the intervention in each condition and examined the probability that a support strategy for supervisors (TT vs TT +) is a good value for varying values of willingness to pay. RESULTS: Therapists in the TT and TT + conditions obtained similarly high implementation fidelity and students in the conditions received similar treatment dosages. A mixed effects modeling approach for student outcomes revealed time effects for symptoms of anxiety and depression reported by students, and emotional disaffection reported by teachers. There were no condition or condition × times effects. For both conditions, the time effects indicated an improvement from pre-treatment to post-treatment in symptoms of anxiety and depression and academic emotional engagement. The average cost of therapist, supervisor, and consultant time required to implement the intervention in each condition was $1002 for TT and $1431 for TT + (p = 0.01). There was a greater than 80% chance that TT was a good value compared to TT + for all values of willingness to pay per one-point improvement in anxiety scores. CONCLUSIONS: A TT implementation approach consisting of a thorough initial training workshop for therapists and supervisors as well as ongoing supervision for therapists resulted in adequate levels of fidelity and student outcomes but at a lower cost, compared to the TT + condition that also included ongoing external expert consultation for supervisors. TRIAL REGISTRATION: ClinicalTrials.gov identifier: NCT02651402.

Therapist and supervisor perspectives about two train-the-trainer implementation strategies in schools: A qualitative study.

Background: Train-the-trainer (TT) implementation strategies (in which designated clinicians are trained to then train others in an intervention) are promising approaches to support mental health clinician use of evidence-based interventions in school contexts. However, there is little evidence to date examining clinicians' perceptions of the acceptability and feasibility of TT strategies, or comparing clinicians' perceptions of different types of TT strategies. Methods: The current study was conducted as part of a larger hybrid effectiveness-implementation trial, in which school-based therapists and supervisors received one of two different types of implementation support to implement cognitive behavioral therapy (CBT) groups for anxiety: TT (i.e., initial training for therapists and supervisors) or enhanced TT (TT+; i.e., initial training for therapists and supervisors, and ongoing external consultation for supervisors). We used applied thematic analysis to compare qualitative interview transcripts from 28 therapist interviews and 33 supervisor interviews from therapists and supervisors who received TT or TT+ support and report themes that were similar and different across the two groups. Results: Most themes were similar across the TT and TT+ conditions: therapists and supervisors in both conditions perceived the group anxiety intervention as acceptable and viewed supervision as acceptable, helpful, and feasible. Therapists and supervisors in both conditions had mixed impressions of the contextual appropriateness of the group anxiety intervention, and some reported logistical challenges with weekly supervision. Some unique themes were identified among the TT+ condition, including supervisors experiencing professional growth, and therapists and supervisors perceiving supervision as critically important and enjoyable. Conclusions: These results suggest that TT implementation support, using a model in which an internal supervisor receives initial training and then provides ongoing supervision, is acceptable and feasible to support a group CBT intervention in schools. The results also highlight additional benefits that therapists and supervisors perceived when supervisors received ongoing consultation. Clinical Trial Registration Information: The clinical trial from which these data were derived was registered at ClinicalTrials.gov (https://clinicaltrials.gov/) prior to the time of first patient enrollment. The registration number is: NCT02651402.

It is important to understand how to best support mental health clinicians in using evidence-based interventions in school contexts. Train-the-trainer (TT) strategies, in which designated clinicians receive training to then support others in using the intervention, may be promising, and it is important to determine the optimal TT model. However, little is known about how clinicians perceive the acceptability and feasibility of implementing evidence-based mental health interventions with different types of TT support, which can include training and/or ongoing consultation for internal trainers. To address this gap, we used a qualitative approach to examine and compare themes from semistructured interviews with therapists and supervisors participating in two different types of TT implementation support to deliver an evidence-based group CBT intervention for anxiety within schools. Therapists and supervisors receiving both kinds of support had mostly positive perceptions of the intervention and implementation support. They viewed the group anxiety intervention as acceptable and impactful, although they had mixed perceptions about its contextual appropriateness. They viewed supervision as acceptable, helpful, and generally feasible, although challenging at times. However, unique themes among the group who received the more intensive type of TT support, such as supervisors experiencing professional growth over time, suggest that there may be additional benefits to the more intensive support. Overall, these results suggest that TT strategies are an acceptable and feasible approach to support clinicians in delivering group CBT in schools. This study highlights the benefit of embedding qualitative interviews within randomized controlled trials to better understand clinician experiences and perspectives.

Development of an Online Training Platform and Implementation Strategy for School-Based Mental Health Professionals in Rural Elementary Schools: A Mixed-Methods Study.

Children in rural settings are less likely to receive mental health services than their urban and suburban counterparts and even less likely to receive evidence-based care. Rural schools could address the need for mental health interventions by using evidence-based practices within a tiered system of supports such as positive behavioral interventions and supports. However, very few school professionals, with or without mental health training, have received training on evidence-based practices. Rural schools need implementation strategies focused on training to prepare school personnel for the implementation of interventions with fidelity. Little is known about training strategies that are feasible and appropriate for the rural school context. User-centered design is an appropriate framework for the development of training strategies for professionals in rural schools because of its participatory approach and the development of products that fit the context where they are going to be used. The purpose of the study was to develop and assess components of an online training platform and implementation strategy based on the user-centered design. Quantitative and qualitative data from 25 participants from an equal number of schools in rural areas of Pennsylvania were used in the study. A mixed-methods design utilizing complementary descriptive statistics and theme analyses indicated that the training platform and implementation strategy were perceived as highly acceptable, appropriate, feasible and usable by school professionals. The resulting training platform and implementation strategy will fill a void in the training literature in rural schools.

Development and evaluation of a remote training strategy for the implementation of mental health evidence-based practices in rural schools: pilot study protocol.

BACKGROUND: An increasing number of schools in rural settings are implementing multi-tier positive behavioral interventions and supports (PBIS) to address school-climate problems. PBIS can be used to provide the framework for the implementation of evidence-based practices (EBPs) to address children's mental health concerns. Given the large service disparities for children in rural areas, offering EBPs through PBIS can improve access and lead to better long-term outcomes. A key challenge is that school personnel need technical assistance in order to implement EBPs with fidelity and clinical effectiveness. Providing ongoing on-site support is not feasible or sustainable in the majority of rural schools, due to their remote physical location. For this reason, remote training technology has been recommended for providing technical assistance to behavioral health staff (BHS) in under-served rural communities. OBJECTIVES: The purpose of this study is to use the user-centered design, guided by an iterative process (rapid prototyping), to develop and evaluate the appropriateness, feasibility, acceptability, usability, and preliminary student outcomes of two online training strategies for the implementation of EBPs at PBIS Tier 2. METHODS: The study will employ a pragmatic design comprised of a mixed-methods approach for the development of the training platform, and a hybrid type 2, pilot randomized controlled trial to examine the implementation and student outcomes of two training strategies: Remote Video vs. Remote Video plus Coaching. DISCUSSION: There is a clear need for well-designed remote training studies focused on training in non-traditional settings. Given the lack of well-trained mental health professionals in rural settings and the stark disparities in access to services, the development and pilot-testing of a remote training strategy for BHS in under-served rural schools could have a significant public health impact. ETHICS AND DISSEMINATION: The project was reviewed and approved by the institutional review board. Results will be submitted to ClinicalTrials.gov and disseminated to community partners and participants, peer-reviewed journals, and academic conferences. TRIAL REGISTRATION: ClinicialTrials.gov, NCT05034198 and NCT05039164.

Study protocol: cluster randomized trial of consultation strategies for the sustainment of mental health interventions in under-resourced urban schools: rationale, design, and methods.

BACKGROUND: The school is a key setting for the provision of mental health services to children, particularly those underserved through traditional service delivery systems. School-wide Positive Behavioral Interventions and Supports (PBIS) is a tiered approach to service delivery based on the public health model that schools use to implement universal (Tier 1) supports to improve school climate and safety. As our prior research has demonstrated, PBIS is a useful vehicle for implementing mental and behavioral health evidence-based practices (EBPs) at Tier 2 for children with, or at risk for, mental health disorders. Very little research has been conducted regarding the use of mental health EBPs at Tier 2 or how to sustain implementation in schools. METHODS/DESIGN: The main aim of the study is to compare fidelity, penetration, cost-effectiveness, and student outcomes of Tier 2 mental health interventions across 2 sustainment approaches for school implementers in 12 K-8 schools. The study uses a 2-arm, cluster randomized controlled trial design. The two arms are: (a) Preparing for Sustainment (PS)-a consultation strategy implemented by school district coaches who receive support from external consultants, and (b) Sustainment as Usual (SAU)-a consultation strategy implemented by school district coaches alone. Participants will be 60 implementers and 360 students at risk for externalizing and anxiety disorders. The interventions implemented by school personnel are: Coping Power Program (CPP) for externalizing disorders, CBT for Anxiety Treatment in Schools (CATS) for anxiety disorders, and Check-in/Check-out (CICO) for externalizing and internalizing disorders. The Interactive Systems Framework (ISF) for Dissemination and Implementation guides the training and support procedures for implementers. DISCUSSION: We expect that this study will result in a feasible, effective, and cost-effective strategy for sustaining mental health EBPs that is embedded within a multi-tiered system of support. Results from this study conducted in a large urban school district would likely generalize to other large, urban districts and have an impact on population-level child mental health. Trial registration ClinicalTrials.gov identifier number NCT04869657. Registered May 3, 2021.

Group CBT for Externalizing Disorders in Urban Schools: Effect of Training Strategy on Treatment Fidelity and Child Outcomes.

Public schools are an ideal setting for the delivery of mental health services to children. Unfortunately, services provided in schools, and more so in urban schools, have been found to lead to little or no significant clinical improvements. Studies with urban school children seldom report on the effects of clinician training on treatment fidelity and child outcomes. This study examines the differential effects of two levels of school-based counselor training: training workshop with basic consultation (C) vs. training workshop plus enhanced consultation (C+) on treatment fidelity and child outcomes. Fourteen school staff members (counselors) were randomly assigned to C or C+. Counselors implemented a group cognitive behavioral therapy protocol (Coping Power Program, CPP) for children with or at risk for externalizing behavior disorders. Independent coders coded each CPP session for content and process fidelity. Changes in outcomes from pre to post were assessed via a parent psychiatric interview and interviewer-rated severity of illness and global impairment. Counselors in C+ delivered CPP with significantly higher levels of content and process fidelity compared to counselors in C. Both C and C+ resulted in significant improvement in interviewer-rated impairment; the conditions did not differ from each other with regard to impairment. Groups did not differ with regard to pre- to- posttreatment changes in diagnostic severity level. School-based behavioral health staff in urban schools are able to implement interventions with fidelity and clinical effectiveness when provided with ongoing consultation. Enhanced consultation resulted in higher fidelity. Enhanced consultation did not result in better student outcomes compared to basic consultation. Implications for resource allocation decisions with staff training in EBP are discussed.

Web-Based Parent-Training for Parents of Youth With Impairment From Anxiety.

Child Anxiety Tales, an online web-based cognitive-behavioral parent-training program for parents of youth with anxiety, was developed and evaluated. Parents (N = 73; 59 females; 52.1% Caucasian, 42.5% African American, 4.1% Hispanic) who reported concerns about anxiety in their child (aged 7-14 yrs; Mean=10.1 ±1.6) were randomly assigned to (a) parent-training provided through Child Anxiety Tales (CAT), (b) parent-training provided via bibliotherapy (BIB), or (c) a waitlist control (WLC). Measures of parent knowledge, the acceptability of training, and child symptomatology were completed at pre- and post-parent-training and at 3-month follow-up. Findings support the feasibility, acceptability, and beneficial effects on knowledge of Child Anxiety Tales for parents of youth with impairment from anxiety.

A hybrid effectiveness-implementation cluster randomized trial of group CBT for anxiety in urban schools: rationale, design, and methods.

BACKGROUND: Schools present a context with great potential for the implementation of psychosocial evidence-based practices. Cognitive behavioral therapy (CBT) is an evidence-based practice that has been found to be very effective in treating anxiety in various community settings, including schools. Friends for Life (FRIENDS) is an efficacious group CBT protocol for anxiety. Unfortunately, evidence-based practices for anxiety are seldom employed in under-resourced urban schools, because many treatment protocols are not a good fit for the urban school context or the population, existing behavioral health staff do not receive adequate training or support to allow them to implement the treatment with fidelity, or school districts do not have the resources to contract with external consultants. In our prior work, we adapted FRIENDS to create a more culturally sensitive, focused, and feasible CBT protocol for anxiety disorders (CBT for Anxiety Treatment in Schools (CATS)). METHODS/DESIGN: The aim of this 5-year study is to evaluate both the effectiveness of CATS for urban public schools compared to the original FRIENDS as well as compare the implementation strategies (train-the-trainer vs. train-the-trainer + ongoing consultation) by conducting a three-arm, parallel group, type 2 hybrid effectiveness-implementation trial in 18 K-8 urban public schools. We will also assess the cost-effectiveness and the mediators and moderators of fidelity. Ninety therapists, 18 agency supervisors, and 360 children will participate. The interactive systems framework for dissemination and implementation guides the training and support procedures for therapists and supervisors. DISCUSSION: This study has the potential to demonstrate that agency therapists and supervisors who have had little to no prior exposure to evidence-based practices (EBPs) can implement an anxiety disorder EBP with fidelity. Comparisons of the implementation strategies would provide large urban mental health systems with data to make decisions about the adoption of EBPs. TRIAL REGISTRATION: ClinicalTrials.gov, NCT02651402.

Training School Mental Health Providers to Deliver Cognitive-Behavioral Therapy.

Anxiety disorders are among the most prevalent mental health difficulties experienced by youth. A well-established literature has identified cognitive-behavior therapy (CBT) as the gold-standard psychosocial treatment for youth anxiety disorders. Access to CBT in community clinics is limited, but a potential venue for the provision of CBT for child anxiety disorders is the school setting. The present study examined a subset of data from a larger study in which therapists from a variety of settings, including schools, were trained in CBT for child anxiety (N = 17). The study investigated the relationship between provider- and organizational-level variables associated with training and implementation among school mental health providers. The present findings indicate a positive relationship between provider attitudes and adherence to CBT. Self-reported barriers to implementation were also identified. Integrating CBT into school mental health providers' repertoires through training and consultation is a critical step for dissemination and implementation of empirically supported psychosocial treatments.

Computers and psychosocial treatment for child anxiety: recent advances and ongoing efforts.

Building on the empirical data supporting the efficacy of cognitive-behavioral therapy (CBT) for child anxiety, researchers are working on the development and evaluation of cost-effective and transportable CBT approaches. Related to this, a widely endorsed goal is to disseminate evidence-based treatments from research settings to community settings. Computer-assisted treatments have emerged as a means to provide cost-effective and efficient service to an increased number of anxious youth for whom a CBT treatment would be otherwise unavailable. We offer a rationale for the development and evaluation of computer-assisted psychosocial treatments for anxiety in youth, offer illustrative advances made in this area, and describe our efforts in using computers to enhance dissemination of CBT for child anxiety. Specifically, our illustrations include a description of (a) Camp-Cope-A-Lot (CCAL), a computer-assisted CBT for the treatment of anxiety disorders in youth ages 7-12, and (b) CBT4CBT: Computer-based training in CBT for anxious youth. Findings from evaluations of these programs are summarized, and further advances are proposed and discussed.

Computer-assisted cognitive behavioral therapy for child anxiety: results of a randomized clinical trial.

OBJECTIVE: This study examined the feasibility, acceptability, and effects of Camp Cope-A-Lot (CCAL), a computer-assisted cognitive behavioral therapy (CBT) for anxiety in youth. METHOD: Children (49; 33 males) ages 7-13 (M = 10.1 ± 1.6; 83.7% Caucasian, 14.2% African American, 2% Hispanic) with a principal anxiety disorder were randomly assigned to (a) CCAL, (b) individual CBT (ICBT), or (c) a computer-assisted education, support, and attention (CESA) condition. All therapists were from the community (school or counseling psychologists, clinical psychologist) or were PsyD or PhD trainees with no experience or training in CBT for child anxiety. Independent diagnostic interviews and self-report measures were completed at pre- and posttreatment and 3-month follow-up. RESULTS: At posttreatment, ICBT or CCAL children showed significantly better gains than CESA children; 70%, 81%, and 19%, respectively, no longer met criteria for their principal anxiety diagnosis. Gains were maintained at follow-up, with no significant differences between ICBT and CCAL. Parents and children rated all treatments acceptable, with CCAL and ICBT children rating higher satisfaction than CESA children. CONCLUSIONS: Findings support the feasibility, acceptability and beneficial effects of CCAL for anxious youth. Discussion considers the potential of computer-assisted treatments in the dissemination of empirically supported treatments.

Exploring the role of parent training in the treatment of childhood anxiety.

Data from a randomized clinical trial comparing the relative efficacy of individual cognitive-behavioral therapy (ICBT), family CBT (FCBT), and a family-based education/support/attention control (FESA) condition were used to examine associations between in-session therapeutic techniques related to parent training (PT) and treatment outcomes. This study explored the extent to which therapists' use of PT techniques, specifically (a) parental anxiety management, (b) transfer of control from therapist to parent to child over child's coping, (c) communication skills training, and (d) contingency management training, contributed to treatment outcome in family-based CBT. Children (N = 53; 31 males; 7.8-13.8 years of age; M = 10.1 years, SD = 2.3; 85% Caucasian, 9% African American, 4% Asian, 2% "other" background) with a principal anxiety disorder completed 16 sessions of CBT with their parents. The relative contributions of PT components on treatment outcome were evaluated. As hypothesized, both transfer-of-control and parental anxiety management techniques significantly contributed to improvement on clinician and parent ratings of child global functioning within FCBT. PT did not significantly contribute to improvement on measures of child anxiety. These preliminary findings suggest that when FCBT is conducted for child anxiety, PT (i.e., transfer-of-control and parental anxiety management techniques) may contribute to improvements in the child's global functioning.

The Pediatric Obsessive-Compulsive Disorder Treatment Study II: rationale, design and methods.

UNLABELLED: This paper presents the rationale, design, and methods of the Pediatric Obsessive-Compulsive Disorder Treatment Study II (POTS II), which investigates two different cognitive-behavior therapy (CBT) augmentation approaches in children and adolescents who have experienced a partial response to pharmacotherapy with a serotonin reuptake inhibitor for OCD. The two CBT approaches test a "single doctor" versus "dual doctor" model of service delivery. A specific goal was to develop and test an easily disseminated protocol whereby child psychiatrists would provide instructions in core CBT procedures recommended for pediatric OCD (e.g., hierarchy development, in vivo exposure homework) during routine medical management of OCD (I-CBT). The conventional "dual doctor" CBT protocol consists of 14 visits over 12 weeks involving: (1) psychoeducation, (2), cognitive training, (3) mapping OCD, and (4) exposure with response prevention (EX/RP). I-CBT is a 7-session version of CBT that does not include imaginal exposure or therapist-assisted EX/RP. In this study, we compared 12 weeks of medication management (MM) provided by a study psychiatrist (MM only) with two types of CBT augmentation: (1) the dual doctor model (MM+CBT); and (2) the single doctor model (MM+I-CBT). The design balanced elements of an efficacy study (e.g., random assignment, independent ratings) with effectiveness research aims (e.g., differences in specific SRI medications, dosages, treatment providers). The study is wrapping up recruitment of 140 youth ages 7-17 with a primary diagnosis of OCD. Independent evaluators (IEs) rated participants at weeks 0,4,8, and 12 during acute treatment and at 3,6, and 12 month follow-up visits. TRIAL REGISTRATION: NCT00074815.