Inter-organizational alignment and implementation outcomes in integrated mental healthcare for children and adolescents: a cross-sectional observational study.

BACKGROUND: Integrated care involves care provided by a team of professionals, often in non-traditional settings. A common example worldwide is integrated school-based mental health (SBMH), which involves externally employed clinicians providing care at schools. Integrated mental healthcare can improve the accessibility and efficiency of evidence-based practices (EBPs) for vulnerable populations suffering from fragmented traditional care. However, integration can complicate EBP implementation due to overlapping organizational contexts, diminishing the public health impact. Emerging literature suggests that EBP implementation may benefit from the similarities in the implementation context factors between the different organizations in integrated care, which we termed inter-organizational alignment (IOA). This study quantitatively explored whether and how IOA in general and implementation context factors are associated with implementation outcomes in integrated SBMH. METHODS: SBMH clinicians from community-based organizations (CBOs; nclinician = 27) and their proximal student-support school staff (nschool = 99) rated their schools and CBOs (clinician only) regarding general (organizational culture and molar climate) and implementation context factors (Implementation Climate and Leadership), and nine common implementation outcomes (e.g., treatment integrity, service access, acceptability). The levels of IOA were estimated by intra-class correlations (ICCs). We fitted multilevel models to estimate the standalone effects of context factors from CBOs and schools on implementation outcomes. We also estimated the 2-way interaction effects between CBO and school context factors (i.e., between-setting interdependence) on implementation outcomes. RESULTS: The IOA in general context factors exceeded those of implementation context factors. The standalone effects of implementation context factors on most implementation outcomes were larger than those of general context factors. Similarly, implementation context factors between CBOs and schools showed larger 2-way interaction effects on implementation outcomes than general context factors. CONCLUSIONS: This study preliminarily supported the importance of IOA in context factors for integrated SBMH. The findings shed light on how IOA in implementation and general context factors may be differentially associated with implementation outcomes across a broad array of integrated mental healthcare settings.

Helping Educational Leaders Mobilize Evidence (HELM): The iterative redesign of the Leadership and Organizational Change for Implementation (LOCI) intervention for use in schools.

Background: Few "intervention agnostic" strategies have been developed that can be applied to the broad array of evidence-based practices (EBPs) in schools. This paper describes two studies that reflect the initial iterative redesign phases of an effective leadership-focused implementation strategy-Leadership and Organizational Change for Implementation (LOCI)-to ensure its acceptability, feasibility, contextual appropriateness, and usability when used in elementary schools. Our redesigned strategy-Helping Educational Leaders Mobilize Evidence (HELM)-is designed to improve principals' use of strategic implementation leadership to support the adoption and high-fidelity delivery of a universal EBP to improve student outcomes. Method: In Study 1, focus groups were conducted (n = 6) with 54 district administrators, principals, and teachers. Stakeholders provided input on the appropriateness of original LOCI components to maximize relevance and utility in schools. Transcripts were coded using conventional content analysis. Key themes referencing low appropriateness were summarized to inform LOCI adaptations. We then held a National Expert Summit (Study 2) with 15 research and practice experts. Participants provided feedback via a nominal group process (NGP; n = 6 groups) and hackathon (n = 4 groups). The research team rated each NGP suggestion for how actionable, impactful/effective, and feasible it was. We also coded hackathon notes for novel ideas or alignment with LOCI components. Results: Study 1 suggestions included modifications to LOCI content and delivery. Study 2's NGP results revealed most recommendations to be actionable, impactful/effective, and feasible. Hackathon results surfaced two novel ideas (distributed leadership teams and leaders' knowledge to support educators EBP use) and several areas of alignment with LOCI components. Conclusion: Use of these iterative methods informed the redesign of LOCI and the development of HELM. Because it was collaboratively constructed, HELM has the potential to be an effective implementation strategy to support the use of universal EBP in schools.

Our research team designed a strategy (HELM) for school principals to improve the support they provide to staff to implement practices proven to work in research for improving student outcomes. We designed HELM by conducting focus groups with school district administrators, principals, and teachers. Participants were asked for their feedback on how to adapt an existing leadership strategy (LOCI) to the school context. After collecting this feedback, we held a meeting with 15 research and practice experts. During this meeting, the group of experts reviewed the focus group feedback and decided how to incorporate it into the design of the HELM strategy. We believe that collecting this feedback and involving research and practice experts in interpreting and integrating participant feedback into the HELM strategy will make HELM a more effective strategy for supporting school principals' in implementing supports in their schools.

Inter-Organizational Alignment and Implementation Outcomes in Integrated Mental Healthcare for Children and Adolescents: A Cross-Sectional Observational Study.

Background: Integrated care involves care provided by a team of professionals, often in non-traditional settings. A common example worldwide is integrated school-based mental health (SBMH), which involves externally employed clinicians providing care at schools. Integrated mental healthcare can improve the accessibility and efficiency of evidence-based practices (EBPs) for vulnerable populations suffering from fragmented traditional care. However, integration can complicate EBP implementation due to overlapping organizational contexts, diminishing the public health impact. Emerging literature suggests that EBP implementation may benefit from the similarities in the implementation context factors between the different organizations in integrated care, which we termed inter-organizational alignment (IOA). This study quantitatively explored whether and how IOAs in general and implementation context factors are associated with implementation outcomes in integrated SBMH. Methods: SBMH clinicians from community-based organizations (CBOs; nclinician=27) and their proximal student-support school staff (nschool=99) rated their schools and CBOs (clinician only) regarding general (organizational culture and molar climate) and implementation context factors (Implementation Climate and Leadership), and nine common implementation outcomes (e.g., treatment integrity, service access, acceptability). The levels of IOA were estimated by intra-class correlations (ICCs). We fitted multilevel models to estimate the standalone effects of context factors from CBOs and schools on implementation outcomes. We also estimated the 2-way interaction effects between CBO and school context factors (i.e., between-setting interdependence) on implementation outcomes. Results: The IOA in general context factors exceeded those of implementation context factors. The standalone effects of implementation context factors on most implementation outcomes were larger than those of general context factors. Similarly, implementation context factors between CBOs and schools showed larger 2-way interaction effects on implementation outcomes than general context factors. Conclusions: This study preliminarily supported the importance of IOA in context factors for integrated SBMH. The findings shed light on how IOA in implementation and general context factors may be differentially associated with implementation outcomes across a broad array of integrated mental healthcare settings.

The relationship between school mental health service use in high school and educational outcomes of adolescents with psychiatric disorders.

This study aimed to examine the relationship between school mental health service use in high school and educational outcomes of adolescents with psychiatric disorders. The sample included 2617 adolescents who were enrolled in eighth grade in a large urban school district in the United States, were enrolled in Medicaid during eighth grade, and had a mental health diagnosis. Psychiatric hospitalization, school enrollment, school absences, out-of-school suspensions, school dropouts, and school exits for negative reasons were examined as mental health and educational outcomes. Compared with adolescents who used school mental health services for 2 years following eighth grade, adolescents who did not use school mental health service during the high school years had a significantly lower annual number of days enrolled in school and higher rates of exiting school for negative reasons such as school dropout and long-term hospitalization. Our findings support the positive role of school mental health care delivery in high schools in preventing negative educational outcomes for adolescents with psychiatric disorder.

Educators' experiences and reflections on the implementation of evidence-based practices for autistic students in public schools during the COVID-19 pandemic.

Introduction: In 2020, the COVID-19 pandemic forced many schools to close their doors and transition to remote learning, disrupting how autistic students received school-based services and support. While school structure changes were challenging for all students, autistic students were uniquely affected, considering their reliance on predictability and routine; moreover, education settings are where most autistic children receive services. Much has been studied regarding the use of evidence-based practices (EBPs) for autistic students in traditional school settings, yet little is known about how educators use EBPs in remote learning environments in the wake of the COVID-19 pandemic. Method: In this study, we explore educators' experiences with EBP implementation at the height of the pandemic and educators' reflections of its impact on autistic students and their school systems. Qualitative data were collected from 81 educators (general educators, special educators, and paraeducators) in semi-structured interviews regarding EBP use at the onset of the pandemic. Results: Four themes emerged from interviews: (1) pandemic and remote learning environment challenges to inclusion and EBP use; (2) EBP use adaptations for remote learning environments; (3) pandemic and remote learning environment benefits for EBP use; and (4) considerations for EBP use beyond the pandemic. Conclusion: These findings elucidate educators' experiences using EBPs during the COVID-19 pandemic and highlight important areas of consideration for autism-focused EBP implementation as remote instruction continues to be a learning format. More research is needed to understand how to best implement EBPs for autistic students in this emerging instruction context.

The COVID-19 pandemic forced many schools to shift to remote or hybrid learning, which impacted how autistic students received school-based services. School settings are where most autistic children receive support and accommodations. Evidence-based practices (EBPs) are strategies shown by high-quality research to support autistic children, and there are strong efforts to increase the use of EBPs in schools. While much is known about how autism-focused EBPs are used in traditional classroom settings, little is known about how these practices are used in remote learning environments. This paper explored educators' experiences using EBPs at the height of the pandemic and educators' reflections of its impact on autistic students and their school systems. Interviews with general educators, special educators, and paraeducators revealed important information. There were pandemic-specific and remote learning environment challenges to inclusion and EBP use. Many educators reported making adaptations to EBPs when instruction was pivoted to remote learning. While there were challenges to remote instruction, there were also pandemic- and remote learning environment-related benefits for EBP use. Educators also reflected on considerations for EBP use beyond the pandemic, including more educator training opportunities to support EBP use in remote settings. Considering the rise in remote and hybrid learning settings, future research should explore how to support educators, autistic students, and their caregivers in remote setting EBP use.

"On an island by myself": implications for the inclusion of autistic students in self-contained classrooms in public elementary schools.

Introduction: Autistic students have limited access to inclusive classes and activities in their schools. Principals and special education teachers who directly teach and administer programs for autistic elementary students can offer critical insight into factors, such as educators' attitudes, that may impact inclusive opportunities in schools. These attitudes may serve as barriers to or facilitators of promoting an inclusive school setting. Methods: Semi-structured interviews with 26 elementary school principals and 26 special education teachers explored their experiences implementing evidence-based practices for autistic students (pivotal response training, discrete trial training, and visual schedules) in 26 self-contained classrooms in the United States. Autism-specific culture and inclusion emerged as a theme, which was analyzed for this paper. Results: An inductive approach to thematic analysis revealed principals' and special education teachers' perspectives regarding the "autism-specific culture" in the school, including attitudes towards and inclusion of autistic students in self-contained classrooms in the broader school environment. Analysis of text related to "autism-specific culture" detailed aspects of inclusion, factors (i.e., barriers and facilitators) affecting inclusion, principals' and special education teachers' attitudes towards autistic students placed in self-contained classrooms, attitudes of other school staff towards teachers in self-contained classrooms, and recommendations to support an inclusive school environment for autistic students. Discussion: Results suggest that valuing "equal" access to classes and activities for autistic students in self-contained classrooms may not be sufficient for promoting an inclusive school environment, Educators may benefit from targeted strategies to facilitate inclusion. Strategies range from supporting educators' attitudes and knowledge of autism to shifting physical aspects of the school environment (e.g., location of classrooms). Additional implications for supporting the true inclusion (i.e., inclusion that goes beyond physical inclusion) involves of autistic students in self-contained classrooms schools are discussed.

The incremental association of implementation leadership and school personnel burnout beyond transformational leadership.

Successful implementation of school-wide interventions (i.e., delivered to all students by a wide array of school personnel) is key to promoting students' academic achievement and psychosocial development. Yet, the implementation of school-wide interventions is complex and can be psychologically taxing for implementing personnel. If evidence-based practice and program (EBP) implementation goes unsupported, implementation challenges might result in chronic stress among school personnel that leads to burnout. While generally effective leadership tends to decrease educator burnout, implementation-specific leadership may also decrease burnout through its strategic supports for EBP implementation. A series of linear regression and path models were used to examine the concurrent association between transformational (e.g., general) and implementation (e.g., strategic) leadership and burnout and its component parts (i.e., emotional exhaustion, depersonalization, personal accomplishment). In a sample of 338 school personnel, we found transformational and implementation leadership were each significantly associated with decreased burnout. However, transformational leadership was not significantly associated with any of the three burnout components, whereas implementation leadership was significantly associated with increased personal accomplishment. These results suggest both general and strategic forms of leadership are key supports for school personnel burnout and as such, leaders may benefit from training to improve each. Additional implications for schools and future directions to understand how best to support school personnel are discussed. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Teacher attitudes toward evidence-based practices: Exploratory and confirmatory analyses of the school-adapted evidence-based practice attitude scale.

Background: The Evidence-Based Practice Attitudes Scale (EBPAS) is widely used in implementation research, but it has not been adapted and validated for use among general education teachers, who are most likely to deliver evidence-based prevention programs in schools, the most common setting where youth access social, emotional, and behavioral health services. Method: School-based stakeholders and a research team comprised of experts in the implementation of evidence-based practices in schools adapted the EBPAS for teachers (the S-EBPAS). The adapted instrument was administered to a representative sample (n = 441) of general education teachers (grades K-5) to assess the reliability and internal consistency via factor analyses. The S-EBPAS included two forms (i.e., EBP-agnostic and EBP-specific item referents), therefore, a multiple-group confirmatory factor analysis (CFA) was also performed to establish measurement invariance between the two forms. Results: After adaptation and refinement, a 9-item, 3-factor structure was confirmed, with the final model supporting three first-order factors that load onto a second-order factor capturing attitudes toward adopting evidence-based practices. Multiple-group CFA analyses of measurement invariance indicated there were no significant differences between the two forms. Conclusions: Overall, this study provides a brief, flexible instrument capturing attitudes toward adopting EBPs that has high reliability and internal consistency, which support its use among general education teachers in school settings implementing evidence-based practices. Plain Language Summary: The Evidence-Based Practice Attitudes Scale (EBPAS) is a popular instrument for measuring attitudes toward evidence-based practices (EBPs). This instrument provides valuable information during implementation initiatives, such as whether providers or front-line implementers have favorable attitudes toward a given practice. The EBPAS has been used in many different settings, such as in community-based mental health clinics, medical hospitals, and in child welfare. However, it's use in schools has been limited, and it has not yet been tested with general education teachers, who are key implementers of evidence-based practices in schools. In order to trust that the scores from an instrument are accurate, it needs to be evaluated when scaling it out to new populations and settings. One popular method to determine this is to use factor analysis, which was employed in this study. This study fills the identified gap by assessing the reliability (i.e., accuracy) and internal consistency of the EBPAS among a representative sample of general education teachers. Findings from this study indicate that the school-adapted EBPAS (S-EBPAS) is a brief, nine-item instrument that provides a reliable estimate of teachers' attitudes toward evidence-based practices. Our results also provide evidence that the S-EBPAS can be used to capture attitudes toward specific EBPs as well as attitudes toward EBP-agnostic. This study provides a flexible instrument that can be used by school-based implementation researchers, practitioners, and intermediaries at multiple phases of implementation projects, such as when exploring a new EBP to adopt.

Concordance of multiple informant assessment of school-based social skills intervention and association with child outcomes: Results from a randomized trial.

Background: Fidelity, or the degree to which an intervention is implemented as designed, is essential for effective implementation. There has been a growing emphasis on assessing fidelity of evidence-based practices for autistic children in schools. Fidelity measurement should be multidimensional and focus on core intervention components and assess their link with program outcomes. This study evaluated the relation between intervention fidelity ratings from multiple sources, tested the relation between fidelity ratings and child outcomes, and determined the relations between core intervention components and child outcomes in a study of an evidence-based psychosocial intervention designed to promote inclusion of autistic children at school, Remaking Recess. Method: This study extends from a larger randomized controlled trial examining the effect of implementation support on Remaking Recess fidelity and child outcomes. Schools were randomized to receive the intervention or the intervention plus implementation support. Observers, intervention coaches, and school personnel completed fidelity measures to rate completion and quality of intervention delivery. A measure of peer engagement served as the child outcome. Pearson correlation coefficients were calculated to determine concordance between raters. Two sets of hierarchical linear models were conducted using fidelity indices as predictors of peer engagement. Results: Coach- and self-rated completion and quality scores, observer- and self-rated quality scores, and observer- and coach-rated quality fidelity scores were significantly correlated. Higher observer-rated completion and quality fidelity scores were predictors of higher peer engagement scores. No single intervention component emerged as a significant predictor of peer engagement. Conclusions: This study demonstrates the importance of using a multidimensional approach for measuring fidelity, testing the link between fidelity and child outcomes, and examining how core intervention components may be associated with child outcomes. Future research should clarify how to improve multi-informant reports to provide "good enough" ratings of fidelity that provide meaningful information about outcomes in community settings. Plain Language Summary: Fidelity is defined as how closely an intervention is administered in the way the creators intended. Fidelity is important because it allows researchers to determine what exactly is leading to changes. In recent years, there has been an interest in examining fidelity of interventions for autistic children who receive services in school. This study looked at the relationship between fidelity ratings from multiple individuals, the relationship between fidelity and child outcomes, and the relationship between individual intervention component and child changes in a study of Remaking Recess, an intervention for autistic children at school. Schools were randomly selected to receive the intervention only or the intervention plus implementation support from the research team. Observers, intervention coaches, and individuals delivering the intervention themselves completed fidelity measures. Child engagement with peers was measured before and after the intervention. Several measures of self-, coach-, and observer-report fidelity were associated with each other. Higher observer-reported fidelity was associated with higher child peer engagement scores. No single intervention step was linked to child peer engagement and both treatment groups had similar outcomes in terms of fidelity. This study shows the importance of having multiple raters assess different parts of intervention fidelity, looking at the link between fidelity and child outcomes, and seeing how individual intervention steps may be related to outcomes. Future research should aim to find out which types of fidelity ratings are "good enough" to lead to positive changes following treatment so that those aspects can be used and targeted in the future.

Supporting Autistic College Students: Examining the Mentoring, Organization and Social Support for Autism Inclusion on Campus (MOSSAIC) Program.

Recent trends suggest that autistic young adults are increasingly accessing postsecondary education than in years past. However, these students often face unique challenges that negatively impact their college experience resulting in high dropout. The Mentoring, Organization and Social Support for Autism Inclusion on Campus (MOSSAIC) Program is a peer-mentorship college transition program intended to support autistic students with executive functioning, social, and self-advocacy skills. This study investigated the experiences of 13 autistic mentees and 12 non-autistic mentors enrolled in the MOSSAIC program. Program feedback was collected using semi-structured interviews in order to understand student experiences, highlight benefits, and identify areas of improvement. Participants reported a general positive experience and improved skills in the domains of socialization, executive functioning, academic performance, and professional development. The most common suggestion for the program was the inclusion of autistic peer mentors. Mentees noted difficulty relating with non-autistic peers and feeling burdened with the need to educate their mentor on how to support autistic adults. These data provide valuable insight into how colleges can better improve support for autistic college students to ensure postsecondary success. Future peer mentorship programs should consider recruiting neurodiverse mentors from diverse backgrounds to improve congruence between mentor and mentee identities.

The Interaction Between General and Strategic Leadership and Climate on Their Multilevel Associations with Implementer Attitudes Toward Universal Prevention Programs for Youth Mental Health: A Cross-Sectional Study.

Emerging literature has highlighted the importance of discerning general and strategic organizational context (OC) factors (e.g., leadership and climate) and their interaction effect on individual implementation behaviors (e.g., attitudes toward evidence-based practices; EBPs) in youth mental healthcare. This study aimed to examine how leadership and climate (general and strategic) are associated with implementer attitudes toward EBPs across the individual and organizational levels and their interaction effect in schools. A series of multilevel models (MLMs) were fitted on a diverse sample of schools actively implementing universal prevention programs for youth mental health (441 implementers from 52 schools). The organization-level aggregates and individual educators' perceptions of general and strategic leadership and climate, and their interaction terms, were entered as level-2 and level-1 predictors of four attitudinal dimensions (Requirement, Openness, Appeal, and Divergence) based on their level of measurement. At the organizational level, higher levels of strategic leadership and climate, but not their general counterparts, were consistently associated with more favorable attitudes in all four dimensions. At the individual/within-school level, higher levels of perceived general and strategic leadership and climate were associated with more favorable attitudes of Requirement and Openness. At the organizational/between-school level, general climate moderated the positive effect of strategic climate on implementers' perception of appeal and divergence of EBPs. Our findings indicate that leaders should make data-based decisions to allocate resources on strategic and/or general leadership and climate to foster favorable staff attitudes toward EBPs based on the level of measurement, implementation-specificity, and attitudinal dimensions.

Supporting the inclusion and retention of autistic students: Exploring teachers' and paraeducators' use of evidence-based practices in public elementary schools.

Introduction: Educators in public schools are required to serve students in their least restrictive environment. While many evidence-based practices (EBPs), defined as practices and strategies shown by research to have meaningful effectson outcomes for autistic students are documented in the literature, less is known about EBP use among educators in public schools. Methods: Eighty-six general and special education teachers and para educators completed a survey about familiarity, training, and EBP use for included autistic children. Results: Across roles, educators reported familiarity (98.8%), use (97.7%), and training (83.7%) in reinforcement. They reported the least familiarity with behavioral momentum (29.1%), training in both video modeling and peer-mediated instruction and intervention (18.6%), and use of video modeling (14.0%). Follow-up interviews (n = 80) highlighted mixed understanding of EBP definitions and use. Discussion: Implications for inclusive education are discussed including autism-specific EBP training within pre-service teacher preparation programs.

Accessible, Equitable, and Personalized Care for Autistic Individuals.

When it comes to service accessibility for autistic individuals, there exists a pipeline problem [...].

Testing a Theory of Implementation Leadership and Climate Across Autism Evidence-Based Interventions of Varying Complexity.

Prominent theories within the field of implementation science contend that organizational leaders can improve providers' fidelity to evidence-based practices (EBPs) by using focused implementation leadership behaviors that create an organizational climate for EBP implementation. However, this work has been criticized for overreliance on nonspecific, self-report fidelity measures and poor articulation of the boundary conditions that may attenuate leadership and climate's influence. This study tests the predictions of EBP implementation leadership and climate theory on observed fidelity to three school-based EBPs for autism that vary in complexity: pivotal response training (PRT), discrete trial training (DTT), and visual schedules (VS). Educators in kindergarten to third-grade autism support classrooms in 65 schools assessed their principals' EBP implementation leadership and school EBP implementation climate prior to the school year. Mid-school year, trained observers rated educator fidelity to all three interventions. Expert raters confirmed PRT was significantly more complex than DTT or VS using the Intervention Complexity Assessment Tool for Systematic Reviews. Linear regression analyses at the school level indicated principals' increased frequency of EBP implementation leadership predicted a higher school EBP implementation climate, which in turn predicted higher educator fidelity to PRT-however, there was no evidence of a relationship between implementation climate and fidelity to DTT or VS. Comparing principals whose EBP implementation leadership was ±1 SD from the mean, there was a significant indirect association of EBP implementation leadership with PRT fidelity through EBP implementation climate (d = 0.49, 95% CI [0.04, 0.93]). Strategies that target EBP implementation leadership and climate may support fidelity to complex behavioral interventions.

Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS).

BACKGROUND: Strategic implementation leadership is a critical determinant of successful implementation, hypothesized to create a more supportive implementation climate conducive to the adoption and use of evidence-based practices. Implementation leadership behaviors may vary significantly across contexts, necessitating studies that examine the validity of established measurement tools in novel health service delivery sectors. The education sector is the most common site for delivering mental health services to children and adolescents in the USA, but research focused on implementation leadership in schools is in the early phases, and there is a need for adaptation and expansion of instruments in order to tailor to the school context. The current study adapted and validated the School Implementation Leadership Scale (SILS) (based on the Implementation Leadership Scale) in a sample of elementary school personnel from six school districts who were implementing one of two well-established prevention programs for supporting children's mental health. METHODS: Participants were 441 public school teachers from 52 elementary schools in the Midwest and West Coast of the USA. Participants completed a survey that contained: (1) an adapted and expanded version of the SILS with additional items generated for four existing subscales as well as three new subscales (communication, vision/mission, and availability), and (2) additional tools to evaluate convergent and divergent validity (i.e., measures of general/molar leadership and teaching attitudes). Data underwent (1) examination of item characteristic curves to reduce items and ensure a pragmatic instrument, (2) confirmatory factor analyses to establish structural validity, and (3) evaluation of convergent and divergent validity. RESULTS: Item reduction analyses resulted in seven subscales of three items each. Results indicated acceptable fit for a seven-factor structural model (CFI = .995, TLI = .99, RMSEA = .07, SRMR = 0.02). Second-order factor loadings were high (λ = .89 to .96), suggesting that the SILS subscales comprise a higher-order implementation leadership factor. All subscales demonstrated good inter-item reliability (α = .91-.96). Convergent and divergent validity results were generally as hypothesized, with moderate to high correlations between SILS subscales and general leadership, moderate correlations with teaching attitudes, and low correlations with school demographics. CONCLUSIONS: Overall, results provided strong structural, convergent, and divergent validity evidence for the 21-item, 7-factor SILS instrument. Implications for the measurement of implementation leadership in schools are discussed, as well as strategies to support leaders to enhance their strategic behaviors related to the implementation of mental health prevention programs (e.g., adaptation of existing leadership-focused implementation strategies).

Using Novel Implementation Tools for Evidence-based Intervention Delivery (UNITED) across public service systems for three evidence-based autism interventions in under-resourced communities: study protocol.

BACKGROUND: There are a growing number of evidence-based interventions (EBIs) for autistic individuals, but few are successfully implemented with fidelity in under-resourced communities and with families from traditionally disenfranchised groups. Implementation science offers tools to increase EBI use in communities, but most implementation strategies are designed specific to a single EBI. It is not feasible to develop a new implementation strategy each time a new EBI is introduced in the community. Therefore, to test the effectiveness and generalizability of implementation strategies we are developing and testing a multifaceted implementation strategy with three EBIs concurrently. The goal of this protocol paper is to describe the randomized field trial of an implementation strategy for use across autism EBIs, diverse settings and participants, with the goal of increasing rapid uptake of effective practices to reach our most vulnerable children. METHODS: We developed a multifaceted implementation strategy called Using Novel Implementation Tools for Evidence-based intervention Delivery (UNITED) to facilitate the implementation and sustainment of three EBIs in under-resourced settings. We will compare fidelity to, and effectiveness of, each intervention [Mind the Gap (MTG), Remaking Recess (RR), Self-Determined Learning Model of Instruction (SDLMI)] with and without UNITED in a randomized field trial. Randomization will be stratified using a minimization allocation method. We will train community practitioners using remote delivery of modules specific to the intervention, and active coaching via Zoom for at least 6 sessions and up to 12 as dictated by each EBI. Our primary outcome is fidelity to each EBI, and our secondary outcome is at the child or family level (family empowerment for MTG, child peer social engagement for RR, and adolescent self-determination for SDLMI, respectively). We will measure progress through the implementation phases using the Stages of Implementation Completion and cost-effectiveness of UNITED. DISCUSSION: The results of this study will provide rigorous data on the effectiveness and generalizability of one relatively light-touch implementation strategy in increasing use of autism EBIs and associated outcomes in diverse under resourced public service settings for underrepresented autistic youth. TRIAL REGISTRATION: Mind the Gap: Clinicaltrials.gov Identifier:  NCT04972825 (Date registered July 22, 2021); Remaking Recess: Clinicaltrials.gov Identifier:  NCT04972838 (Date registered July 22, 2021); Self-Determined Learning Model of Instruction: Clinicaltrials.gov Identifier:  NCT04972851 (Date registered July 22, 2021).

A culturally grounded autism parent training program with Black parents.

LAY ABSTRACT: Parent training programs have been well-studied in Autism Spectrum Disorders and shown to increase a parent's feeling of empowerment, advocacy skills, and treatment enrollment for their child. The majority of parent training interventions have been developed without considering the unique needs of under-represented communities, such as the Black community. Black children with autism are not only misdiagnosed or not diagnosed at all, but are not accessing services equally compared to their White peers. There is an urgent need for culturally adapted interventions in order to decrease the disparity gap. The Color of Autism Foundation developed and ran a parent training program for Black parents of children with autism. The program was grounded in two key features: (1) creating a circle of support for parents to connect and heal from ongoing and historical racial trauma and (2) using parents of Black children with autism as the main facilitators. We believe this increased parent's ability to engage in the educational aspects of the training. Overall, parents reported high levels of satisfaction with the training were highly engaged (attended an average of five of six sessions) and reported high levels of empowerment. Parents also reported continued mistrust in the medical and research community and a need for more Black providers. Further work should examine the relationship of the parent and provider in autism treatment and study the impact of circles of healing for Black families.

Iterative redesign of a caregiver-mediated intervention for use in educational settings.

LAY ABSTRACT: Teachers often report concerns about behavior challenges in their students with autism spectrum disorder (ASD) in the school setting. Furthermore, teachers often report that they do not have adequate training in how to manage these challenging behaviors effectively. The RUBI program is an intervention initially developed for parents of children with ASD and co-occurring challenging behavior in clinic settings. The present project used school staff input to systematically redesign RUBI to be used with educators in schools. School staff gave input at multiple stages of development to ensure the adapted intervention was appropriate to use in a school setting. Responses were coded and analyzed to identify strengths and weaknesses of the RUBI manual in schools and adaptations were made accordingly. Scores of how appropriate, possible, likable, and usable RUBI would be in schools rose after the intervention was redesigned. The redesigned RUBIES manual may give school staff the tools they need to manage disruptive behaviors. In addition, collaborating with providers over multiple stages to redesign established interventions for new contexts may be a promising way to help bring research tools to practice in the future.

Construct validity of the school-implementation climate scale.

Background: Implementation climate is an organizational construct theorized to facilitate the adoption and delivery of evidence-based practices. Within schools, teachers often are tasked with implementing universal prevention programs. Therefore, they are ideal informants when assessing school implementation climate for initial and continuous implementation improvement efforts. The purpose of this study was to examine the construct validity (i.e., factor structure and convergent/divergent validity) of a school-adapted measure of strategic implementation climate called the School Implementation Climate Scale (SICS). Methods: Confirmatory factor analyses of SICS data, collected from 441 teachers in 52 schools, were used to compare uncorrelated and correlated first-order factor models and a second-order hierarchical model. Correlations with other school measures were examined to assess SICS convergent and divergent validities. Results: Results demonstrated acceptable internal consistency for each SICS subscale (αs > 0.80 for all subscales) and construct validity of the hypothesized factor structure of the SICS with three new scales. The hierarchical second-order factor structure with eight first-order factors was found to best model the SICS data. Correlations with other school measures were in the expected direction and magnitude. Conclusions: Results from this study provide psychometric evidence that supports the use of the SICS to inform the implementation research and practice in schools. Plain Language Summary: Schools are busy trying to implement various universal programs and systems to help support kids in their growth. Beginning and sustaining these efforts is quite challenging, and there is need for tools and ideas to help those implementation efforts. One concept is implementation climate, which is broadly the school staff's perception of the implementation support for a given practice. However, no measure currently exists to help schools assess their implementation climate. The goal of our study was to adapt a measure of implementation climate used in other settings to the school environment. We used feedback from educational experts to make changes and used various analyses to determine if the newly adapted measure was psychometrically sound. Findings suggest the new measure is usable to guide implementation efforts in schools.

School-Implemented Interventions for Preschool to High School Students with Autism: An Update on Recent Research.

PURPOSE OF REVIEW: The purpose of this review is to provide an update on the recent research (2016-2021) that evaluates the effectiveness of school-implemented interventions for students with autism (3-21 years old) from preschool to high school. RECENT FINDINGS: Overall, the recent literature demonstrated that there are EBPs that help students with autism acquire a variety of skills across domains (academic, social communication). Though many educators and peers were able to achieve high-fidelity implementation, there remains variable fidelity of intervention use in some studies. Though there is some evidence that educators and peers can successfully implement interventions, there are additional focal areas that are missing from the literature that are needed in schools (e.g., mental health, vocational). Future research should leverage implementation science approaches to support the use of proven efficacious interventions in schools.