The Utility of the Behavior Assessment System for Children-2 Behavioral and Emotional Screening System and Strengths and Difficulties Questionnaire in Predicting Mental Disorders in the Project to Learn About Youth-Mental Health.

We examined the predictive utility of the Behavior Assessment System for Children-2 Behavioral and Emotional Screening System (BASC-2-BESS) and Strengths and Difficulties Questionnaire (SDQ) in identifying students with a mental disorder. Data were collected in a two-stage study over 34 months with kindergarten-12th grade (K-12) students (aged 5-19 years) in four U.S. school districts. In Stage 1, teachers completed the BASC-2-BESS and the SDQ. In Stage 2, parents of 1,054 children completed a structured diagnostic interview to determine presence of a mental disorder. Results suggest that teacher versions of the BASC-2-BESS and SDQ have modest utility in identifying children meeting criteria for a mental disorder based on parent report. Area Under the Curve (AUC) statistics representing prediction of any externalizing disorder (.73 for both measures) were higher than the AUCs predicting any internalizing disorder (.58 for both measures). Findings can inform the use of teacher report in mental health screening, specifically the selection of measures when implementing screening procedures.

Exploring Intervention Sustainment and Intervention Spread Following a Randomized Clinical Trial of the MOSAIC Program.

The randomized trial of the Making Socially Accepting Inclusive Classrooms (MOSAIC) program included intensive coaching from research staff to support teachers' implementation of MOSAIC strategies and resulted in positive student outcomes (Mikami et al., J. Clin. Child Adolesc. Psychol. 51(6):1039-1052, 2022). However, these intensive procedures are costly (in time, money, and resources) and serve as barriers to intervention adoption under typical school conditions. In this study, we explored the extent to which MOSAIC-trained teachers could sustain practices under typical practice conditions (sustainment), the extent to which teachers who did not participate in the trial could adopt the practices under typical practice conditions (spread), and the extent to which strategy use in the follow-up year was associated with participation in MOSAIC-focused professional learning communities (PLCs). Participants were 30 elementary school teachers, including (a) 13 teachers who received intensive coaching on MOSAIC practices during the previous year (MOSAIC group), and (b) seven teachers who participated in the trial in the control condition, plus 10 new teachers interested in MOSAIC (new-to-MOSAIC group). We assessed MOSAIC strategy use over the school year via monthly observations and biweekly teacher self-report surveys. Observation data revealed high sustainment in the MOSAIC group, with teachers showing less than 20% decline in the use of most strategies between the two years of participation. New-to-MOSAIC teachers implemented some core MOSAIC strategies, although not to the extent as those in the MOSAIC group. Higher strategy use was modestly associated with PLC attendance. We discuss implications for encouraging sustainment and intervention spread after initial, intensive supports are withdrawn. Supplementary Information: The online version contains supplementary material available at 10.1007/s12310-022-09555-w.

Tailored isn't always better: Impact of standardized versus tailored training on intention to use measurement-based care.

Background: Brief educational trainings are often used for disseminating and implementing evidence-based practices (EBPs). However, many accessible trainings are ubiquitously standardized. Tailored training focused on modifying individual or contextual factors that may hinder EBP implementation is recommended, but there is a dearth of research comparing standardized versus tailored training. This study sought to: (a) assess the impact of MBC training on clinician intention to use measurement-based care (MBC); (b) compare the effect of standardized versus tailored training on clinician intention to MBC; and (c) identify clinician-level predictors of intention. Methods: Clinicians (n = 152) treating adult clients with depression at 12 community mental health clinics were randomized to either tailored or standardized MBC training. Clinic-specific barriers and facilitators were used to inform training content and structure tailoring. Linear mixed modeling tested the association between training condition and post-training intention to use MBC, as well as hypothesized individual-level predictors of post-training intention (e.g., age, gender). Results: Clinician intention pre- and post-training increased across training conditions (B = 0.38, t = -5.95, df = 36.99, p < .01, Cohen's d = 0.58). Results of linear mixed modeling procedures suggest no significant difference in clinician intention between conditions post-training (B = -0.03, SE = .19, p > .05, Cohen's d = .15). Only baseline intention emerged as a predictor of post-training intention (B = 0.39, SE = .05, p < .05). Conclusions: These findings suggest the additional effort to tailor training may not yield incremental benefit over standardized training, at least in the short term. As a result, implementation efforts may be able to reserve time and finances for other elements of implementation beyond the training component. Plain Language Summary: Educational training is a common approach for enhancing knowledge about research-supported mental health treatments. However, these trainings are often not tailored to meet the needs of the trainees, and there is insufficient evidence about whether tailoring might improve the impact of training compared to a one-size-fits-all, standard version. This study compared the impact of a tailored versus standard training on mental health clinician's intentions to use measurement-based (MBC) care for monitoring treatment progress for clients with depression. Study results indicated that intention to use MBC improved for clinicians receiving both the tailored and standard training after training completion. There were no differences in intention to use MBC care when the two types of training were compared. These study findings suggest that tailoring, which may require substantial time and effort, may not be a necessary step to improve the short-term impact of educational trainings.

Promoting Classroom Social and Academic Functioning among Children at Risk for ADHD: The MOSAIC Program.

OBJECTIVE: Social and academic functioning are linked in elementary school, and both are frequently impaired in children with elevated symptoms of attention-deficit/hyperactivity disorder (ADHD). This study evaluated the Making Socially Accepting Inclusive Classrooms (MOSAIC) program, a classroom intervention to support children's social and academic functioning, especially for children at risk for ADHD. Teachers delivered MOSAIC practices to the whole class and applied some strategies more frequently to target children selected for elevated ADHD symptoms and peer impairment. METHOD: Participants were 34 general education teachers (grades K-5) and 558 children in their classrooms, randomized to MOSAIC or to a typical practice control group for one academic year. In the fall and spring, we assessed (a) peers' sociometric judgments of children, (b) children's self-report of supportive relationships with teachers and peers, and (c) teachers' report of children's social and academic competencies and impairments. RESULTS: Regarding whole class effects, relative to control group children, children in MOSAIC classrooms (target and non-target children) were rated by teachers in spring as having better competencies and lower impairment, after controlling for fall functioning. There were no main effects of MOSAIC on peer sociometrics or child perceptions of supportive relationships. Target status moderated some effects such that, in spring, target children in MOSAIC perceived greater support from their teachers but received poorer sociometrics than did target children in control classrooms. CONCLUSIONS: We discuss the difficulty in changing peers' perceptions of children with ADHD symptoms, even in the presence of improvements in other aspects of social and academic functioning.

Implementing Measurement-Based Care in Behavioral Health: A Review.

Importance: Measurement-based care (MBC) is the systematic evaluation of patient symptoms before or during an encounter to inform behavioral health treatment. Despite MBC's demonstrated ability to enhance usual care by expediting improvements and rapidly detecting patients whose health would otherwise deteriorate, it is underused, with typically less than 20% of behavioral health practitioners integrating it into their practice. This narrative review addresses definitional issues, offers a concrete and evaluable operationalization of MBC fidelity, and summarizes the evidence base and utility of MBC. It also synthesizes the extant literature's characterization of barriers to and strategies for supporting MBC implementation, sustainment, and scale-up. Observations: Barriers to implementing MBC occur at multiple levels: patient (eg, concerns about confidentiality breach), practitioner (eg, beliefs that measures are no better than clinical judgment), organization (eg, no resources for training), and system (eg, competing requirements). Implementation science-the study of methods to integrate evidence-based practices such as MBC into routine care-offers strategies to address barriers. These strategies include using measurement feedback systems, leveraging local champions, forming learning collaboratives, training leadership, improving expert consultation with clinical staff, and generating incentives. Conclusions and Relevance: This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC's core components; (2) develop criterion standard methods for monitoring fidelity and reporting quality of implementation; (3) develop algorithms for MBC to guide psychotherapy; (4) test putative mechanisms of change, particularly for psychotherapy; (5) develop brief and psychometrically strong measures for use in combination; (6) assess the critical timing of administration needed to optimize patient outcomes; (7) streamline measurement feedback systems to include only key ingredients and enhance electronic health record interoperability; (8) identify discrete strategies to support implementation; (9) make evidence-based policy decisions; and (10) align reimbursement structures.

Implementing measurement based care in community mental health: a description of tailored and standardized methods.

OBJECTIVE: Although tailored implementation methods are touted as superior to standardized, few researchers have directly compared the two and little guidance regarding the specific details of each method exist. Our study compares these methods in a dynamic cluster randomized trial seeking to optimize implementation of measurement based care (MBC) for depression in community behavioral health. This specific manuscript provides a detailed, replicable account of the components of each multi-faceted implementation method. RESULTS: The standardized best practice method includes training, consultation, a clinical guideline, and electronic health record enhancements with the goal to optimize the delivery of MBC with fidelity. Conversely, the tailored, customized and collaborative method is informed by recent implementation science advancements and begins with a needs assessment, followed by tailored training that feeds back barriers data to clinicians, the formation of an implementation team, a clinician-driven clinic-specific guideline, and the use of fidelity data to inform implementation team activities; the goal of the tailored condition is to ensure the intervention and implementation strategies address unique factors of the context. The description of these methods will inform others seeking to implement MBC, as well as those planning to use standardized or tailored implementation methods for interventions beyond behavioral health.