Effectiveness of a Brief Engagement, Problem-Solving, and Triage Strategy for High School Students: Results of a Randomized Study.

Schools offer an advantageous setting for the prevention, early identification, and treatment of mental health problems for youth. However, school mental health (SMH) services are typically not based on evidence for effectiveness, nor are they efficiently delivered, with SMH practitioners (SMHPs) able to only treat a small number of students in need. The current study evaluated the feasibility, acceptability, efficiency, and outcomes of a four-session assessment, engagement, problem-solving, and triage strategy for SMHPs that aimed to improve efficiency while being based on elements of evidence-based care. The study, conducted in 15 US school districts in three states, used stratified random assignment to assign 49 high schools and their participating SMHP(s) to either the Brief Intervention for School Clinicians (BRISC; N = 259 students) or services as usual (SAU; N = 198 students). SMHPs implemented BRISC elements with adequate to excellent fidelity and reported the strategy was feasible and well-aligned with presenting problems. Students assigned to BRISC reported significantly greater engagement in SMH at 2 months and completion of SMH treatment by 6 months. BRISC-assigned SMHPs reported significantly greater treatment completion after four sessions (53.4%) compared to SAU (15.4%). Students in the BRISC condition also reported significantly greater reduction in problem severity as evaluated by the Youth Top Problems Assessment. No differences were found for anxiety or depression symptoms or overall functioning. Results indicate that BRISC is a feasible early intervention and triage strategy that may aid in more efficient provision of SMH services with no compromise to SMH effectiveness.

How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care.

BACKGROUND: Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms-such as provider knowledge, skills, and attitudes-is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services. METHODS: A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge). RESULTS: There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage. CONCLUSIONS: Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices. TRIAL REGISTRATION: ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

The Cognitive Walkthrough for Implementation Strategies (CWIS): a pragmatic method for assessing implementation strategy usability.

BACKGROUND: Implementation strategies have flourished in an effort to increase integration of research evidence into clinical practice. Most strategies are complex, socially mediated processes. Many are complicated, expensive, and ultimately impractical to deliver in real-world settings. The field lacks methods to assess the extent to which strategies are usable and aligned with the needs and constraints of the individuals and contexts who will deliver or receive them. Drawn from the field of human-centered design, cognitive walkthroughs are an efficient assessment method with potential to identify aspects of strategies that may inhibit their usability and, ultimately, effectiveness. This article presents a novel walkthrough methodology for evaluating strategy usability as well as an example application to a post-training consultation strategy to support school mental health clinicians to adopt measurement-based care. METHOD: The Cognitive Walkthrough for Implementation Strategies (CWIS) is a pragmatic, mixed-methods approach for evaluating complex, socially mediated implementation strategies. CWIS includes six steps: (1) determine preconditions; (2) hierarchical task analysis; (3) task prioritization; (4) convert tasks to scenarios; (5) pragmatic group testing; and (6) usability issue identification, classification, and prioritization. A facilitator conducted two group testing sessions with clinician users (N = 10), guiding participants through 6 scenarios and 11 associated subtasks. Clinicians reported their anticipated likelihood of completing each subtask and provided qualitative justifications during group discussion. Following the walkthrough sessions, users completed an adapted quantitative assessment of strategy usability. RESULTS: Average anticipated success ratings indicated substantial variability across participants and subtasks. Usability ratings (scale 0-100) of the consultation protocol averaged 71.3 (SD = 10.6). Twenty-one usability problems were identified via qualitative content analysis with consensus coding, and classified by severity and problem type. High-severity problems included potential misalignment between consultation and clinical service timelines as well as digressions during consultation processes. CONCLUSIONS: CWIS quantitative usability ratings indicated that the consultation protocol was at the low end of the "acceptable" range (based on norms from the unadapted scale). Collectively, the 21 resulting usability issues explained the quantitative usability data and provided specific direction for usability enhancements. The current study provides preliminary evidence for the utility of CWIS to assess strategy usability and generate a blueprint for redesign.

A Digital Feedback System to Support Implementation of Measurement-Based Care by School-Based Mental Health Clinicians.

Evidence supports the utility of measurement-based care (MBC) to improve youth mental health outcomes, but clinicians rarely engage in MBC practices. Digital measurement feedback systems (MFS) may reflect a feasible strategy to support MBC adoption and sustainment. This pilot study was initiated to evaluate the impact of a MFS and brief consultation supports to facilitate MBC uptake and sustainment among mental health clinicians in the education sector, the most common mental health service delivery setting for youth. Following an initial training in MBC, 14 clinicians were randomized to either a digital MFS and brief consultation supports or control. Baseline ratings of MBC attitudes, skill, and use were collected. In addition, daily assessment ratings tracked 2 core MBC practices (i.e., assessment tool administration, provision of feedback) over a 6-month follow-up period. Clinicians in the MFS condition demonstrated rapid increases in both MBC practices, whereas the control group did not significantly change. For clinicians in the MFS group, consultation effects were significant for feedback and approached significance for administration. Over the follow-up period, average decreases in the current study were moderate with only 1 of the 2 outcome variables (administration) decreasing significantly. Inspection of individual clinician trajectories revealed substantial within-group trend variation. MFS may represent an effective MBC implementation strategy beyond initial training, although individual clinician response is variable. Identifying feasible and impactful implementation strategies is critical given the ability of MBC to support precision health care.

Student Perceptions of the Acceptability and Utility of Standardized and Idiographic Assessment in School Mental Health.

Evidence-based assessment (EBA) comprises the use of research and theory to select methods and processes that have demonstrated reliability, validity, and clinical usefulness for prescribed populations. EBA can lead to positive clinical change, and recent work has suggested that it is perceived to be useful by school mental health providers. However, virtually nothing is known about student perceptions of assessment use. Semi-structured interviews were conducted with 31 ethnically diverse middle and high school students (71% female) receiving mental health services in school-based health centers. Findings indicated that the majority of students found assessments to be useful, and perceived three primary functions of assessments: structuring the therapy session, increasing students' self-awareness, and improving communication with the provider. Barriers to acceptability were also found for a minority of respondents. Some students found the nature of standardized assessments to be confining, and others expressed that they wanted more feedback from their counselors about their responses. Idiographic assessments demonstrated especially high acceptability in this sample, with students reporting that tracking idiographic outcomes increased self-awareness, spurred problem-solving, and helped them to reach behavioral goals. Implications for school mental health service improvements are discussed.

The Contextualized Technology Adaptation Process (CTAP): Optimizing Health Information Technology to Improve Mental Health Systems.

Health information technologies have become a central fixture in the mental healthcare landscape, but few frameworks exist to guide their adaptation to novel settings. This paper introduces the contextualized technology adaptation process (CTAP) and presents data collected during Phase 1 of its application to measurement feedback system development in school mental health. The CTAP is built on models of human-centered design and implementation science and incorporates repeated mixed methods assessments to guide the design of technologies to ensure high compatibility with a destination setting. CTAP phases include: (1) Contextual evaluation, (2) Evaluation of the unadapted technology, (3) Trialing and evaluation of the adapted technology, (4) Refinement and larger-scale implementation, and (5) Sustainment through ongoing evaluation and system revision. Qualitative findings from school-based practitioner focus groups are presented, which provided information for CTAP Phase 1, contextual evaluation, surrounding education sector clinicians' workflows, types of technologies currently available, and influences on technology use. Discussion focuses on how findings will inform subsequent CTAP phases, as well as their implications for future technology adaptation across content domains and service sectors.

Determinants and Functions of Standardized Assessment Use Among School Mental Health Clinicians: A Mixed Methods Evaluation.

The current study evaluated why and how school mental health clinicians use standardized assessment tools in their work with youth and families. Quantitative and qualitative (focus group) data were collected prior to and following a training and consultation sequence as part of a trial program to assess school clinician's (n = 15) experiences administering standardized tools to youth on their caseloads (n = 191). Findings indicated that, although assessment use was initially somewhat low, clinicians used measures to conduct initial assessments with the bulk of their caseloads (average = 62.2%) during the implementation period. Clinicians also reported on factors influencing their use of assessments at the client, provider, and system levels; perceived functions of assessment; student responses to assessment use; and use of additional sources of clinically-relevant information (primarily educational data) for the purposes of assessment and progress monitoring. Implications for the contextual appropriateness of standardized assessment and training in assessment tools are discussed.

The Brief Intervention for School Clinicians (BRISC): A mixed-methods evaluation of feasibility, acceptability, and contextual appropriateness.

To maximize impact across the broad spectrum of mental health needs exhibited by youth in school settings, interventions must be designed to be effective, efficient, and demonstrate good fit with the educational context. The current paper reports on the second phase of an iterative development process for a short-term, "Tier 2" intervention for use by school-based mental health providers - the Brief Intervention for School Clinicians (BRISC) - using mixed qualitative and quantitative analyses to evaluate feasibility, acceptability, and appropriateness while emphasizing student experiences. This phase was intended to yield information to drive further protocol refinement and testing across subsequent phases. We describe the rationale for, development of, and formative testing of the BRISC intervention. Results suggest that BRISC may be feasible to deliver, acceptable to students, and appropriate to the school context. In particular, the BRISC process appears to be effective in enhancing student engagement in the intervention and identifying and addressing individualized student needs. These findings and directions for further enhancing BRISC's potential for positive impact highlight how treatment development may benefit from initial, small-scale evaluations focused both on client and implementation outcomes.

Using modular psychotherapy in school mental health: provider perspectives on intervention-setting fit.

The "fit" or appropriateness of well-researched interventions within usual care contexts is among the most commonly cited, but infrequently researched, factors in the successful implementation of new practices. The current study was initiated to address two exploratory research questions: How do clinicians describe their current school mental health service delivery context? and How do clinicians describe the fit between modular psychotherapy and multiple levels of the school mental health service delivery context? Following a year-long training and consultation program in an evidence-based, modular approach to psychotherapy, semistructured qualitative interviews were conducted with 17 school-based mental health providers to evaluate their perspectives on the appropriateness of implementing the approach within a system of school-based health centers. Interviews were transcribed and coded for themes using conventional and directed content analysis. Findings identified key elements of the school mental health context including characteristics of the clinicians, their practices, the school context, and the service recipients. Specific evaluation of intervention-setting appropriateness elicited many comments about both practical and value-based (e.g., cultural considerations) aspects at the clinician and client levels but fewer comments at the school or organizational levels. Results suggest that a modular approach may fit well with the school mental health service context, especially along practical aspects of appropriateness. Future research focused on the development of methods for routinely assessing appropriateness at different stages of the implementation process is recommended.

Patterns and Predictors of Mental Healthcare Utilization in Schools and other Service Sectors among Adolescents at Risk for Depression.

This study examined racial/ethnic and socioeconomic differences in service utilization across sectors (specialty mental health, school, primary care) for youth at risk of depression. Our sample included 362 adolescents who were enrolled in a larger project examining the effects of an indicated school-based depression prevention program. Service use across sectors mirrored national trends and previous research findings in which the education sector was most frequently utilized for mental health services. Race/ethnicity was significantly associated with parent-reported specialty mental health service utilization, even when controlling for other predictors of use. The study also suggests that racial disparities in service access generally appear to be reduced through the availability of education sector mental health services. Socioeconomic status was not associated with service use in any sector when controlling for other predictors. Parent-child agreement was moderate for report of specialty mental health service use and low for report of use of services within the education and primary care sectors.

"If it's worth my time, i will make the time": school-based providers' decision-making about participating in an evidence-based psychotherapy consultation program.

This study evaluated influences on school-based clinicians' decision-making surrounding participation in a modular psychotherapy training and consultation program lasting one academic year. Clinicians were recruited from three participation groups: those who never engaged, those who engaged and then discontinued, and those who participated fully. Qualitative interviews explored influences on initial and continued participation, as well as differences in decision-making by participation group, knowledge about evidence-based practices, and attitudes toward evidence-based practices. Eight major themes were identified: time, practice utility, intervention/training content, training process, attitudes toward training, social influences, commitment to training, and expectations. Some themes were discussed universally across all comparison groups, while others varied in frequency or content. Recommendations for increasing participation are presented, based on the findings.

Preventive intervention for anxious preschoolers and their parents: strengthening early emotional development.

The high prevalence and early onset of anxiety disorders have inspired innovative prevention efforts targeting young at-risk children. With parent-child prevention models showing success for older children and adolescents, the goal of this study was to evaluate a parent-child indicated preventive intervention for preschoolers with mild to moderate anxiety symptoms. Sixteen children (ages 3-5) and at least one of their parents participated in Strengthening Early Emotional Development (SEED), a new 10-week intervention with concurrent groups for parents and children. Outcome measures included clinician-rated and parent-rated assessments of anxiety symptoms, as well as measures of emotion knowledge, parent anxiety, and parental attitudes about children's anxiety. Participation in SEED was associated with reduced child anxiety symptoms and improved emotion understanding skills. Parents reported decreases in their own anxiety, along with attitudes reflecting enhanced confidence in their children's ability to cope with anxiety. Reductions in child and parent anxiety were maintained at 3-month follow-up. Findings suggest that a parent-child cognitive-behavioral preventive intervention may hold promise for young children with mild to moderate anxiety. Improvements in parent anxiety and parental attitudes may support the utility of intervening with parents. Fostering increased willingness to encourage their children to engage in new and anxiety-provoking situations may help promote continued mastery of new skills and successful coping with anxiety.

Treating persistent distress and anxiety in parents of children with cancer: an initial feasibility trial.

Persistent anxiety is common among parents of children with cancer and may affect the family's well-being and adjustment. The goals of this pilot study are to determine the feasibility and potential efficacy of a brief cognitive-behavioral parent intervention aimed at reducing parental distress and anxiety related to their child's cancer diagnosis. Parents of children with cancer, at least 1 month postdiagnosis, were screened at an outpatient oncology clinic, and those reporting elevated levels of distress were offered a 4-session cognitive-behavioral intervention based on a modified version of the Surviving Cancer Competently Intervention Program-Newly Diagnosed. Five parents reporting persistent distress received the intervention. Results revealed decreases in parents' distress, state anxiety, and depressive symptoms, as well as in parents' feelings of burden associated with their children's cancer. This initial study suggests that identification of parents with prolonged heightened psychological distress is feasible and acceptable and that offering them a brief intervention within a pediatric oncology setting may be beneficial.