Development of a method for Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI): A modified Delphi study.

Background: Intervention adaptation is often necessary to improve the fit between evidence-based practices/programs and implementation contexts. Existing frameworks describe intervention adaptation processes but do not provide detailed steps for prospectively designing adaptations, are designed for researchers, and require substantial time and resources to complete. A pragmatic approach to guide implementers through developing and assessing adaptations in local contexts is needed. The goal of this project was to develop Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI), a method for intervention adaptation that leverages human centered design methods and is tailored to the needs of intervention implementers working in applied settings with limited time and resources. Method: MODIFI was iteratively developed via a mixed-methods modified Delphi process. Feedback was collected from 43 implementation research and practice experts. Two rounds of data collection gathered quantitative ratings of acceptability (Round 1) and feasibility (Round 2), as well as qualitative feedback regarding MODIFI revisions analyzed using conventional content analysis. Results: In Round 1, most participants rated all proposed components as essential but identified important avenues for revision which were incorporated into MODIFI prior to Round 2. Round 2 emphasized feasibility, where ratings were generally high and fewer substantive revisions were recommended. Round 2 changes largely surrounded operationalization of terms/processes and sequencing of content. Results include a detailed presentation of the final version of the three-step MODIFI method (Step 1: Learn about the users, local context, and intervention; Step 2: Adapt the intervention; Step 3: Evaluate the adaptation) along with a case example of its application. Discussion: MODIFI is a pragmatic method that was developed to extend the contributions of other research-based adaptation theories, models, and frameworks while integrating methods that are tailored to the needs of intervention implementers. Guiding teams to tailor evidence-based interventions to their local context may extend for whom, where, and under what conditions an intervention can be effective.

Study protocol of a randomized trial of STRIPES: a schoolyear, peer-delivered high school intervention for students with ADHD.

BACKGROUND: Youth with ADHD are at risk of academic impairments, dropping out of high school, and dysfunction in young adulthood. Interventions delivered early in high school could prevent these harmful outcomes, yet few high school students with ADHD receive treatment due to limited access to intervention providers. This study will test a peer-delivered intervention (STRIPES) for general education 9th grade students with impairing ADHD symptoms. METHODS: A type 1 hybrid effectiveness-implementation design will be used to evaluate the effectiveness of STRIPES and explore the intervention's implementability. Analyses will test the impact of STRIPES vs. enhanced school services control on target mechanisms and determine whether differences in basic cognitive profiles moderate intervention response. The acceptability and feasibility of STRIPES and treatment moderators will also be examined. DISCUSSION: This study will generate knowledge about the effectiveness and implementability of STRIPES, which will inform dissemination efforts in the future. A peer-delivered high school intervention for organization, time management, and planning skills can provide accessible and feasible treatment targeting declines in academic motivation, grades, and attendance during the ninth-grade year. TRIAL REGISTRATION: This study is registered on OSF Registries (10.17605/OSF.IO/Q8V6S).

Longitudinal Effects of a Motivationally Focused Strategy to Increase the Yield of Training and Consultation on Teachers' Adoption and Fidelity of a Universal Program.

Group-based didactic training is a cornerstone implementation strategy used to support the adoption and delivery of evidence-based prevention programs (EBPP) by teachers in schools, but it is often insufficient to drive successful implementation. Beliefs and Attitudes for Successful Implementation in Schools for Teachers (BASIS-T) is a theory-based, motivational implementation strategy designed to increase the yield of EBPP training and consultation. The purpose of this study was to examine the longitudinal effects of BASIS-T on hypothesized mechanisms of behavior change (e.g., attitudes toward EBPP, self-efficacy, intentions to implement) and implementation and student outcomes associated with a well-established universal prevention program-the good behavior game (GBG). This pilot trial included 82 elementary school teachers from nine public elementary schools who were randomly assigned at the school-level to the BASIS-T (n = 43) or active comparison (n = 39) condition, with both conditions receiving training and consultation of the good behavior game by a third-party purveyor. Analyses included mixed-effects and multilevel growth modeling of adoption, mechanisms of behavior change, and student behavior outcomes. Meaningful effects were found favoring BASIS-T on immediate adoption of the GBG within the first month of school (74% vs. 40%) and self-efficacy (p < 0.05). These findings advance our understanding of the type of implementation strategies that complement pre-implementation training and post-training consultation in schools by identifying the importance of task self-efficacy as a mechanism of behavior change related to adoption for prevention programming. Supplementary Information: The online version contains supplementary material available at 10.1007/s12310-022-09536-z.

A Mixed-Method Study Examining Solutions to Common Barriers to Teachers' Adoption of Evidence-Based Classroom Practices.

Objectives: We conducted a mixed-method focus group study to (a) assess the appropriateness and likely effectiveness of strategies that target individual behavior change mechanisms associated with perceived barriers of lack of time and unsupportive leadership and (b) identify recommendations regarding strategies for overcoming the barriers. Method: Sample included 39 school-based staff (80% female, 77% White) across two districts in the Midwest. Mixed methods included a simultaneous approach. Results: Lack of time and supportive leadership continue to pervade school-based implementation efforts. Recommendations centered around the need for school leaders to give teachers the power to re-prioritize how they spend their time as well as providing protected, facilitated time for teachers to collaborate and learn practical skills targeting self-advocacy. Conclusion: Our findings provide compelling evidence for the use of implementation methodology to strategically target mechanisms of individual behavior change during the process of incorporating new and innovative practices in schools.

Advancing mechanisms of implementation to accelerate sustainable evidence-based practice integration: protocol for generating a research agenda.

INTRODUCTION: Mechanisms explain how implementation strategies work. Implementation research requires careful operationalisation and empirical study of the causal pathway(s) by which strategies effect change, and factors that may amplify or weaken their effects. Understanding mechanisms is critically important to replicate findings, learn from negative studies or adapt an implementation strategy developed in one setting to another. Without understanding implementation mechanisms, it is difficult to design strategies to produce expected effects across contexts, which may have disproportionate effects on settings in which priority populations receive care. This manuscript outlines the protocol for an Agency for Healthcare Research and Quality-funded initiative to: (1) establish priorities for an agenda to guide research on implementation mechanisms in health and public health, and (2) disseminate the agenda to research, policy and practice audiences. METHODS AND ANALYSIS: A network of scientific experts will convene in 'Deep Dive' meetings across 3 years. A research agenda will be generated through analysis and synthesis of information from six sources: (1) systematic reviews, (2) network members' approaches to studying mechanisms, (3) new proposals presented in implementation proposal feedback sessions, (4) working group sessions conducted in a leading implementation research training institute, (5) breakout sessions at the Society for Implementation Research Collaboration's (SIRC) 2019 conference and (6) SIRC conference abstracts. Two members will extract mechanism-relevant text segments from each data source and a third member will generate statements as an input for concept mapping. Concept mapping will generate unique clusters of challenges, and the network will engage in a nominal group process to identify priorities for the research agenda. ETHICS AND DISSEMINATION: This initiative will yield an actionable research agenda to guide research to identify and test mechanisms of change for implementation strategies. The agenda will be disseminated via multiple channels to solicit feedback and promote rigorous research on implementation mechanisms.

Dissemination Science in School Mental Health: A Framework for Future Research.

There has been an increase in school mental health research aimed at producing generalizable knowledge to address longstanding science-to-practice gaps to increase children's access to evidence-based mental health services. Successful dissemination and implementation are both important pieces to address science-to-practice gaps, but there is conceptual and semantic imprecision that creates confusion regarding where dissemination ends and implementation begins, as well as an imbalanced focus in research on implementation relative to dissemination. In this paper, we provide an enhanced operational definition of dissemination; offer a conceptual model that outlines elements of effective dissemination that can produce changes in awareness, knowledge, perceptions, and motivation across different stakeholder groups; and delineate guiding principles that can inform dissemination science and practice. The overarching goal of this paper is to stimulate future research that aims to advance dissemination science and practice in school mental health.

Protocol for a hybrid type 2 cluster randomized trial of trauma-focused cognitive behavioral therapy and a pragmatic individual-level implementation strategy.

BACKGROUND: More than two-thirds of youth experience trauma during childhood, and up to 1 in 5 of these youth develops posttraumatic stress symptoms that significantly impair their functioning. Although trauma-focused cognitive behavior therapy (TF-CBT) has a strong evidence base, it is rarely adopted, delivered with adequate fidelity, or evaluated in the most common setting where youth access mental health services-schools. Given that individual behavior change is ultimately required for successful implementation, even when organizational factors are firmly in place, focusing on individual-level processes represents a potentially parsimonious approach. Beliefs and Attitudes for Successful Implementation in Schools (BASIS) is a pragmatic, motivationally focused multifaceted strategy that augments training and consultation and is designed to target precise mechanisms of behavior change to produce enhanced implementation and youth clinical outcomes. This study protocol describes a hybrid type 2 effectiveness-implementation trial designed to concurrently evaluate the main effects, mediators, and moderators of both the BASIS implementation strategy on implementation outcomes and TF-CBT on youth mental health outcomes. METHODS: Using a cluster randomized controlled design, this trial will assign school-based mental health (SMH) clinicians and schools to one of three study arms: (a) enhanced treatment-as-usual (TAU), (b) attention control plus TF-CBT, or (c) BASIS+TF-CBT. With a proposed sample of 120 SMH clinicians who will each recruit 4-6 youth with a history of trauma (480 children), this project will gather data across 12 different time points to address two project aims. Aim 1 will evaluate, relative to an enhanced TAU condition, the effects of TF-CBT on identified mechanisms of change, youth mental health outcomes, and intervention costs and cost-effectiveness. Aim 2 will compare the effects of BASIS against an attention control plus TF-CBT condition on theoretical mechanisms of clinician behavior change and implementation outcomes, as well as examine costs and cost-effectiveness. DISCUSSION: This study will generate critical knowledge about the effectiveness and cost-effectiveness of BASIS-a pragmatic, theory-driven, and generalizable implementation strategy designed to enhance motivation-to increase the yield of evidence-based practice training and consultation, as well as the effectiveness of TF-CBT in a novel service setting. TRIAL REGISTRATION: ClinicalTrials.gov registration number NCT04451161 . Registered on June 30, 2020.

Collaboratively maximizing the impact of human-centered design in psychological and implementation science: Reply to Proctor et al. (2021).

Proctor et al.'s (2021) comment "Division 21 Has Been Devoted to Human-Centered Design Since the 1950s" on our article (Lyon et al., 2020) is a welcome addition and useful touchpoint surrounding the historical and current relationship between human-centered design and psychological science. "Siloing" in psychology inhibits the progress of the discipline. We offer a set of recommendations for reducing silos and increasing the integration of engineering psychology with implementation science to advance human-centered design and the use of research evidence in practice. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Examining the Effects of a Brief, Group-Based Motivational Implementation Strategy on Mechanisms of Teacher Behavior Change.

Training and consultation are core implementation strategies used to support the adoption and delivery of evidence-based prevention programs (EBPPs), but are often insufficient alone to effect teacher behavior change. Motivational interviewing (MI) and related behavior change techniques (e.g., strategic education, social influence, implementation planning) delivered in a group format offer promising supplements to training and consultation to improve EBPP implementation. Beliefs and Attitudes for Successful Implementation in Schools for Teachers (BASIS-T) is a theoretically informed, motivational implementation strategy delivered in a group format prior to and immediately after EBPP training. The purpose of this study was to examine the proximal effects of BASIS-T on hypothesized mechanisms of behavior change (e.g., attitudes, subjective norms, intentions to implement) in the context of teachers receiving training and consultation to implement the Good Behavior Game. As part of a pilot trial, 83 elementary school teachers from 9 public elementary schools were randomly assigned (at the school-level to reduce contamination across participants) to a BASIS-T (n = 44) or active comparison control (n = 39) condition, with both conditions receiving Good Behavior Game (GBG) training and consultation. A series of mixed effects models revealed meaningful effects favoring BASIS-T on a number of hypothesized mechanisms of behavior change leading to increased motivation to implement GBG. The implications, limitations, and directions for future research on the use of MI with groups of individuals and other behavior change techniques to increase the yield of training and consultation are discussed.

A Mixed Methods Pilot Study of an Equity-Explicit Student-Teacher Relationship Intervention for the Ninth-Grade Transition.

BACKGROUND: Student-teacher relationships are associated with the social and emotional climate of a school, a key domain of the Whole School, Whole Community, Whole Child Model. Few interventions target student-teacher relationships during the critical transition to high school, or incorporate strategies for enhancing equitable relationships. We conducted a mixed-methods feasibility study of a student-teacher relationship intervention, called Equity-Explicit Establish-Maintain-Restore (E-EMR). METHODS: We tested whether students (N = 133) whose teachers received E-EMR training demonstrated improved relationship quality, school belonging, motivation, behavior, and academic outcomes from pre- to post-test, and whether these differences were moderated by race. We also examined how teachers (N = 16) integrated a focus on equity into their implementation of the intervention. RESULTS: Relative to white students, students of the color showed greater improvement on belongingness, behavior, motivation, and GPA. Teachers described how they incorporated a focus on race/ethnicity, culture, and bias into E-EMR practices, and situated their relationships with students within the contexts of their own identity, the classroom/school context, and broader systems of power and privilege. CONCLUSIONS: We provide preliminary evidence for E-EMR to change teacher practice and reduce educational disparities for students of color. We discuss implications for other school-based interventions to integrate an equity-explicit focus into program content and evaluation.

Leveraging human-centered design to implement modern psychological science: Return on an early investment.

Although classic models of implementation emphasized the importance of innovation characteristics in their adoption and sustained use, contemporary implementation research and practice have deprioritized these variables. Human-centered design (HCD) is an approach that grounds product development in information collected about the people and settings that will ultimately use those products. HCD has strong roots in psychological theory, but its application is typically limited to the development of digital technologies. HCD is rarely applied to the design of psychosocial innovations-including both service-recipient-facing interventions and implementation strategies-within the applied psychological disciplines. The current article reviews the psychological origins of HCD and details pathways through which HCD theories and methods can be leveraged to advance the "core tasks" of contemporary implementation research and practice in psychology. These include (a) identification of multilevel implementation determinants through specification of user needs and contexts; (b) tailoring of implementation strategies, such as contextually driven intervention redesign; and (c) evaluating implementation mechanisms and outcomes, including disentangling how the core HCD focus on usability relates to closely associated implementation variables such as acceptability, feasibility, and appropriateness. Collectively, these applications provide directions through which to leverage the mature field of HCD, maximize psychology's return on its early theoretical investment, and promote the large-scale impact of findings from across the applied fields of psychology. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Designing the Future of Children's Mental Health Services.

Advancements in evidence-based psychosocial interventions, digital technologies, and implementation strategies (i.e., health services research products) for youth mental health services have yet to yield significant improvement in public health outcomes. Achieving such impact will require that these research products are easy to use, useful, and contextually appropriate. This paper describes how human-centered design (HCD), an approach that aligns product development with the needs of the people and settings that use those products, can be leveraged to improve youth mental health services. We articulate how HCD can advance accessibility, effectiveness, and equity, with specific consideration of unique aspects of youth mental health services.

The influence of a blended, theoretically-informed pre-implementation strategy on school-based clinician implementation of an evidence-based trauma intervention.

BACKGROUND: Individual-level implementation determinants, such as clinician attitudes, commonly influence the successful adoption of evidence-based practices, but few explicit strategies have been tested with regard to their ability to impact these key mechanisms of change. This paper reports on an initial test of a blended, theoretically informed pre-implementation strategy designed to target malleable individual-level determinants of behavior change. Beliefs and Attitudes for Successful Implementation in Schools (BASIS) is a brief and pragmatic pre-implementation strategy that uses strategic education, social influence techniques, and group-based motivational interviewing to target implementation attitudes, perceived social norms, perceived behavioral control, and behavioral intentions to implement among mental health clinicians working in the education sector. METHODS: As part of a pilot trial, 25 school mental health clinicians were randomized to BASIS (n = 12) or an attention control placebo (n = 13), with both conditions receiving training and consultation in an evidence-based intervention for youth experiencing trauma (the Cognitive Behavioral Intervention for Trauma in Schools). Theorized mechanisms of change (attitudes, perceived social norms, perceived behavioral control, and behavioral intentions) were assessed at baseline, post-training, and 4-month follow-up. Clinician participation in post-training consultation and intervention adoption were also tracked. RESULTS: A series of regression models and independent sample t tests indicated that BASIS had significant, medium to large effects on the majority of its proximal mechanisms from baseline to post-training. BASIS was also associated with a greater latency between initial training in the intervention and discontinuation of participation in post-training consultation, with clinicians in the BASIS condition persisting in consultation for an average of 134 days versus 32 days for controls, but this difference was not statistically significant. At 4-month follow-up, most differences in the theorized mechanisms had attenuated, and approximately the same small number of BASIS clinicians adopted the trauma intervention as controls. CONCLUSION: Findings suggest that the brief BASIS pre-implementation strategy had a significant influence on its proximal mechanisms of change, but that these changes did not persist over time or translate into adoption of the trauma intervention. Implications for theory refinement, revisions to the BASIS protocol, and next steps for research surrounding individual-level implementation strategies are discussed. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT03791281 . Registered 31 December 2018-Retrospectively registered.

Implementing the Bounce Back trauma intervention in urban elementary schools: A real-world replication trial.

The current study provides the first replication trial of Bounce Back, a school-based intervention for elementary students exposed to trauma, in a different school district and geographical area. Participants in this study were 52 1st through 4th graders (Mage = 7.76 years; 65% male) who were predominately Latino (82%). Schools were randomly assigned to immediate treatment or waitlist control. Differential treatment effects (Time × Group Interaction) were found for child-reported posttraumatic stress disorder (PTSD) and parent-reported child coping, indicating that the immediate treatment group showed greater reductions in PTSD and improvements in coping compared with the delayed group. Differential treatment effects were not significant for depression or anxiety. Significant maintenance effects were found for both child-reported PTSD and depression as well as parent-reported PTSD and coping for the immediate treatment group at follow-up. Significant treatment effects were also found in the delayed treatment group, showing reductions in child-reported PTSD, depression, and anxiety as well as parent-reported depression and coping upon receiving treatment. In conclusion, the current study suggests that Bounce Back is an effective intervention for reducing PTSD symptoms and improving coping skills, even among a sample experiencing high levels of trauma and other ongoing stressors. (PsycINFO Database Record

Stress, Coping, and Mood Among Latino Adolescents: A Daily Diary Study.

The current study examines whether daily coping moderates the effects of daily stress on same-day mood and next-day mood among 58 Latino adolescents (Mage  = 13.31; 53% male). The daily diary design capitalized on repeated measurements, boosting power to detect effects and allowing for a robust understanding of the day-to-day experiences of Latino adolescents. Hierarchical linear modeling revealed that on days when youth reported higher levels of peer and academic stress, they also reported more negative moods. However, only poverty-related stress predicted mood the following day. Engagement coping buffered the effect of poverty-related stress on next-day negative and positive mood, while disengagement exacerbated the effects of academic and peer stress. The need for interventions promoting balanced coping repertoires is discussed.

Predictors and correlates of follow-up visit adherence among adolescents receiving laparoscopic adjustable gastric banding.

BACKGROUND: Adherence behaviors have not been examined among adolescents undergoing laparoscopic adjustable gastric banding (LAGB). In addition, studies of youth receiving bariatric surgery have not considered the influence of psychopathology on postoperative adherence. The purpose of this study was to evaluate predictors and correlates of adherence to post-surgery visits among a sample of adolescents undergoing LAGB. METHODS: Postoperative visits with surgical staff were analyzed over the 2 years after surgery (n = 101 adolescents). Growth mixture modeling examined trends in adherence. RESULTS: A 3-class solution provided the best fit to the data. The classes from the final model were characterized by class 1 (61.6%) demonstrating high levels of adherence over the 24 months after LAGB, class 2 (28.5%) showing a more gradual decline in adherence, and class 3 (9.9%) with an accelerated decline in adherence. Higher levels of preoperative depressive symptoms and more preoperative episodes of loss of control overeating decreased the likelihood of adherence. Class 3 adolescents had significantly higher estimated 24-month body mass indices than classes 1 or 2. CONCLUSION: Variable patterns of follow-up visit adherence were identified among adolescents receiving LAGB, which were predicted by depressive symptoms and loss of control overeating. The trajectory characterized by a rapid decline in adherence to follow-up visits was also associated with less weight loss.

Examining the impact of a family treatment component for CBITS: when and for whom is it helpful?

This study compared the Cognitive Behavioral Intervention for Trauma in Schools (CBITS), as it is typically delivered, to CBITS-plus-family treatment component (CBITS + Family), developed through a community partnership. This study used a quasi-experimental design, capitalizing on ongoing CBITS implementation within a school system. In total, 32 parent/student dyads were recruited in CBITS groups and 32 parent/student dyads were recruited in CBITS + Family groups. Parents and students in both conditions completed pre- and posttreatment measures, in addition to a 6-month posttreatment follow-up assessing symptoms. Families were low-income and predominately Latino. Children were 59% female with an average age of 11.70. Participating parents were 84% female with an average age of 38.18. The majority of parents (80%) were immigrants and 70% reported not finishing high school. Parents who received CBITS + Family showed significant improvements in attitudes toward mental health, school involvement, and primary control coping, while demonstrating significant reductions in involuntary engagement and inconsistent discipline. CBITS + Family appears to be most beneficial for children with high symptom severity in terms of reducing posttraumatic stress disorder symptoms and disengagement coping. Finally, greater improvements in parent variables predicted larger symptom reductions among children within the CBITS + Family group. This study suggests that CBITS + Family is beneficial for parents of children exposed to trauma and may be especially helpful for children with high initial symptom severity. Children in CBITS + Family appear to benefit most when their parents show larger improvements in school involvement and greater reductions in parental inconsistency and involuntary engagement.

Psychological outcomes and predictors of initial weight loss outcomes among severely obese adolescents receiving laparoscopic adjustable gastric banding.

OBJECTIVE: Elevated rates of psychopathology are noted among severely obese youth presenting for weight loss surgery. The role of mental health providers in this population is not well defined, and the selection of candidates is often the result of clinical judgment alone. The purpose of this study was to comprehensively evaluate psychiatric symptoms among a large sample of adolescents receiving laparoscopic adjustable gastric banding (LAGB) by (1) examining changes in depressive symptoms and quality of life in the year following surgery; (2) evaluating the interaction between patterns of change in depression, quality of life, and weight postsurgery; and (3) identifying presurgical psychological predictors of initial weight change. METHOD: Participants were 101 severely obese adolescents aged 14 to 18 years receiving LAGB at the Center for Adolescent Bariatric Surgery at the Morgan Stanley Children's Hospital of New York Presbyterian/Columbia University Medical Center between August 2006 and December 2009. Measures of height, weight, depressive symptoms, and quality of life were obtained in the first year following surgery. Changes in the Beck Depression Inventory (BDI), Pediatric Quality of Life Inventory (PedsQL), and body mass index were analyzed using latent growth curve modeling. RESULTS: Short-term changes in psychiatric symptoms and weight were analyzed using latent growth curve modeling. Significant changes in total BDI (ßslope = -0.885, SE = 0.279, P < .01; ßquadratic = 0.054, SE = 0.021, P < .001) and PedsQL (ßslope = -0.885, SE = 0.279, P < .001) scores were observed following LAGB, and comparable postoperative changes between psychosocial variables and body mass index were also noted (BDI: covariance [COV] = 0.21, SE = 0.06, P < .001; PedsQL: COV = -0.41, SE = 0.10, P < .01). Two variables (family conflict/loss of control eating) were found to be significant predictors of weight change over the year following surgery (P < .05). CONCLUSIONS: Adolescents experienced notable improvements in initial depressive symptoms and quality of life after LAGB, and measures of preoperative binge eating and family conflict affected postsurgery body mass index among youth. TRIAL REGISTRATION: ClinicalTrials.gov identifier: NCT01045499.