Support From Intermediary Organizations for Evidence-Based Practices in Behavioral Health Care.

Intermediary and purveyor organizations play a key role in disseminating and implementing evidence-based behavioral health best practices (EBPs). The authors provide a case example to describe how state-funded intermediaries can enhance the implementation and sustainment of EBP. Benefits of using state-funded intermediaries include the ability to collaborate with state entities to address barriers to and then incentivize best practices, access to resources to develop a robust infrastructure to support EBP training and implementation, and enhanced capacity to support organizations beyond individual EBPs (e.g., developing an internal quality-improvement process, supporting cross-cutting competencies, and helping organizations to identify synergies across EBP and to prioritize what to implement first).

Integrated Treatment Group Curriculum for People with Serious Mental Health Conditions Who Use Substances.

Without proper treatment, people with co-occurring mental health and substance use problems are at great risk for poor outcomes and high treatment costs in multiple domains. Intermediary organizations can provide support to programs implementing integrated treatment and other evidence-based practices; this includes developing practical tools for programs built to encourage fidelity to a particular practice. In this paper, we describe a group curriculum workbook designed to help practitioners provide integrated treatment with fidelity and a pilot learning collaborative to evaluate whether this workbook is a helpful tool for programs to support people with serious mental health conditions and substance use in identifying and achieving personal goals. Results of the pilot found that nearly all participants demonstrated progress with respect to their identified goals, and group facilitators reported that the workbook was easy to use, that participants enjoyed the material, and that they intended to continue offering the group as part of their regular programming.

Staff Time in the Community: An Enduring Critical Component of Individual Placement and Support in the Digital Age.

OBJECTIVE: This study examined the relationship between individual placement and support (IPS) employment specialists' time spent in the community and employment outcomes in the current digital age, featuring increased technology use and online hiring practices. METHODS: The authors examined the relationship between employment outcomes and IPS employment specialists' time spent in the community at 78 sites in 2018 and 84 sites in 2019. RESULTS: The amount of time staff spent in the community was significantly and positively associated with better employment outcomes. CONCLUSIONS: These data support the continued importance of employment specialists' spending time in the community with employers and IPS recipients to achieve optimal outcomes for recipients.

Behavioral Health Workforce Development in the era of COVID-19: Examples From a State-Funded Intermediary Organization.

Intermediary and purveyor organizations (IPOs) play a key role in disseminating and implementing behavioral health evidence-based practices. The COVID-19 pandemic created a time of crisis and disruption to behavioral health care delivery. Using the conceptual framework of basic, targeted, and intensive technical assistance (TA) from the Training and Technology Transfer Centers, case studies are used to describe how programs at The Center for Practice Innovations a state funded-intermediary organization, adapted its training and technical assistance to be delivered entirely remotely, to include content related to COVID-19 and to provide guidance on telehealth-based behavioral health care.

Self- Evaluation Tool to Support Implementation of Treatment for Tobacco Use Disorder in Behavioral Health Programs.

Tobacco use in people with behavioral health conditions remain two to three times higher than the general population causing premature death and impacting recovery negatively across several domains. Intermediary organizations can provide practical tools, training, and technical assistance to help programs improve capacity to treat tobacco use. This report describes the construction and application of the Tobacco Integration Self-Evaluation Tool (TiSET) for behavioral health programs, a 20-item scale inspired by the DDCMHT and additional content from the Facility Tobacco Policy and Treatment Practices Self-Evaluation tool that one of the study authors (JW) used previously with addiction treatment programs. Completing the TiSET is an important step for behavioral health programs to evaluate their ability to effectively treat people that use tobacco. An important next step is to use those results to facilitate a quality improvement process. We include large agency example illustrating how the TiSET can be applied in real-world practice.

Recommendations for Integrated Systems and Services for People With Co-occurring Mental Health and Substance Use Conditions.

People with co-occurring mental and substance use disorders experience poor outcomes and incur high costs in multiple domains. Efforts to develop and disseminate evidence-based integrated programs for people with such co-occurring disorders began to wane in the past decade as efforts shifted toward integrating primary health care. Several recent trends underscore the need to refocus efforts on providing integrated care for people with both mental and substance use disorders. The authors summarize what is known about integrated care for people with these co-occurring disorders and recommend advancing implementation and research on integration and improving outcomes with existing resources.

Applying Implementation Drivers to Scale-up Evidence-Based Practices in New York State.

Mental health authorities in several states, often working with academic partners, have played important roles in disseminating evidence-based practices (EBPs) for adults diagnosed with serious mental illness. This work has been facilitated by intermediary organizations that work directly with providers to implement EBPs. This report uses two case studies to describe how the Center for Practice Innovations (CPI), an intermediary organization, has used the Active Implementation Research Network's nine implementation drivers to successfully implement EBPs across the large state of New York. One case study focuses on supported employment and the second on integrated treatment for co-occurring mental health and substance use conditions. We provide these case studies to illustrate how intermediary organizations can use implementation science to organize and select effective support strategies to disseminate and implement a range of EBPs within a state system.

Applying Motivational Interviewing Strategies to Enhance Organizational Readiness and Facilitate Implementation Efforts.

Motivational interviewing (MI) is an empirically supported clinical method to help individuals make behavioral changes to achieve a personal goal. Through a set of specific techniques, MI helps individuals mobilize their own intrinsic values and goals to explore and resolve ambivalence about change. This article examines how MI-informed approaches can be applied to help staff adopt new evidence-based practices in organizational settings. Although the implementation science literature offers strategies for implementing new practices within organizations, leaders of quality improvement initiatives often encounter ambivalence about change among staff. Implementation approaches that require staff to make substantial changes may be facilitated by drawing from MI strategies. These include building a sense of collaboration from the beginning, eliciting "change talk," and addressing any ambivalence encountered. Motivational interviewing techniques may be particularly helpful in working with those in a stage of precontemplation (who have yet to see a reason for change) and those who are contemplating change (who see that a problem exists but are ambivalent about change). This article provides examples of how an MI-informed approach can be applied to help facilitate change in staff within organizations that are implementing quality improvement initiatives. These techniques are illustrated using a representative scenario.

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

BACKGROUND: Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. OBJECTIVE: This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. METHODS: We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. RESULTS: Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book. Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that learners rated the modules positively, and self-report of knowledge acquisition was high (mean range: 4.4-4.6 out of 5). About half of learners indicated that they would change their practice after watching the modules (range: 48-51%). All learners who completed the level 1 evaluation demonstrated 80% or better mastery of knowledge on the level 2 evaluation embedded in each module. The CFIR was used to identify implementation barriers and facilitators among the evaluation data which facilitated planning for subsequent implementation support activities in the IPS initiative. CONCLUSION: Instructional design approaches such as ADDIE may offer implementation scientists and practitioners a flexible and systematic approach for the development of e-learning modules as a single component or one strategy in a multifaceted approach for training in EBPs.

Comparative Initial and Sustained Engagement in Web-based Training by Behavioral Healthcare Providers in New York State.

Improved dissemination is critical to implementation of evidence-based practice in community behavioral healthcare settings. Web-based training modalities are a promising strategy for dissemination of evidence-based practice in community behavioral health settings. Initial and sustained engagement of these modalities in large, multidisciplinary community provider samples is not well understood. This study evaluates comparative engagement and user preferences by provider type in a web-based training platform in a large, multidisciplinary community sample of behavioral health staff in New York State. Workforce make-up among platform registrants was compared to the general NYS behavioral health workforce. Training completion by functional job type was compared to characterize user engagement and preferences. Frequently completed modules were classified by credit and requirement incentives. High initial training engagement across professional role was demonstrated, with significant differences in initial and sustained engagement by professional role. The most frequently completed modules across functional job types contained credit or requirement incentives. The analysis demonstrated that high engagement of a web-based training in a multidisciplinary provider audience can be achieved without tailoring content to specific professional roles. Overlap between frequently completed modules and incentives suggests a role for incentives in promoting engagement of web-based training. These findings further the understanding of strategies to promote large-scale dissemination of evidence-based practice in community behavioral health settings.

Relationship Between Self-Assessed Fidelity and Self-Reported Employment in the Individual Placement and Support Model of Supported Employment.

OBJECTIVE: A growing body of literature demonstrates that high-fidelity implementation of the individual placement and support (IPS) model of supported employment increases the chances of achieving desired outcomes. This study examined the relationship between IPS fidelity, as self-reported by program sites, and employment outcomes and determined whether this relationship was maintained over time. METHODS: A total of 78 outpatient programs in New York State provided data on self-reported IPS fidelity and employment outcomes. Pearson correlations were used to determine the relationship between fidelity scores and competitive employment rates. A mixed-effects model examined the relationship between repeated fidelity and employment measures over time. RESULTS: A significant positive relationship was found between better self-reported IPS fidelity and greater employment. The relationship between IPS fidelity and employment was sustained over time (up to one year). CONCLUSIONS: Higher-fidelity implementation of the IPS model, as self-assessed by program sites, was associated with higher employment rates, which were sustained over time.

Is There a Role for Fidelity Self-Assessment in the Individual Placement and Support Model of Supported Employment?

OBJECTIVE: Fidelity assessments help ensure that evidence-based practices are implemented properly. Although assessments are typically conducted by independent raters, some programs have implemented self-assessments because of resource constraints. Self-assessments were compared with independent assessments of programs implementing individual placement and support supported employment. METHODS: Eleven community-based outpatient programs in New York State completed both self- and independent assessments. Intraclass correlation coefficients and paired t tests were used to compare scores from self- and independent assessments. RESULTS: For both assessment methods, mean scores for all programs were within the range of fair fidelity. Self- and independent assessment total scores were not significantly different; however, significant differences were found on some scale items in this small sample. CONCLUSIONS: Self-assessment may be valid for examining a program's overall functioning and useful when resource constraints prevent independent assessment. Independent assessors may be able to identify nuances, particularly on individual assessment items, that can point to areas for program improvement.

Adoption of a Blended Training Curriculum for ACT in New York State.

Scant evidence exists in the literature for best practices in training assertive community treatment (ACT) teams to deliver highly effective services to consumers. This column describes a blended training curriculum, which includes both face-to-face and distance learning strategies, developed by the ACT Training Institute in New York State to meet the ongoing training needs of teams across New York State. Data on training uptake, which has steadily increased over time, are reported. The role of the state is crucial in driving adoption of training activities. The column also describes how the ACT Training Institute uses fidelity and outcome data to identify training needs.

Longitudinal Course of Clients With Co-occurring Schizophrenia-Spectrum and Substance Use Disorders in Urban Mental Health Centers: A 7-Year Prospective Study.

OBJECTIVE: A previous longitudinal study in rural New Hampshire showed that community mental health center clients with co-occurring schizophrenia-spectrum and substance use disorders (SZ/SUD) improved steadily and substantially over 10 years. The current study examined 7 years of prospective clinical and functional outcomes among inner-city Connecticut (CT) community mental health center clients with SZ/SUD. METHOD: Participants were 150 adults with SZ/SUD, selected for high service needs, in 2 inner-city mental health centers in CT. Initially, all received integrated mental health and substance abuse treatments for at least the first 3 years as part of a clinical trial. Assessments at baseline and yearly over 7 years measured progress toward 6 target clinical and functional outcomes: absence of psychiatric symptoms, remission of substance abuse, independent housing, competitive employment, social contact with non-users of substances, and life satisfaction. RESULTS: The CT SZ/SUD participants improved significantly on 5 of the 6 main outcomes: absence of psychiatric symptoms (45%-70%), remission of substance use disorders (8%-61%), independent housing (33%-47%), competitive employment (14%-28%), and life satisfaction (35%-53%). Only social contact with nonusers of substances was unimproved (14%-17%). CONCLUSIONS: Many urban community mental health center clients with SZ/SUD and access to integrated treatment improve significantly on clinical, vocational, residential, and life satisfaction outcomes over time, similar to clients with SZ/SUD in rural areas. Thus, the long-term course for people with SZ/SUD is variable but often quite positive.

Using incentives for training participation.

TOPIC: This column describes how public partners can help incentivize participation in training. Specifically, a state mental health agency and its implementation center applied financial and nonfinancial incentives to encourage participation in training and implementation supports. PURPOSE: Although training is not sufficient to change practice, it is a necessary first step in implementing evidence-based treatments. Finding ways to incentivize participation, particularly strategies with minimal resource involvement, is important for the psychiatric rehabilitation workforce and cash-strapped public systems. SOURCES USED: This description draws from published material and experiences from New York State. CONCLUSIONS AND IMPLICATIONS FOR PRACTICE: Engaging public partners to incentivize training can significantly increase participation in training. Incentive programs exist that do not require additional funding-an important consideration, given the fiscal climate for most public payers.

Using distance technologies to facilitate a learning collaborative to implement stagewise treatment.

OBJECTIVE: This report describes experiences and outcomes of an online learning collaborative focused on implementation of stagewise treatment. METHODS: Eleven participating programs convened online monthly for a year. Between meetings, program staff created an implementation plan and programs collected performance indicator data, including assessment of staff knowledge of integrated treatment for people with co-occurring disorders, whether a person's current stage of treatment was documented in his or her chart, and whether the treatments were appropriate for the stage of treatment. Descriptive statistics were used to characterize performance indicators and feedback. Wilcoxon matched-pairs signed-rank tests examined changes in performance indicators over time. RESULTS: Program staff generally demonstrated significant improvements in performance indicators over time and rated the distance learning collaborative favorably. CONCLUSIONS: Distance learning collaboratives can be structured to provide opportunities for program staff to interact and learn from one another and to implement and sustain changes.

Predictors of incarceration among urban adults with co-occurring severe mental illness and a substance use disorder.

OBJECTIVE: People with severe mental illness and a co-occurring substance use disorder (co-occurring disorders) who live in urban areas experience high rates of incarceration. This study examined sociodemographic, clinical, economic, and community integration factors as predictors of incarceration among people with co-occurring disorders. METHODS: This secondary analysis used data from a randomized controlled trial of assertive community treatment versus standard case management. In the parent study, researchers interviewed 198 people with co-occurring disorders from two urban mental health centers in Connecticut at baseline and every six months for three years. Researchers tracked incarceration, clinical engagement and status, employment, living situation, social relationships, and substance use. The study reported here used bivariate analyses and logistic regression analyses to compare individuals who were incarcerated during the study period with those who were not. RESULTS: The overall incarceration rate was 38% during the study period. In multivariate analyses, prior incarceration predicted incarceration during the study period (odds ratio [OR]=3.26). Two factors were associated with a reduced likelihood of incarceration: friendships with individuals who did not use substances (OR=.19) and substance use treatment engagement (OR=.60). CONCLUSIONS: Positive social relationships and engagement in substance use treatment are promising service and policy targets to prevent incarceration in this high-risk population.