Organizational Climate and Support Among Peer Specialists Working in Peer-Run, Hybrid and Conventional Mental Health Settings.

As the peer specialist workforce continues to expand, it is critical to better understand peer providers' working conditions and workplace experiences. The current study utilized a targeted non-probability sample of 801 peer specialists to explore whether key organizational climate and support variables would yield distinct multivariate groups, and to investigate the correlates of these groups. Analyses yielded a seven-group solution, with peer run organizations comprising a substantially greater proportion of the groups with high organizational climate and support scores. In direct comparisons, peer-run programs outranked all other groups in the areas of perceived organizational climate, supports for career development and perceived service quality.

Fidelity to recovery-oriented ACT practices and consumer outcomes.

OBJECTIVE: A previous study of a recovery-oriented assertive community treatment initiative (PACT) in Washington State found reductions in state psychiatric hospital use and related costs for PACT participants, especially in the first six months after enrollment and for consumers who were high users of the state psychiatric hospital before ACT enrollment. This study examined whether these outcomes varied by team fidelity to recovery-oriented ACT practices. METHODS: Generalized estimating equations (GEE) were used to examine the relationship between scores on the Tool for Measurement of Assertive Community Treatment (TMACT), a recently developed tool for assessing fidelity to recovery-oriented ACT, and the use of state hospitals, local hospitals, emergency departments, local crisis stabilization units, and arrests for 631 PACT consumers. These relationships were also examined for PACT consumers with any state hospital use (N=450) and those considered high users of the state hospital (≥ 96 days in two years before PACT enrollment). RESULTS: TMACT scores were associated (p<.01) with a decrease in the amount of use but not the probability of using state psychiatric hospitals, local hospital psychiatric inpatient units, and local crisis stabilization units. The marginal effects of higher TMACT scores on the probability and use of emergency departments or arrests were not statistically significant. CONCLUSIONS: This study provides preliminary evidence for the predictive validity of the TMACT. Future research should examine the subscale structure of the TMACT as well as the association between TMACT fidelity and consumer well-being, quality of life, and other important person-centered outcomes.

Advances in fidelity measurement for mental health services research: four measures.

Mental health intervention research requires clear and accurate specification of treatment conditions in intervention studies. Measures are increasingly available for community-based interventions for persons with serious mental illnesses. Measures must go beyond structural features to assess critical processes in interventions. They must also balance effectiveness, or adequate coverage of active treatment elements, with efficiency, or the degree to which measures may be used cost-effectively. The context of their use is changing with the emergence of new frameworks for implementation research and quality improvement. To illustrate a range of approaches, this article describes four recently developed fidelity measures: Cognitive Therapy for Psychosis Adherence Scale, Strengths Model Fidelity Scale, Illness Management and Recovery Program Fidelity Scale, and Tool for Measurement of ACT. The fidelity measures assess interventions in a range of treatment contexts from dyads to teams. Each measure focuses assessment resources on critical elements. Each has demonstrated coverage of its target intervention and satisfactory psychometric properties and is related to outcomes. Measures have been used for training, quality improvement, or certification. They assess domains and have uses beyond their nominal position in implementation and quality frameworks. This review of recent fidelity measures indicates that process components in community-based interventions can be effectively assessed. Omission of elements assessing potentially critical active treatment components poses risk to both research and practice until there is evidence to demonstrate that they are nonessential. Further development of fidelity measurement theory and approaches should proceed in conjunction with development of theory and methods in implementation science.

The TMACT: a new tool for measuring fidelity to assertive community treatment.

BACKGROUND: Fidelity assessment is important for implementation of evidence-based practices (EBPs), including assertive community treatment (ACT). OBJECTIVES: The TMACT, an enhanced fidelity tool, was developed and pilot-tested to better assess critical ACT structures and processes. DESIGN: Ten ACT teams were administered the TMACT and the long-standing ACT fidelity measure, the Dartmouth Assertive Community Treatment Scale (DACTS), at baseline, 6, 12, and 18 months. RESULTS: Overall, fidelity scores for all 10 teams were relatively high. Six teams showed improvement, concluding with high TMACT scores at 18 months. Four teams with significantly lower total scores had experienced turnover and organizational barriers. TMACT ratings were higher in core ACT practices than in recovery practices and EBPs. TMACT scores rose steadily but were significantly lower than DACTS scores, which remained unchanged. CONCLUSIONS: The TMACT sets higher performance standards through enhanced assessment of recovery-orientation, EBPs, and teamwork and is more sensitive to change than the DACTS.

Recovery orientation of treatment, consumer empowerment, and satisfaction with services: a mediational model.

OBJECTIVE: This study explores the relationship between the recovery orientation of treatment and subjective experiences of consumer empowerment and satisfaction with services for individuals with severe and persistent mental illness. METHODS: Instruments measuring perceptions of empowerment, recovery orientation of treatment, and satisfaction with services were administered to 45 participants enrolled in two demographically similar mental health treatment programs in Tampa, Florida - a community mental health center and an Assertive Community Treatment team. Analyses were conducted according to traditional mediation models. Empowerment was expected to mediate the relationship between the recovery orientation of treatment and consumer satisfaction with services. RESULTS: A recovery-based treatment orientation significantly predicted both consumer empowerment and satisfaction with services. Empowerment mediated the relationship between treatment orientation and consumer satisfaction. CONCLUSIONS: These preliminary findings highlight the impact of the recovery orientation of treatment on empowerment and satisfaction with services among individuals with severe and persistent mental illness.

Effects of participation in consumer-operated service programs on both personal and organizationally mediated empowerment: results of multisite study.

The number of empowerment-oriented consumer-operated service programs (COSPs) in mental health has increased dramatically over the past decade; however, little empirical evidence exists about the effects of such programs on their intended outcomes. This study examined the effects of COSPs on various aspects of empowerment within the context of a multisite, federally funded, randomized clinical trial of COSPs. Results suggest that the individuals who received the consumer-operated services perceived higher levels of personal empowerment than those in the control intervention; overall, effect sizes were very modest when all sites were examined together in intent-to-treat analyses. However, we noted variations in outcomes by intensity of COSP use and also by study site, which suggest that specific programs had significant effects, while others did not. The implications of these results for the mental health field and for service providers and policy makers are discussed.

Is it ACT yet? Real-world examples of evaluating the degree of implementation for assertive community treatment.

Despite growing interest in assessment of program implementation, little is known about the best way to evaluate whether a particular program has implemented the intended service to a level that is minimally acceptable to a funding source, such as a state mental health authority. Such is the case for assertive community treatment (ACT), an evidence-based practice being widely disseminated. Using an exploratory, actuarial approach to defining program standards, this study applies different statistical criteria for determining whether or not a program meets ACT standards using the 28-item Dartmouth Assertive Community Treatment Scale. The sample consists of 51 ACT programs, 25 intensive case management programs, and 11 brokered case management programs which were compared to identify levels of fidelity that discriminated between programs, but were still attainable by the majority of ACT programs. A grading system based on mean total score for a reduced set of 21 items appeared to be most attainable, but still discriminated ACT programs from other forms of case management. Implications for setting and evaluating ACT program standards are discussed.

Fundamental principles of evidence-based medicine applied to mental health care.

This article discusses the fundamental principles of evidence-based medicine: using the best available evidence, individualizing the evidence, attending to patient preferences, and expanding clinical expertise. These principles have important implications for the adoption of evidence-based practices in mental health care.

Evidence-based practices: setting the context and responding to concerns.

After nearly 20 years of progress in general medicine, the evidence-based practice movement is becoming the central theme for mental health care reform in the first decade of 2000. Several leaders in the movement met to discuss concerns raised by six stakeholder groups: consumers, family members, practitioners, administrators, policy makers, and researchers. Recurrent themes relate to concerns regarding the limits of science, diversion of funding from valued practices, increased costs, feasibility, prior investments in other practices, and shifts in power and control. The authors recommend that all stakeholder groups be involved in further dialog and planning to ensure that practices emerge that represent the integration of the best research evidence with clinical expertise and consumer values.