Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring.

This systematic review and meta-analysis examines the impact of measuring, monitoring, and feeding back information on client progress to clinicians while they deliver psychotherapy. It considers the effects of the 2 most frequently studied routine outcome monitoring (ROM) practices: The Partners for Change Outcome Management System and the Outcome Questionnaire System. Like other ROM practices, they typify attempts to enhance routine care by assisting psychotherapists in recognizing problematic treatment response and increasing collaboration between therapist and client to overcome poor treatment response. A total of 24 studies were identified and considered suitable for analysis. Two-thirds of the studies found that ROM-assisted psychotherapy was superior to treatment-as-usual offered by the same practitioners. Mean standardized effect sizes indicated that the effects ranged from small to moderate. Feedback practices reduced deterioration rates and nearly doubled clinically significant/reliable change rates in clients who were predicted to have a poor outcome. Clinical examples, diversity considerations, and therapeutic advances are provided. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The relationship between clients' depression etiological beliefs and psychotherapy orientation preferences, expectations, and credibility beliefs.

The purpose of this study was to examine the relationship between clients' etiological beliefs for depression and treatment preferences, credibility beliefs, and outcome expectations for five different depression treatments-behavioral activation, cognitive therapy, interpersonal psychotherapy, pharmacotherapy, and psychodynamic psychotherapy. Adult psychotherapy clients (N = 98) were asked to complete an online survey that included the Reasons for Depression Questionnaire, a brief description of each of the five treatment options, and credibility, expectancy, and preference questions for each option. On average, the participating clients rated pharmacotherapy as significantly less credible, having a lower likelihood of success, and being less preferred than the four types of psychotherapy. In general, interpersonal psychotherapy was also rated more negatively than the other types of psychotherapy. However, these findings depended somewhat on whether the participating client was personally experiencing depression. Credibility beliefs, outcome expectations, and preferences for pharmacotherapy were positively associated with biological beliefs for depression; however, the other hypothesized relationships between etiological beliefs and treatment attitudes were not supported. Although the study is limited based on the specific sample and treatment descriptions that were used, the results may still have implications for psychotherapy research, training, and practice. (PsycINFO Database Record

Creating a climate for therapist improvement: A case study of an agency focused on outcomes and deliberate practice.

Recent evidence suggests that psychotherapists may not increase in effectiveness over accrued experience in naturalistic settings, even settings that provide access to patients' outcomes. The current study examined changes in psychotherapists' effectiveness within an agency making a concerted effort to improve outcomes through the use of routine outcome monitoring coupled with ongoing consultation and the planful application of feedback including the use of deliberate practice. Data were available for 7 years of implementation from 5,128 patients seen by 153 psychotherapists. Results indicate that outcomes indeed improved across time within the agency, with increases of d = 0.035 (p = .003) per year. In contrast with previous reports, psychotherapists in the current sample showed improvements within their own caseloads across time (d = 0.034, p = .042). It did not appear that the observed agency-level improvement was due to the agency simply hiring higher-performing psychotherapists or losing lower-performing psychotherapists. Implications of these findings are discussed in relation to routine outcome monitoring, expertise in psychotherapy, and quality improvement within mental health care. (PsycINFO Database Record

Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting.

OBJECTIVE: Psychotherapy researchers have long questioned whether increased therapist experience is linked to improved outcomes. Despite numerous cross-sectional studies examining this question, no large-scale longitudinal study has assessed within-therapist changes in outcomes over time. METHOD: The present study examined changes in psychotherapists' outcomes over time using a large, longitudinal, naturalistic psychotherapy data set. The sample included 6,591 patients seen in individual psychotherapy by 170 therapists who had on average 4.73 years of data in the data set (range = 0.44 to 17.93 years). Patient-level outcomes were examined using the Outcome Questionnaire-45 and a standardized metric of change (prepost d). Two-level multilevel models (patients nested within therapist) were used to examine the relationship between therapist experience and patient prepost d and early termination. Experience was examined both as chronological time and cumulative patients seen. RESULTS: Therapists achieved outcomes comparable with benchmarks from clinical trials. However, a very small but statistically significant change in outcome was detected indicating that on the whole, therapists' patient prepost d tended to diminish as experience (time or cases) increases. This small reduction remained when controlling for several patient-level, caseload-level, and therapist-level characteristics, as well as when excluding several types of outliers. Further, therapists were shown to vary significantly across time, with some therapists showing improvement despite the overall tendency for outcomes to decline. In contrast, therapists showed lower rates of early termination as experience increased. CONCLUSIONS: Implications of these findings for the development of expertise in psychotherapy are explored. (PsycINFO Database Record

Supervisor variance in psychotherapy outcome in routine practice.

OBJECTIVE: Although supervision has long been considered as a means for helping trainees develop competencies in their clinical work, little empirical research has been conducted examining the influence of supervision on client treatment outcomes. Specifically, one might ask whether differences in supervisors can predict/explain whether clients will make a positive or negative change through psychotherapy. METHOD: In this naturalistic study, we used a large (6521 clients seen by 175 trainee therapists who were supervised by 23 supervisors) 5-year archival data-set of psychotherapy outcomes from a private nonprofit mental health center to test whether client treatment outcomes (as measured by the OQ-45.2) differed depending on who was providing the supervision. Hierarchical linear modeling was used with clients (Level 1) nested within therapists (Level 2) who were nested within supervisors (Level 3). RESULTS: In the main analysis, supervisors explained less than 1% of the variance in client psychotherapy outcomes. CONCLUSIONS: Possible reasons for the lack of variability between supervisors are discussed.

Using client outcome monitoring as a tool for supervision.

A large body of research has supported the use of client outcome monitoring and client feedback in psychotherapy. However, discussions between supervisors and trainee clinicians in supervision are still largely based on subjective appraisals made by the trainees. In this article, we discuss 3 strategies for integrating client outcome data and feedback into the supervisory process: training students to obtain and use objective client feedback, using specific client data to inform discussions of clients, and identifying patterns of outcomes across clients to facilitate supervisee growth and development.

Preferences for mental health treatment options among Alaska Native college students.

In this study we investigated the mental health treatment preferences held by Alaska Native (AN) college students regarding treatment type, treatment provider, and therapy roles. Preferences were compared between AN and Caucasian participants and also between ANs with high and low identification with their Indigenous culture. While there were many similarities between groups, some important differences were found. The results of this study have significant implications for making mental health treatments more available and culturally appropriate for ANs.

Providers' voices on telebehavioral health: survey of an outpatient counseling agency in Alaska.

Hope Counseling Center sought to expand behavioral health services to underserved populations in Alaska by offering telebehavioral health services. Providers completed a questionnaire addressing their experiences, opinions, and training needs as they relate to telebehavioral health. Open conversations about the training needs, limitations, and benefits of telebehavioral health supported program development and led to training on new equipment, rapport building, and telebehavioral health outcome studies.

A prediction of initial appointment attendance and initial outcome expectations.

Clients' outcome expectations have been found to play an important role in psychotherapy. Although expectations likely exist before the start of treatment, little is known about how early expectations are developed and the role they play in initial appointment attendance. Adult clients (n = 57) from two psychology department training clinics completed measures of outcome expectations, generalized hope, and distress at the time of referral (after the initial phone conversation). As a set, these variables, along with previous therapy experience and length of wait until the initial appointment, successfully predicted appointment status for 88.7% of the sample. Attendance was more likely when the duration of wait was shorter (OR = 1.58, p < .01) and for those with previous therapy experience (OR = 9.89, p < .05). Initial outcome expectations were significantly correlated with general levels of hope (r = .59, p < .01) and negatively correlated with severity of distress (r = -.48, p < .01). Based on these results, clinical recommendations for increasing the likelihood of attendance and for enhancing expectations are made.

Outcome measures for practice.

The current review targets efforts to use outcome measures in routine care for the purpose of enhancing psychotherapy outcome, particularly for patients who are predicted to have a negative treatment outcome. The place of outcome measures in solving the negative effects problem is emphasized, with a narrow focus on one set of measures that is relatively well advanced in its clinical utility. This clinical innovation relies on research-based clinical decision tools that provide psychotherapists with timely warnings and problem-solving strategies when a patient deviates from an expected treatment response. Summary of a meta-analytic review using this patient feedback methodology suggests that measuring, monitoring, predicting treatment failure, and providing clinical support tools to clinicians enhance treatment outcome for patients who have an early negative treatment response. Other measures are then briefly reviewed before we turn to future directions. Clinicians are encouraged to employ these methods in routine practice.

Improving outcomes for poorly responding clients: the use of clinical support tools and feedback to clients.

We present two methods of enhancing outcome and preventing treatment failure in psychotherapy. The first involves providing therapists with a decision tree and several assessment measures for clients who are not having a positive response to psychotherapy. The organization of the decision tree and the selection of measures were based on results from psychotherapy outcome studies. The second method involves providing clients with feedback on their progress throughout the course of treatment. Both methods of providing feedback enhanced treatment outcomes and representative studies are reviewed. Use of these methods is recommended for application in routine practice.

Providing feedback to psychotherapists on their patients' progress: clinical results and practice suggestions.

We describe and illustrate our system to measure, monitor, and feed back information about patient treatment. This clinical innovation relies on research-based clinical decision tools that provide psychotherapists with timely warnings when a patient's deviation from an expected treatment response foretells possible treatment failure. We summarize the results of four controlled studies using this methodology; the collective results suggest that measuring, monitoring, and predicting treatment failure (feedback) enhance treatment outcomes for patients who have a negative response. Clinicians are encouraged to employ these methods in routine practice despite their confidence in their own ability to predict patient outcome.