Monitoring implementation in program evaluation with direct audio coding.

This project explored the reliability and utility of transcription in coding qualitative data across two studies in a program evaluation context. The first study tested the method of direct audio coding, or coding audio files without transcripts, using qualitative data software. The presence and frequency of codes applied in direct audio coding and traditional transcription coding were compared and the two methods produced similar results. Direct audio coding was then employed in an evaluation study to monitor implementation and the method was found to be reliable. Implications are discussed with considerations for both researchers and practitioners.

Parental report of outcomes from a randomized trial of in-home family services.

This study conducted a randomized trial to examine the efficacy of the Boys Town In-Home Family Services (IHFS) program for families of high-risk youth. Participants were recruited from a state helpline for families struggling with poor family functioning and child emotional or behavioral issues. Consent was obtained for 300 of which 152 were randomly assigned to participate in IHFS for 3-4 months and 148 were assigned to the services as usual comparison group. For the families in the treatment group, 18% did not participant in the intervention, and 66% of families received 20 or more service hours. Parent report data were collected at intake, post, as well 6 and 12 months after post data collection. Data were collected on constructs such as caregiver strain, family functioning, parenting, family resources, and parent report of child behavior. Piecewise analyses of the intake to post data indicated significantly greater reductions in caregiver strain for the treatment condition. Given the conservative corrections for the use of multiple tests, no other measures demonstrated significant differences. For the piecewise model of the maintenance phase, there were no significant differences between groups aside from caregiver strain that showed a significant improvement for the comparison condition. Supplementary dose-response analyses indicated that for most families there was an ideal dosage of about 25-75 hr to bring about the largest improvements in caregiver strain, parenting skills, and child behavior. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Examining Change in Therapeutic Alliance to Predict Youth Mental Health Outcomes.

OBJECTIVE: To examine the link between therapeutic alliance and youth outcomes. METHOD: The study was conducted at a group-home with 112 youth with a disruptive-behavior diagnosis. Therapeutic alliance was collected routinely via youth and staff report. Outcome data were collected using youth and staff reports of externalizing behavior as well as behavioral incidents occurring during care. Outcome data were collected following intake into services and at 6 and 12 months of care. Data were analyzed to examine (1) if youth behavior problems at intake were predictive of therapeutic alliance and (2) if changes in alliance were predictive of subsequent youth outcomes. These were conducted with a 6-month service-delivery model and replicated with a 12-month model. RESULTS: There was some support for the first hypothesis, that initial levels of youth externalizing behavior would be related to alliance ratings; however, most of the effects were marginally significant. The second hypothesis, that changes in therapeutic alliance would be related to subsequent youth outcomes, was supported for the 6-month model, but not the 12-month model. CONCLUSIONS: Changes in therapeutic alliance may be predictive of youth outcomes during care. Additional research into examining therapeutic alliance trajectories is warranted to improve mental health services for youth.

Convergent Validity of the Strength-Based Behavioral and Emotional Rating Scale with Youth in a Residential Setting.

Strength-based assessment has been identified as an appropriate approach to use in planning treatment and evaluating outcomes of youth in residential settings. In previous research, the Behavioral and Emotional Rating Scale-2, a standardized and norm-referenced strength-based measure, has demonstrated adequate reliability and validity with youth served in community and educational settings. The purpose of the present study was to examine the internal reliability and convergent validity of the BERS-2 by comparing the test to the Child Behavior Checklist and the Symptoms and Functioning Severity Scale. The results indicate that the scores from the BERS-2 are internally consistent and converge with other behavioral and emotional measures which, taken together, suggest that the BERS-2 could be acceptable for assessing the emotional and behavioral strengths of youth in residential settings. Study limitations and future research directions are identified.

Therapeutic Alliance Between Youth and Staff in Residential Group Care: Psychometrics of the Therapeutic Alliance Quality Scale.

Therapeutic alliance has been frequently studied in individual counseling sessions; however, research on therapeutic alliance in residential settings for youth with mental health diagnoses has been limited. This may be due, in part, to the presence of multiple service providers often in caregiving roles. The purpose of this study was to examine the psychometric quality of a widely utilized measure of therapeutic alliance used in psychotherapy with youth in residential care where the treatment is provided by a trained married couple. We also compared the relationship between youth ratings of their male and female service provider, as well as examined correlations in ratings between youth and staff on therapeutic alliance. Finally, we investigated the direction, magnitude, and trajectory of change in therapeutic alliance over a 12-month period following admission into residential care. The method was a longitudinal assessment of 135 youth and 124 staff regarding therapeutic alliance over the course of 12 months or discharge from services. Results indicated strong psychometric properties and high correlations for youth ratings of both their male and female service providers. However, the correlation was low between youth and service provider ratings of alliance. Longitudinal analyses indicated that rates of therapeutic alliance changed over time.