Discrepancies in Ratings of Behavioral Healthcare Interventions Among Evidence-Based Program Resources Websites.

Decision makers in the behavioral health disciplines could benefit from tools to assist them in identifying and implementing evidence-based interventions. One tool is an evidence-based program resources website (EBPR). Prior studies documented that when multiple EBPRs rate an intervention, they may disagree. Prior research concerning the reason for such conflicts is sparse. The present study examines how EBPRs rate interventions and the sources of disagreement between EBPRs when rating the same intervention. This study hypothesizes that EBPRs may disagree about intervention ratings because they either use different rating paradigms or they use different studies as evidence of intervention effectiveness (or both). This study identified 15 EBPRs for inclusion. One author (M.J.L.E.) coded the EBPRs for which "tiers of evidence" each EBPR used to classify behavioral health interventions and which criteria they used when rating interventions. The author then computed one Jaccard index of similarity for the criteria shared between each pair of EBPRs that co-rated interventions, and one for the studies used by EBPR rating pairs when rating the same program. The authors used a combination of chi-square, correlation, and binary logistic regression analyses to analyze the data. There was a statistically significant negative correlation between the number of Cochrane Risk of Bias criteria shared between 2 EBPRs and the likelihood of those 2 EBPRs agreeing on an intervention rating (r = -.12, P ≤ .01). There was no relationship between the number of studies evaluated by 2 EBPRs and the likelihood of those EBPRs agreeing on an intervention rating. The major reason for disagreements between EBPRs when rating the same intervention in this study was due to differences in the rating criteria used by the EBPRs. The studies used by the EBPRs to rate programs does not appear to have an impact.

Judges' Perceptions of Screening, Assessment, Prevention, and Treatment for Substance Use, Mental Health, and HIV among Juveniles on Community Supervision: Results of a National Survey.

Juvenile Justice-Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS) National Survey was funded in part to describe the current status of screening, assessment, prevention and treatment for substance use, mental health, and HIV for youth on community supervision within the US juvenile justice system. Surveys were administered to community supervision agencies and their primary behavioral healthcare providers, as well as the juvenile or family court judge with the largest caseload of youth on community supervision. This article presents the findings from the judges' survey. Survey results indicated juvenile and family court judges were open to innovations for improving the court's performance, rated their relationships with collaborators highly, and appreciated the impact of screening, assessment, prevention, and treatment on judicial practices.