Getting More Out of Clinical Documentation: Can Clinical Dashboards Yield Clinically Useful Information?

This study investigated coded data retrieved from clinical dashboards, which are decision-support tools that include a graphical display of clinical progress and clinical activities. Data were extracted from clinical dashboards representing 256 youth (M age = 11.9) from 128 practitioners who were trained in the Managing and Adapting Practice (MAP) system (Chorpita & Daleiden in BF Chorpita EL Daleiden 2014 Structuring the collaboration of science and service in pursuit of a shared vision. 43(2):323 338. 2014, Chorpita & Daleiden in BF Chorpita EL Daleiden 2018 Coordinated strategic action: Aspiring to wisdom in mental health service systems. 25(4):e12264. 2018) in 55 agencies across 5 regional mental health systems. Practitioners labeled up to 35 fields (i.e., descriptions of clinical activities), with the options of drawing from a controlled vocabulary or writing in a client-specific activity. Practitioners then noted when certain activities occurred during the episode of care. Fields from the extracted data were coded and reliability was assessed for Field Type, Practice Element Type, Target Area, and Audience (e.g., Caregiver Psychoeducation: Anxiety would be coded as Field Type = Practice Element; Practice Element Type = Psychoeducation; Target Area = Anxiety; Audience = Caregiver). Coders demonstrated moderate to almost perfect interrater reliability. On average, practitioners recorded two activities per session, and clients had 10 unique activities across all their sessions. Results from multilevel models showed that clinical activity characteristics and sessions accounted for the most variance in the occurrence, recurrence, and co-occurrence of clinical activities, with relatively less variance accounted for by practitioners, clients, and regional systems. Findings are consistent with patterns of practice reported in other studies and suggest that clinical dashboards may be a useful source of clinical information. More generally, the use of a controlled vocabulary for clinical activities appears to increase the retrievability and actionability of healthcare information and thus sets the stage for advancing the utility of clinical documentation.

What Therapy Practices Do Providers Value in Youth Behavioral Health? A Measure Development Study.

Existing measures of attitudes toward evidence-based practices (EBPs) assess attitudes toward manualized or research-based treatments. Providers of youth behavioral health (N = 282) completed the Valued Practices Inventory (VPI), a new measure of provider attitudes toward specific practices for youth that avoids mention of EBPs by listing specific therapies-some of which are drawn from EBPs (e.g., problem solving) and some of which are not included in EBPs (e.g., dream interpretation). Exploratory factor analysis revealed two factors: practices derived from the evidence base (PDEB) and alternative techniques (AT). The PDEB scale was significantly correlated with scales on the Evidence-Based Practice Attitude Scale-50 (Aarons et al. in Administration and Policy in Mental Health and Mental Health Services Research, 39(5): 331-340, 2012), whereas the AT scale was not. Attitudes toward PDEB and AT were also related to provider characteristics such as years of experience and work setting. The VPI offers a complementary approach to existing measures of attitudes because it avoids mention of EBPs, which may help prevent biases in responses.

Therapist Attitudes Towards Evidence-Based Practice: A Joint Factor Analysis.

Despite the accumulated research support for the use of evidence-based practices (EBPs) with youth, these treatment approaches remain underutilized in community settings. Therapist attitudes towards EBPs play a pivotal role in their adoption and implementation of these practices. The present investigation employs joint exploratory factor analysis to evaluate the structure of two measures of therapist attitudes, the Evidence-Based Practices Attitudes Scale and the Modified Practice Attitude Scale. Results suggest three factors including (a) importance of clinical experience over EBPs, (b) clinician openness to change, and (c) problems with EBPs. Recommendations are provided for future evaluation of therapist attitudes and associated characteristics.

Facilitators and Barriers of Implementing a Measurement Feedback System in Public Youth Mental Health.

This study examines implementation facilitators and barriers of a statewide roll-out of a measurement feedback system (MFS) in a youth public mental health system. 76 % of all state care coordinators (N = 47) completed interviews, which were coded via content analysis until saturation. Facilitators (e.g., recognition of the MFS's clinical utility) and barriers (e.g., MFS's reliability and validity) emerged paralleling the Exploration, Adoption/Preparation, Implementation, and Sustainment framework outlined by Aarons et al. (Adm Policy Mental Health Mental Health Serv Res, 38:4-23, 2011). Sustainment efforts may leverage innovation fit, individual adopter, and system related facilitators.

Evidence Base Update: 50 Years of Research on Treatment for Child and Adolescent Anxiety.

Anxiety disorders are the most common mental health disorder among children and adolescents. We examined 111 treatment outcome studies testing 204 treatment conditions for child and adolescent anxiety published between 1967 and mid-2013. Studies were selected for inclusion in this review using the PracticeWise Evidence-Based Services database. Using guidelines identified by this journal (Southam-Gerow & Prinstein, 2014), studies were included if they were conducted with children and/or adolescents (ages 1-19) with anxiety and/or avoidance problems. In addition to reviewing the strength of the evidence, the review also examined indicators of effectiveness, common practices across treatment families, and mediators and moderators of treatment outcome. Six treatments reached well-established status for child and adolescent anxiety, 8 were identified as probably efficacious, 2 were identified as possibly efficacious, 6 treatments were deemed experimental, and 8 treatments of questionable efficacy emerged. Findings from this review suggest substantial support for cognitive-behavioral therapy (CBT) as an effective and appropriate first-line treatment for youth with anxiety disorders. Several other treatment approaches emerged as probably efficacious that are not primarily CBT based, suggesting that there are alternative evidence-based treatments that practitioners can turn to for children and adolescents who do not respond well to CBT. The review concludes with a discussion of treatments that improve functioning in addition to reducing symptoms, common practices derived from evidence-based treatments, mediators and moderators of treatment outcomes, recommendations for best practice, and suggestions for future research.

Balancing effectiveness with responsiveness: Therapist satisfaction across different treatment designs in the Child STEPs randomized effectiveness trial.

OBJECTIVE: To investigate the association between protocol design and therapist satisfaction in the Child STEPs Randomized Effectiveness Trial (Weisz et al., 2012). METHOD: Therapist report was obtained at the close of 145 cases seen by 77 therapists, each of whom was randomized to a Standard evidence-based treatment (EBT), modular EBT, or usual care (UC) condition. RESULTS: Analysis of satisfaction items revealed 2 correlated factors representing perceived effectiveness and perceived responsiveness of the treatments. Therapist total satisfaction scores were significantly higher for cases in the modular condition than for those in the standard EBT or UC conditions. With regard to specific dimensions, the modular and UC cases were rated significantly higher than standard EBT cases on the Responsiveness scale, whereas modular and standard EBT cases were rated significantly higher than UC on the Effectiveness scale. Finally, increases in Effectiveness scores from first to second case were significantly larger for Modular cases than for cases in both other study conditions, and increases from first to second case in Total Satisfaction scores were significantly larger for modular cases than for UC cases. CONCLUSIONS: Therapist satisfaction with a treatment approach has independent dimensions, which can vary as a function of the protocol design. By virtue of being perceived as more effective than UC and more responsive than standard EBTs, the modular protocol design was also viewed as more overall satisfying than both, and secondary analysis suggested that these results were not due to mere first impressions of the protocols.

Predictors of use of evidence-based practices for children and adolescents in usual care.

Practice data from 74 therapists providing public mental health services to 519 youth ages 5-19 were examined. Multilevel modeling suggested child and therapist characteristics predicted use of practices derived from the evidence-base (PDEB) and use of practices with minimal evidence support (PMES). Longer episode length predicted greater receipt of PDEB; older youth, males, and youth in out-of-home levels of care were more likely to receive PMES; and youth receiving an evidence-based treatment program were less likely to receive PMES. Professional specialty and theoretical orientation significantly predicted PDEB whereas therapist characteristics did not predict PMES. Implementation implications are discussed.

Self-consciousness and social anxiety in youth: the Revised Self-Consciousness Scales for Children.

Despite the established relationship between self-consciousness (SC) and anxiety and depression in adults, there is a paucity of research examining SC in children and adolescents. We therefore sought to examine the factor structure, reliability, and validity of scores for a revised version of the Self-Consciousness Scales for Children, a measure of SC in youth. The Revised Self-Consciousness Scale for Children (R-SCS-C) was examined in 2 studies using a community sample of children and adolescents. In the 1st study, 1,207 youth (685 girls) ages 7 to 18 completed the R-SCS-C as well as measures of imaginary audience, anxiety, depression, and positive and negative affect. Results of an exploratory factor analysis of the R-SCS-C conducted on a randomly selected subsample (n = 603) supported a 3-factor solution, including the subscales of Public Self-Consciousness, Private Self-Consciousness, and Social Anxiety. A subsequent confirmatory factor analysis (CFA) conducted on the remaining half of the sample (n = 604) revealed that this model fit the data well. Additionally, subsequent multigroup CFAs by gender and age demonstrated good model fit across both gender and younger (ages 7 to 12 years) and older (ages 13 to 18 years) cohorts. In the 2nd study, 245 youth completed the R-SCS-C twice, approximately 2 weeks apart. The R-SCS-C scores in these samples demonstrated acceptable internal consistency, convergent and divergent validity, and test-retest reliability. Implications of these findings and directions for future research are discussed.

Long-term outcomes for the Child STEPs randomized effectiveness trial: a comparison of modular and standard treatment designs with usual care.

OBJECTIVE: This article reports outcomes from the Child STEPs randomized effectiveness trial conducted over a 2-year period to gauge the longer term impact of protocol design on the effectiveness of evidence-based treatment procedures. METHOD: An ethnoracially diverse sample of 174 youths ages 7- 13 (N = 121 boys) whose primary clinical concerns involved diagnoses or clinical elevations related to anxiety, depression, or disruptive behavior were treated by community therapists randomly assigned to 1 of 3 conditions: (a) standard, which involved the use of 1 or more of 3 manualized evidence-based treatments, (b) modular, which involved a single modular protocol (Modular Approach to Treatment of Children With Anxiety, Depression, or Conduct Problems; MATCH) having clinical procedures similar to the standard condition but flexibly selected and sequenced using a guiding clinical algorithm, and (c) usual care. RESULTS: As measured with combined Child Behavior Checklist and Youth Self-Report Total Problems, Internalizing, and Externalizing scales, the rate of improvement for youths in the modular condition was significantly better than for those in usual care. On a measure of functional impairment (Brief Impairment Scale), no significant differences were found among the 3 conditions. Analysis of service utilization also showed no significant differences among conditions, with almost half of youths receiving some additional services in the 1st year after beginning treatment, and roughly one third of youths in the 2nd year. CONCLUSIONS: Overall, these results extend prior findings, supporting incremental benefits of MATCH over usual care over a 2-year period.

Effects of workshop trainings on evidence-based practice knowledge and attitudes among youth community mental health providers.

Enhancing the public health impact of evidence-based practices (EBPs) in usual care settings is a key priority of the National Institute of Mental Health. Longitudinal data from community mental health providers (N = 268) participating in a series of state-sponsored workshops in modular approaches to EBPs for youth are presented. EBP workshop attendance for youth anxiety resulted in increased knowledge for EBPs for anxiety (and not other conditions) and EBP workshop attendance for youth disruptive behaviors resulted in increased knowledge for EBPs for disruptive behaviors (and not other conditions). Providers' tendencies toward incorrectly classifying non-EBP therapies as evidence-based increased over time, suggesting that providers over-generalize the EBP label as a result of attending these types of workshops. Regarding EBP attitudes, most measures of attitudes improved when providers attended a workshop. Additionally, an overly inclusive view of what constitutes an EBP at intake was related to significant decreases in openness to trying EBPs over time, whereas more positive attitudes at intake was related to achieving a more refined view of what constitutes an EBP over the course of attending trainings. Study limitations and implications for implementation of EBPs in usual care settings are discussed.

Assessment of therapy practices in community treatment for children and adolescents.

OBJECTIVE: The Monthly Treatment and Progress Summary (MTPS) was developed to assess treatment techniques applied in clinical practice. This study examined the factor structure of the reported therapeutic practice elements on the MTPS and explored patterns in technique use based on client and therapist characteristics in a community mental health setting. METHODS: MTPS data from 278 lead therapists in Hawai'i's local system of care were extracted from the online state mental health information management system. Therapists' endorsements (yes-no) of each practice element were examined across 278 completed youth treatment episodes, and an exploratory factor analysis with varimax rotation was conducted on the categorical data set. RESULTS: Three factors emerged from the analyses: behavior management (behavioral interventions), coping and self-control (self-change practices), and family interventions (family supports). Treatment teams with licensed therapists reported higher use of coping and self-control practice elements, whereas teams with unlicensed therapists and paraprofessionals reported greater use of behavior management practice elements. Lead therapists reported that teams treating younger clients and those with attentional disorders were more likely to use behavior management practice elements, and teams treating youths with more severe impairment at intake utilized more behavior management and family intervention practice elements. CONCLUSIONS: Overall, the MTPS shows promise as a therapist report of practices. The finding that practice elements organized into theoretical patterns and were applied in expected ways suggests a thoughtful approach to usual care techniques. With the increased focus on health care reform and managed care, the MTPS can inform system monitoring, feedback, and improvement.

Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners.

Research in the dissemination of evidence-based practices (EBPs) suggests that practitioners' knowledge of and attitudes towards EBPs influence their decisions to adopt such practices. This study investigated the relationships between practitioner background variables and EBP knowledge and attitudes, as well as the relationship between knowledge and attitudes among public sector youth direct service providers (n = 240). Findings suggest that knowledge and attitudes relate to practitioners' most advanced degree, practice setting, and licensure status. Additionally, lack of knowledge in the form of EBP under-identification was related to negative attitudes. Findings are discussed as they relate to the dissemination of EBPs.

A psychometric analysis of the Revised Child Anxiety and Depression Scales--parent version in a school sample.

The Revised Child Anxiety and Depression Scale-Parent Version (RCADS-P) is a parent-report questionnaire of youth anxiety and depression with scales corresponding to the DSM diagnoses of separation anxiety disorder, social phobia, generalized anxiety disorder, panic disorder, obsessive-compulsive disorder, and major depressive disorder. The RCADS-P was recently developed and has previously demonstrated strong psychometric properties in a clinic-referred sample (Ebesutani et al., Journal of Abnormal Child Psychology 38, 249-260, 2010b). The present study examined the psychometric properties of the RCADS-P in a school-based population. As completed by parents of 967 children and adolescents, the RCADS-P demonstrated high internal consistency, test-retest reliability, and good convergent/divergent validity, supporting the RCADS-P as a measure of internalizing problems specific to depression and five anxiety disorders in school samples. Normative data are also reported to allow for the derivation of T-scores to enhance clinicians' ability to make classification decisions using RCADS-P subscale scores.

Concurrent Validity of the Child Behavior Checklist DSM-Oriented Scales: Correspondence with DSM Diagnoses and Comparison to Syndrome Scales.

This study used receiver operating characteristic (ROC) methodology and discriminative analyses to examine the correspondence of the Child Behavior Checklist (CBCL) rationally-derived DSM-oriented scales and empirically-derived syndrome scales with clinical diagnoses in a clinic-referred sample of children and adolescents (N = 476). Although results demonstrated that the CBCL Anxiety, Affective, Attention Deficit/Hyperactivity, Oppositional and Conduct Problems DSM-oriented scales corresponded significantly with related clinical diagnoses derived from parent-based structured interviews, these DSM-oriented scales did not evidence significantly greater correspondence with clinical diagnoses than the syndrome scales in all cases but one. The DSM-oriented Anxiety Problems scale was the only scale that evidenced significantly greater correspondence with diagnoses above its syndrome scale counterpart -the Anxious/Depressed scale. The recently developed and rationally-derived DSM-oriented scales thus generally do not add incremental clinical utility above that already afforded by the syndrome scales with respect to corresponding with diagnoses. Implications of these findings are discussed.

Longitudinal predictors of youth functional improvement in a public mental health system.

The present study examined youth characteristics that predict level of impairment at entry into a system of care and rate of improvement over the course of service provision. Youth characteristics studied included gender, age, specific diagnostic categories, and comorbidity. A total of 2,171 youth served in a state-wide public mental health system were included in the study. Hierarchical linear modeling was used to analyze longitudinal data derived from quarterly ratings of functional status. Gender had no relationship to initial level of impairment or rate of improvement. Older youth, those with disruptive behavior disorders, and those with more than one DSM diagnosis were more impaired at system entry. Those with attentional disorders began services less impaired. Older youth improved at faster rates. Youth with a disruptive behavior disorder diagnosis improved at slower rates. Neither comorbidity nor the presence of a mood or attentional disorder affected the rate of improvement. Both researchers and systems of care developers should consider these patterns in their future work.

Implementation of evidence-based services for youth: assessing provider knowledge.

Although provider knowledge is a potential barrier in the dissemination of evidence-based services for youth, research in this area is currently limited by a lack of instrumentation. The present study examined the utility of the Knowledge of Evidence-Based Services Questionnaire (KEBSQ), a 40-item self-report measure designed to assess reporter knowledge of evidence-based practices (EBPs) in the treatment of youth psychopathology. The KEBSQ items encompass practice elements identified in both empirically supported and unsupported protocols used in the treatment of four prevalent childhood problem areas: anxious/avoidant, depressed/withdrawn, disruptive behavior, and attention/hyperactivity. Findings from the present investigation lend support for the basic psychometric properties of the KEBSQ. Results supported temporal stability, discriminative validity, and sensitivity to training. Practical implications to the dissemination of EBPs, areas for future research, and limitations are discussed.

Common and unique factors associated with DSM-IV-TR internalizing disorders in children.

With the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association. Diagnostic and statistical manual of mental disorders DSM-IV Fourth Edition-Text Revision. Author, Washington, DC. 2000) ahead, decisions will be made about the future of taxonomic conceptualizations. This study examined the factor structure of items from three internalizing disorders (Social Phobia, Generalized Anxiety Disorder, and Depression) on the Anxiety Disorders Interview Schedule for DSM-IV-Child Version (Silverman, W. K., & Albano, A. M. Anxiety disorders interview schedule for children for DSM-IV, child and parent versions. Psychological Corporation, San Antonio, 1996). Two-, three-, and four-factor models emerged in an exploratory factor analysis. Confirmatory factor analysis provided additional empirical support for the four-factor model over the two- or three-factor models. Implications for the structure of the DSM-V taxonomy in children and adolescents are discussed.