A Longitudinal Analysis of Trajectories and Predictors of Fidelity Using the SafeCare Parenting Model.

Evidence-based practice (EBP) fidelity, understood as the extent to which a program is implemented as the developers intended, is a key implementation variable which likely relates to consumer outcomes. However, studies that track fidelity longitudinally and at large scale are uncommon, and finding reliable predictors of fidelity has proven to be a complex challenge. Further, attitudes toward EBP are a potentially important predictor of fidelity, but results across the literature have been mixed. The purpose of the present study is to use data from the ongoing implementation and dissemination of the SafeCare model to better understand (1) the characteristics of SafeCare implementation fidelity trajectories, and (2) whether individual level factors predict differences in fidelity and fidelity trajectories, especially provider attitudes toward EBP. The analyses reported here include 14,778 observed fidelity sessions by 868 providers in 172 agencies. We use multilevel modeling to examine fidelity, fidelity trajectories over time, and several potential individual-level predictors of fidelity, including demographics, work history, and attitudes toward EBP. We found: (1) that SafeCare fidelity begins high at baseline (93.85% on average); (2) that SafeCare fidelity displays a statistically significant trend of positive linear growth, even among those with less positive attitudes; and (3) that positive attitudes are associated with slightly higher fidelity on average and at baseline, while negative attitudes are associated with slightly lower fidelity on average and at baseline. To our knowledge, this is the largest longitudinal analysis of EBP fidelity in a child welfare program to date, and our findings support the notion that intensive coaching supports which are titrated over time can be sufficient to ensure sustained high fidelity, at least in some cases. Further, these findings indicate that robust training and coaching processes can ensure high fidelity and fidelity growth even among providers with less positive attitudes toward EBP.

Psychologists’ Attitudes Toward EvidenceBased Practices: An Online Study with Child Mental Health Psychologists / Las Actitudes de los Psicólogos Hacia las Prácticas Basadas en la Evidencia (PBE)

Psychologists’ attitudes towards Evidence-Based Practices (EBPs) may have an impact in adhering to such practices. The purpose of this study was to analyse the psychometric characteristics of the Portuguese version of the Evidence Based Practice Attitude Scale (EBPAS) (Aarons, 2004). This study also aims to characterize the attitudes of psychologists working in the field of child mental health and analyze the differences in these attitudes according to therapeutic approaches and professional experience. A sample of 71 (93% female) Portuguese psychologists (age M = 37.07, SD = 10.68) completed an online assessment protocol that included the EBPAS and a questionnaire assessing sociodemographic information, therapeutic approaches, and professional experience. The results support the construct validity and reliability of the measure. Portuguese psychologists seem to have more favorable attitudes towards EBPs compared to samples from other countries. When evaluating the differences in these attitudes considering the different variables, the results indicate that psychologists adopting a Cognitive-Behavioral orientation and with less years of professional experience show more favorable attitudes towards EBPs. This research contributes to a wider understanding about the factors that may influence psychologists’ attitudes towards EBPs and thus allow for more effective dissemination and implementation efforts. (AU)

Las actitudes de los psicólogos hacia las Prácticas Basadas en la Evidencia (PBE) pueden tener un impacto en la adhesión a dichas prácticas. El propósito de este estudio fue analizar las características psicométricas de la versión portuguesa de la Escala de Actitudes hacia las Prácticas Basadas en la Evidencia (EBPAS) (Aarons, 2004). Este estudio también pretende caracterizar las actitudes de los psicólogos que trabajan en el área de la salud mental infantil y analizar las diferencias en estas actitudes según los enfoques terapéuticos y la experiencia profesional. Una muestra de 71 (93% mujeres) psicólogos portugueses (edad M = 37.07, DP = 10.68) completaron una evaluación online, incluyendo un cuestionario para recoger información relacionada con las características socio-demográficas del psicólogo, su formación académica y experiencia profesional y el EBPAS. Los resultados apoyan la validez de constructo y la fiabilidad de la medida. Los psicólogos portugueses parecen revelar actitudes más favorables hacia los EBP en comparación con las muestras de otros países. Al evaluar las diferencias en estas actitudes considerando las diferentes variables, los resultados indican que los psicólogos que adoptan una orientación cognitivo-conductual y con menos años de experiencia profesional muestran actitudes más favorables hacia las PBE. Esta investigación contribuye a un mayor conocimiento de las variables que pueden influir en las actitudes de los psicólogos hacia las PBE y, por tanto, permite realizar esfuerzos de difusión e implementación más eficaces. (AU)

Teacher attitudes toward evidence-based practices: Exploratory and confirmatory analyses of the school-adapted evidence-based practice attitude scale.

Background: The Evidence-Based Practice Attitudes Scale (EBPAS) is widely used in implementation research, but it has not been adapted and validated for use among general education teachers, who are most likely to deliver evidence-based prevention programs in schools, the most common setting where youth access social, emotional, and behavioral health services. Method: School-based stakeholders and a research team comprised of experts in the implementation of evidence-based practices in schools adapted the EBPAS for teachers (the S-EBPAS). The adapted instrument was administered to a representative sample (n = 441) of general education teachers (grades K-5) to assess the reliability and internal consistency via factor analyses. The S-EBPAS included two forms (i.e., EBP-agnostic and EBP-specific item referents), therefore, a multiple-group confirmatory factor analysis (CFA) was also performed to establish measurement invariance between the two forms. Results: After adaptation and refinement, a 9-item, 3-factor structure was confirmed, with the final model supporting three first-order factors that load onto a second-order factor capturing attitudes toward adopting evidence-based practices. Multiple-group CFA analyses of measurement invariance indicated there were no significant differences between the two forms. Conclusions: Overall, this study provides a brief, flexible instrument capturing attitudes toward adopting EBPs that has high reliability and internal consistency, which support its use among general education teachers in school settings implementing evidence-based practices. Plain Language Summary: The Evidence-Based Practice Attitudes Scale (EBPAS) is a popular instrument for measuring attitudes toward evidence-based practices (EBPs). This instrument provides valuable information during implementation initiatives, such as whether providers or front-line implementers have favorable attitudes toward a given practice. The EBPAS has been used in many different settings, such as in community-based mental health clinics, medical hospitals, and in child welfare. However, it's use in schools has been limited, and it has not yet been tested with general education teachers, who are key implementers of evidence-based practices in schools. In order to trust that the scores from an instrument are accurate, it needs to be evaluated when scaling it out to new populations and settings. One popular method to determine this is to use factor analysis, which was employed in this study. This study fills the identified gap by assessing the reliability (i.e., accuracy) and internal consistency of the EBPAS among a representative sample of general education teachers. Findings from this study indicate that the school-adapted EBPAS (S-EBPAS) is a brief, nine-item instrument that provides a reliable estimate of teachers' attitudes toward evidence-based practices. Our results also provide evidence that the S-EBPAS can be used to capture attitudes toward specific EBPs as well as attitudes toward EBP-agnostic. This study provides a flexible instrument that can be used by school-based implementation researchers, practitioners, and intermediaries at multiple phases of implementation projects, such as when exploring a new EBP to adopt.

Individual and organizational factors as predictors of early evidence-based practice adoption in Michigan high schools: Baseline data from an implementation trial.

Background: Adolescents increasingly access mental health services in schools. School mental health professionals (SPs; school counselors, social workers, etc.) can offer evidence-based mental health practices (EBPs) in schools, which may address access gaps and improve clinical outcomes. Although some studies have assessed factors associated with EBP adoption in schools, additional research focusing on SP- and school-level factors is warranted to support EBP implementation as SPs' mental health delivery grows. Methods: Baseline data were collected from SPs at Michigan high schools participating in a statewide trial to implement SP-delivered cognitive behavioral therapy (CBT) to students. Models examined factors associated with attitudes about EBPs, implementation climate, and implementation leadership, and their associations with CBT knowledge, training attendance, and pre-training CBT delivery. Results: One hundred ninety-eight SPs at 107 schools (87%) completed a baseline survey. The mean Evidence-Based Practice Attitude Scale (EBPAS) total score was 2.9, and school-aggregated mean scores of the Implementation Climate Scale (ICS) and Implementation Leadership Scale (ILS) were 1.83 and 1.77, respectively, all on a scale ranging from 0 (low) to 4 (high). ICS and ILS scores were lower than typically reported in clinical settings, while EBPAS scores were higher. School characteristics were not significantly associated with EBPAS, ICS, or ILS scores, but scores did differ by SP role. Higher EBPAS scores were associated with more CBT knowledge (average marginal effect for 1 SD change [AME] = 0.15 points) and a higher probability of training completion (AME = 8 percentage points). Higher ICS scores were associated with a higher probability of pre-training CBT delivery (AME = 6 percentage points), and higher ILS scores were associated with higher probability of training completion (AME = 10 percentage points). Conclusions: Our findings suggest that SPs' attitudes toward EBPs and organizational support were positively associated with early signs of implementation success. As schools increasingly fill the adolescent mental healthcare access gap, efforts to strengthen both provider attitudes toward EBP and strategic organizational factors supporting EBP delivery will be key to encouraging EBP uptake in schools. Plain Language Summary: Schools are an important setting in which adolescents receive mental healthcare. We need to better understand how to implement evidence-based practices (EBPs) in this setting to improve student mental health. This study examined the attitudes and perceptions of school professionals (SPs) as key contributors to the implementation of a particular EBP, the delivery of cognitive behavioral therapy (CBT) in schools. The study found that implementation climate and leadership scores in participating schools were lower than scores typically reported in clinical settings, while scores for SP attitudes about EBP adoption were higher than typical scores in clinical settings. Results further suggest that SPs with more positive attitudes toward EBPs are more knowledgeable of CBT and more likely to complete a 1-day CBT training. We also found that higher implementation climate scores were associated with SPs reporting pre-training CBT delivery (although this association was not statistically significant), and more implementation leadership was associated with SPs completing the CBT training. These findings suggest that SP attitudes toward EBPs and organizational support in schools are positively associated with early signs of implementation success. Early, low-intensity efforts to (1) improve SP attitudes about mental health EBPs, and (2) increase schools' support for implementation may scaffold more intensive implementation efforts in schools down the road.

Translation and validation of the evidence-based practice attitude scale (EBPAS-15) to Brazilian Portuguese: Examining providers' perspective about evidence-based parent intervention.

Background: Few existing evidence-based parent interventions (EBPIs) for prevention and treatment of child and youth mental health disorders are implemented in low-middle-income countries. This study aimed to translate and confirm the factor structure of the Evidence-Based Practice Attitude Scale (EBPAS-15) survey in Brazilian Portuguese with the goal of examining providers' perspective about EBPIs. Methods: We translated and back translated the EBPAS-15 from English to Brazilian Portuguese. Participants were recruited via snowball sampling and data were collected using an online survey from July of 2018 through January of 2020. A confirmatory factor analysis was conducted to determine if the scale retained its original structure. Open-ended questions about providers' perspectives of their own clinical practice were coded using the Theoretical Domains Framework (TDF). Analyses included data from 362 clinicians (318 women, 41 men) from 20 of the 27 states of Brazil. Participants on average were 26.7 years old, held specialist degrees in the field of psychology, actively worked as therapists, and practiced in private clinics. Results: The translation of the EBPAS to Brazilian Portuguese retained the same four-factor structure as the English version except for dropping one item from the Divergence domain. When asked about the challenges in their practices, providers generally referred to parents as clients with little skills to discipline their children and lacking knowledge about child development. Discussion: The Brazilian version of the EBPAS-15 is promising, but future research should consider using quantitative data alongside qualitative information to better understand providers' attitudes about evidence-based interventions to inform implementation efforts. Trial registration: N/A.

Norwegian Social Work and Child Welfare Students' Attitudes Toward Research-Supported Treatments.

Purpose: Evidence-based practice (EBP) has increasingly become a part of social work education, but there is a lack of knowledge about students' attitudes toward it. This study evaluated Norwegian social work students' attitudes toward research-supported treatments (RSTs).Method: Attitudes were measured with the Evidence-Based Practice Attitude Scale-36 (EBPAS-36), a validated measure including 12 subscales.Results: The findings suggest that master's students are more positive toward RSTs compared to bachelor's students. Having less educational training in EBP was associated with more skepticism toward the concept, suggesting that educational training in EBP contributes to facilitating a positive attitude toward RSTs.Discussion: These findings indicate a need to emphasize EBP in social work education. To enable EBP engagement in practice, we argue that emphasis should be put on teaching students to critically appraise research.

Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale (EBPAS) in a large and representative Swedish sample: is the use of the total scale and subscale scores justified?

BACKGROUND: There is a call for valid and reliable instruments to evaluate implementation of evidence-based practices (EBP). The 15-item Evidence-Based Practice Attitude Scale (EBPAS) measures attitude toward EBP, incorporating four lower-order factor subscales (Appeal, Requirements, Openness, and Divergence) and a Total scale (General Attitudes). It is one of a few measures of EBP attitudes evaluated for its psychometric properties. The reliability of the Total scale has been repeatedly supported, but also the multidimensionality of the inventory. However, whether all of the items contribute to the EBPAS Total beyond their subscales has yet to be demonstrated. In addition, the Divergence subscale has been questioned because of its low correlation with the other subscales and low inter-item correlations. The EBPAS is widely used to tailor and evaluate implementation efforts, but a Swedish version has not yet been validated. This study aimed to contribute to the development and cross-validation of the EBPAS by examining the factor structure of t a Swedish-language version in a large sample of mental health professionals. METHODS: The EBPAS was translated into Swedish and completed by 570 mental health professionals working in child and adolescent psychiatry settings spread across Sweden. The factor structure was examined using first-order, second-order and bifactor confirmatory factor analytic (CFA) models. RESULTS: Results suggested adequate fit for all CFA models. The EBPAS Total was strongly supported in the Swedish version. Support for the hierarchical second-order model was also strong, while the bifactor model gave mixed support for the subscales. The Openness and Requirements subscales came out best, while there were problems with both the Appeal (e.g. not different from the General Attitudes factor) and the Divergence subscales (e.g. low reliability). CONCLUSIONS: Overall, the psychometric properties were on par with the English version and the total score appears to be a valid measure of general attitudes towards EBP. This is the first study supporting this General Attitudes factor based on a bifactor model. Although comparatively better supported in this Swedish sample, we conclude that the use of the EBPAS subscale scores may result in misleading conclusions. Practical implications and future directions are discussed.

Attitudes Towards the Use of Routine Outcome Monitoring of Psychological Therapies Among Mental Health Providers: The EBPAS-ROM.

Implementation of routine outcome monitoring (ROM) in mental health care is progressing slowly. Knowledge about factors influencing ROM implementation, including health providers' attitudes towards ROM, is necessary. Based on a survey of 662 psychologists and nurses, this article describes (1) the development of a short instrument measuring provider attitudes towards ROM, derived from the Evidence-based Practice Attitude Scale (EBPAS), and (2) how attitudinal domains relate to clinicians' current use of standardized instruments for treatment evaluation. The EBPAS-ROM showed concurrent validity in predicting aspects important for the implementation of ROM, including perceived limitations and the value of organizational support.

A National Study of American Indian and Alaska Native Substance Abuse Treatment: Provider and Program Characteristics.

American Indians and Alaska Natives (AIANs) experience major disparities in accessing quality care for mental health and substance use disorders. There are long-standing concerns about access to and quality of care for AIANs in rural and urban areas including the influence of staff and organizational factors, and attitudes toward evidence-based treatment for addiction. We conducted the first national survey of programs serving AIAN communities and examined workforce and programmatic differences between clinics located in urban/suburban (n=50) and rural (n=142) communities. We explored the correlates of openness toward using evidence-based treatments (EBTs). Programs located in rural areas were significantly less likely to have nurses, traditional healing consultants, or ceremonial providers on staff, to consult outside evaluators, to use strategic planning to improve program quality, to offer pharmacotherapies, pipe ceremonies, and cultural activities among their services, and to participate in research or program evaluation studies. They were significantly more likely to employ elders among their traditional healers, offer AA-open group recovery services, and collect data on treatment outcomes. Greater openness toward EBTs was related to a larger clinical staff, having addiction providers, being led by directors who perceived a gap in access to EBTs, and working with key stakeholders to improve access to services. Programs that provided early intervention services (American Society of Addiction Medicine level 0.5) reported less openness. This research provides baseline workforce and program level data that can be used to better understand changes in access and quality for AIAN over time.

Refining the Evidence-Based Practice Attitude Scale: An Alternative Confirmatory Factor Analysis.

Barriers to adopting evidence-based practices into real-world mental health organizations have received considerable attention and study. One particular attempt is Aarons's Evidence-Based Practice Attitude Scale (EBPAS), which measures a worker's attitudes toward adopting new treatments, interventions, and practices. This study follows Aarons's work by conducting a confirmatory factor analysis of the EBPAS administered in a large child and family human service agency in New York state (N = 1,273). Replicating Aarons et al.'s four-factor model of the EBPAS, the authors found that, within the model, the pattern of factor loadings that was apparent in previous investigations held for their data as well. That is, the factor loadings of items within the Divergence subscale were larger for items 5 and 7 and smaller for items 3 and 6. The authors found that both of their alternative models, one that added a residual covariance to items in the Divergence factor and a five-factor model that divided the Divergence factor into two factors, fit their data better than Aarons et al.'s model. They also investigated measurement and structural invariance for workers in community-based and in residential programs using a multiple group analysis. Measurement invariance was supported but factor means and correlations differed.