Leading for the long haul: a mixed-method evaluation of the Sustainment Leadership Scale (SLS).

BACKGROUND: Despite our progress in understanding the organizational context for implementation and specifically the role of leadership in implementation, its role in sustainment has received little attention. This paper took a mixed-method approach to examine leadership during the sustainment phase of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Utilizing the Implementation Leadership Scale as a foundation, we sought to develop a short, practical measure of sustainment leadership that can be used for both applied and research purposes. METHODS: Data for this study were collected as a part of a larger mixed-method study of evidence-based intervention, SafeCare®, sustainment. Quantitative data were collected from 157 providers using web-based surveys. Confirmatory factor analysis was used to examine the factor structure of the Sustainment Leadership Scale (SLS). Qualitative data were collected from 95 providers who participated in one of 15 focus groups. A framework approach guided qualitative data analysis. Mixed-method integration was also utilized to examine convergence of quantitative and qualitative findings. RESULTS: Confirmatory factor analysis supported the a priori higher order factor structure of the SLS with subscales indicating a single higher order sustainment leadership factor. The SLS demonstrated excellent internal consistency reliability. Qualitative analyses offered support for the dimensions of sustainment leadership captured by the quantitative measure, in addition to uncovering a fifth possible factor, available leadership. CONCLUSIONS: This study found qualitative and quantitative support for the pragmatic SLS measure. The SLS can be used for assessing leadership of first-level leaders to understand how staff perceive leadership during sustainment and to suggest areas where leaders could direct more attention in order to increase the likelihood that EBIs are institutionalized into the normal functioning of the organization.

Research-Supported Intervention and Discretion Among Frontline Workers Implementing Home Visitation Services.

OBJECTIVE: We examine how frontline workers and supervisors delivering a research supported intervention (RSI) to reduce child neglect negotiated system-related challenges, the pragmatics of RSI implementation, and their professional identities and relationships with clients. METHODS: We conducted semi-structured interviews, small group discussions, and focus groups with frontline workers and supervisors in one large county over two time periods. We used iterative coding to analyze qualitative data. RESULTS: Frontline workers navigated several aspects of RSI implementation and sustainment: (1) contract requirements and information dissemination, (2) fidelity, (3) competing demands and crises, (4) structure versus creativity, and (5) relationships with clients. CONCLUSIONS: Workers dynamically negotiated multiple system- and provider-level (or outer- and inner-contextual) demands influencing RSI provision for clients with complex service needs. Results affirm the need to attend to the unintended consequences of implementing new contract, reimbursement, and other system organizational processes and to address the "committed work" supporting RSI delivery.

The Roles of System and Organizational Leadership in System-Wide Evidence-Based Intervention Sustainment: A Mixed-Method Study.

If evidence-based interventions (EBIs) are not sustained, investments are wasted and public health impact is limited. Leadership has been suggested as a key determinant of implementation and sustainment; however, little empirical work has examined this factor. This mixed-methods study framed using the Exploration, Preparation, Implementation, Sustainment (EPIS) conceptual framework examines leadership in both the outer service system context and inner organizational context in eleven system-wide implementations of the same EBI across two U.S. states and 87 counties. Quantitative data at the outer context (i.e., system) and inner context (i.e., team) levels demonstrated that leadership predicted future sustainment and differentiated between sites with full, partial, or no sustainment. In the outer context positive sustainment leadership was characterized as establishing a project's mission and vision, early and continued planning for sustainment, realistic project plans, and having alternative strategies for project survival. Inner context frontline transformational leadership predicted sustainment while passive-avoidant leadership predicted non-sustainment. Qualitative results found that sustainment was associated with outer context leadership characterized by engagement in ongoing supportive EBI championing, marketing to stakeholders; persevering in these activities; taking action to institutionalize the EBI with funding, contracting, and system improvement plans; and fostering ongoing collaboration between stakeholders at state and county, and community stakeholder levels. For frontline leadership the most important activities included championing the EBI and providing practical support for service providers. There was both convergence and expansion that identified unique contributions of the quantitative and qualitative methods. Greater attention to leadership in both the outer system and inner organizational contexts is warranted to enhance EBI implementation and sustainment.

Coaching mental health peer advocates for rural LGBTQ people.

Lesbian, gay, bisexual, transgender, and queer or questioning (LGBTQ) people are affected by mental health disparities, especially in rural communities. We trained peer advocates in rural areas in the fundamentals of mental health, outreach, education, and support for this population. The peer advocates were coached by licensed mental health professionals. We evaluated this process through iterative qualitative analysis of semi-structured interviews and written logs from coaches and advocates. The six major themes comprising the results centered on (1) coaching support, (2) peer advocate skills and preparation, (3) working with help seekers, (4) negotiating diversity, (5) logistical challenges in rural contexts, and (6) systemic challenges. We concluded that peer advocacy for LGBTQ people with mental distress offers an affirmative, community-based strategy to assist the underserved. To be successful, however, peer advocates will likely require ongoing training, coaching, and infrastructural support to negotiate contextual factors that can influence provision of community resources and support to LGBTQ people within rural communities.

STRUCTURAL INEQUALITY AND SOCIAL SUPPORT FOR WOMEN PRISONERS RELEASED TO RURAL COMMUNITIES.

Incarceration and community reentry for rural women reflect gendered processes. We draw upon in-depth semi-structured interviews and focus groups to examine the return of women prisoners to underserved rural communities, while attending to the perspectives of their closest social supporters. Our findings underscore the complexity of the reentry process for rural women and its particular impact on their families. We challenge dominant discourses of personal responsibility that detract from the structura violence and injustice shaping reentry experiences for women and their social supporters. We also consider the policy implications of discharge and reentry planning for rural women and their families, as well as strategies to reduce recidivism.

Contracting and Procurement for Evidence-Based Interventions in Public-Sector Human Services: A Case Study.

Sustainment of evidence-based interventions (EBIs) in human services depends on the inner context of community-based organizations (CBOs) that provide services and the outer context of their broader environment. Increasingly, public officials are experimenting with contracting models from for-profit industries to procure human services. In this case study, we conducted qualitative interviews with key government and CBO stakeholders to examine implementation of the Best Value-Performance Information Procurement System to contract for EBIs in a child welfare system. Findings suggest that stakeholder relationships may be compromised when procurement disregards local knowledge, communication, collaboration, and other factors supporting EBIs and public health initiatives.

The role of collaborations in sustaining an evidence-based intervention to reduce child neglect.

Child neglect is the most prevalent form of child maltreatment and represents 79.5% of open child-welfare cases. A recent study found the evidence-based intervention (EBI) SafeCare(®) (SC) to significantly reduce child neglect recidivism rates. To fully capitalize on the effectiveness of such EBIs, service systems must engage in successful implementation and sustainment; however, little is known regarding what factors influence EBI sustainment. Collaborations among stakeholders are suggested as a means for facilitating EBI implementation and sustainment. This study combines descriptive quantitative survey data with qualitative interview and focus group findings to examine the role of collaboration within the context of public-private partnerships in 11 child welfare systems implementing SC. Participants included administrators of government child welfare systems and community-based organizations, as well as supervisors, coaches, and home visitors of the SC program. Sites were classified as fully-, partially-, and non-sustaining based on implementation fidelity. One-way analysis of variance was used to examine differences in stakeholder reported Effective Collaboration scores across fully-sustaining, partially-sustaining, and non-sustaining sites. Qualitative transcripts were analyzed via open and focused coding to identify the commonality, diversity, and complexity of collaborations involved in implementing and sustaining SC. Fully-sustaining sites reported significantly greater levels of effective collaboration than non-sustaining sites. Key themes described by SC stakeholders included shared vision, building on existing relationships, academic support, problem solving and resource sharing, and maintaining collaborations over time. Both quantitative and qualitative results converge in highlighting the importance of effective collaboration in EBI sustainment in child welfare service systems.