Telling the story of complex change: an Impact Framework for the real world.

BACKGROUND: In the National Health Service (NHS) in England, traditional approaches to evidencing impact and value have an important role to play but are unlikely to demonstrate the full value of national quality improvement programmes and large-scale change initiatives in health and care. This type of work almost always takes place in complex and complicated settings, in that it involves multiple players, numerous interventions and a host of other confounding factors. Improvement work is usually emergent, with cause and effect only understood in hindsight; challenges around contribution and attribution can lead the key players to question how they can be certain that the described or observed changes are due to their intervention and would not have happened without them. In this complex environment, there is a risk of oversimplifying the observed impact and focusing instead on those things that are easier to measure, missing that which is important but more difficult to evidence. METHODS: Between 2016 and 2019, an action-orientated approach, drawing on realist and development evaluation approaches, was taken to designing and testing the Impact Framework. First, we undertook a pragmatic review of tools and approaches used by others to capture and demonstrate their impact both within and outside the health and care environment. Following the identification and review of these tools and approaches, and in consultation with national improvement teams in England about their evaluation challenges and aspirations, we developed a set of underpinning principles to inform the design and build of the framework. The principles were informed and finessed following conversations with improvement teams and programme leads in NHS England with respect to the challenges that they were facing and their aspirations in terms of demonstrating their impact and learning as they worked. RESULTS: The 'Impact Framework' described in this article offers a practical approach to capturing the impact of improvement work at any scale, taking account of unintended outcomes, considering attribution and contribution, and using a narrative approach to uncover the difference made by improvement initiatives in rich detail. In this article, we describe how the Impact Framework has been used with one of NHS England's national programmes, Time for Care, which was delivered between 2016 and 2020. CONCLUSIONS: The Impact Framework continues to be used, developed and further tested by national improvement programmes being delivered by NHS England and NHS Improvement and is updated regularly. The framework has been developed to be accessible to frontline teams and is supported by a set of resources to help improvement teams and individuals to use by themselves (https://www.england.nhs.uk/sustainableimprovement/impact-framework/).

Direct Care Worker Training to Respond to the Behavior of Individuals With Dementia: The CARES® Dementia-Related Behavior™ Online Program.

Only a handful of online training programs are available for direct care workers (DCWs) to acquire the strategic skills needed to improve dementia care in instances of challenging or inappropriate behavior. Utilizing pre- and post-test data from a convenience sample of 40 DCWs, the present study sought to determine (a) whether DCWs' knowledge of responding to dementia-related behavior increased following participation in the CARES® Dementia-Related Behavior™ Online Training Program (or CARES® Behavior) and (b) if CARES® Behavior was acceptable and useful. The average number of correct scores on a dementia care knowledge measure was significantly higher among DCWs after viewing the online modules when compared with pre-test scores (p < .01). Descriptive empirical and open-ended data also suggested that the interactive, "real-world" content of CARES® Behavior was feasibly delivered online, acceptable, and may influence how DCWs deliver clinical care to individuals with dementia-related behavior.

CARES(®) Dementia Care for Families™: Effects of Online, Psychoeducational Training on Knowledge of Person-Centered Care and Satisfaction.

Challenges to intervention use among family caregivers of individuals with dementia include availability and timing of delivery. The current study sought to determine whether an online, psychoeducational intervention for dementia family caregivers, CARES(®) Dementia Care for Families™ (CARES for Families), improved and enhanced dementia caregivers' knowledge of person-centered care approaches. Forty-one family members completed pre- and posttest surveys that assessed improvement in dementia care knowledge, and multiple close- and open-ended items examined how the CARES for Families online modules benefited users at posttest. A paired t test demonstrated a significant and considerable increase in dementia care knowledge among family caregivers (p < 0.001); caregivers also indicated that CARES for Families' content, flexibility, and use of actual family caregivers and individuals with dementia in video care vignettes were strengths. The findings suggest that CARES for Families can offer an efficient supplement to holistic dementia care that gerontological nurses provide.

The Memory Club: Providing support to persons with early-stage dementia and their care partners.

There is a growing emphasis on delivering services for persons with early-stage dementia (ie, ''persons with memory loss,'' or PWMLs) and their family members (care partners). The goal of this evaluation was to determine whether participation in the Memory Club, a 10- to 13-session joint support group, would result in decreased distress, enhanced preparation for care, and improved feelings of confidence managing the challenges of early-stage dementia. The single group, pre-/post-test evaluation included 63 PWMLs and 61 care partners who participated in three Memory Club sites in Minnesota. Paired T-test results found that care partners reported significant (P < .05) increases in preparation activities, feelings of preparation, and confidence in managing memory loss. The results suggest that the Memory Club can fill an important gap in early-stage dementia care by offering care partners the opportunity to plan, prepare, and increase coping skills in the face of early dementia progression.