ABSTRACT
INTRODUCTION: Translating complex behavior change interventions into practice can be accompanied by a loss of fidelity and effectiveness. We present the evaluation of two sequential phases of implementation of a complex evidence-based community workshop to reduce falls, using the Replicating Effective Programs Framework. Between the two phases, workshop training and delivery were revised to improve fidelity with key elements. METHODS: Stepping On program participants completed a questionnaire at baseline (phase 1: n = 361; phase 2: n = 2219) and 6 months post-workshop (phase 1: n = 232; phase 2: n = 1281). Phase 2 participants had an additional follow-up at 12 months (n = 883). Outcomes were the number of falls in the prior 6 months and the Falls Behavioral Scale (FaB) score. RESULTS: Workshop participation in phase 1 was associated with a 6% reduction in falls (RR = 0.94, 95% CI 0.74-1.20) and a 0.14 improvement in FaB score (95% CI, 0.11- 0.18) at 6 months. Workshop participation in phase 2 was associated with a 38% reduction in falls (RR = 0.62, 95% CI 0.57-0.68) and a 0.16 improvement in FaB score (95% CI 0.14-0.18) at 6 months, and a 28% reduction in falls (RR = 0.72, 95% CI 0.65-0.80) and a 0.19 score improvement in FaB score (95% CI 0.17-0.21) at 12-month follow-up. CONCLUSIONS: Effectiveness can be maintained with widespread dissemination of a complex behavior change intervention if attention is paid to fidelity of key elements. An essential role for implementation science is to ensure effectiveness as programs transition from research to practice.
ABSTRACT
Falls among older adults result in substantial morbidity and mortality. Community-based programs have been shown to decrease the rate of falls. In 2007, the Centers for Disease Control and Prevention funded a research study to determine how to successfully disseminate the evidence-based fall prevention program (Stepping On) in the community setting. As the first step for this study, a panel of subject matter experts was convened to suggest which parts of the Stepping On fall prevention program were considered key elements, which could not be modified by implementers. METHODS: Older adult fall prevention experts from the US, Canada, and Australia participated in a modified Delphi technique process to suggest key program elements of Stepping On. Forty-four experts were invited to ensure that the panel of experts would consist of equal numbers of physical therapists, occupational therapists, geriatricians, exercise scientists, and public health researchers. Consensus was determined by percent of agreement among panelists. A Rasch analysis of item fit was conducted to explore the degree of diversity and/or homogeneity of responses across our panelists. RESULTS: The Rasch analysis of the 19 panelists using fit statistics shows there was a reasonable and sufficient range of diverse perspectives (Infit MnSQ 1.01, Z score -0.1, Outfit MnSQ 0.96, Z score -0.2 with a separation of 4.89). Consensus was achieved that these elements were key: 17 of 18 adult learning elements, 11 of 22 programming, 12 of 15 exercise, 7 of 8 upgrading exercises, 2 of 4 peer co-leader's role, and all of the home visits, booster sessions, group leader's role, and background and training of group leader elements. The top five key elements were: (1) use plain language, (2) develop trust, (3) engage people in what is meaningful and contextual for them, (4) train participants for cues in self-monitoring quality of exercises, and (5) group leader learns about exercises and understands how to progress them. DISCUSSION: The Delphi consensus process suggested key elements related to Stepping On program delivery. These elements were considered essential to program effectiveness. Findings from this study laid the foundation for translation of Stepping On for broad US dissemination.
ABSTRACT
BACKGROUND: Fidelity monitoring is essential with implementation of complex health interventions, but there is little description of how to use results of fidelity monitoring to improve the draft program package prior to widespread dissemination. Root cause analysis (RCA) provides a systematic approach to identifying underlying causes and devising solutions to prevent errors in complex processes. Its use has not been described in implementation science. METHODS: Stepping On (SO) is a small group, community-based intervention that has been shown to reduce falls by 31%. To prepare SO for widespread U.S. dissemination, we conducted a pilot of the draft program package, monitoring the seven SO sessions for fidelity of program delivery and assessing participant receipt and enactment through participant interviews after the workshop. Lapses to fidelity in program delivery, receipt, and enactment were identified. We performed a RCA to identify underlying causes of, and solutions to, such lapses, with the goal of preventing fidelity lapses with widespread dissemination. RESULTS: Lapses to fidelity in program delivery were in the domains of group leader's role, use of adult learning principles, and introducing and upgrading the exercises. Lapses in fidelity of participant receipt and enactment included lack of knowledge about balance exercises and reduced adherence to frequency of exercise practice and advancement of exercise. Root causes related to leader training and background, site characteristics and capacity, and participant frailty and expectations prior to starting the program. The RCA resulted in changes to the program manual, the training program, and training manual for new leaders, and to the methods for and criteria for participant and leader recruitment. A Site Implementation Guide was created to provide information to sites interested in the program. CONCLUSION: Disseminating complex interventions can be done more smoothly by first using a systematic quality improvement technique, such as the RCA, to identify how lapses in fidelity occur during the earliest stages of implementation. This technique can also help bring about solutions to these lapses of fidelity prior to widespread dissemination across multiple domain lapses.
ABSTRACT
OBJECTIVES: To decrease the rate of falls in high-risk community-dwelling older adults. DESIGN: Randomized, controlled trial. SETTING: Community-based. PARTICIPANTS: Three hundred forty-nine adults aged 65 and older with two falls in the previous year or one fall in the previous 2 years with injury or balance problems. INTERVENTION: Subjects received two in-home visits from a trained nurse or physical therapist who assessed falls risk factors using an algorithm. The intervention consisted of recommendations to the subject and their primary physician, referrals to physical therapy and other providers, 11 monthly telephone calls, and a balance exercise plan. Control subjects received a home safety assessment. MEASUREMENTS: The primary outcome was rate of falls per year in the community. Secondary outcomes included all-cause hospitalizations and nursing home admissions per year. RESULTS: There was no difference in rate of falls between the intervention and control groups (rate ratio (RR)=0.81, P=.27). Nursing home days were fewer in the intervention group (10.3 vs 20.5 days, P=.04). Intervention subjects with a Mini-Mental State Examination (MMSE) score of 27 or less had a lower rate of falls (RR=0.55; P=.05) and, if they lived with someone, had fewer hospitalizations (RR=0.44, P=.05), nursing home admissions (RR=0.15, P=.003), and nursing home days (7.5 vs 58.2, P=.008). CONCLUSION: This multifactorial intervention did not decrease falls in at-risk community-living adults but did decrease nursing home utilization. There was evidence of efficacy in the subgroup who had an MMSE score of 27 or less and lived with a caregiver, but validation is required.
