A systematic review of experimentally tested implementation strategies across health and human service settings: evidence from 2010-2022.

BACKGROUND: Studies of implementation strategies range in rigor, design, and evaluated outcomes, presenting interpretation challenges for practitioners and researchers. This systematic review aimed to describe the body of research evidence testing implementation strategies across diverse settings and domains, using the Expert Recommendations for Implementing Change (ERIC) taxonomy to classify strategies and the Reach Effectiveness Adoption Implementation and Maintenance (RE-AIM) framework to classify outcomes. METHODS: We conducted a systematic review of studies examining implementation strategies from 2010-2022 and registered with PROSPERO (CRD42021235592). We searched databases using terms "implementation strategy", "intervention", "bundle", "support", and their variants. We also solicited study recommendations from implementation science experts and mined existing systematic reviews. We included studies that quantitatively assessed the impact of at least one implementation strategy to improve health or health care using an outcome that could be mapped to the five evaluation dimensions of RE-AIM. Only studies meeting prespecified methodologic standards were included. We described the characteristics of studies and frequency of implementation strategy use across study arms. We also examined common strategy pairings and cooccurrence with significant outcomes. FINDINGS: Our search resulted in 16,605 studies; 129 met inclusion criteria. Studies tested an average of 6.73 strategies (0-20 range). The most assessed outcomes were Effectiveness (n=82; 64%) and Implementation (n=73; 56%). The implementation strategies most frequently occurring in the experimental arm were Distribute Educational Materials (n=99), Conduct Educational Meetings (n=96), Audit and Provide Feedback (n=76), and External Facilitation (n=59). These strategies were often used in combination. Nineteen implementation strategies were frequently tested and associated with significantly improved outcomes. However, many strategies were not tested sufficiently to draw conclusions. CONCLUSION: This review of 129 methodologically rigorous studies built upon prior implementation science data syntheses to identify implementation strategies that had been experimentally tested and summarized their impact on outcomes across diverse outcomes and clinical settings. We present recommendations for improving future similar efforts.

Leveraging Implementation Science to Advance Environmental Justice Research and Achieve Health Equity through Neighborhood and Policy Interventions.

Environmental justice research is increasingly focused on community-engaged, participatory investigations that test interventions to improve health. Such research is primed for the use of implementation science-informed approaches to optimize the uptake and use of interventions proven to be effective. This review identifies synergies between implementation science and environmental justice with the goal of advancing both disciplines. Specifically, the article synthesizes the literature on neighborhood-, community-, and policy-level interventions in environmental health that address underlying structural determinants (e.g., structural racism) and social determinants of health. Opportunities to facilitate and scale the equitable implementation of evidence-based environmental health interventions are highlighted, using urban greening as an illustrative example. An environmental justice-focused version of the implementation science subway is provided, which highlights these principles: Remember and Reflect, Restore and Reclaim, and Reinvest. The review concludes with existing gaps and future directions to advance the science of implementation to promote environmental justice.

Study protocol: Type III hybrid effectiveness-implementation study implementing Age-Friendly evidence-based practices in the VA to improve outcomes in older adults.

BACKGROUND: Unmet care needs among older adults accelerate cognitive and functional decline and increase medical harms, leading to poorer quality of life, more frequent hospitalizations, and premature nursing home admission. The Department of Veterans Affairs (VA) is invested in becoming an "Age-Friendly Health System" to better address four tenets associated with reduced harm and improved outcomes among the 4 million Veterans aged 65 and over receiving VA care. These four tenets focus on "4Ms" that are fundamental to the care of older adults, including (1) what Matters (ensuring that care is consistent with each person's goals and preferences); (2) Medications (only using necessary medications and ensuring that they do not interfere with what matters, mobility, or mentation); (3) Mentation (preventing, identifying, treating, and managing dementia, depression, and delirium); and (4) Mobility (promoting safe movement to maintain function and independence). The Safer Aging through Geriatrics-Informed Evidence-Based Practices (SAGE) Quality Enhancement Research Initiative (QUERI) seeks to implement four evidence-based practices (EBPs) that have shown efficacy in addressing these core tenets of an "Age-Friendly Health System," leading to reduced harm and improved outcomes in older adults. METHODS: We will implement four EBPs in 9 VA medical centers and associated outpatient clinics using a type III hybrid effectiveness-implementation stepped-wedge trial design. We selected four EBPs that align with Age-Friendly Health System principles: Surgical Pause, EMPOWER (Eliminating Medications Through Patient Ownership of End Results), TAP (Tailored Activities Program), and CAPABLE (Community Aging in Place - Advancing Better Living for Elders). Guided by the Pragmatic Robust Implementation and Sustainability Model (PRISM), we are comparing implementation as usual vs. active facilitation. Reach is our primary implementation outcome, while "facility-free days" is our primary effectiveness outcome across evidence-based practice interventions. DISCUSSION: To our knowledge, this is the first large-scale randomized effort to implement "Age-Friendly" aligned evidence-based practices. Understanding the barriers and facilitators to implementing these evidence-based practices is essential to successfully help shift current healthcare systems to become Age-Friendly. Effective implementation of this project will improve the care and outcomes of older Veterans and help them age safely within their communities. TRIAL REGISTRATION: Registered 05 May 2021, at ISRCTN #60,657,985. REPORTING GUIDELINES: Standards for Reporting Implementation Studies (see attached).

Quantifying implementation strategy and dissemination channel preferences and experiences for pain management in primary care: a novel implementer-reported outcome.

BACKGROUND: Precision implementation science requires methods to evaluate and select implementation strategies. This study developed and evaluated a novel measure of concordance between current and preferred dissemination channels (DC) and implementation strategies (IS) to guide efforts to improve the adoption of evidence-based management strategies for chronic pain. METHODS: We conducted a one-time electronic survey of Pennsylvania primary care practitioners (PCPs) about current vs. preferred chronic pain management DC and IS use. Survey items were selected based on preliminary data, the Model for Dissemination of Research, and the Evidence-Based Recommendations for Implementing Change taxonomy of implementation strategies. We used Cohen's kappa (κ) to assess the agreement between participant-level current and preferred DC/IS. We calculated % preferred minus % experienced for each DC/IS and assessed the equality of proportions to determine whether this difference significantly departed from zero. We categorized DC and IS based on the degree of use and preference, to evaluate alignment. RESULTS: The current sample included 101 Pennsylvania PCPs primarily in urban (94.06%), non-academic (90.10%) settings who self-identified as mostly female (66.34%) and white (85.15%). The greatest difference between preferred and experienced DCs, or "need," was identified by participants as workshops, clinical experts, seminars, and researchers. Similarly, participants reported the greatest IS gaps as multidisciplinary chronic pain workgroups, targeted support for clinicians, and a chronic pain clinical champion. Participating PCPs had moderate DC concordance (kappa = 0.45, 95% CI = 0.38-0.52) and low IS concordance (kappa = 0.18, 95% CI = 0.13-0.23). DC and IS concordance were both greater than that expected by chance. We further identified well-aligned DC and IS, including professional organizations, briefs, and guidelines. CONCLUSION: We identified a novel implementer-reported outcome of dissemination channel and implementation strategy concordance that allows implementation scientists to quantify the magnitude of the gap between the current and preferred experience of implementers. This quantitative measure can help with the selection and evaluation of dissemination channels and implementation strategies. Future research should leverage this measure to understand the degree to which preference concordance influences clinical outcomes and performance.

What matters when it comes to measuring Age-Friendly Health System transformation.

Thousands of health systems are now recognized as "Age-Friendly Health Systems," making this model one of the most widely disseminated - and most promising- models to redesign care delivery for older adults. Sustaining these gains will require demonstrating the impact on care delivery and outcomes of older adults. We propose a new measurement model to more tightly link Age-Friendly Health System transformation to outcomes within each "M" (What Matters, Medications, Mobility, and Mentation). We evaluated measures based on the following characteristics: (1) conceptual responsiveness to changes brought about by practicing "4Ms" care; (2) degree to which they represent outcomes that matter to older adults; and (3) how they can be feasibly, reliably, and validly measured. We offer specific examples of how novel measures are currently being used where available. Finally, we present measures that could capture system-level effects across "M"s. We tie these suggestions together into a conceptual measurement model for AFHS transformation, with the intent to spur discussion, debate, and iterative improvement in measures over time.

Strategies for effective dissemination of research to United States policymakers: a systematic review.

BACKGROUND: Research has the potential to influence US social policy; however, existing research in this area lacks a coherent message. The Model for Dissemination of Research provides a framework through which to synthesize lessons learned from research to date on the process of translating research to US policymakers. METHODS: The peer-reviewed and grey literature was systematically reviewed to understand common strategies for disseminating social policy research to policymakers in the United States. We searched Academic Search Premier, PolicyFile, SocINDEX, Social Work Abstracts, and Web of Science from January 1980 through December 2019. Articles were independently reviewed and thematically analyzed by two investigators and organized using the Model for Dissemination of Research. RESULTS: The search resulted in 5225 titles and abstracts for inclusion consideration. 303 full-text articles were reviewed with 27 meeting inclusion criteria. Common sources of research dissemination included government, academic researchers, the peer reviewed literature, and independent organizations. The most frequently disseminated research topics were health-related, and legislators and executive branch administrators were the most common target audience. Print materials and personal communication were the most common channels for disseminating research to policymakers. There was variation in dissemination channels by level of government (e.g., a more formal legislative process at the federal level compared with other levesl). Findings from this work suggest that dissemination is most effective when it starts early, galvanizes support, uses champions and brokers, considers contextual factors, is timely, relevant, and accessible, and knows the players and process. CONCLUSIONS: Effective dissemination of research to US policymakers exists; yet, rigorous quantitative evaluation is rare. A number of cross-cutting strategies appear to enhance the translation of research evidence into policy. REGISTRATION: Not registered.

Effective Care Practices in Patients Receiving Prolonged Mechanical Ventilation. An Ethnographic Study.

Rationale: Patients receiving prolonged mechanical ventilation experience low survival rates and incur high healthcare costs. However, little is known about how to optimally organize and manage their care.Objectives: To identify a set of effective care practices for patients receiving prolonged mechanical ventilation.Methods: We performed a focused ethnographic evaluation at eight long-term acute care hospitals in the United States ranking in either the lowest or highest quartile of risk-adjusted mortality in at least four of the five years between 2007 and 2011.Measurements and Main Results: We conducted 329 hours of direct observation, 196 interviews, and 39 episodes of job shadowing. Data were analyzed using thematic content analysis and a positive-negative deviance approach. We found that high- and low-performing hospitals differed substantially in their approach to care. High-performing hospitals actively promoted interdisciplinary communication and coordination using a range of organizational practices, including factors related to leadership (e.g., leaders who communicate a culture of quality improvement), staffing (e.g., lower nurse-to-patient ratios and ready availability of psychologists and spiritual care providers), care protocols (e.g., specific yet flexible respiratory therapy-driven weaning protocols), team meetings (e.g., interdisciplinary meetings that include direct care providers), and the physical plant (e.g., large workstations that allow groups to interact). These practices were believed to facilitate care that is simultaneously goal directed and responsive to individual patient needs, leading to more successful liberation from mechanical ventilation and improved survival.Conclusions: High-performing long-term acute care hospitals employ several organizational practices that may be helpful in improving care for patients receiving prolonged mechanical ventilation.

Parent Empowerment in Pediatric Healthcare Settings: A Systematic Review of Observational Studies.

BACKGROUND: Parent empowerment is often an expressed goal in clinical pediatrics and in pediatric research, but the antecedents and consequences of parent empowerment are not well established. OBJECTIVE: The objective of this systematic review was to synthesize potential antecedents and consequences of parent empowerment in healthcare settings. ELIGIBILITY CRITERIA: The inclusion criteria were (1) studies with results about parent empowerment in the context of children's healthcare or healthcare providers; and (2) qualitative studies, observational studies, and systematic reviews of such studies. INFORMATION SOURCES: We searched the databases of PubMed, Web of Science, and Google Scholar (2006-2017) and reference lists. INCLUDED STUDIES: Forty-four articles met the inclusion criteria. SYNTHESIS OF RESULTS: We identified six themes within consequences of empowerment: increased parent involvement in daily care, improved symptom management, enhanced informational needs and tools, increased involvement in care decisions, increased advocacy for child, and engagement in empowering others. Six themes summarizing antecedents of empowerment also emerged: parent-provider relationships, processes of care, experiences with medical care, experiences with community services, receiving informational/emotional support, and building personal capacity and narrative. We synthesized these findings into a conceptual model to guide future intervention development and evaluation. STRENGTHS AND LIMITATIONS OF EVIDENCE: Non-English articles were excluded. INTERPRETATION: Parent empowerment may enhance parent involvement in daily care and care decisions, improve child symptoms, enhance informational needs and skills, and increase advocacy and altruistic behaviors. Parent empowerment may be promoted by the parent-provider relationship and care processes, finding the right fit of medical and community services, and attention to the cognitive and emotional needs of parents. CLINICAL REGISTRATION NO: PROSPERO 2017:CRD42017059478.

Determinants of Intensive Care Unit Telemedicine Effectiveness. An Ethnographic Study.

RATIONALE: Telemedicine is an increasingly common care delivery strategy in the ICU. However, ICU telemedicine programs vary widely in their clinical effectiveness, with some studies showing a large mortality benefit and others showing no benefit or even harm. OBJECTIVES: To identify the organizational factors associated with ICU telemedicine effectiveness. METHODS: We performed a focused ethnographic evaluation of 10 ICU telemedicine programs using site visits, interviews, and focus groups in both facilities providing remote care and the target ICUs. Programs were selected based on their change in risk-adjusted mortality after adoption (decreased mortality, no change in mortality, and increased mortality). We used a constant comparative approach to guide data collection and analysis. MEASUREMENTS AND MAIN RESULTS: We conducted 460 hours of direct observation, 222 interviews, and 18 focus groups across six telemedicine facilities and 10 target ICUs. Data analysis revealed three domains that influence ICU telemedicine effectiveness: 1) leadership (i.e., the decisions related to the role of the telemedicine, conflict resolution, and relationship building), 2) perceived value (i.e., expectations of availability and impact, staff satisfaction, and understanding of operations), and 3) organizational characteristics (i.e., staffing models, allowed involvement of the telemedicine unit, and new hire orientation). In the most effective telemedicine programs these factors led to services that are viewed as appropriate, integrated, responsive, and consistent. CONCLUSIONS: The effectiveness of ICU telemedicine programs may be influenced by several potentially modifiable factors within the domains of leadership, perceived value, and organizational structure.

Family Perspectives on Telemedicine for Pediatric Subspecialty Care.

BACKGROUND: Children often have difficulty accessing subspecialty care, and telemedicine may improve access to subspecialty care, but information is lacking on how best to implement telemedicine programs to maximize acceptance and, ultimately, maximize impact for patients and their families. METHODS AND MATERIALS: To understand how subspecialty telemedicine is perceived and to identify design elements with the potential to improve telemedicine uptake and impact, we conducted and analyzed semi-structured interviews with 21 informants, including parents and caregivers of children with subspecialty care needs and adolescent and young adult patients with subspecialty care needs. RESULTS: Although informants saw the potential value of using telemedicine to replace in-person subspecialty visits, they were more enthusiastic about using telemedicine to complement rather than replace in-person visits. For example, they described the potential to use telemedicine to facilitate previsit triage encounters to assess whether the patient was being scheduled with the correct subspecialist and with the appropriate level of urgency. They also felt that telemedicine would be useful for communication with subspecialists after scheduled in-person visits for follow-up questions, care coordination, and to discuss changes in health status. Informants felt that it was important for telemedicine programs to have transparent and reliable scheduling, same-day scheduling options, continuity of care with trusted providers, clear guidelines on when to use telemedicine, and preservation of parent choice regarding method of care delivery. CONCLUSIONS: Parents and patients articulated preferences regarding pediatric subspecialty telemedicine in this qualitative, hypothesis-generating study. Understanding and responding to patient and caregiver perceptions and preferences will be crucial to ensure that telemedicine drives true innovation in care delivery rather than simply recapitulating prior models of care.

Identifying Strategies for Effective Telemedicine Use in Intensive Care Units: The ConnECCT Study Protocol.

Telemedicine, the use of audiovisual technology to provide health care from a remote location, is increasingly used in intensive care units (ICUs). However, studies evaluating the impact of ICU telemedicine show mixed results, with some studies demonstrating improved patient outcomes, while others show limited benefit or even harm. Little is known about the mechanisms that influence variation in ICU telemedicine effectiveness, leaving providers without guidance on how to best use this potentially transformative technology. The Contributors to Effective Critical Care Telemedicine (ConnECCT) study aims to fill this knowledge gap by identifying the clinical and organizational factors associated with variation in ICU telemedicine effectiveness, as well as exploring the clinical contexts and provider perceptions of ICU telemedicine use and its impact on patient outcomes, using a range of qualitative methods. In this report, we describe the study protocol, data collection methods, and planned future analyses of the ConnECCT study. Over the course of 1 year, the study team visited purposefully sampled health systems across the United States that have adopted telemedicine. Data collection methods included direct observations, interviews, focus groups, and artifact collection. Data were collected at the ICUs that provide in-person critical care as well as at the supporting telemedicine units. Iterative thematic content analysis will be used to identify and define key constructs related to telemedicine effectiveness and describe the relationship between them. Ultimately, the study results will provide a framework for more effective implementation of ICU telemedicine, leading to improved clinical outcomes for critically ill patients.

Family Perspectives on High-Quality Pediatric Subspecialty Referrals.

OBJECTIVE: Although children are frequently referred to subspecialist physicians, many inadequacies in referral processes have been identified from physician and system perspectives. Little is known, however, about how to comprehensively measure or improve the quality of the referral systems from a family-centered perspective. To foster family-centered improvements to pediatric subspecialty referrals, we sought to develop a framework for high-quality, patient-centered referrals from the perspectives of patients and their families. METHODS: We used stakeholder-informed qualitative analysis of parent, caregiver, and patient interviews to identify outcomes, processes, and structures of high-quality pediatric subspecialty referrals as perceived by patients and their family members. RESULTS: We interviewed 21 informants. Informants identified 5 desired outcomes of subspecialty referrals: improved functional status or symptoms; improved long-term outcomes; improved knowledge of their disease; informed expectations; and reduced anxiety about the child's health status. Processes that informants identified as supporting these outcomes centered around 6 key steps in subspecialty referrals, including the referral decision, previsit information transfer, appointment scheduling, subspecialist visit, postvisit information transfer, and ongoing care integration and communication. Health care delivery structures identified by informants as supporting these processes included physical infrastructure, human resources, and information technology systems. CONCLUSIONS: We identified family-centered outcomes, processes, and structures of high-quality pediatric subspecialty referrals. These domains can be used not only to improve measurement of the quality of existing referral systems but also to inform future interventions to improve patient-centered outcomes for children in need of specialty care.