Sustainability of an outcome measure in outpatient stroke rehabilitation: A realist evaluation.

RATIONALE: Only half of newly implemented evidence-based practices are sustained. Though poor sustainment can lead to negative consequences for clinical teams, organizations and patients, the causal explanations of sustainment are largely unknown. AIMS AND OBJECTIVES: We aimed to ascertain how (mechanisms) and in what circumstances (context) a newly implemented outcome measure in rehabilitation was sustained or not (outcome). METHODOLOGY: Informed by an integrated knowledge translation approach, we conducted a realist evaluation using a mixed method, embedded single case study design with data collection up to 18 months following the implementation of the Mayo-Portland Adaptability Inventory - version 4 (MPAI-4), a rehabilitation outcome measure. Quantitative data (survey and patient charts) was analysed using descriptive statistics, then integrated with qualitative data (interviews with 10 key informants) and analysed using inductive and deductive retroduction. We integrated the data to develop a case description and ultimately, to refine the programme theory to better understand the sustainability of the MPAI-4. RESULTS: We linked context, mechanisms and outcomes, and also emphasized sustainability strategies in 18 explanations of how sustainability works. These explanations provide evidence for four overarching patterns: (1) implementation and sustainability phases are interconnected, (2) outcomes build on each other recursively, with patient benefits as the keystone outcome, (3) sustainment is achieved to varying levels across different sustainability outcomes [e.g., high level (e.g., rate of MPAI-4 scoring: 77.7%) to low level (e.g., rate of MPAI-4 application to clinical decision-making: 3.7%)] and (4) the work of sustaining the MPAI-4 is shared amongst different stakeholders. CONCLUSION: Implementation teams can draw from this programme theory to improve the sustainment of outcomes measures while researchers could continue to refine the theory. Continued investigation of sustainability, including diverse and continuous sustainability outcomes, is needed to understand how to maintain improvements in quality of care and patient outcomes.

Collaborative sustainability planning for an outcome measure in outpatient stroke rehabilitation: A qualitative description study.

RATIONALE: Evidence suggests that sustainability planning and the use of a collaborative approach to planning result in better sustainability outcomes and more relevant knowledge. Yet, both approaches appear to be underutilized. A detailed description of collaborative sustainability planning may encourage the use of these two impactful strategies. AIMS AND OBJECTIVES: To explore the collaborative sustainability planning process for a single outcome measure in three rehabilitation sites. METHODOLOGY: Within the Mayo-Portland Adaptability Inventory-version 4 (MPAI-4) implementation project, we conducted a qualitative description study. We used data from 12 core sustainability planning meetings and 108 follow-up meetings that included a total of 31 clinical and research team participants. Sustainability planning was informed by an MPAI-4-specific implementation guide, and by the results from a realist review of the sustainability of rehabilitation practices and the Clinical Sustainability Assessment Tool. We analyzed qualitative data using thematic content analysis. RESULTS: Three themes describe the collaborative sustainability planning process: (1) "collaboration as a driver for sustainability" which captures the active collaboration underpinning sustainability planning; (2) "co-creation of a sustainability plan to achieve shared objectives" which captures the identified barriers and facilitators, and selected sustainability strategies linked to one of six collaboratively identified shared objectives; and (3) "the iterative nature of sustainability planning" which captures the necessity of an agile and responsive sustainability planning process. CONCLUSION: Identified strategies may be useful to support (collaborative) sustainment. Future research could investigate the effect of collaborative sustainability planning on sustainability objectives, and the relationship between these objectives.

Evaluating the implementation of the Mayo-Portland Adaptability Inventory-4 (MPAI-4) in three rehabilitation settings in Quebec: a mixed-methods study protocol.

INTRODUCTION: Stroke is a leading cause of morbidity and mortality worldwide, placing an immense burden on patients and the health system. Timely access to rehabilitation services can improve stroke survivors' quality of life. The use of standardised outcome measures is endorsed for optimising patient rehabilitation outcomes and improving clinical decision-making. This project results from a provincially mandated recommendation to use the fourth version of the Mayo-Portland Adaptability Inventory (MPAI-4) to measure changes in social participation of stroke survivors and to maintain commitment to evidence-informed practices in stroke care. This protocol outlines the implementation process of the MPAI-4 for three rehabilitation centres. The objectives are to: (a) describe the context of MPAI-4 implementation; (b) determine clinical teams' readiness for change; (c) identify barriers and enablers to implementing the MPAI-4 and match the implementation strategies; (d) evaluate the MPAI-4 implementation outcomes including the degree of integration of the MPAI-4 into clinical practice and (e) explore participants' experiences using the MPAI-4. METHODS AND ANALYSIS: We will use a multiple case study design within an integrated knowledge translation (iKT) approach with active engagement from key informants. Each case is a rehabilitation centre implementing MPAI-4. We will collect data from clinicians and programme managers using mixed methods guided by several theoretical frameworks. Data sources include surveys, focus groups and patient charts. We will conduct descriptive, correlational and content analyses. Ultimately, we will analyse, integrate data from qualitative and quantitative components and report them within and across participating sites. Results will provide insights about iKT within stroke rehabilitation settings that could be applied to future research projects. ETHICS AND DISSEMINATION: The project received Institutional Review Board approval from the Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal. We will disseminate results in peer-reviewed publications and at local, national and international scientific conferences.

The Definitions and Conceptualizations of the Practice Context in the Health Professions: A Scoping Review.

INTRODUCTION: Health care professionals work in different contexts, which can influence professional competencies. Despite existing literature on the impact of context on practice, the nature and influence of contextual characteristics, and how context is defined and measured, remain poorly understood. The aim of this study was to map the breadth and depth of the literature on how context is defined and measured and the contextual characteristics that may influence professional competencies. METHODS: A scoping review using Arksey and O'Malley's framework. We searched MEDLINE (Ovid) and CINAHL (EBSCO). Our inclusion criteria were studies that reported on context or relationships between contextual characteristics and professional competencies or that measured context. We extracted data on context definitions, context measures and their psychometric properties, and contextual characteristics influencing professional competencies. We performed numerical and qualitative analyses. RESULTS: After duplicate removal, 9106 citations were screened and 283 were retained. We compiled a list of 67 context definitions and 112 available measures, with or without psychometric properties. We identified 60 contextual factors and organized them into five themes: Leadership and Agency, Values, Policies, Supports, and Demands. DISCUSSION: Context is a complex construct that covers a wide array of dimensions. Measures are available, but none include the five dimensions in one single measure or focus on items targeting the likelihood of context influencing several competencies. Given that the practice context plays a critical role in health care professionals' competencies, stakeholders from all sectors (education, practice, and policy) should work together to address those contextual characteristics that can adversely influence practice.

Measurement Properties of the Mayo-Portland Adaptability Inventory (MPAI-4) and Related Measures: A Systematic Review.

OBJECTIVE: To assess the Mayo-Portland Adaptability Inventory-version 4 (MPAI-4) and related measures' measurement properties and the quality of evidence supporting these results; and identify the interpretability and feasibility of the MPAI-4 and related measures. DATA SOURCES: We conducted a systematic review according to COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidelines. We searched 9 electronic databases and registries, and hand searched reference lists of included articles. STUDY SELECTION: Two independent reviewers screened and selected all articles. From 605 retrieved articles, 48 were included. DATA EXTRACTION: Two independent reviewers appraised the evidence quality and rated the extracted classical test theory and Rasch results from each study. DATA SYNTHESIS: We used meta-analysis and COSMIN's approach to synthesize measurement properties evidence (insufficient, sufficient), and the modified Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to synthesize evidence quality (very low, low, moderate, high) by diagnosis (traumatic brain injury [TBI], stroke), and setting (inpatient, outpatient). The MPAI-4 and its subscales are sufficiently comprehensible (GRADE: very low), but there is currently no other content validity evidence (relevance, comprehensiveness). The MPAI-4 and its participation index (M2PI) have sufficient interrater reliability for stroke and TBI outpatients (GRADE: moderate), whereas interrater reliability between TBI inpatients and clinicians is currently insufficient (GRADE: moderate). There is no evidence for measurement error. For stroke and TBI outpatients, the MPAI-4 and M2PI have sufficient construct validity (GRADE: high) and responsiveness (GRADE: moderate-high). For TBI inpatients, the MPAI-4 and M2PI have mixed indeterminant/sufficient construct validity and responsiveness evidence (GRADE: moderate-high). There is 1 study with mixed insufficient/sufficient evidence for each MPAI-4 adaptation (21- and 22-item MPAI, 9-item M2PI) (GRADE: low-high). CONCLUSION: Users can be most confident in using the MPAI-4 and M2PI in TBI and stroke outpatient settings. Future research is needed on reliability, measurement error, predictive validity, and content validity of the MPAI-4 and its related measures across populations and settings.

Adolescent medicine training in postgraduate family medicine education: a scoping review.

INTRODUCTION: Adolescents and young adults require age-appropriate healthcare services delivered by clinicians with expertise in adolescent medicine. However, resident family physicians report a low perceived self-efficacy and under-preparedness to deliver adolescent medical care. We conducted a scoping review to map the breadth and depth of the current evidence about adolescent medicine training for family medicine residents. CONTENT: We followed Arksey and O'Malley's framework and searched seven electronic databases and key organizations' webpages from inception to September 2020. Informed by the CanMEDS-FM, we analyzed the extracted data concerning basic document characteristics, competencies and medical topics using numerical and qualitative content analysis. SUMMARY: We included 41 peer-reviewed articles and six adolescent health competency frameworks (n=47). Most competencies taught in family medicine programs were organized under the roles of family medicine expert (75%), communicator (11.8%), and professional roles (7.9%). Health advocate and leader were rarely included (1.3%), and never scholar. OUTLOOK: The omission of multiple competency roles in family medicine resident education on adolescents is insufficient for family physicians to deliver optimal care to adolescents. The combined efforts of family medicine stakeholders to address adolescent medicine competency gaps may positively impact the perceived competence reported by family medicine residents.

Understanding How Newly Implemented Rehabilitation Best Practices Are Sustained: A Realist Review.

OBJECTIVE: We conducted a realist review to understand how (mechanism) and in what circumstances (context) evidence-based practices are sustained in rehabilitation (outcome). DATA SOURCES: MEDLINE, Embase, reference lists, and targeted websites. STUDY SELECTION: Two independent reviewers calibrated study selection; then 1 reviewer screened all titles and abstracts, while the second reviewer screened a random 20%. We repeated this process for full texts. We included 115 documents representing 61 implementation projects (8.9% of identified documents). Included documents described implementation projects in which physical therapists, occupational therapists, and/or speech-language pathologists were the target users of an evidence-based practice. DATA EXTRACTION: Two reviewers repeated the independent process described in study selection to extract basic study and sustainability characteristics as well as context, mechanism, outcome, and strategy text. DATA SYNTHESIS: Using basic numerical analyses, we found that only 54% of evidence-based practices in rehabilitation are sustained. Furthermore, while authors who reported sustainability planning sustained the practice 94% of the time, sustainability planning in rehabilitation is rare (only reported 26% of the time). Extracted text was synthesized using the realist technique of inductive and deductive retroduction in which context, mechanism, outcome, and strategy text are combined into narrative explanations of how sustainability works. To inform these explanations, we applied normalization process theory and the theory of planned behavior. Collectively, the 52 identified narratives provide evidence for 3 patterns: (1) implementation and sustainability phases are interconnected, (2) continued use of the evidence-based practice can be interpreted as the ultimate sustainability outcome, and (3) intermediate sustainability outcomes (ie, fit/alignment, financial support, benefits, expertise) can become contextual features influencing other sustainability outcomes. CONCLUSIONS: Implementation teams can use the narrative explanations generated in this review to optimize sustainability planning. This can sustain practice changes and improve quality of care and patient outcomes. Future research should seek to iteratively refine the proposed narrative explanations.

The Withdrawal Assessment Tool to identify iatrogenic withdrawal symptoms in critically ill paediatric patients: A COSMIN systematic review of measurement properties.

RATIONALE, AIMS AND OBJECTIVES: The Withdrawal Assessment Tool (WAT-1) is one of the most widely used clinician-reported outcome measures to evaluate iatrogenic withdrawal symptoms (IWS) in critically ill children. However, the WAT-1's measurement properties have not been aggregated. Aggregating psychometric research on the WAT-1 will enhance appropriate use, and outline gaps for future empirical research. The aim of this systematic review is to critically appraise, compare, and summarize the measurement properties and evidence quality, and describe the interpretability and feasibility of the WAT-1 for identifying IWS symptoms in critically ill children. METHODS: A systematic search of Medline, Embase and CINAHL was conducted from inception to 15 April 2020. Study inclusion/exclusion, data extraction, and measurement property evidence and the modified GRADE quality scoring were applied according to the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidelines. RESULTS: Six studies were included in the review. There was sufficient, high-quality evidence for reliability, structural validity, criterion validity, measurement error, construct validity, and feasibility. More information is required to support the WAT-1's content validity, responsiveness, internal consistency, cross-cultural validity, and interpretability according to COSMIN guidelines. CONCLUSION: The results of this review indicate that the WAT-1 is a precise, easy to use measure of IWS in critically ill children despite some measurement property inconsistencies and gaps in the publication record. More information is required to support its content validity, responsiveness, internal consistency, cross-cultural validity, and interpretability.