Quality of locally designed surveys in a quality improvement collaborative: review of survey validity and identification of common errors.

OBJECTIVE: Surveys are a commonly used tool in quality improvement (QI) projects, but little is known about the standards to which they are designed and applied. We aimed to investigate the quality of surveys used within a QI collaborative, and to characterise the common errors made in survey design. METHODS: Five reviewers (two research methodology and QI, three clinical and QI experts) independently assessed 20 surveys, comprising 250 survey items, that were developed in a North American cystic fibrosis lung transplant transition collaborative. Content Validity Index (CVI) scores were calculated for each survey. Reviewer consensus discussions decided an overall quality assessment for each survey and survey item (analysed using descriptive statistics) and explored the rationale for scoring (using qualitative thematic analysis). RESULTS: 3/20 surveys scored as high quality (CVI >80%). 19% (n=47) of survey items were recommended by the reviewers, with 35% (n=87) requiring improvements, and 46% (n=116) not recommended. Quality assessment criteria were agreed upon. Types of common errors identified included the ethics and appropriateness of questions and survey format; usefulness of survey items to inform learning or lead to action, and methodological issues with survey questions, survey response options; and overall survey design. CONCLUSION: Survey development is a task that requires careful consideration, time and expertise. QI teams should consider whether a survey is the most appropriate form for capturing information during the improvement process. There is a need to educate and support QI teams to adhere to good practice and avoid common errors, thereby increasing the value of surveys for evaluation and QI. The methodology, quality assessment criteria and common errors described in this paper can provide a useful resource for this purpose.

Maternal obesity: Perinatal implications.

Over the previous three decades, the prevalence and growth of overweight and obese status has risen relentlessly in both the general population and pregnant women. This rise is seen in both higher pre-pregnancy body mass index measurements along with excessive weight gain during pregnancy. Maternal obesity has been shown to exacerbate co-morbidities such as insulin resistance, pregnancy induced hypertension, and infectious states in parturient mothers. These changes have been shown to subsequently increase rates of fetal anomalies and affect fetal growth, as well as various aspects of the delivery such as rates of instrumented vaginal deliveries and an increase in delivery by cesarean section. Maternal obesity increases fetal birth weight, influences the delivery room resuscitation of the neonate by increasing the need for respiratory support, and increases the risk of neonatal hypoxic ischemic encephalopathy. This review also looks at recent studies revealing the strong association between maternal and offspring obesity and other long-term neurodevelopmental outcomes of offspring.

Unpacking the 'process of sustaining'-identifying threats to sustainability and the strategies used to address them: a longitudinal multiple case study.

BACKGROUND: Although sustainability remains a recognised challenge for Quality Improvement (QI) initiatives, most available research continues to investigate sustainability at the end of implementation. As a result, the learning and continuous adjustments that shape sustainability outcomes are lost. With little understanding of the actions and processes that influence sustainability within QI initiatives, there is limited practical guidance and direction on how to enhance the sustainability of QI initiatives. This study aims to unpack the 'process of sustaining', by exploring threats to sustainability encountered throughout the implementation of QI Initiatives and identifying strategies used by QI teams to address these threats over time. METHODS: A longitudinal multiple case study design was employed to follow 4 QI initiatives over a 3-year period. A standardised sustainability tool was used quarterly to collect perceptions of sustainability threats and actions throughout implementation. Interviews (n=38), observations (32.5 h), documentary analysis, and a focus group (n=10) were conducted to enable a greater understanding of how the process of sustaining is supported in practice. Data were analysed using the Consolidated Framework for Sustainability (CFS) to conduct thematic analysis. RESULTS: Analysis identified five common threats to sustainability: workforce stability, improvement timelines, organisational priorities, capacity for improvement, and stakeholder support. Each of these threats impacted multiple sustainability constructs demonstrating the complexity of the issues encountered. In response to threats, 12 strategies to support the process of sustaining were identified under three themes: engagement (five strategies that promoted the development of relationships), integration (three strategies that supported initiatives to become embedded within local systems), and adaptation (four strategies that enhanced understanding of, and response to, emergent conditions and contextual needs). CONCLUSIONS: Sustaining improvements from QI initiatives requires continuous investment in relationships, resilience to integrate improvements in local systems, and flexibility to understand emergent conditions. Findings provide practitioners, funders, and researchers with a better understanding of, and preparation for, the threats associated with sustaining improvements from QI initiatives and offer insight into specific actions that can be taken to mitigate these risks. This learning can be used to inform future initiative design and support, to optimise the sustainability of healthcare improvements. TRIAL REGISTRATION: Not applicable.

How do healthcare providers use national audit data for improvement?

BACKGROUND: Substantial resources are invested by Health Departments worldwide in introducing National Clinical Audits (NCAs). Yet, there is variable evidence on the NCAs' effectiveness and little is known on factors underlying the successful use of NCAs to improve local practice. This study will focus on a single NCA (the National Audit of Inpatient Falls -NAIF 2017) to explore: (i) participants' perspectives on the NCA reports, local feedback characteristics and actions undertaken following the feedback underpinning the effective use of the NCA feedback to improve local practice; (ii) reported changes in local practice following the NCA feedback in England and Wales. METHODS: Front-line staff perspectives were gathered through interviews. An inductive qualitative approach was used. Eighteen participants were purposefully sampled from 7 of the 85 participating hospitals in England and Wales. Analysis was guided by constant comparative techniques. RESULTS: Regarding the NAIF annual report, interviewees valued performance benchmarking with other hospitals, the use of visual representations and the inclusion of case studies and recommendations. Participants stated that feedback should target front-line healthcare professionals, be straightforward and focused, and be delivered through an encouraging and honest discussion. Interviewees highlighted the value of using other relevant data sources alongside NAIF feedback and the importance of continuous data monitoring. Participants reported that engagement of front-line staff in the NAIF and following improvement activities was critical. Leadership, ownership, management support and communication at different organisational levels were perceived as enablers, while staffing level and turnover, and poor quality improvement (QI) skills, were perceived as barriers to improvement. Reported changes in practice included increased awareness and attention to patient safety issues and greater involvement of patients and staff in falls prevention activities. CONCLUSIONS: There is scope to improve the use of NCAs by front-line staff. NCAs should not be seen as isolated interventions but should be fully embedded and integrated into the QI strategic and operational plans of NHS trusts. The use of NCAs could be optimised, but knowledge of them is poor and distributed unevenly across different disciplines. More research is needed to provide guidance on key elements to consider throughout the whole improvement process at different organisational levels.

Challenges to implementing artificial intelligence in healthcare: a qualitative interview study with healthcare leaders in Sweden.

BACKGROUND: Artificial intelligence (AI) for healthcare presents potential solutions to some of the challenges faced by health systems around the world. However, it is well established in implementation and innovation research that novel technologies are often resisted by healthcare leaders, which contributes to their slow and variable uptake. Although research on various stakeholders' perspectives on AI implementation has been undertaken, very few studies have investigated leaders' perspectives on the issue of AI implementation in healthcare. It is essential to understand the perspectives of healthcare leaders, because they have a key role in the implementation process of new technologies in healthcare. The aim of this study was to explore challenges perceived by leaders in a regional Swedish healthcare setting concerning the implementation of AI in healthcare. METHODS: The study takes an explorative qualitative approach. Individual, semi-structured interviews were conducted from October 2020 to May 2021 with 26 healthcare leaders. The analysis was performed using qualitative content analysis, with an inductive approach. RESULTS: The analysis yielded three categories, representing three types of challenge perceived to be linked with the implementation of AI in healthcare: 1) Conditions external to the healthcare system; 2) Capacity for strategic change management; 3) Transformation of healthcare professions and healthcare practice. CONCLUSIONS: In conclusion, healthcare leaders highlighted several implementation challenges in relation to AI within and beyond the healthcare system in general and their organisations in particular. The challenges comprised conditions external to the healthcare system, internal capacity for strategic change management, along with transformation of healthcare professions and healthcare practice. The results point to the need to develop implementation strategies across healthcare organisations to address challenges to AI-specific capacity building. Laws and policies are needed to regulate the design and execution of effective AI implementation strategies. There is a need to invest time and resources in implementation processes, with collaboration across healthcare, county councils, and industry partnerships.

Roadmap to resilience: Incorporating a wellness program into the pharmacy residency curriculum.

BACKGROUND AND PURPOSE: In recent years, wellness initiatives across various health professions have prompted national pharmacy organizations to prioritize pharmacist well-being. Pharmacy residency programs present ideal platforms to foster wellness practices among new pharmacy practitioners. By describing the components and implementation of the Resident Wellness Program at an academic medical center, we aim to guide other institutions in facilitating wellness activities for pharmacy trainees. EDUCATIONAL ACTIVITY AND SETTING: The Resident Wellness Program was implemented in 2019 and provides pharmacy residents with a structured framework of wellness activities intended to promote mental and physical health and prevent burnout. Feedback surveys and written reflections have provided initial evidence of the program's value in enhancing resident well-being. FINDINGS: A qualitative analysis of surveys and reflections highlights the program's positive impact, with more than 90% of participants indicating that the program met their needs and promoted self-development. Perspectives from residents and administrators identified key strengths, including the structured nature of sessions and diversity of wellness topics. Opportunities for improvement include teaching participants to apply practical wellness strategies and refining topics to align with residents' interests. As the program evolves, a formal analysis via standardized surveys and an assessment of longitudinal impact will support continued enhancement. SUMMARY: The implementation of a pharmacy resident wellness program provides an opportunity to promote well-being and work performance. By engaging in similar initiatives, other institutions can mirror the commitment of national pharmacy organizations and contribute to a culture of wellness among pharmacy residents and the greater pharmacy workforce.

Toward Successful Implementation of Artificial Intelligence in Health Care Practice: Protocol for a Research Program.

BACKGROUND: The uptake of artificial intelligence (AI) in health care is at an early stage. Recent studies have shown a lack of AI-specific implementation theories, models, or frameworks that could provide guidance for how to translate the potential of AI into daily health care practices. This protocol provides an outline for the first 5 years of a research program seeking to address this knowledge-practice gap through collaboration and co-design between researchers, health care professionals, patients, and industry stakeholders. OBJECTIVE: The first part of the program focuses on two specific objectives. The first objective is to develop a theoretically informed framework for AI implementation in health care that can be applied to facilitate such implementation in routine health care practice. The second objective is to carry out empirical AI implementation studies, guided by the framework for AI implementation, and to generate learning for enhanced knowledge and operational insights to guide further refinement of the framework. The second part of the program addresses a third objective, which is to apply the developed framework in clinical practice in order to develop regional capacity to provide the practical resources, competencies, and organizational structure required for AI implementation; however, this objective is beyond the scope of this protocol. METHODS: This research program will use a logic model to structure the development of a methodological framework for planning and evaluating implementation of AI systems in health care and to support capacity building for its use in practice. The logic model is divided into time-separated stages, with a focus on theory-driven and coproduced framework development. The activities are based on both knowledge development, using existing theory and literature reviews, and method development by means of co-design and empirical investigations. The activities will involve researchers, health care professionals, and other stakeholders to create a multi-perspective understanding. RESULTS: The project started on July 1, 2021, with the Stage 1 activities, including model overview, literature reviews, stakeholder mapping, and impact cases; we will then proceed with Stage 2 activities. Stage 1 and 2 activities will continue until June 30, 2026. CONCLUSIONS: There is a need to advance theory and empirical evidence on the implementation requirements of AI systems in health care, as well as an opportunity to bring together insights from research on the development, introduction, and evaluation of AI systems and existing knowledge from implementation research literature. Therefore, with this research program, we intend to build an understanding, using both theoretical and empirical approaches, of how the implementation of AI systems should be approached in order to increase the likelihood of successful and widespread application in clinical practice. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/34920.

Implementation Frameworks for Artificial Intelligence Translation Into Health Care Practice: Scoping Review.

BACKGROUND: Significant efforts have been made to develop artificial intelligence (AI) solutions for health care improvement. Despite the enthusiasm, health care professionals still struggle to implement AI in their daily practice. OBJECTIVE: This paper aims to identify the implementation frameworks used to understand the application of AI in health care practice. METHODS: A scoping review was conducted using the Cochrane, Evidence Based Medicine Reviews, Embase, MEDLINE, and PsycINFO databases to identify publications that reported frameworks, models, and theories concerning AI implementation in health care. This review focused on studies published in English and investigating AI implementation in health care since 2000. A total of 2541 unique publications were retrieved from the databases and screened on titles and abstracts by 2 independent reviewers. Selected articles were thematically analyzed against the Nilsen taxonomy of implementation frameworks, and the Greenhalgh framework for the nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) of health care technologies. RESULTS: In total, 7 articles met all eligibility criteria for inclusion in the review, and 2 articles included formal frameworks that directly addressed AI implementation, whereas the other articles provided limited descriptions of elements influencing implementation. Collectively, the 7 articles identified elements that aligned with all the NASSS domains, but no single article comprehensively considered the factors known to influence technology implementation. New domains were identified, including dependency on data input and existing processes, shared decision-making, the role of human oversight, and ethics of population impact and inequality, suggesting that existing frameworks do not fully consider the unique needs of AI implementation. CONCLUSIONS: This literature review demonstrates that understanding how to implement AI in health care practice is still in its early stages of development. Our findings suggest that further research is needed to provide the knowledge necessary to develop implementation frameworks to guide the future implementation of AI in clinical practice and highlight the opportunity to draw on existing knowledge from the field of implementation science.

Conceptualising interventions to enhance spread in complex systems: a multisite comprehensive medication review case study.

BACKGROUND: Advancing the description and conceptualisation of interventions in complex systems is necessary to support spread, evaluation, attribution and reproducibility. Improvement teams can provide unique insight into how interventions are operationalised in practice. Capturing this 'insider knowledge' has the potential to enhance intervention descriptions. OBJECTIVES: This exploratory study investigated the spread of a comprehensive medication review (CMR) intervention to (1) describe the work required from the improvement team perspective, (2) identify what stays the same and what changes between the different sites and why, and (3) critically appraise the 'hard core' and 'soft periphery' (HC/SP) construct as a way of conceptualising interventions. DESIGN: A prospective case study of a CMR initiative across five sites. Data collection included: observations, document analysis and semistructured interviews. A facilitated workshop triangulated findings and measured perceived effort invested in activities. A qualitative database was developed to conduct thematic analysis. RESULTS: Sites identified 16 intervention components. All were considered essential due to their interdependency. The function of components remained the same, but adaptations were made between and within sites. Components were categorised under four 'spheres of operation': Accessibility of evidence base; Process of enactment; Dependent processes and Dependent sociocultural issues. Participants reported most effort was invested on 'dependent sociocultural issues'. None of the existing HC/SP definitions fit well with the empirical data, with inconsistent classifications of components as HC or SP. CONCLUSIONS: This study advances the conceptualisation of interventions by explicitly considering how evidence-based practices are operationalised in complex systems. We propose a new conceptualisation of 'interventions-in-systems' which describes intervention components in relation to their: proximity to the evidence base; component interdependence; component function; component adaptation and effort.

Realizing the potential of artificial intelligence in healthcare: Learning from intervention, innovation, implementation and improvement sciences.

Introduction: Artificial intelligence (AI) is widely seen as critical for tackling fundamental challenges faced by health systems. However, research is scant on the factors that influence the implementation and routine use of AI in healthcare, how AI may interact with the context in which it is implemented, and how it can contribute to wider health system goals. We propose that AI development can benefit from knowledge generated in four scientific fields: intervention, innovation, implementation and improvement sciences. Aim: The aim of this paper is to briefly describe the four fields and to identify potentially relevant knowledge from these fields that can be utilized for understanding and/or facilitating the use of AI in healthcare. The paper is based on the authors' experience and expertise in intervention, innovation, implementation, and improvement sciences, and a selective literature review. Utilizing knowledge from the four fields: The four fields have generated a wealth of often-overlapping knowledge, some of which we propose has considerable relevance for understanding and/or facilitating the use of AI in healthcare. Conclusion: Knowledge derived from intervention, innovation, implementation, and improvement sciences provides a head start for research on the use of AI in healthcare, yet the extent to which this knowledge can be repurposed in AI studies cannot be taken for granted. Thus, when taking advantage of insights in the four fields, it is important to also be explorative and use inductive research approaches to generate knowledge that can contribute toward realizing the potential of AI in healthcare.

How to design, implement and evaluate organizational interventions for maximum impact: the Sigtuna Principles.

Research on organizational interventions needs to meet the objectives of both researchers and participating organizations. This duality means that real-world impact has to be considered throughout the research process, simultaneously addressing both scientific rigour and practical relevance. This discussion paper aims to offer a set of principles, grounded in knowledge from various disciplines that can guide researchers in designing, implementing, and evaluating organizational interventions. Inspired by Mode 2 knowledge production, the principles were developed through a transdisciplinary, participatory and iterative process where practitioners and academics were invited to develop, refine and validate the principles. The process resulted in 10 principles: 1) Ensure active engagement and participation among key stakeholders; 2) Understand the situation (starting points and objectives); 3) Align the intervention with existing organizational objectives; 4) Explicate the program logic; 5) Prioritize intervention activities based on effort-gain balance; 6) Work with existing practices, processes, and mindsets; 7) Iteratively observe, reflect, and adapt; 8) Develop organizational learning capabilities; 9) Evaluate the interaction between intervention, process, and context; and 10) Transfer knowledge beyond the specific organization. The principles suggest how the design, implementation, and evaluation of organizational interventions can be researched in a way that maximizes both practical and scientific impact.

Psychosocial aspects of Historical and Cultural Learning: Historical Trauma and Resilience among Indigenous Young Adults.

PURPOSE: The purpose of this manuscript is to evaluate the impact of the Remember the Removal (RTR) program, with specific emphasis on participants' experiences learning about and reacting to Cherokee history, including historical trauma. METHODS: Two cohorts of intervention participants (1984 and 2015) participated in focus groups. An exploratory analysis was performed to categorize themes around the effects of historical training. RESULTS: Results yielded two themes and subsequent sub-themes: 1) Reactions to Historical Learning: confronting misrepresentation and erasure, mixed emotions, looking backwards, looking forwards, strengthening Cherokee identity; and 2) The Effects of Colonization: emotional sides of historical loss, empowerment, resilience, and belonging, and addressing contemporary discrimination. CONCLUSION: Teaching tribally-specific historical events was related to increased thoughts about historical loss, an increased awareness of non-Native people's lack of historical knowledge about Native people and subsequent experiences of discrimination, but also an increased sense of tribal identity, resilience, and belonging.

Process mapping in healthcare: a systematic review.

INTRODUCTION: Process mapping (PM) supports better understanding of complex systems and adaptation of improvement interventions to their local context. However, there is little research on its use in healthcare. This study (i) proposes a conceptual framework outlining quality criteria to guide the effective implementation, evaluation and reporting of PM in healthcare; (ii) reviews published PM cases to identify context and quality of PM application, and the reported benefits of using PM in healthcare. METHODS: We developed the conceptual framework by reviewing methodological guidance on PM and empirical literature on its use in healthcare improvement interventions. We conducted a systematic review of empirical literature using PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology. Inclusion criteria were: full text empirical study; describing the process through which PM has been applied in a healthcare setting; published in English. Databases searched are: Medline, Embase, HMIC-Health Management Information Consortium, CINAHL-Cumulative Index to Nursing and Allied Health Literature, Scopus. Two independent reviewers extracted and analysed data. Each manuscript underwent line by line coding. The conceptual framework was used to evaluate adherence of empirical studies to the identified PM quality criteria. Context in which PM is used and benefits of using PM were coded using an inductive thematic analysis approach. RESULTS: The framework outlines quality criteria for each PM phase: (i) preparation, planning and process identification, (ii) data and information gathering, (iii) process map generation, (iv) analysis, (v) taking it forward. PM is used in a variety of settings and approaches to improvement. None of the reviewed studies (N = 105) met all ten quality criteria; 7% were compliant with 8/10 or 9/10 criteria. 45% of studies reported that PM was generated through multi-professional meetings and 15% reported patient involvement. Studies highlighted the value of PM in navigating the complexity characterising healthcare improvement interventions. CONCLUSION: The full potential of PM is inhibited by variance in reporting and poor adherence to underpinning principles. Greater rigour in the application of the method is required. We encourage the use and further development of the proposed framework to support training, application and reporting of PM. TRIAL REGISTRATION: Prospero ID: CRD42017082140.

Working together to co-produce better health: The experience of the Collaboration for Leadership in Applied Health Research and Care for Northwest London.

OBJECTIVES: To improve the provision of health care, academics can be asked to collaborate with clinicians, and clinicians with patients. Generating good evidence on health care practice depends on these collaborations working well. Yet such relationships are not the norm. We examine how social science research and health care improvement practice were linked through a programme designed to broker collaborations between clinicians, academics, and patients to improve health care - the UK National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care for Northwest London. We discuss the successes and challenges of the collaboration and make suggestions on how to develop synergistic relationships that facilitate co-production of social science knowledge and its translation into practice. METHODS: A qualitative approach was used, including ethnographic elements and critical, reflexive dialogue between members of the two collaborating teams. RESULTS: Key challenges and remedies were connected with the risks associated with new ways of working. These risks included differing ideas between collaborators about the purpose, value, and expectations of research, and institutional opposition. Dialogue between collaborators did not mean absence of tensions or clashes. Risk-taking was unpopular - institutions, funders, and partners did not always support it, despite simultaneously demanding 'innovation' in producing research that influenced practice. CONCLUSIONS: Our path was made smoother because we had funding to support the creation of a 'potential space' to experiment with different ways of working. Other factors that can enhance collaboration include a shared commitment to dialogical practice, a recognition of the legitimacy of different partners' knowledge, a long timeframe to identify and resolve problems, the maintenance of an enabling environment for collaboration, a willingness to work iteratively and reflexively, and a shared end goal.

Using virtual worlds as a platform for collaborative meetings in healthcare: a feasibility study.

BACKGROUND: Healthcare teams often consist of geographically dispersed members. Virtual worlds can support immersive, high-quality, multimedia interaction between remote individuals; this study investigated use of virtual worlds to support remote healthcare quality improvement team meetings. METHODS: Twenty individuals (12 female, aged 25-67 [M = 42.3, SD = 11.8]) from 6 healthcare quality improvement teams conducted collaborative tasks in virtual world or face-to-face settings. Quality of collaborative task performances were measured and questionnaires and interviews were used to record participants' experiences of conducting the tasks and using the virtual world software. RESULTS: Quality of collaborative task outcomes was high in both face-to-face and virtual world settings. Participant interviews elicited advantages for using virtual worlds in healthcare settings, including the ability of the virtual environment to support tools that cannot be represented in equivalent face-to-face meetings, and the potential for virtual world settings to cause improvements in group-dynamics. Reported disadvantages for future virtual world use in healthcare included the difficulty that people with weaker computer skills may experience with using the software. Participants tended to feel absorbed in the collaborative task they conducted within the virtual world, but did not experience the virtual environment as being 'real'. CONCLUSIONS: Virtual worlds can provide an effective platform for collaborative meetings in healthcare quality improvement, but provision of support to those with weaker computer skills should be ensured, as should the technical reliability of the virtual world being used. Future research could investigate use of virtual worlds in other healthcare settings.

The role of geographic bias in knowledge diffusion: a systematic review and narrative synthesis.

BACKGROUND: Descriptive studies examining publication rates and citation counts demonstrate a geographic skew toward high-income countries (HIC), and research from low- or middle-income countries (LMICs) is generally underrepresented. This has been suggested to be due in part to reviewers' and editors' preference toward HIC sources; however, in the absence of controlled studies, it is impossible to assert whether there is bias or whether variations in the quality or relevance of the articles being reviewed explains the geographic divide. This study synthesizes the evidence from randomized and controlled studies that explore geographic bias in the peer review process. METHODS: A systematic review was conducted to identify research studies that explicitly explore the role of geographic bias in the assessment of the quality of research articles. Only randomized and controlled studies were included in the review. Five databases were searched to locate relevant articles. A narrative synthesis of included articles was performed to identify common findings. RESULTS: The systematic literature search yielded 3501 titles from which 12 full texts were reviewed, and a further eight were identified through searching reference lists of the full texts. Of these articles, only three were randomized and controlled studies that examined variants of geographic bias. One study found that abstracts attributed to HIC sources elicited a higher review score regarding relevance of the research and likelihood to recommend the research to a colleague, than did abstracts attributed to LIC sources. Another study found that the predicted odds of acceptance for a submission to a computer science conference were statistically significantly higher for submissions from a "Top University." Two of the studies showed the presence of geographic bias between articles from "high" or "low" prestige institutions. CONCLUSIONS: Two of the three included studies identified that geographic bias in some form was impacting on peer review; however, further robust, experimental evidence is needed to adequately inform practice surrounding this topic. Reviewers and researchers should nonetheless be aware of whether author and institutional characteristics are interfering in their judgement of research.

How helpful are Patient and Public Involvement strategic documents - Results of a framework analysis using 4Pi National Involvement Standards.

BACKGROUND: Patient and Public Involvement (PPI) strategic documents are viewed as an essential feature of organisational commitment to openness and transparency. They provide a mechanism to communicate opportunities for wider community influence in healthcare. The absence of documentation can be negatively interpreted, for example during regulatory inspection, as a lack of intent by organisations to collaborate with a broad constituency. Published literature paints a confusing picture of rationale and evidence that could provide the foundation for strategic action. This makes it difficult for those responsible for turning goals into meaningful involvement. We investigated how content is presented and organised in strategic documents. This pragmatic study is intended to stimulate reflective practice, promote debate and generate further inquiry with a wide audience. METHODS: We created and iterated a framework adapted from 4Pi National Involvement Standards to analyse organisational PPI strategic documents against five domains which are principles, purpose, presence, process and impact. Fifteen strategic documents were grouped into four categories (acute care providers; clinical commissioning groups; community healthcare providers; and other) and included for analysis. A matrix was produced. By reading the matrix vertically (down) and horizontally (across), comparisons can be made between 4Pi domains and across organisations. RESULTS: There was no discernible pattern between domains or between organisations. There was variation in the level to which criteria were met. No single strategy fully met the criteria for all five domains of 4Pi National Involvement Standards. The criteria for purpose was fully met in eight strategic documents. Only two documents fully met impact criteria. Four organisations showed better completeness with fully or partially met criteria across five domains. A single organisation partially met the criteria for all domains. The remaining 10 were unable to meet the criteria in at least one domain. CONCLUSION: Our findings align with published literature that suggests the underpinning rationale for PPI is confusing. A strategic aim is difficult to articulate. Context and complexity are at play making the sharing of generalisable knowledge elusive. We offer further critique about the value of these documents and consider: 'is there an alternative approach to construct PPI strategy to generate theory, capture learning and evaluate effectiveness at the same time?' We suggest testing the adoption of programme theory in PPI. The emergent nature and context sensitive features of programme theory enable curiosity, creativity and critical appraisal. It has the potential to release practitioners from the tokenistic cycle of monitoring and reporting and replace this with a richer understanding of 'what' works and 'how' tied to a 'why' - in order to achieve a shared aim that everyone can get behind.

The role of patients and carers in diffusing a health-care innovation: A case study of "My Medication Passport".

BACKGROUND: Patients are increasingly recognized as playing important roles in improving health services. Little is known about the mechanisms by which patients develop and diffuse local innovations in a complex health-care system. OBJECTIVE: To ascertain how diffusion of an innovation, My Medication Passport, occurred and roles played by patients in it. DESIGN: Case study: quantitative mapping of innovation's diffusion and analysis of the routes and occupations of those through whom the innovation spread; documentary analysis; reflective assessment of patient's roles. SETTING AND PARTICIPANTS: NHS Trusts, third sector organizations, patients and health-care professionals. INTERVENTIONS STUDIED: Co-produced action to raise awareness and influence use of the innovation; order database which enabled ease of access to the innovation. MAIN OUTCOME MEASURES: Geographical spread of innovation; occupations of individuals; types of organizations using the innovation. RESULTS: The innovation spread from initial development and use in Northwest London across the UK and beyond. Key roles played by patients were as follows: co-producer; advocate; relationship builder; relationship broker; planner; presenter; awareness raiser; trainer; networker. Patients identified and introduced potential audiences and users to MMP, using social, organizational, sectoral, lay and professional networks to do so. They organized a range of awareness-raising and communication activities, monitored feedback, evaluated the impact and responded to new interest. DISCUSSION AND CONCLUSIONS: The roles of patients in diffusing innovations are under-recognized. Collaborative working between patients, carers and health-care professionals in planning and progressing the use and supporting diffusion of the innovation was important. Principles described in this study are relevant to progressing other patient-led ideas for innovative changes relating to health service development.

Evolving quality improvement support strategies to improve Plan-Do-Study-Act cycle fidelity: a retrospective mixed-methods study.

BACKGROUND: Although widely recommended as an effective approach to quality improvement (QI), the Plan-Do-Study-Act (PDSA) cycle method can be challenging to use, and low fidelity of published accounts of the method has been reported. There is little evidence on the fidelity of PDSA cycles used by front-line teams, nor how to support and improve the method's use. Data collected from 39 front-line improvement teams provided an opportunity to retrospectively investigate PDSA cycle use and how strategies were modified to help improve this over time. METHODS: The fidelity of 421 PDSA cycles was reviewed using a predefined framework and statistical analysis examined whether fidelity changed over three annual rounds of projects. The experiences of project teams and QI support staff were investigated through document analysis and interviews. RESULTS: Although modest, statistically significant improvements in PDSA fidelity occurred; however, overall fidelity remained low. Challenges to achieving greater fidelity reflected problems with understanding the PDSA methodology, intention to use and application in practice. These problems were exacerbated by assumptions made in the original QI training and support strategies: that PDSA was easy to understand; that teams would be motivated and willing to use PDSA; and that PDSA is easy to apply. QI strategies that evolved to overcome these challenges included project selection process, redesign of training, increased hands-on support and investment in training QI support staff. CONCLUSION: This study identifies support strategies that may help improve PDSA cycle fidelity. It provides an approach to assess minimum standards of fidelity which can be replicated elsewhere. The findings suggest achieving high PDSA fidelity requires a gradual and negotiated process to explore different perspectives and encourage new ways of working.