A proposed methodology to evaluate the influence of climate change on drinking water treatments and costs.

Drinking water (DW) production treatments can be affected by climate change, in particular intense rainfall events, having an impact on the availability and quality of the water source. The current study proposes a methodology for the evaluation of the costs of the different treatment steps for surface water (SW) and groundwater (GW), through the analysis and quantification of the main cost items. It provides the details to count for strong variations in the key quality parameters of inlet water following severe rainfalls (namely turbidity, iron, manganese, and E. coli). This methodology is then applied to a large drinking water treatment plant (DWTP) in Italy, which treats both SW, around 70 %, and GW, around 30%. It discusses the overall DW production costs (from 7.60 c€/m3 to 10.43 c€/m3) during the period 2019-2021 and analyzes the contributions of the different treatment steps in water and sludge trains. Then it focuses on the effects on the treatments of significant variations in SW turbidity (up to 1863 NTU) due to intense rainfalls, and on the daily costs of DW with respect to the average (baseline) costs evaluated on the annual basis. It emerges that, when SW has low turbidity levels, the energy-based steps have the biggest contribution on the costs (final pumping 22 % for SW and 10 % for GW, withdrawal 15 % and 14 %, respectively), whereas at very high turbidity levels, sludge greatly increases, and its treatment and disposal costs become significant (up to 14 % and 50 %). Efforts are being made to adopt the best strategies for the management of DWTPs in these adverse conditions, with the aim to guarantee potable water and optimize water production costs. A mitigation measure consists of increasing GW withdrawal up to the authorized flow rate, thus reducing SW withdrawal. In this context, the study is completed by discussing the potential upgrading of the DWTP by only treating GW withdrawn from riverbank filtration. The DW production cost would be 7.76 c€/m3, which is lower than that seen for the same year (2021) with the current plant configuration (8.32 c€/m3).

Evaluating rural health outcomes: A methodological approach using population-level data.

Background: The sustainability of rural surgical and obstetrical facilities depends on their efficacy and quality of care, which are difficult to measure in a rural context. In an evaluation of rural practice, it is often the case that the only comparators are larger referral facilities, for which facility-level comparisons are difficult due to differences in population demographics, acuity of patients, and services offered. This publication outlines these limitations and highlights a best-practice approach to making facility-level comparisons using population-level data, risk stratification, tests of noninferiority, and Firth logistic regression analysis. This includes an investigation of minimum sample-size requirements through Monte Carlo power analysis in the context of low-acuity rural surgical care. Methods: Monte Carlo power analysis was used to estimate the minimum sample size required to achieve a power of 0.8 for both logistic regression and Firth logistic regression models that compare the proportion of surgical adverse events against facility type, among other confounders. We provide guidelines for the implementation of a recommended methodology that uses risk stratification, Firth penalized logistic regression, and tests of noninferiority. Results: We illustrate limitations in facility-level comparison of surgical quality among patients undergoing one of four index procedures including hernia repair, colonoscopy, appendectomy, and cesarean delivery. We identified minimum sample sizes for comparison of each index procedure that fluctuate depending on the level of risk stratification used. Conclusion: The availability of administrative data can provide an adequate sample size to allow for facility-level comparisons in surgical quality, at the rural level and elsewhere. When they are made appropriately, these comparisons can be used to evaluate the efficacy of general practitioners and nurse practitioners in performing low-acuity procedures.

How to properly evaluate cardiac vagal tone in oncology studies: a state-of-the-art review.

Heart rate variability (HRV) analysis provides an assessment of cardiac vagal tone and consequently global cardiac health as well as systemic condition. In systemic diseases such as cancer and during treatments that affect the whole body, like chemotherapy, the vagus nerve activity is low and deregulated. Some studies focus on using HRV to predict mortality in oncology. However, in cancer patients, systemic alterations substantially increase artifacts during HRV measurement, especially atrial ectopic beats. Moreover, HRV may be altered by various factors (duration and time of measurement, breathing, drugs, and other confounding factors) that alter each metric in different ways. The Standard Deviation of all Normal to Normal intervals (SDNN) is the most commonly used metric to evaluate HRV in oncology, but it does not appear to be specific to the cardiac vagal tone. Thus, cardiac vagal activity diagnosis and vital prognosis of cancer patients can be biased. Our review presents the main HRV metrics that can be currently used in oncology studies and their links with vagus nerve and cancer. We present the influence of external factors and the required duration and time of measurement. Considering all these parameters, this review proposes seven key points for an assessment of HRV and cardiac vagal tone in patients with cancer.

An Extensible Evaluation Framework Applied to Clinical Text Deidentification Natural Language Processing Tools: Multisystem and Multicorpus Study.

BACKGROUND: Clinical natural language processing (NLP) researchers need access to directly comparable evaluation results for applications such as text deidentification across a range of corpus types and the means to easily test new systems or corpora within the same framework. Current systems, reported metrics, and the personally identifiable information (PII) categories evaluated are not easily comparable. OBJECTIVE: This study presents an open-source and extensible end-to-end framework for comparing clinical NLP system performance across corpora even when the annotation categories do not align. METHODS: As a use case for this framework, we use 6 off-the-shelf text deidentification systems (ie, CliniDeID, deid from PhysioNet, MITRE Identity Scrubber Toolkit [MIST], NeuroNER, National Library of Medicine [NLM] Scrubber, and Philter) across 3 standard clinical text corpora for the task (2 of which are publicly available) and 1 private corpus (all in English), with annotation categories that are not directly analogous. The framework is built on shell scripts that can be extended to include new systems, corpora, and performance metrics. We present this open tool, multiple means for aligning PII categories during evaluation, and our initial timing and performance metric findings. Code for running this framework with all settings needed to run all pairs are available via Codeberg and GitHub. RESULTS: From this case study, we found large differences in processing speed between systems. The fastest system (ie, MIST) processed an average of 24.57 (SD 26.23) notes per second, while the slowest (ie, CliniDeID) processed an average of 1.00 notes per second. No system uniformly outperformed the others at identifying PII across corpora and categories. Instead, a rich tapestry of performance trade-offs emerged for PII categories. CliniDeID and Philter prioritize recall over precision (with an average recall 6.9 and 11.2 points higher, respectively, for partially matching spans of text matching any PII category), while the other 4 systems consistently have higher precision (with MIST's precision scoring 20.2 points higher, NLM Scrubber scoring 4.4 points higher, NeuroNER scoring 7.2 points higher, and deid scoring 17.1 points higher). The macroaverage recall across corpora for identifying names, one of the more sensitive PII categories, included deid (48.8%) and MIST (66.9%) at the low end and NeuroNER (84.1%), NLM Scrubber (88.1%), and CliniDeID (95.9%) at the high end. A variety of metrics across categories and corpora are reported with a wider variety (eg, F2-score) available via the tool. CONCLUSIONS: NLP systems in general and deidentification systems and corpora in our use case tend to be evaluated in stand-alone research articles that only include a limited set of comparators. We hold that a single evaluation pipeline across multiple systems and corpora allows for more nuanced comparisons. Our open pipeline should reduce barriers to evaluation and system advancement.

Grand rounds in methodology: designing for integration in mixed methods research.

Mixed methods research is a popular approach used to understand persistent and complex problems related to quality and safety, such as reasons why interventions are not implemented as intended or explaining differential outcomes. However, the quality and rigour of mixed methods research proposals and publications often miss opportunities for integration, which is the core of mixed methods. Achieving integration remains challenging, and failing to integrate reduces the benefits of a mixed methods approach. Therefore, the purpose of this article is to guide quality and safety researchers in planning and designing a mixed methods study that facilitates integration. We highlight how meaningful integration in mixed methods research can be achieved by centring integration at the following levels: research question, design, methods, results and reporting and interpretation levels. A holistic view of integration through all these levels will enable researchers to provide better answers to complex problems and thereby contribute to improvement of safety and quality of care.

Effects of Community-Wide Teen Pregnancy Prevention Initiatives on Local Teen Birth Rates in the United States: A Synthetic Control Approach.

The impact of community-wide teen pregnancy prevention initiatives (CWIs) on local U.S. birth rates among adolescents aged 15 to 19 years was examined using synthetic control methodology within a quasi-experimental design. CWIs were implemented in 10 U.S. communities from 2010 to 2015. Each initiative implemented evidence-based teen pregnancy prevention interventions at local organizations and enhanced best practices in adolescent reproductive health care at local health centers, while engaging diverse community sectors. The synthetic control method was used to estimate the impact of each CWI on overall and race- and ethnicity-specific teen births relative to rates in synthetic control communities. Additionally, we estimated the overall effect of CWIs across communities by pooling results from the 10 synthetic control case studies using the mean percentile rank. Pooled data across all 10 communities indicated an estimated average of 6.6 fewer births per 1000 teens per year overall during the initiative relative to each community's synthetic control (p = .001). By race and ethnicity, there were an estimated average of 6.4 fewer births per 1000 teens per year among Black teens (p = .03), 10.7 fewer births among Hispanic teens (p = .03), and 4.2 fewer births (p = .10) among White teens. Results from individual communities indicated an intervention effect on overall and/or race/ethnicity-specific teen birth rates in five communities. This study demonstrates the value of synthetic control methods in evaluating community-level outcomes of programmatic efforts. Findings indicate the CWIs had a positive impact on teen birth rates and have the potential to address racial and ethnic disparities in those rates.

Virtual quality improvement collaborative with primary care practices during COVID-19: a case study within a clinically integrated network.

INTRODUCTION: Quality improvement collaboratives (QICs) are a common approach to facilitate practice change and improve care delivery. Attention to QIC implementation processes and outcomes can inform best practices for designing and delivering collaborative content. In partnership with a clinically integrated network, we evaluated implementation outcomes for a virtual QIC with independent primary care practices delivered during COVID-19. METHODS: We conducted a longitudinal case study evaluation of a virtual QIC in which practices participated in bimonthly online meetings and monthly tailored QI coaching sessions from July 2020 to June 2021. Implementation outcomes included: (1) level of engagement (meeting attendance and poll questions), (2) QI capacity (assessments completed by QI coaches), (3) use of QI tools (plan-do-check-act (PDCA) cycles started and completed) and (4) participant perceptions of acceptability (interviews and surveys). RESULTS: Seven clinics from five primary care practices participated in the virtual QIC. Of the seven sites, five were community health centres, three were in rural counties and clinic size ranged from 1 to 7 physicians. For engagement, all practices had at least one member attend all online QIC meetings and most (9/11 (82%)) poll respondents reported meeting with their QI coach at least once per month. For QI capacity, practice-level scores showed improvements in foundational, intermediate and advanced QI work. For QI tools used, 26 PDCA cycles were initiated with 9 completed. Most (10/11 (91%)) survey respondents were satisfied with their virtual QIC experience. Twelve interviews revealed additional themes such as challenges in obtaining real-time data and working with multiple electronic medical record systems. DISCUSSION: A virtual QIC conducted with independent primary care practices during COVID-19 resulted in high participation and satisfaction. QI capacity and use of QI tools increased over 1 year. These implementation outcomes suggest that virtual QICs may be an attractive alternative to engage independent practices in QI work.

Development and validation of the Overall Fidelity Enactment Scale for Complex Interventions (OFES-CI).

BACKGROUND: In many quality improvement (QI) and other complex interventions, assessing the fidelity with which participants 'enact' intervention activities (ie, implement them as intended) is underexplored. Adapting the evaluative approach used in objective structured clinical examinations, we aimed to develop and validate a practical approach to assessing fidelity enactment-the Overall Fidelity Enactment Scale for Complex Interventions (OFES-CI). METHODS: We developed the OFES-CI to evaluate enactment of the SCOPE QI intervention, which teaches nursing home teams to use plan-do-study-act (PDSA) cycles. The OFES-CI was piloted and revised early in SCOPE with good inter-rater reliability, so we proceeded with a single rater. An intraclass correlation coefficient (ICC) was used to assess inter-rater reliability. For 27 SCOPE teams, we used ICC to compare two methods for assessing fidelity enactment: (1) OFES-CI ratings provided by one of five trained experts who observed structured 6 min PDSA progress presentations made at the end of SCOPE, (2) average rating of two coders' deductive content analysis of qualitative process evaluation data collected during the final 3 months of SCOPE (our gold standard). RESULTS: Using Cicchetti's classification, inter-rater reliability between two coders who derived the gold standard enactment score was 'excellent' (ICC=0.93, 95% CI=0.85 to 0.97). Inter-rater reliability between the OFES-CI and the gold standard was good (ICC=0.71, 95% CI=0.46 to 0.86), after removing one team where open-text comments were discrepant with the rating. Rater feedback suggests the OFES-CI has strong face validity and positive implementation qualities (acceptability, easy to use, low training requirements). CONCLUSIONS: The OFES-CI provides a promising novel approach for assessing fidelity enactment in QI and other complex interventions. It demonstrates good reliability against our gold standard assessment approach and addresses the practicality problem in fidelity assessment by virtue of its suitable implementation qualities. Steps for adapting the OFES-CI to other complex interventions are offered.

A holistic methodology for mitigating awkward postural risks: Evidence from South Indian small-scale industries.

BACKGROUND: Small-scale industries (SSI) are the global economy's backbone since most industrial workers are connected. Most of these workers are contractual and temporary without appropriate training. Also, the SSI does not have a standard workplace with an appropriate layout and infrastructure, as they manage with minimum resources. Therefore, the work hazards, i.e., musculoskeletal disorders and fatigue, often go unnoticed as holistic postural risk methodology is still scarce for identifying the awkward postures in SSI. OBJECTIVE: The present study proposes a novel holistic methodology to track and mitigate awkward postural risks in human-physical activities in SSI. To determine the effectiveness of the proposed methodology, a case study is presented in the South Indian Pump industry, wherein a critical workstation with a complex ergonomic work environment is employed. METHODS: An ergonomic evaluation was conducted empirically and numerically in the workplaces using Digital Human Models. In numerical evaluation, three virtual workspaces have been created to redesign the identified crucial workstation, focusing on ergonomics and workflow. RESULTS: The results obtained from the case study are encouraging for to use of the novel methodology in SSI. The case study reports that the proposed design significantly reduced the REBA score and WISHA lifting index by 6 and 1.20, respectively, without significant investment. CONCLUSION: The proposed methodology could encourage research to identify awkward posture in SSI.

Real world evidence for public health decision-making on vaccination policies: perspectives from an expert roundtable.

INTRODUCTION: Influenza causes significant morbidity and mortality, but influenza vaccine uptake remains below most countries' targets. Vaccine policy recommendations vary, as do procedures for reviewing and appraising the evidence. AREAS COVERED: During a series of roundtable discussions, we reviewed procedures and methodologies used by health ministries in four European countries to inform vaccine recommendations. We review the type of evidence currently recommended by each health ministry and the range of approaches toward considering randomized controlled trials (RCTs) and real-world evidence (RWE) studies when setting influenza vaccine recommendations. EXPERT OPINION: Influenza vaccine recommendations should be based on data from both RCTs and RWE studies of efficacy, effectiveness, and safety. Such data should be considered alongside health-economic, cost-effectiveness, and budgetary factors. Although RCT data are more robust and less prone to bias, well-designed RWE studies permit timely evaluation of vaccine benefits, effectiveness comparisons over multiple seasons in large populations, and detection of rare adverse events, under real-world conditions. Given the variability of vaccine effectiveness due to influenza virus mutations and increasing diversification of influenza vaccines, we argue that consideration of both RWE and RCT evidence is the best approach to more nuanced and timely updates of influenza vaccine recommendations.

Developing a framework to guide the evaluation of training in research skills for health and care professionals.

Background: Delivering research skills training to health professionals through short, applied sessions outside a formal higher education program, can help fill gaps in training and build research capacity in clinical settings. This has been the endeavor of some of the Applied Research Collaborations funded by the National Institute for Health and Care Research in England since 2014. How to evaluate this type of training in terms of the wider impact it may have, has not featured heavily in the literature and methods have largely borrowed from more generic approaches to training evaluation which can over-simplify outcomes and ignore longer-term impacts. Methods: We developed the framework in four stages: mapping potential impacts of our research skills training courses to identify key concepts; shaping into three domains in which impact could be expected, informed by established definitions of research capacity building; testing the initial framework and adapting wording of impacts; refining the framework into a practical tool. Results: The final framework specifies types of impact in three domains of influence - individual, group/organization and health system, and maps these against key questions to guide inquiry, as well as suggested methods for capturing the impact and expected timeframe for each type of impact. Discussion: The framework provides a structure for guiding the evaluation of research training as well as a focus on medium-longer term impacts, encouraging a broader and continuous approach to evaluation. It is hoped this will support educators in other contexts and fields, in the planning of a wider range of training evaluation activities, to capture impact more fully.

Why it is hard to use PROMs and PREMs in routine health and care.

Patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) show the results of healthcare activities as rated by patients and others. Patients or their proxies record feedback using questionnaires. These can enhance quality for all and tailored care for individuals. This paper describes obstacles that inhibit widespread use of PROMs and PREMs and some potential solutions.Implementation is a prerequisite for any innovation to succeed. Health and care services are complex and people need to be engaged at every level. Most people are cautious about proven innovations such as PROMs and PREMs but champions and leaders can help them engage. The NASSS framework (reasons for Non-adoption, Abandonment and failure to Scale up, Spread or Sustain digital health innovations) helps indicate that implementation is complex why it may be resisted.The Plan-Do-Study-Act (PDSA) approach aids implementation and helps ensure that everyone knows who should do what, when, where, how and why. Noise is an under-appreciated problem, especially when tracking patients over time such as before and after treatment. Interoperability of PROMs and PREMs with electronic health records should use Fast Health Interoperability Resources and internationally accepted coding schemes such as SNOMED CT and LOINC.Most projects need multiple measures to meet the needs of everyone involved. Measure selection should focus on their relevance, ease of use, and response rates.If these problems are avoided or mitigated, PROMs and PREMs can help deliver better patient outcomes, patient experience, staff satisfaction and health equity.

Effect of implementing a heart failure admission care bundle on hospital readmission and mortality rates: interrupted time series study.

This study aimed to evaluate the impact of developing and implementing a care bundle intervention to improve care for patients with acute heart failure admitted to a large London hospital. The intervention comprised three elements, targeted within 24 hours of admission: N-terminal pro-B-type natriuretic peptide (NT-proBNP) test, transthoracic Doppler two-dimensional echocardiography and specialist review by cardiology team. The SHIFT-Evidence approach to quality improvement was used. During implementation, July 2015-July 2017, 1169 patients received the intervention. An interrupted time series design was used to evaluate impact on patient outcomes, including 15 618 admissions for 8951 patients. Mixed-effects multiple Poisson and log-linear regression models were fitted for count and continuous outcomes, respectively. Effect sizes are slope change ratios pre-intervention and post-intervention. The intervention was associated with reductions in emergency readmissions between 7 and 90 days (0.98, 95% CI 0.97 to 1.00), although not readmissions between 0 and 7 days post-discharge. Improvements were seen in in-hospital mortality (0.96, 95% CI 0.95 to 0.98), and there was no change in trend for hospital length of stay. Care process changes were also evaluated. Compliance with NT-proBNP testing was already high in 2014/2015 (162 of 163, 99.4%) and decreased slightly, with increased numbers audited, to 2016/2017 (1082 of 1101, 98.2%). Over this period, rates of echocardiography (84.7-98.9%) and specialist input (51.6-90.4%) improved. Care quality and outcomes can be improved for patients with acute heart failure using a care bundle approach. A systematic approach to quality improvement, and robust evaluation design, can be beneficial in supporting successful improvement and learning.

Rapid evaluation of service innovations in health and social care: key considerations.

Funding: This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (RSET: 16/138/17; BRACE: 16/138/31).

Identifying value in healthcare transformation initiatives: an evaluation of an approach to benefits realisation.

Benefits realisation management (BRM) aims to facilitate the process of identifying, measuring and tracking desired benefits derived from a project. Improvement methodology frameworks often describe BRM as integral to identifying and measuring value derived from transformation initiatives within the National Health Service and beyond. Despite this, reporting of benefits realisation plans and methodological approaches to identifying and measuring benefits remains surprisingly scarce.This project aimed to pilot and evaluate the application of a purpose-designed benefits mapping template with seven newly funded transformation projects across three hospitals in the UK. The scope of the template was to identify key project benefits and metrics associated with the project initiatives. Plan-do-study-act (PDSA) cycles were used to capture the approach and utilisation of the template by project teams. These methods also enabled critical review of the template as an enabler to identifying relevant benefits and project metrics.Stakeholder engagement with the templates was variable. This was attributed to clinical pressures induced by the second wave of COVID-19 in the UK. Despite this, teams were able to produce completed templates outlining a number of wide-ranging benefits. Themes of benefits drawn from the maps include patient experience, patient outcomes, staff experience, access to care and efficiency. Qualitative feedback from teams included the reported value of a structured template to help recognise all the potential benefits associated with each project initiative. The PDSA cycles highlighted the template as an early step in BRM. Further components to this process are recommended to include consensus of the key metrics to be measured, a tool that summarises the reporting details of those metrics, and an effective means to collate reported metrics overtime.

Primer informe del Observatorio de la Academia de Medicina Familiar y Comunitaria de España (AMFE) en la universidad española, 2023 / Initial descriptive evaluation of Family and Community Medicine as a field within undergraduate medicine degrees in Spanish universities, 2023

Objetivos: conocer el grado de implementación de la Medicina Familiar y Comunitaria (MFyC) en el grado de Medicina de todas las universidades españolas.Métodos: estudio descriptivo transversal, llevado a cabo entre enero y marzo de 2023. Cuestionario ad hoc, cumplimentado por docentes de las 44 facultades de Medicina (año académico 2022-2023), sobre seis temáticas centradas en la asignatura de MFyC, las prácticas tuteladas, las rotaciones, metodologías docentes y evaluativas, y el profesorado. Resultados: participan 41 facultades (93,2%), 83% públicas y 17% privadas. La asignatura de MFyC está implantada en 34 facultades (82,9%), siendo obligatoria en 32 (94,1%), un 78% del total.La asignatura se denomina Medicina Familiar y Comunitaria solo en 14 facultades (34%) y cuenta con gran variabilidad en créditos ECTS: 3 créditos en 13 facultades (36%) y 6 créditos en 11 facultades (30%). Se imparte en quinto curso en 21 facultades (51%) y en sexto curso en 13 (32%). Hay prácticas tuteladas de MFyC en 28 facultades (68%) y créditos propios en 19 (46%). Mediana duración de 5 semanas. Gran variabilidad en las denominaciones. Coordinación por MFyC en 14 facultades (50%). Hay rotaciones en el centro de salud en 34 facultades (83%), siendo obligatorias en 29 (85%). No hay departamentos de Medicina Familiar, y solo hay unidades docentes universitarias en 4 facultades. Actualmente, hay 3 catedráticos y 13 profesores titulares. Conclusiones: se observa una progresión de la MFyC en la universidad en asignaturas, contenidos y profesorado, pero aún estamos lejos del nivel en el que se encuentran las universidades de otros países. Debilidades: gran heterogeneidad en denominación, contenidos, metodologías, carga docente y estructura. Fortalezas: implementación de metodologías docentes y evaluativas innovadoras.(AU)

Aims: to ascertain the degree of implementation of Family and Community Medicine (MFyC) on the undergraduate medicine degree course of Spanish universities.Methods: cross-sectional descriptive study, January-March 2023. Ad-hoc questionnaire, completed by lecturers of 44 medical schools (academic year 2022-2023). The questionnaire included six MFyC topics; that is, supervised family practice internships, shifts, teaching and evaluation methodologies and lecturers in medical schools.Results: a total of 41 faculties (93.2%) took part; 83% public and 17% private. MFyC course was implemented in 34 faculties (82.9%). The course was mandatory in 32 faculties (94.1%), 78% of the total.The course was named family and community medicine only in 14 medical schools (34%) with a major variability in ECTS credits (3 credits in 13 schools [36%] and 6 credits in 11 schools [30%]). It was taught in the 5th and 6th years in 21 (51%) and 13 (32%) faculties, respectively. There was supervised work experience in 28 faculties (68%), own credits in 19 (46%). Median duration was five weeks. There was a major variability in denomination. There was coordination by family practitioners in 14 faculties (50%).There were health centre internships in 34 faculties (83%), mandatory in 29 (85%).There are no family medicine departments and only university teaching units in four faculties. Currently, there are only three professors and 13 tenured lecturers.Conclusions: development of F&CM as a field was observed in terms of courses, content and teaching staff. However, this still falls well below international standards. Weaknesses are a major heterogeneity in denomination, content, methodologies, teaching load and structure and implementation of innovative teaching and evaluation methodologies was perceived as a strength.(AU)

Did the Acute Frailty Network improve outcomes for older people living with frailty? A staggered difference-in-difference panel event study.

OBJECTIVES: To evaluate whether the Acute Frailty Network (AFN) was more effective than usual practice in supporting older people living with frailty to return home from hospital sooner and healthier. DESIGN: Staggered difference-in-difference panel event study allowing for differential effects across intervention cohorts. SETTING: All English National Health Service (NHS) acute hospital sites. PARTICIPANTS: All 1 410 427 NHS patients aged 75+ with high frailty risk who had an emergency hospital admission to acute, general or geriatric medicine departments between 1 January 2012 and 31 March 2019. INTERVENTION: Membership of the AFN, a quality improvement collaborative designed to support acute hospitals in England deliver evidence-based care for older people with frailty. 66 hospital sites joined the AFN in six sequential cohorts, the first starting in January 2015, the sixth in May 2018. Usual care was delivered in the remaining 248 control sites. MAIN OUTCOME MEASURES: Length of hospital stay, in-hospital mortality, institutionalisation, hospital readmission. RESULTS: No significant effects of AFN membership were found for any of the four outcomes nor were there significant effects for any individual cohort. CONCLUSIONS: To realise its aims, the AFN might need to develop better resourced intervention and implementation strategies.

Barriers to delirium screening and management during hospital admission: a qualitative analysis of inpatient nursing perspectives.

BACKGROUND: Delirium in hospitalized patients is a major public health issue, yet delirium is often unrecognized and missed during inpatient admission. The objective of this study was to identify barriers to delirium screening, identification, and management from a nursing perspective on inpatient, acute care units. METHODS: This was a pre-implementation, diagnostic evaluation study to determine current practice patterns and potential barriers to optimizing delirium care at a major university hospital. A qualitative approach was used, which included focus groups of inpatient nurses working on major medical and surgical acute care units. Focus groups were conducted until signs of thematic saturation were present, and data were analyzed via inductive thematic analysis, without predetermined theories or structures. A consensus approach was utilized for transcript coding, and final themes were generated after multiple reviews of initial themes against transcript datasets. RESULTS: Focus group sessions (n = 3) were held with 18 nurses across two major inpatient units. Nurses reported several barriers to successful delirium screening and management. Specific challenges included difficulty with using delirium screening tools, an organizational culture not conducive to delirium prevention, and competing clinical priorities. Proposed solutions were also discussed, including decision-support systems with automated pager alerts and associated delirium order sets, which may help improve delirium care coordination and standardization. CONCLUSION: At a major university hospital, nurses affirm the difficulty experienced with delirium screening and identification, particularly due to screening tool challenges, cultural barriers, and clinical workload. These impediments may serve as targets for a future implementation trial to improve delirium screening and management.

Complex implementation mechanisms in primary care: do physicians' beliefs about the effectiveness of innovation play a mediating role? Applying a realist inquiry and structural equation modeling approach in a formative evaluation study.

BACKGROUND: The adoption of digital health technologies can improve the quality of care for polypharmacy patients, if the underlying complex implementation mechanisms are better understood. Context effects play a critical role in relation to implementation mechanisms. In primary care research, evidence on the effects of context in the adoption of digital innovation for polypharmacy management is lacking. STUDY AIM: This study aims to identify contextual factors relevant to physician behavior and how they might mediate the adoption process. METHODS: The physicians who participated in this formative evaluation study (n = 218) were part of the intervention group in a cluster-randomized controlled trial (AdAM). The intervention group implemented a digital innovation for clinical decision making in polypharmacy. A three-step methodological approach was used: (1) a realist inquiry approach, which involves the description of a context-mechanism-outcome configuration for the primary care setting; (2) a belief elicitation approach, which involves qualitative content analysis and the development of a quantitative latent contextualized scale; and (3) a mediation analysis using structural equation modeling (SEM) based on quantitative survey data from physicians to assess the mediating role of the contextualized scale (n = 179). RESULTS: The key dimensions of a (1) context-mechanism-outcome model were mapped and refined. A (2) latent construct of the physicians' innovation beliefs related to the effectiveness of polypharmacy management practices was identified. Innovation beliefs play a (3) mediating role between the organizational readiness to implement change (p < 0.01) and the desired behavioral intent of physicians to adopt digital innovation (p < 0.01; R2 = 0.645). Our contextualized model estimated significant mediation, with a relative size of 38% for the mediation effect. Overall, the model demonstrated good fit indices (CFI = 0.985, RMSEA = 0.034). CONCLUSION: Physician adoption is directly affected by the readiness of primary care organizations for the implementation of change. In addition, the mediation analysis revealed that this relationship is indirectly influenced by primary care physicians' beliefs regarding the effectiveness of digital innovation. Both individual physician beliefs and practice organizational capacity could be equally prioritized in developing implementation strategies. The methodological approach used is suitable for the evaluation of complex implementation mechanisms. It has been proven to be an advantageous approach for formative evaluation. TRIAL REGISTRATION: NCT03430336 . First registration: 12/02/2018. CLINICALTRIALS: gov.