Auditing Abbreviated Breast MR Imaging: Clinical Considerations and Implications.

Abbreviated breast MR (AB-MR) imaging is a relatively new breast imaging tool, which maintains diagnostic accuracy while reducing image times compared with full-protocol breast MR (FP-MR) imaging. Breast imaging audits involve calculating individual and organizational metrics, which can be compared with established benchmarks, providing a standard against which performance can be measured. Unlike FP-MR imaging, there are no established benchmarks for AB-MR imaging but studies demonstrate comparable performance for cancer detection rate, positive predictive value 3, sensitivity, and specificity with T2. We review the basics of performing an audit, including strategies to implement if benchmarks are not being met.

Audit as a tool for improving obstetric care in low- and middle-income countries.

Maternal and/or perinatal death review or audits aim to improve the quality of health services and reduce deaths due to causes identified. A death review audit cycle identifies causes of deaths and possible modifiable factors, these can point to potential breaks in the continuity of health care and other health systems faults and challenges. It is an important function of audit cycles to develop, implement, monitor, and review action plans to improve the service. The WHO has produced two handbooks (Making Every Baby Count and Monitoring Emergency Obstetric Care) to guide maternal and perinatal death reviews. Health worker related factors accounts for two thirds of aspects that, if done differently may have prevented the adverse outcome. This emphasises the need for skilled health care workers at every delivery and for deliveries to take place in health facilities.

Choosing Wisely audit: CT KUB ordering in emergency department renal colic presentations.

OBJECTIVE: Our aim was to safely reduce unnecessary CT KUBs (kidneys, ureters, bladder) in patients with renal colic. METHODS: This was a before and after intervention observational study of 74 patients in April 2023 and 57 patients in October 2023. RESULTS: Seventy-five per cent of patients with suspected renal colic underwent a CT KUB in the pre-audit period. Following education, an update in the ED Renal Colic Policy, electronic medical record ordering and short stay pathway, a re-audit was undertaken in October 2023 resulting in an absolute reduction of 15% of CT KUBs ordered. CONCLUSIONS: Audit interventions can reduce unnecessary CT KUBs in renal colic.

Effective peer review audit and identification of the surgeon outlier.

BACKGROUND: Surgical audit aims to identify ways to maintain and improve the quality of care for patients, in part by assessment of a surgeon's activities and outcomes. However effective data systems to facilitate audit are uncommon. We aimed to assess the effectiveness of a tool for Peer Review Audit. METHODS: All General Surgeons in Darwin and the Top End were encouraged to self-record their surgical activity, including procedures and adverse events related to procedures, using the College's Morbidity Audit and Logbook Tool (MALT). RESULTS: A total of 6 surgeons and 3518 operative events were recorded in MALT between 2018 and 2019. De-identified reports of each surgeon's activities, compared directly to the audit group, were created by each surgeon, with correction for complexity of procedures and ASA status. Nine complications Grade 3 and greater were recorded, plus 6 deaths, 25 unplanned returns to theatre (8% failure to rescue rate), 7 unplanned admissions to ICU and 8 unplanned readmissions. One surgeon outlier was identified (>3 standard deviation over group mean) for unplanned returns to theatre. This surgeon's specific cases were reviewed at our morbidity and mortality meeting using the MALT Self Audit Report and changes were implemented as a result, with future progress monitored. CONCLUSION: The College's MALT system effectively enabled Peer Group Audit. All participating surgeons were readily able to present and validate their own results. A surgeon outlier was reliably identified. This led to effective practice change. The proportion of surgeons who participated was low. Adverse events were likely under-reported.

The effect of clinician education on blood transfusion practice in obstetrics: completing the audit cycle.

BACKGROUND: With blood products being a limited and expensive resource within the healthcare system, there is an ever-increasing emphasis on judicial and appropriate use. AIMS: To evaluate whether implementing contemporary society recommendations on restrictive transfusion policies would reduce inappropriate use of red blood cell transfusions, by evaluating the effect of a staff educational campaign. METHODS: An audit of peri-partum red cell concentrate (RCC) transfusion practice within a tertiary obstetric unit was undertaken, covering a 1-year period (2015), examining data related to transfusion prescribing practices. Subsequently, an educational programme was held for clinical and laboratory staff which aimed to bring practice in line with society guidelines. A repeat audit covering another 1-year period (2018) was undertaken. RESULTS: The number of RCC units of transfused reduced by 49% between 2015 and 2018 (426 to 218). The number of patients receiving transfusion dropped from 166 in 2018 (1.8% of births) to 119 in 2015 (1.5% of births). Among stable patients who were transfused, the proportion receiving a single unit increased from 6.9 to 53.9%. (p < 0.001). Haematological reassessment between units rose from 13.8 to 80.4% (p < 0.001). Written consent documentation improved (68% in 2018 vs. 38% in 2015) (p < 0.001). CONCLUSIONS: The implementation of guidelines has resulted in substantial reduction in RCC transfusions between 2015 and 2018. Fewer women received a blood transfusion, and those who did received fewer units. There is a higher proportion of patients being reassessed between units and receiving single unit transfusions. Recording of consent has improved.

Perceived usefulness of trauma audit filters in urban India: a mixed-methods multicentre Delphi study comparing filters from the WHO and low and middle-income countries.

OBJECTIVE: To compare experts' perceived usefulness of audit filters from Ghana, Cameroon, WHO and those locally developed; generate context-appropriate audit filters for trauma care in selected hospitals in urban India; and explore characteristics of audit filters that correlate to perceived usefulness. DESIGN: A mixed-methods approach using a multicentre online Delphi technique. SETTING: Two large tertiary hospitals in urban India. METHODS: Filters were rated on a scale from 1 to 10 in terms of perceived usefulness, with the option to add new filters and comments. The filters were categorised into three groups depending on their origin: low and middle-income countries (LMIC), WHO and New (locally developed), and their scores compared. Significance was determined using Kruskal-Wallis test followed by Wilcoxon rank-sum test. We performed a content analysis of the comments. RESULTS: 26 predefined and 15 new filter suggestions were evaluated. The filters had high usefulness scores (mean overall score 9.01 of 10), with the LMIC filters having significantly higher scores compared with those from WHO and those newly added. Three themes were identified in the content analysis relating to medical relevance, feasibility and specificity. CONCLUSIONS: Audit filters from other LMICs were deemed highly useful in the urban India context. This may indicate that the transferability of defined trauma audit filters between similar contexts is high and that these can provide a starting point when implemented as part of trauma quality improvement programmes in low-resource settings.

Prevalence of Effective Audit-and-Feedback Practices in Primary Care Settings: A Qualitative Examination Within Veterans Health Administration.

OBJECTIVE: The purpose of this study is to uncover and catalog the various practices for delivering and disseminating clinical performance in various Veterans Affairs (VA) locations and to evaluate their quality against evidence-based models of effective feedback as reported in the literature. BACKGROUND: Feedback can enhance clinical performance in subsequent performance episodes. However, evidence is clear that the way in which feedback is delivered determines whether performance is harmed or improved. METHOD: We purposively sampled 16 geographically dispersed VA hospitals based on high, low, consistently moderate, and moderately average highly variable performance on a set of 17 outpatient clinical performance measures. We excluded four sites due to insufficient interview data. We interviewed four key personnel from each location (n = 48) to uncover effective and ineffective audit and feedback strategies. Interviews were transcribed and analyzed qualitatively using a framework-based content analysis approach to identify emergent themes. RESULTS: We identified 102 unique strategies used to deliver feedback. Of these strategies, 64 (62.74%) have been found to be ineffective according to the audit-and-feedback research literature. Comparing features common to effective (e.g., individually tailored, computerized feedback reports) versus ineffective (e.g., large staff meetings) strategies, most ineffective strategies delivered feedback in meetings, whereas strategies receiving the highest effectiveness scores delivered feedback via visually understood reports that did not occur in a group setting. CONCLUSIONS: Findings show that current practices are leveraging largely ineffective feedback strategies. Future research should seek to identify the longitudinal impact of current feedback and audit practices on clinical performance. APPLICATION: Feedback in primary care has little standardization and does not follow available evidence for effective feedback design. Future research in this area is warranted.

A retrospective audit of postoperative days alive and out of hospital, including before and after implementation of the WHO surgical safety checklist.

We implemented the World Health Organization surgical safety checklist at Auckland City Hospital from November 2007. We hypothesised that the checklist would reduce postoperative mortality and increase days alive and out of hospital, both measured to 90 postoperative days. We compared outcomes for cohorts who had surgery during 18-month periods before vs. after checklist implementation. We also analysed outcomes during 9 years that included these periods (July 2004-December 2013). We analysed 9475 patients in the 18-month period before the checklist and 10,589 afterwards. We analysed 57,577 patients who had surgery from 2004 to 2013. Mean number of days alive and out of hospital (95%CI) in the cohort after checklist implementation was 1.0 (0.4-1.6) days longer than in the cohort preceding implementation, p < 0.001. Ninety-day mortality was 395/9475 (4%) and 362/10,589 (3%) in the cohorts before and after checklist implementation, multivariable odds ratio (95%CI) 0.93 (0.80-1.09), p = 0.4. The cohort changes in these outcomes were indistinguishable from longer-term trends in mortality and days alive and out of hospital observed during 9 years, as determined by Bayesian changepoint analysis. Postoperative mortality to 90 days was 228/5686 (4.0%) for Maori and 2047/51,921 (3.9%) for non-Maori, multivariable odds ratio (95%CI) 0.85 (0.73-0.99), p = 0.04. Maori spent on average (95%CI) 1.1 (0.5-1.7) fewer days alive and out of hospital than non-Maori, p < 0.001. In conclusion, our patients experienced improving postoperative outcomes from 2004 to 2013, including the periods before and after implementation of the surgical checklist. Maori patients had worse outcomes than non-Maori.

Small-scale release of non-gene drive mosquitoes in Burkina Faso: from engagement implementation to assessment, a learning journey.

BACKGROUND: Innovative tools are needed to complement the existing approach for malaria elimination. Gene drive mosquitoes are one potential new technology in the control of malaria vectors. Target Malaria is one of the research projects developing this technology, and in July 2019, the project proceeded to an important step for this evaluation pathway: the small-scale release of non-gene drive sterile male mosquitoes in a village in Burkina Faso. In addition to the entomological and laboratory work to prepare for this important milestone, significant community and stakeholder engagement work was done. The existing guidelines on gene drive mosquito provide an overall framework for such engagement work. However, they do not provide a road map on how to proceed or what benchmarks should be used to assess this work. METHODS: This study provides a review of engagement activities relevant to field trials on non-gene drive genetically-modified mosquitoes as well as an assessment framework-using both qualitative and quantitative studies as well as an audit procedure. The latter was implemented to evaluate whether the release activities could proceed with the appropriate level of agreement from the community. RESULTS: This paper shows the importance of this first phase of work to innovate and learn about engagement processes for responsible research in the field of genetic approaches for malaria vector control. The function of these assessments is crucial for the learning agenda. The assessments demonstrated ways to increase understanding and ensure effective progress with field studies and, therefore, the pathway for responsible research. CONCLUSION: Gene drive technology is increasingly considered as a promising approach to control vector borne diseases, in particular malaria. Stakeholders' involvement in this research process is one of the recurring requirements in international guidance documents. With this paper Target Malaria offers an opportunity to explore the practical achievements and challenges of stakeholder engagement during early phases of a technology evaluation, and in particular how it implemented an assessment framework to learn from its experience.

Inflammatory bowel disease integral care units: Evaluation of a nationwide quality certification programme. The GETECCU experience.

BACKGROUND: One of the most valued targets in inflammatory bowel disease (IBD) is for physicians to provide and patients to receive a high-level quality of care. This study aimed to evaluate the implementation of a nationwide quality certification programme for IBD units. METHODS: Identification of quality indicators (QI) for IBD Unit certification was based on Delphi methodology that selected 53 QI, which were subjected to a normalisation process. Selected QI were then used in the certification process. Coordinated by GETECCU, this process began with a consulting round and an audit drill followed by a formal audit carried out by an independent certifying agency. This audit involved the scrutiny of the selected QI in medical records. If 80%-90% compliance was achieved, the IBD unit audited received the qualification of "advanced", and if it exceeded 90% the rating was "excellence". Afterwards, an anonymous survey was conducted among certified units to assess satisfaction with the programme for IBD units. RESULTS: As of January 2021, 66 IBD units adhere to the nationwide certification programme. Among the 53 units already audited by January 2021, 31 achieved the certification of excellence, 20 the advanced certification, and two did not obtain the certification. The main survey results indicated high satisfaction with an average score of 8.5 out of 10. CONCLUSION: Certification of inflammatory bowel disease units by GETECCU is the largest nationwide certification programme for IBD units reported. More than 90% of IBD units adhered to the programme achieved the certification.

The contemporary value of dedicated preterm birth clinics for high-risk singleton pregnancies: 15-year outcomes from a leading maternal centre.

OBJECTIVES: Preterm birth clinics provide dedicated obstetric care to women at high risk of spontaneous preterm birth (SPTB). There remains a lack of conclusive evidence to support the overall utility of such clinics, attributable to a paucity and heterogeneity of primary data. This study audits Australia's largest and oldest dedicated preterm birth clinic with the aim to add primary data to the area and offer opportunities for similar clinics to align practice. METHODS: A retrospective audit of referrals to the Preterm Labour Clinic at the Royal Women's Hospital, Melbourne, Australia, between 2004 and 2018 was conducted. 1,405 singleton pregnancies met inclusion criteria. The clinic's key outcomes, demographics, predictive tests and interventions were analysed. The primary outcomes were SPTB before 37, 34 and 30 weeks' gestation. RESULTS: The overall incidence of SPTB in the clinic was 21.2% (n=294). Linear regression showed reductions in the adjusted rates of overall SPTB and pre-viable SPTB (delivery <24 weeks) from 2004 (108%; 8%) to 2018 (65%; 2% respectively). Neonatal morbidity and post-delivery intensive care admission concurrently declined (p=0.02; 0.006 respectively). Rates of short cervix (cervical length <25 mm) increased over time (2018: 30.9%) with greater uptake of vaginal progesterone for treatment. Fetal fibronectin, mid-trimester short cervix, and serum alkaline phosphatase were associated with SPTB on logistic regression. CONCLUSIONS: Dedicated preterm birth clinics can reduce rates of SPTB, particularly deliveries before 24 weeks' gestation, and improve short-term neonatal outcomes in pregnant women at risk of preterm birth.

The Queensland Inpatient Diabetes Survey (QuIDS) 2019: the bedside audit of practice.

OBJECTIVES: To assess the quality of care for patients with diabetes in Queensland hospitals, including blood glucose control, rates of hospital-acquired harm, the incidence of insulin prescription and management errors, and appropriate foot and peri-operative care. DESIGN, SETTING: Cross-sectional audit of 27 public hospitals in Queensland: four of five tertiary/quaternary referral centres, four of seven large regional or outer metropolitan hospitals, seven of 13 smaller outer metropolitan or small regional hospitals, and 12 of 88 hospitals in rural or remote locations. PARTICIPANTS: 850 adult inpatients with diabetes mellitus in medical, surgical, mental health, high dependency, or intensive care wards. RESULTS: Twenty-seven of 115 public hospitals that admit acute inpatients participated in the audit, including 4175 of 6652 eligible acute hospital beds in Queensland. A total of 1003 patients had diabetes (24%), and data were collected for 850 (85%). Their mean age was 65.9 years (SD, 15.1 years), 357 were women (42%), and their mean HbA1c level was 66 mmol/mol (SD, 26 mmol/mol). Rates of good diabetes days (appropriate monitoring, no more than one blood glucose measurement greater than 10 mmol/L, and none below 5 mmol/L) were low in patients with type 1 diabetes (22.1 per 100 patient-days) or type 2 diabetes treated with insulin (40.1 per 100 patient-days); hypoglycaemia rates were high for patients with type 1 diabetes mellitus (24.1 episodes per 100 patient-days). One or more medication errors were identified for 201 patients (32%), including insulin prescribing errors for 127 patients (39%). Four patients with type 1 diabetes experienced diabetic ketoacidosis in hospital (8%); 121 patients (14%) met the criteria for review by a specialist diabetes team but were not reviewed by any diabetes specialist (medical, nursing, allied health). CONCLUSIONS: We identified several deficits in inpatient diabetes management in Queensland, including high rates of medication error and hospital-acquired harm and low rates of appropriate glycaemic control, particularly for patients treated with insulin. These deficits require attention, and ongoing evaluation of outcomes is necessary.

Applying Machine Learning Across Sites: External Validation of a Surgical Site Infection Detection Algorithm.

BACKGROUND: Surgical complications have tremendous consequences and costs. Complication detection is important for quality improvement, but traditional manual chart review is burdensome. Automated mechanisms are needed to make this more efficient. To understand the generalizability of a machine learning algorithm between sites, automated surgical site infection (SSI) detection algorithms developed at one center were tested at another distinct center. STUDY DESIGN: NSQIP patients had electronic health record (EHR) data extracted at one center (University of Minnesota Medical Center, Site A) over a 4-year period for model development and internal validation, and at a second center (University of California San Francisco, Site B) over a subsequent 2-year period for external validation. Models for automated NSQIP SSI detection of superficial, organ space, and total SSI within 30 days postoperatively were validated using area under the curve (AUC) scores and corresponding 95% confidence intervals. RESULTS: For the 8,883 patients (Site A) and 1,473 patients (Site B), AUC scores were not statistically different for any outcome including superficial (external 0.804, internal [0.784, 0.874] AUC); organ/space (external 0.905, internal [0.867, 0.941] AUC); and total (external 0.855, internal [0.854, 0.908] AUC) SSI. False negative rates decreased with increasing case review volume and would be amenable to a strategy in which cases with low predicted probabilities of SSI could be excluded from chart review. CONCLUSIONS: Our findings demonstrated that SSI detection machine learning algorithms developed at 1 site were generalizable to another institution. SSI detection models are practically applicable to accelerate and focus chart review.

Understanding how and why audits work in improving the quality of hospital care: A systematic realist review.

BACKGROUND: Several types of audits have been used to promote quality improvement (QI) in hospital care. However, in-depth studies into the mechanisms responsible for the effectiveness of audits in a given context is scarce. We sought to understand the mechanisms and contextual factors that determine why audits might, or might not, lead to improved quality of hospital care. METHODS: A realist review was conducted to systematically search and synthesise the literature on audits. Data from individual papers were synthesised by coding, iteratively testing and supplementing initial programme theories, and refining these theories into a set of context-mechanism-outcome configurations (CMOcs). RESULTS: From our synthesis of 85 papers, seven CMOcs were identified that explain how audits work: (1) externally initiated audits create QI awareness although their impact on improvement diminishes over time; (2) a sense of urgency felt by healthcare professionals triggers engagement with an audit; (3) champions are vital for an audit to be perceived by healthcare professionals as worth the effort; (4) bottom-up initiated audits are more likely to bring about sustained change; (5) knowledge-sharing within externally mandated audits triggers participation by healthcare professionals; (6) audit data support healthcare professionals in raising issues in their dialogues with those in leadership positions; and (7) audits legitimise the provision of feedback to colleagues, which flattens the perceived hierarchy and encourages constructive collaboration. CONCLUSIONS: This realist review has identified seven CMOcs that should be taken into account when seeking to optimise the design and usage of audits. These CMOcs can provide policy makers and practice leaders with an adequate conceptual grounding to design contextually sensitive audits in diverse settings and advance the audit research agenda for various contexts. PROSPERO REGISTRATION: CRD42016039882.

Clinical auditing as an instrument to improve care for patients with ovarian cancer: The Dutch Gynecological Oncology Audit (DGOA).

INTRODUCTION: The Dutch Gynecological Oncology Audit (DGOA) was initiated in 2014 to serve as a nationwide audit, which registers the four most prevalent gynecological malignancies. This study presents the first results of clinical auditing for ovarian cancer in the Netherlands. METHODS: The Dutch Gynecological Oncology Audit is facilitated by the Dutch Institute of Clinical Auditing (DICA) and run by a scientific committee. Items are collected through a web-based registration based on a set of predefined quality indicators. Results of quality indicators are shown, and benchmarked information is given back to the user. Data verification was done in 2016. RESULTS: Between January 01, 2014 and December 31, 2018, 6535 patients with ovarian cancer were registered. The case ascertainment was 98.3% in 2016. The number of patients with ovarian cancer who start therapy within 28 days decreased over time from 68.7% in 2014 to 62.7% in 2018 (p < 0.001). The percentage of patients with primary cytoreductive surgery decreased over time (57.8%-39.7%, P < 0.001). However, patients with complete primary cytoreductive surgery improved over time (53.5%-69.1%, P < 0.001). Other quality indicators did not significantly change over time. CONCLUSION: The Dutch Gynecological Oncology Audit provides valuable data on the quality of care on patients with ovarian cancer in the Netherlands. Data show variation between hospitals with regard to pre-determined quality indicators. Results of 'best practices' will be shared with all participants of the clinical audit with the aim of improving quality of care nationwide.

Prospective audit of the safety of endoscopist-directed nurse-administered propofol sedation in an Australian referral hospital.

BACKGROUND AND AIM: Endoscopist directed nurse administered propofol sedation (EDNAPS) is widely considered to be safe and efficient, but there are limited data from the Australian health-care setting, and Australian sedation guidelines do not support the practice. Thus, we report data from a prospective audit of EDNAPS over a 6.5-year period in an Australian referral hospital. METHODS: Consecutive endoscopic procedures performed between January 2013 and June 2019. Sedation protocol was an initial dose of midazolam 1-3 mg intravenously (i.v.) and propofol 10-50 mg i.v.. Further aliquots of propofol 10-30 mg i.v. were given as required. ProvationMD® endoscopic reporting system was used to prospectively record patient demographics, medication and dose, American Society of Anesthesiologist's (ASA) class, and sedation-related complications. RESULTS: During the 78-month period, 28 051 eligible procedures were performed; 3093 procedures performed with anesthetic support or without EDNAPS were excluded. In total, 24 958 procedures with EDNAPS were analyzed including 7563 gastroscopies, 12 941 colonoscopies, 2932 gastroscopy and colonoscopy, 1440 flexible sigmoidoscopies, and 82 combined gastroscopy and flexible sigmoidoscopy. Of these, 9539 were ASA 1 (38.2%), 13 680 were ASA 2 (54.8%), 1733 were ASA 3 (6.9%), and 4 were ASA 4 (0.02%). Sedation-related complications occurred in 66 patients (0.26%), predominantly transient hypoxic episodes. No patient required intubation for an airway emergency, and there was no sedation-related mortality. Sedation-related complications increased with ASA class and were significantly more common with gastroscopy. CONCLUSIONS: Endoscopist directed nurse administered propofol sedation is a safe way of performing endoscopic sedation in low-risk patients in the hospital setting.

Understanding the Mammography Audit.

Screening mammography aims to identify small, node-negative breast cancers when they are still curable while maintaining an acceptable range of false-positive recalls and biopsies. The mammography audit is a powerful tool to help radiologists understand their performance with respect to that goal. This article defines audit terms and describes how to use collected and derived data to perform a mammography audit. Accepted benchmarks are discussed as well as their applicability to radiologists and breast imaging practices in the United States. Special considerations regarding volumes and radiologist characteristics are explored, because these factors may affect audit results.

Breast Magnetic Resonance Imaging Audit: Pitfalls, Challenges, and Future Considerations.

Breast magnetic resonance (MR) imaging is the most sensitive imaging modality for breast cancer detection and guidelines recommend its use, in addition to screening mammography, for high-risk women. The most recent American College of Radiology (ACR) Breast Imaging Reporting and Data System (BI-RADS) manual coordinated cross-modality BI-RADS terminology and established an outcome monitoring section that helps guide a medical imaging outcomes audit. This article provides a framework for performing a breast MR imaging audit in clinical practice, incorporating ACR BI-RADS guidance and more recently published data, clarifies common pitfalls, and discusses audit challenges related to evolving clinical practice.