Development and Validation of an Electronic Adverse Event Model for Patient Safety Surveillance in Interventional Radiology.

BACKGROUND: Comprehensive adverse event (AE) surveillance programs in interventional radiology (IR) are rare. Our aim was to develop and validate a retrospective electronic surveillance model to identify outpatient IR procedures that are likely to have an AE, to support patient safety and quality improvement. METHODS: We identified outpatient IR procedures performed in the period from October 2017 to September 2019 from the Veterans Health Administration (n = 135,283) and applied electronic triggers based on posyprocedure care to flag cases with a potential AE. From the trigger-flagged cases, we randomly sampled n = 1,500 for chart review to identify AEs. We also randomly sampled n = 600 from the unflagged cases. Chart-reviewed cases were merged with patient, procedure, and facility factors to estimate a mixed-effects logistic regression model designed to predict whether an AE occurred. Using model fit and criterion validity, we determined the best predicted probability threshold to identify cases with a likely AE. We reviewed a random sample of 200 cases above the threshold and 100 cases from below the threshold from October 2019 to March 2020 (n = 20,849) for model validation. RESULTS: In our development sample of mostly trigger-flagged cases, 444 of 2,096 cases (21.8%) had an AE. The optimal predicted probability threshold for a likely AE from our surveillance model was >50%, with positive predictive value of 68.9%, sensitivity of 38.3%, and specificity of 95.3%. In validation, chart-reviewed cases with AE probability >50% had a positive predictive value of 63% (n = 203). For the period from October 2017 to March 2020, the model identified approximately 70 IR cases per month that were likely to have an AE. CONCLUSIONS: This electronic trigger-based approach to AE surveillance could be used for patient-safety reporting and quality review.

Development of a Periprocedure Trigger for Outpatient Interventional Radiology Procedures in the Veterans Health Administration.

OBJECTIVES: Interventional radiology (IR) is the newest medical specialty. However, it lacks robust quality assurance metrics, including adverse event (AE) surveillance tools. Considering the high frequency of outpatient care provided by IR, automated electronic triggers offer a potential catalyst to support accurate retrospective AE detection. METHODS: We programmed previously validated AE triggers (admission, emergency visit, or death up to 14 days after procedure) for elective, outpatient IR procedures performed in Veterans Health Administration surgical facilities between fiscal years 2017 and 2019. We then developed a text-based algorithm to detect AEs that explicitly occurred in the periprocedure time frame: before, during, and shortly after the IR procedure. Guided by the literature and clinical expertise, we generated clinical note keywords and text strings to flag cases with high potential for periprocedure AEs. Flagged cases underwent targeted chart review to measure criterion validity (i.e., the positive predictive value), to confirm AE occurrence, and to characterize the event. RESULTS: Among 135,285 elective outpatient IR procedures, the periprocedure algorithm flagged 245 cases (0.18%); 138 of these had ≥1 AE, yielding a positive predictive value of 56% (95% confidence interval, 50%-62%). The previously developed triggers for admission, emergency visit, or death in 14 days flagged 119 of the 138 procedures with AEs (73%). Among the 43 AEs detected exclusively by the periprocedure trigger were allergic reactions, adverse drug events, ischemic events, bleeding events requiring blood transfusions, and cardiac arrest requiring cardiopulmonary resuscitation. CONCLUSIONS: The periprocedure trigger performed well on IR outpatient procedures and offers a complement to other electronic triggers developed for outpatient AE surveillance.

Arteriovenous Graft Failure in the Veterans Health Administration: Outcome Disparities Associated with Race.

Background Vascular access for ongoing hemodialysis often fails, frequently requiring repeated procedures to maintain vascular patency. While research has shown racial discrepancies in multiple aspects of renal failure treatment, there is poor understanding of how these factors might relate to vascular access maintenance procedures after arteriovenous graft (AVG) placement. Purpose To evaluate racial disparities associated with premature vascular access failure after percutaneous access maintenance procedures following AVG placement using a retrospective national cohort from the Veterans Health Administration (VHA). Materials and Methods All hemodialysis vascular maintenance procedures performed at VHA hospitals between October 2016 and March 2020 were identified. To ensure the sample represented patients who consistently used the VHA, patients without AVG placement within 5 years of their first maintenance procedure were excluded. Access failure was defined as a repeat access maintenance procedure or as hemodialysis catheter placement occurring 1-30 days after the index procedure. Multivariable logistic regression analyses were performed to calculate prevalence ratios (PRs) measuring the association between hemodialysis maintenance failure and African American race compared with all other races. Models controlled for vascular access history, patient socioeconomic status, and procedure and facility characteristics. Results In total, 1950 access maintenance procedures in 995 patients (mean age, 69 years ± 9 [SD], 1870 men) with an AVG created in one of 61 VHA facilities were identified. Most procedures involved African American patients (1169 of 1950, 60%) and patients residing in the South (1002 of 1950, 51%). Premature access failure occurred in 215 of 1950 (11%) procedures. When compared with all other races, African American race was associated with premature access site failure (PR, 1.4; 95% CI: 1.07, 1.43; P = .02). Among the 1057 procedures in 30 facilities with interventional radiology resident training programs, there was no evidence of racial disparity in the outcome (PR, 1.1; P = .63). Conclusion African American race was associated with higher risk-adjusted rates of premature arteriovenous graft failure after dialysis maintenance. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Forman and Davis in this issue.

Assessing the sustainability of compliance with surgical site infection prophylaxis after discontinuation of mandatory active reporting: study protocol.

BACKGROUND: Surgical site infections are common. Risk can be reduced substantially with appropriate preoperative antimicrobial administration. In 2005, the VA implemented the Surgical Care Improvement Project (SCIP) in the setting of high rates of non-compliance with antimicrobial prophylaxis guidelines. SCIP included public reporting of evidenced-based antimicrobial guideline compliance metrics in high-risk surgeries. SCIP was highly successful and led to high rates of adoption of preoperative antimicrobials and early discontinuation of postoperative antimicrobials (>95%). The program was retired in 2015, as the manual measurement and reporting process was costly with limited expected additional benefit. To our knowledge, no studies have assessed whether the gains achieved by SCIP were sustained since active support for the program was discontinued. Furthermore, there has been no investigation of the spread of antimicrobial prophylaxis guideline adoption beyond the limited set of procedures that were included in the program. METHODS: Using a mixed methods sequential exploratory approach, this study will (1) quantitatively measure compliance with SCIP metrics over time and across all procedures in the five major surgical specialties targeted by SCIP and (2) collect qualitative data from stakeholders to identify strategies that were effective for sustaining compliance. Diffusion of Innovation Theory will guide assessment of whether improvements achieved spread to procedures not included under the umbrella of the program. Electronic algorithms to measure SCIP antimicrobial use will be adapted from previously developed methodology. These highly novel data mining algorithms leverage the rich VA electronic health record and capture structured and text data and represent a substantial technological advancement over resource-intensive manual chart review or incomplete electronic surveillance based on pharmacy data. An interrupted time series analysis will be used to assess whether SCIP compliance was sustained following program discontinuation. Generalized linear models will be used to assess whether compliance with appropriate prophylaxis increased in all SCIP targeted and non-targeted procedures by specialty over the duration the program's active reporting. The Dynamic Sustainability Framework will guide the qualitative methods to assess intervention, provider, facility, specialty, and contextual factors associated with sustainability over time. Barriers and facilitators to sustainability will be mapped to implementation strategies and the study will yield an implementation playbook to guide future sustainment efforts. RELEVANCE: Sustainability of practice change has been described as one of the most important, but least studied areas of clinical medicine. Learning how practices spread is also a critically important area of investigation. This study will use novel informatics strategies to evaluate factors associated with sustainability following removal of active policy surveillance and advance our understanding about these important, yet understudied, areas.