Efficacy and Impact of a Multimodal Intervention on CT Pulmonary Angiography Ordering Behavior in the Emergency Department.

OBJECTIVE: To evaluate the efficacy of a multimodal intervention in reducing CT pulmonary angiography (CTPA) overutilization in the evaluation of suspected pulmonary embolism in the emergency department (ED). METHODS: Previous mixed-methods analysis of barriers to guideline-concordant CTPA ordering results was used to develop a provider-focused behavioral intervention consisting of a clinical decision support tool and an audit and feedback system at a multisite, tertiary academic network. The primary outcome (guideline concordance) and secondary outcomes (yield and CTPA and D-dimer order rates) were compared using a pre- and postintervention design. ED encounters for adult patients from July 5, 2017, to January 3, 2019, were included. Fisher's exact tests and statistical process control charts were used to compare the pre- and postintervention groups for each outcome. RESULTS: Of the 201,912 ED patient visits evaluated, 3,587 included CTPA. Guideline concordance increased significantly after the intervention, from 66.9% to 77.5% (P < .001). CTPA order rate and D-dimer order rate also increased significantly, from 17.1 to 18.4 per 1,000 patients (P = .035) and 30.6 to 37.3 per 1,000 patients (P < .001), respectively. Percent yield showed no significant change (12.3% pre- versus 10.8% postintervention; P = .173). Statistical process control analysis showed sustained special-cause variation in the postintervention period for guideline concordance and D-dimer order rates, temporary special-cause variation for CTPA order rates, and no special-cause variation for percent yield. CONCLUSION: Our success in increasing guideline concordance demonstrates the efficacy of a mixed-methods, human-centered approach to behavior change. Given that neither of the secondary outcomes improved, our results may demonstrate potential limitations to the guidelines directing the ordering of CTPA studies and D-dimer ordering.

Using Resident-Sensitive Quality Measures Derived From Electronic Health Record Data to Assess Residents' Performance in Pediatric Emergency Medicine.

PURPOSE: Traditional quality metrics do not adequately represent the clinical work done by residents and, thus, cannot be used to link residency training to health care quality. This study aimed to determine whether electronic health record (EHR) data can be used to meaningfully assess residents' clinical performance in pediatric emergency medicine using resident-sensitive quality measures (RSQMs). METHOD: EHR data for asthma and bronchiolitis RSQMs from Cincinnati Children's Hospital Medical Center, a quaternary children's hospital, between July 1, 2017, and June 30, 2019, were analyzed by ranking residents based on composite scores calculated using raw, unadjusted, and case-mix adjusted latent score models, with lower percentiles indicating a lower quality of care and performance. Reliability and associations between the scores produced by the 3 scoring models were compared. Resident and patient characteristics associated with performance in the highest and lowest tertiles and changes in residents' rank after case-mix adjustments were also identified. RESULTS: 274 residents and 1,891 individual encounters of bronchiolitis patients aged 0-1 as well as 270 residents and 1,752 individual encounters of asthmatic patients aged 2-21 were included in the analysis. The minimum reliability requirement to create a composite score was met for asthma data (α = 0.77), but not bronchiolitis (α = 0.17). The asthma composite scores showed high correlations ( r = 0.90-0.99) between raw, latent, and adjusted composite scores. After case-mix adjustments, residents' absolute percentile rank shifted on average 10 percentiles. Residents who dropped by 10 or more percentiles were likely to be more junior, saw fewer patients, cared for less acute and younger patients, or had patients with a longer emergency department stay. CONCLUSIONS: For some clinical areas, it is possible to use EHR data, adjusted for patient complexity, to meaningfully assess residents' clinical performance and identify opportunities for quality improvement.

Providers Electing to Receive Electronic Result Notifications: Demographics and Motivation.

BACKGROUND: Automated electronic result notifications can alert health care providers of important clinical results. In contrast to historical notification systems, which were predominantly focused on critical laboratory abnormalities and often not very customizable, modern electronic health records provide capabilities for subscription-based electronic notification. This capability has not been well studied. OBJECTIVES: The purpose of this study was to develop an understanding of when and how a provider decides to use a subscription-based electronic notification. Better appreciation for the factors that contribute to selecting such notifications could aid in improving the functionality of these tools. METHODS: We performed an 8-month quantitative assessment of 3,291 notifications and a qualitative survey assessment of 73 providers who utilized an elective notification tool in our electronic health record. RESULTS: We found that most notifications were requested by attending physicians (∼60%) and from internal medicine specialty (∼25%). Most providers requested only a few notifications while a small minority (nearly 5%) requested 10 or more in the study period. The majority (nearly 30%) of requests were for chemistry laboratories. Survey respondents reported using the tool predominantly for important or time-sensitive laboratories. Overall opinions of the tool were positive (median = 7 out of 10, 95% confidence interval: 6-9), with 40% of eligible respondents reporting the tool improved quality of care. Reported examples included time to result review, monitoring of heparin drips, and reviewing pathology results. CONCLUSION: Developing an understanding for when and how providers decide to be notified of clinical results can help aid in the design and improvement of clinical tools, such as improved elective notifications. These tools may lead to reduced time to result review which could in turn improve clinical care quality.

Virtual Urgent Care Quality and Safety in the Time of Coronavirus.

BACKGROUND: Telemedicine use rapidly increased during the COVID-19 pandemic. This study assessed quality aspects of rapid expansion of a virtual urgent care (VUC) telehealth system and the effects of a secondary telephonic screening initiative during the pandemic. METHODS: A retrospective cohort analysis was performed in a single health care network of VUC patients from March 1, 2020, through April 20, 2020. Researchers abstracted demographic data, comorbidities, VUC return visits, emergency department (ED) referrals and ED visits, dispositions, intubations, and deaths. The team also reviewed incomplete visits. For comparison, the study evaluated outcomes of non-admission dispositions from the ED: return visits with and without admission and deaths. We separately analyzed the effects of enhanced callback system targeting higher-risk patients with COVID-like illness during the last two weeks of the study period. RESULTS: A total of 18,278 unique adult patients completed 22,413 VUC visits. Separately, 718 patient-scheduled visits were incomplete; the majority were no-shows. The study found that 50.9% of all patients and 74.1% of patients aged 60 years or older had comorbidities. Of VUC visits, 6.8% had a subsequent VUC encounter within 72 hours; 1.8% had a subsequent ED visit. Of patients with enhanced follow-up, 4.3% were referred for ED evaluation. Mortality was 0.20% overall; 0.21% initially and 0.16% with enhanced follow-up (p = 0.59). Males and black patients were significantly overrepresented in decedents. CONCLUSION: Appropriately deployed VUC services can provide a pragmatic strategy to care for large numbers of patients. Ongoing surveillance of operational, technical, and clinical factors is critical for patient quality and safety with this modality.

Adherence to Subspecialty Guidelines in the Emergency Department.

OBJECTIVES/HYPOTHESIS: The American Academy of Otolaryngology-Head and Neck Surgery has published clinical practice guidelines (CPGs) to guide management of common otolaryngologic (ENT) conditions. While these CPGs have been disseminated within specialty journals, many patients' first presentation of certain ENT complaints is to primary and acute care settings, including the emergency department (ED). It is less clear whether practice in these settings is concordant with specialty CPGs. STUDY DESIGN: Retrospective cohort study. METHODS: A retrospective review of medical records was performed at an academic tertiary care center with ED diagnoses of 1) Bell's palsy/facial weakness (BP) or 2) acute otitis externa (AOE) from May 2014-June 2018. Individual chart abstraction was performed for all encounters with these diagnoses for the purpose of assessing providers' adherence to CPGs. RESULTS: During the study period, 224 patients were diagnosed with BP and 465 patients were diagnosed with AOE. Of the patients diagnosed with BP, 94% (n = 211/224) were prescribed oral steroids, concordant with guidelines, while 36% of these patients received head computed tomography (CT) scans and 43% received laboratory tests, counter to the guidelines. For those with a diagnosis of AOE, 28.6% received topical antibiotics only as primary treatment (n = 133/465) in accordance with guidelines while systemic antibiotics were prescribed in 42.2% (n = 196/465) discordant with the guidelines and 29.2% received both topical and systemic antibiotics (n = 136/465). CONCLUSIONS: CPGs developed by subspecialty societies provide evidence-based recommendations for the care of patients with particular conditions, but may not be disseminated broadly outside of the specialty. Further research is required to understand the reasons behind divergent management of such conditions. LEVEL OF EVIDENCE: 3 Laryngoscope, 131:1266-1270, 2021.

Risk Stratification of COVID-19 Patients Using Ambulatory Oxygen Saturation in the Emergency Department.

INTRODUCTION: It is difficult to determine illness severity for coronavirus disease 2019 (COVID-19) patients, especially among stable-appearing emergency department (ED) patients. We evaluated patient outcomes among ED patients with a documented ambulatory oxygen saturation measurement. METHODS: This was a retrospective chart review of ED patients seen at New York University Langone Health during the peak of the COVID-19 pandemic in New York City. We identified ED patients who had a documented ambulatory oxygen saturation. We studied the outcomes of high oxygen requirement (defined as >4 liters per minute) and mechanical ventilation among admitted patients and bounceback admissions among discharged patients. We also performed logistic regression and compared the performance of different ambulatory oxygen saturation cutoffs in predicting these outcomes. RESULTS: Between March 15-April 14, 2020, 6194 patients presented with fever, cough, or shortness of breath at our EDs. Of these patients, 648 (11%) had a documented ambulatory oxygen saturation, of which 165 (24%) were admitted. Notably, admitted and discharged patients had similar initial vital signs. However, the average ambulatory oxygen saturation among admitted patients was significantly lower at 89% compared to 96% among discharged patients (p<0.01). Among admitted patients with an ambulatory oxygen saturation, 30% had high oxygen requirements and 8% required mechanical ventilation. These rates were predicted by low ambulatory oxygen saturation (p<0.01). Among discharged patients, 50 (10%) had a subsequent ED visit resulting in admission. Although bounceback admissions were predicted by ambulatory oxygen saturation at the first ED visit (p<0.01), our analysis of cutoffs suggested that this association may not be clinically useful. CONCLUSION: Measuring ambulatory oxygen saturation can help ED clinicians identify patients who may require high levels of oxygen or mechanical ventilation during admission. However, it is less useful for identifying which patients may deteriorate clinically in the days after ED discharge and require subsequent hospitalization.

Hyperbaric oxygen therapy for COVID-19 patients with respiratory distress: treated cases versus propensity-matched controls.

Objective: Given the high mortality and prolonged duration of mechanical ventilation of COVID-19 patients, we evaluated the safety and efficacy of hyperbaric oxygen for COVID-19 patients with respiratory distress. Methods: This is a single-center clinical trial of COVID-19 patients at NYU Winthrop Hospital from March 31 to April 28, 2020. Patients in this trial received hyperbaric oxygen therapy at 2.0 atmospheres of pressure in monoplace hyperbaric chambers for 90 minutes daily for a maximum of five total treatments. Controls were identified using propensity score matching among COVID-19 patients admitted during the same time period. Using competing-risks survival regression, we analyzed our primary outcome of inpatient mortality and secondary outcome of mechanical ventilation. Results: We treated 20 COVID-19 patients with hyperbaric oxygen. Ages ranged from 30 to 79 years with an oxygen requirement ranging from 2 to 15 liters on hospital days 0 to 14. Of these 20 patients, two (10%) were intubated and died, and none remain hospitalized. Among 60 propensity-matched controls based on age, sex, body mass index, coronary artery disease, troponin, D-dimer, hospital day, and oxygen requirement, 18 (30%) were intubated, 13 (22%) have died, and three (5%) remain hospitalized (with one still requiring mechanical ventilation). Assuming no further deaths among controls, we estimate that the adjusted subdistribution hazard ratios were 0.37 for inpatient mortality (p=0.14) and 0.26 for mechanical ventilation (p=0.046). Conclusion: Though limited by its study design, our results demonstrate the safety of hyperbaric oxygen among COVID-19 patients and strongly suggests the need for a well-designed, multicenter randomized control trial.

Design and implementation of a clinical decision support tool for primary palliative Care for Emergency Medicine (PRIM-ER).

BACKGROUND: The emergency department is a critical juncture in the trajectory of care of patients with serious, life-limiting illness. Implementation of a clinical decision support (CDS) tool automates identification of older adults who may benefit from palliative care instead of relying upon providers to identify such patients, thus improving quality of care by assisting providers with adhering to guidelines. The Primary Palliative Care for Emergency Medicine (PRIM-ER) study aims to optimize the use of the electronic health record by creating a CDS tool to identify high risk patients most likely to benefit from primary palliative care and provide point-of-care clinical recommendations. METHODS: A clinical decision support tool entitled Emergency Department Supportive Care Clinical Decision Support (Support-ED) was developed as part of an institutionally-sponsored value based medicine initiative at the Ronald O. Perelman Department of Emergency Medicine at NYU Langone Health. A multidisciplinary approach was used to develop Support-ED including: a scoping review of ED palliative care screening tools; launch of a workgroup to identify patient screening criteria and appropriate referral services; initial design and usability testing via the standard System Usability Scale questionnaire, education of the ED workforce on the Support-ED background, purpose and use, and; creation of a dashboard for monitoring and feedback. RESULTS: The scoping review identified the Palliative Care and Rapid Emergency Screening (P-CaRES) survey as a validated instrument in which to adapt and apply for the creation of the CDS tool. The multidisciplinary workshops identified two primary objectives of the CDS: to identify patients with indicators of serious life limiting illness, and to assist with referrals to services such as palliative care or social work. Additionally, the iterative design process yielded three specific patient scenarios that trigger a clinical alert to fire, including: 1) when an advance care planning document was present, 2) when a patient had a previous disposition to hospice, and 3) when historical and/or current clinical data points identify a serious life-limiting illness without an advance care planning document present. Monitoring and feedback indicated a need for several modifications to improve CDS functionality. CONCLUSIONS: CDS can be an effective tool in the implementation of primary palliative care quality improvement best practices. Health systems should thoughtfully consider tailoring their CDSs in order to adapt to their unique workflows and environments. The findings of this research can assist health systems in effectively integrating a primary palliative care CDS system seamlessly into their processes of care. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT03424109. Registered 6 February 2018, Grant Number: AT009844-01.

An Evaluation of Guideline-Discordant Ordering Behavior for CT Pulmonary Angiography in the Emergency Department.

PURPOSE: The aim of this study was to determine rates of and possible reasons for guideline-discordant ordering of CT pulmonary angiography for the evaluation of suspected pulmonary embolism (PE) in the emergency department. METHODS: A retrospective review was performed of 212 consecutive encounters (January 6, 2016, to February 25, 2016) with 208 unique patients in the emergency department that resulted in CT pulmonary angiography orders. For each encounter, the revised Geneva score and two versions of the Wells criteria were calculated. Each encounter was then classified using a two-tiered risk stratification method (PE unlikely versus PE likely). Finally, the rate of and possible explanations for guideline-discordant ordering were assessed via in-depth chart review. RESULTS: The frequency of guideline-discordant studies ranged from 53 (25%) to 79 (37%), depending on the scoring system used; 46 (22%) of which were guideline discordant under all three scoring systems. Of these, 18 (39%) had at least one patient-specific factor associated with increased risk for PE but not included in the risk stratification scores (eg, travel, thrombophilia). CONCLUSIONS: Many of the guideline-discordant orders were placed for patients who presented with evidence-based risk factors for PE that are not included in the risk stratification scores. Therefore, guideline-discordant ordering may indicate that in the presence of these factors, the assessment of risk made by current scoring systems may not align with clinical suspicion.

Natural Language Processing for Identification of Incidental Pulmonary Nodules in Radiology Reports.

PURPOSE: To develop natural language processing (NLP) to identify incidental lung nodules (ILNs) in radiology reports for assessment of management recommendations. METHODS AND MATERIALS: We searched the electronic health records for patients who underwent chest CT during 2014 and 2017, before and after implementation of a department-wide dictation macro of the Fleischner Society recommendations. We randomly selected 950 unstructured chest CT reports and reviewed manually for ILNs. An NLP tool was trained and validated against the manually reviewed set, for the task of automated detection of ILNs with exclusion of previously known or definitively benign nodules. For ILNs found in the training and validation sets, we assessed whether reported management recommendations agreed with Fleischner Society guidelines. The guideline concordance of management recommendations was compared between 2014 and 2017. RESULTS: The NLP tool identified ILNs with sensitivity and specificity of 91.1% and 82.2%, respectively, in the validation set. Positive and negative predictive values were 59.7% and 97.0%. In reports of ILNs in the training and validation sets before versus after introduction of a Fleischner reporting macro, there was no difference in the proportion of reports with ILNs (108 of 500 [21.6%] versus 101 of 450 [22.4%]; P = .8), or in the proportion of reports with ILNs containing follow-up recommendations (75 of 108 [69.4%] versus 80 of 101 [79.2%]; P = .2]. Rates of recommendation guideline concordance were not significantly different before and after implementation of the standardized macro (52 of 75 [69.3%] versus 60 of 80 [75.0%]; P = .43). CONCLUSION: NLP reliably automates identification of ILNs in unstructured reports, pertinent to quality improvement efforts for ILN management.

Automated Pulmonary Embolism Risk Classification and Guideline Adherence for Computed Tomography Pulmonary Angiography Ordering.

BACKGROUND: The assessment of clinical guideline adherence for the evaluation of pulmonary embolism (PE) via computed tomography pulmonary angiography (CTPA) currently requires either labor-intensive, retrospective chart review or prospective collection of PE risk scores at the time of CTPA order. The recording of clinical data in a structured manner in the electronic health record (EHR) may make it possible to automate the calculation of a patient's PE risk classification and determine whether the CTPA order was guideline concordant. OBJECTIVES: The objective of this study was to measure the performance of automated, structured data-only versions of the Wells and revised Geneva risk scores in emergency department (ED) encounters during which a CTPA was ordered. The hypothesis was that such an automated method would classify a patient's PE risk with high accuracy compared to manual chart review. METHODS: We developed automated, structured data-only versions of the Wells and revised Geneva risk scores to classify 212 ED encounters during which a CTPA was performed as "PE likely" or "PE unlikely." We then combined these classifications with D-dimer ordering data to assess each encounter as guideline concordant or discordant. The accuracy of these automated classifications and assessments of guideline concordance were determined by comparing them to classifications and concordance based on the complete Wells and revised Geneva scores derived via abstractor manual chart review. RESULTS: The automatically derived Wells and revised Geneva risk classifications were 91.5 and 92% accurate compared to the manually determined classifications, respectively. There was no statistically significant difference between guideline adherence calculated by the automated scores compared to manual chart review (Wells, 70.8% vs. 75%, p = 0.33; revised Geneva, 65.6% vs. 66%, p = 0.92). CONCLUSION: The Wells and revised Geneva score risk classifications can be approximated with high accuracy using automated extraction of structured EHR data elements in patients who received a CTPA. Combining these automated scores with D-dimer ordering data allows for the automated assessment of clinical guideline adherence for CTPA ordering in the ED, without the burden of manual chart review.

Assessing the Reliability of Performing Citywide Chronic Disease Surveillance Using Emergency Department Data from Sentinel Hospitals.

Given the inequalities in the distribution of disease burden, geographically detailed methods of disease surveillance are needed to identify local hot spots of chronic disease. However, few data sources include the patient-level addresses needed to perform these studies. Given that individual hospitals would have access to this geographically granular data, this study assessed the reliability of estimating chronic disease prevalence using emergency department surveillance at specific hospitals. Neighborhood-level diabetes, hypertension, and asthma prevalence were estimated using emergency claims data from each individual hospital in New York City from 2009-2012. Estimates were compared to prevalence obtained from a traditional health survey. A multivariable analysis also was performed to identify which individual hospitals were more accurate at estimating citywide disease prevalence. Among 52 hospitals, variation was found in the accuracy of disease prevalence estimates using emergency department surveillance. Estimates at some hospitals, such as NYU Langone Medical Center, had strong correlations for all diseases studied (diabetes: 0.81, hypertension: 0.84, and asthma: 0.84). Hospitals with patient populations geographically distributed throughout New York City had better accuracy in estimating citywide disease prevalence. For diabetes and hypertension, hospitals with racial/ethnic patient distributions similar to Census estimates and higher fidelity of diagnosis coding also had more accurate prevalence estimates. This study demonstrated how citywide chronic disease surveillance can be performed using emergency data from specific sentinel hospitals. The findings may provide an alternative means of mapping chronic disease burden by using existing data, which may be critical in regions without resources for geographically detailed health surveillance.

Designing a clinical dashboard to fill information gaps in the emergency department.

Data fragmentation within electronic health records causes gaps in the information readily available to clinicians. We investigated the information needs of emergency medicine clinicians in order to design an electronic dashboard to fill information gaps in the emergency department. An online survey was distributed to all emergency medicine physicians at a large, urban academic medical center. The survey response rate was 48% (52/109). The clinical information items reported to be most helpful while caring for patients in the emergency department were vital signs, electrocardiogram (ECG) reports, previous discharge summaries, and previous lab results. Brief structured interviews were also conducted with 18 clinicians during their shifts in the emergency department. From the interviews, three themes emerged: 1) difficulty accessing vital signs, 2) difficulty accessing point-of-care tests, and 3) difficulty comparing the current ECG with the previous ECG. An emergency medicine clinical dashboard was developed to address these difficulties.