External Validation and Comparison of a General Ward Deterioration Index Between Diversely Different Health Systems.

OBJECTIVES: Implementing a predictive analytic model in a new clinical environment is fraught with challenges. Dataset shifts such as differences in clinical practice, new data acquisition devices, or changes in the electronic health record (EHR) implementation mean that the input data seen by a model can differ significantly from the data it was trained on. Validating models at multiple institutions is therefore critical. Here, using retrospective data, we demonstrate how Predicting Intensive Care Transfers and other UnfoReseen Events (PICTURE), a deterioration index developed at a single academic medical center, generalizes to a second institution with significantly different patient population. DESIGN: PICTURE is a deterioration index designed for the general ward, which uses structured EHR data such as laboratory values and vital signs. SETTING: The general wards of two large hospitals, one an academic medical center and the other a community hospital. SUBJECTS: The model has previously been trained and validated on a cohort of 165,018 general ward encounters from a large academic medical center. Here, we apply this model to 11,083 encounters from a separate community hospital. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: The hospitals were found to have significant differences in missingness rates (> 5% difference in 9/52 features), deterioration rate (4.5% vs 2.5%), and racial makeup (20% non-White vs 49% non-White). Despite these differences, PICTURE's performance was consistent (area under the receiver operating characteristic curve [AUROC], 0.870; 95% CI, 0.861-0.878), area under the precision-recall curve (AUPRC, 0.298; 95% CI, 0.275-0.320) at the first hospital; AUROC 0.875 (0.851-0.902), AUPRC 0.339 (0.281-0.398) at the second. AUPRC was standardized to a 2.5% event rate. PICTURE also outperformed both the Epic Deterioration Index and the National Early Warning Score at both institutions. CONCLUSIONS: Important differences were observed between the two institutions, including data availability and demographic makeup. PICTURE was able to identify general ward patients at risk of deterioration at both hospitals with consistent performance (AUROC and AUPRC) and compared favorably to existing metrics.

Portable Breath-Based Volatile Organic Compound Monitoring for the Detection of COVID-19 During the Circulation of the SARS-CoV-2 Delta Variant and the Transition to the SARS-CoV-2 Omicron Variant.

Importance: Breath analysis has been explored as a noninvasive means to detect COVID-19. However, the impact of emerging variants of SARS-CoV-2, such as Omicron, on the exhaled breath profile and diagnostic accuracy of breath analysis is unknown. Objective: To evaluate the diagnostic accuracies of breath analysis on detecting patients with COVID-19 when the SARS-CoV-2 Delta and Omicron variants were most prevalent. Design, Setting, and Participants: This diagnostic study included a cohort of patients who had positive and negative test results for COVID-19 using reverse transcriptase polymerase chain reaction between April 2021 and May 2022, which covers the period when the Delta variant was overtaken by Omicron as the major variant. Patients were enrolled through intensive care units and the emergency department at the University of Michigan Health System. Patient breath was analyzed with portable gas chromatography. Main Outcomes and Measures: Different sets of VOC biomarkers were identified that distinguished between COVID-19 (SARS-CoV-2 Delta and Omicron variants) and non-COVID-19 illness. Results: Overall, 205 breath samples from 167 adult patients were analyzed. A total of 77 patients (mean [SD] age, 58.5 [16.1] years; 41 [53.2%] male patients; 13 [16.9%] Black and 59 [76.6%] White patients) had COVID-19, and 91 patients (mean [SD] age, 54.3 [17.1] years; 43 [47.3%] male patients; 11 [12.1%] Black and 76 [83.5%] White patients) had non-COVID-19 illness. Several patients were analyzed over multiple days. Among 94 positive samples, 41 samples were from patients in 2021 infected with the Delta or other variants, and 53 samples were from patients in 2022 infected with the Omicron variant, based on the State of Michigan and US Centers for Disease Control and Prevention surveillance data. Four VOC biomarkers were found to distinguish between COVID-19 (Delta and other 2021 variants) and non-COVID-19 illness with an accuracy of 94.7%. However, accuracy dropped substantially to 82.1% when these biomarkers were applied to the Omicron variant. Four new VOC biomarkers were found to distinguish the Omicron variant and non-COVID-19 illness (accuracy, 90.9%). Breath analysis distinguished Omicron from the earlier variants with an accuracy of 91.5% and COVID-19 (all SARS-CoV-2 variants) vs non-COVID-19 illness with 90.2% accuracy. Conclusions and Relevance: The findings of this diagnostic study suggest that breath analysis has promise for COVID-19 detection. However, similar to rapid antigen testing, the emergence of new variants poses diagnostic challenges. The results of this study warrant additional evaluation on how to overcome these challenges to use breath analysis to improve the diagnosis and care of patients.

Rapid breath analysis for acute respiratory distress syndrome diagnostics using a portable two-dimensional gas chromatography device.

Acute respiratory distress syndrome (ARDS) is the most severe form of acute lung injury, responsible for high mortality and long-term morbidity. As a dynamic syndrome with multiple etiologies, its timely diagnosis is difficult as is tracking the course of the syndrome. Therefore, there is a significant need for early, rapid detection and diagnosis as well as clinical trajectory monitoring of ARDS. Here, we report our work on using human breath to differentiate ARDS and non-ARDS causes of respiratory failure. A fully automated portable 2-dimensional gas chromatography device with high peak capacity (> 200 at the resolution of 1), high sensitivity (sub-ppb), and rapid analysis capability (~ 30 min) was designed and made in-house for on-site analysis of patients' breath. A total of 85 breath samples from 48 ARDS patients and controls were collected. Ninety-seven elution peaks were separated and detected in 13 min. An algorithm based on machine learning, principal component analysis (PCA), and linear discriminant analysis (LDA) was developed. As compared to the adjudications done by physicians based on the Berlin criteria, our device and algorithm achieved an overall accuracy of 87.1% with 94.1% positive predictive value and 82.4% negative predictive value. The high overall accuracy and high positive predicative value suggest that the breath analysis method can accurately diagnose ARDS. The ability to continuously and non-invasively monitor exhaled breath for early diagnosis, disease trajectory tracking, and outcome prediction monitoring of ARDS may have a significant impact on changing practice and improving patient outcomes. Graphical abstract.