Development and Validation of Deep-Learning-Based Sepsis and Septic Shock Early Prediction System (DeepSEPS) Using Real-World ICU Data.

BACKGROUND: Successful sepsis treatment depends on early diagnosis. We aimed to develop and validate a system to predict sepsis and septic shock in real time using deep learning. METHODS: Clinical data were retrospectively collected from electronic medical records (EMRs). Data from 2010 to 2019 were used as development data, and data from 2020 to 2021 were used as validation data. The collected EMRs consisted of eight vital signs, 13 laboratory data points, and three demographic information items. We validated the deep-learning-based sepsis and septic shock early prediction system (DeepSEPS) using the validation datasets and compared our system with other traditional early warning scoring systems, such as the national early warning score, sequential organ failure assessment (SOFA), and quick sequential organ failure assessment. RESULTS: DeepSEPS achieved even higher area under receiver operating characteristic curve (AUROC) values (0.7888 and 0.8494 for sepsis and septic shock, respectively) than SOFA. The prediction performance of traditional scoring systems was enhanced because the early prediction time point was close to the onset time of sepsis; however, the DeepSEPS scoring system consistently outperformed all conventional scoring systems at all time points. Furthermore, at the time of onset of sepsis and septic shock, DeepSEPS showed the highest AUROC (0.9346). CONCLUSIONS: The sepsis and septic shock early warning system developed in this study exhibited a performance that is worth considering when predicting sepsis and septic shock compared to other traditional early warning scoring systems. DeepSEPS showed better performance than existing sepsis prediction programs. This novel real-time system that simultaneously predicts sepsis and septic shock requires further validation.

Early prediction of need for invasive mechanical ventilation in the neonatal intensive care unit using artificial intelligence and electronic health records: a clinical study.

BACKGROUND: Respiratory support is crucial for newborns with underdeveloped lung. The clinical outcomes of patients depend on the clinician's ability to recognize the status underlying the presented symptoms and signs. With the increasing number of high-risk infants, artificial intelligence (AI) should be considered as a tool for personalized neonatal care. Continuous monitoring of vital signs is essential in cardiorespiratory care. In this study, we developed deep learning (DL) prediction models for rapid and accurate detection of mechanical ventilation requirements in neonates using electronic health records (EHR). METHODS: We utilized data from the neonatal intensive care unit in a single center, collected between March 3, 2012, and March 4, 2022, including 1,394 patient records used for model development, consisting of 505 and 889 patients with and without invasive mechanical ventilation (IMV) support, respectively. The proposed model architecture includes feature embedding using feature-wise fully connected (FC) layers, followed by three bidirectional long short-term memory (LSTM) layers. RESULTS: A mean gestational age (GA) was 36.61 ± 3.25 weeks, and the mean birth weight was 2,734.01 ± 784.98 g. The IMV group had lower GA, birth weight, and longer hospitalization duration than the non-IMV group (P < 0.05). Our proposed model, tested on a dataset from March 4, 2019, to March 4, 2022. The mean AUROC of our proposed model for IMV support prediction performance demonstrated 0.861 (95%CI, 0.853-0.869). It is superior to conventional approaches, such as newborn early warning score systems (NEWS), Random Forest, and eXtreme gradient boosting (XGBoost) with 0.611 (95%CI, 0.600-0.622), 0.837 (95%CI, 0.828-0.845), and 0.0.831 (95%CI, 0.821-0.845), respectively. The highest AUPRC value is shown in the proposed model at 0.327 (95%CI, 0.308-0.347). The proposed model performed more accurate predictions as gestational age decreased. Additionally, the model exhibited the lowest alarm rate while maintaining the same sensitivity level. CONCLUSION: Deep learning approaches can help accurately standardize the prediction of invasive mechanical ventilation for neonatal patients and facilitate advanced neonatal care. The results of predictive, recall, and alarm performances of the proposed model outperformed the other models.

Multicenter validation of a deep-learning-based pediatric early-warning system for prediction of deterioration events.

BACKGROUND: Early recognition of deterioration events is crucial to improve clinical outcomes. For this purpose, we developed a deep-learning-based pediatric early-warning system (pDEWS) and aimed to validate its clinical performance. METHODS: This is a retrospective multicenter cohort study including five tertiary-care academic children's hospitals. All pediatric patients younger than 19 years admitted to the general ward from January 2019 to December 2019 were included. Using patient electronic medical records, we evaluated the clinical performance of the pDEWS for identifying deterioration events defined as in-hospital cardiac arrest (IHCA) and unexpected general ward-to-pediatric intensive care unit transfer (UIT) within 24 hours before event occurrence. We also compared pDEWS performance to those of the modified pediatric early-warning score (PEWS) and prediction models using logistic regression (LR) and random forest (RF). RESULTS: The study population consisted of 28,758 patients with 34 cases of IHCA and 291 cases of UIT. pDEWS showed better performance for predicting deterioration events with a larger area under the receiver operating characteristic curve, fewer false alarms, a lower mean alarm count per day, and a smaller number of cases needed to examine than the modified PEWS, LR, or RF models regardless of site, event occurrence time, age group, or sex. CONCLUSIONS: The pDEWS outperformed modified PEWS, LR, and RF models for early and accurate prediction of deterioration events regardless of clinical situation. This study demonstrated the potential of pDEWS as an efficient screening tool for efferent operation of rapid response teams.

Deep learning of ECG waveforms for diagnosis of heart failure with a reduced left ventricular ejection fraction.

The performance and clinical implications of the deep learning aided algorithm using electrocardiogram of heart failure (HF) with reduced ejection fraction (DeepECG-HFrEF) were evaluated in patients with acute HF. The DeepECG-HFrEF algorithm was trained to identify left ventricular systolic dysfunction (LVSD), defined by an ejection fraction (EF) < 40%. Symptomatic HF patients admitted at Seoul National University Hospital between 2011 and 2014 were included. The performance of DeepECG-HFrEF was determined using the area under the receiver operating characteristic curve (AUC) values. The 5-year mortality according to DeepECG-HFrEF results was analyzed using the Kaplan-Meier method. A total of 690 patients contributing 18,449 ECGs were included with final 1291 ECGs eligible for the study (mean age 67.8 ± 14.4 years; men, 56%). HFrEF (+) identified an EF < 40% and HFrEF (-) identified EF ≥ 40%. The AUC value was 0.844 for identifying HFrEF among patients with acute symptomatic HF. Those classified as HFrEF (+) showed lower survival rates than HFrEF (-) (log-rank p < 0.001). The DeepECG-HFrEF algorithm can discriminate HFrEF in a real-world HF cohort with acceptable performance. HFrEF (+) was associated with higher mortality rates. The DeepECG-HFrEF algorithm may help in identification of LVSD and of patients at risk of worse survival in resource-limited settings.

An Artificial Intelligence Algorithm With 24-h Holter Monitoring for the Identification of Occult Atrial Fibrillation During Sinus Rhythm.

Background: Subclinical atrial fibrillation (AF) is one of the pathogeneses of embolic stroke. Detection of occult AF and providing proper anticoagulant treatment is an important way to prevent stroke recurrence. The purpose of this study was to determine whether an artificial intelligence (AI) model can assess occult AF using 24-h Holter monitoring during normal sinus rhythm. Methods: This study is a retrospective cohort study that included those who underwent Holter monitoring. The primary outcome was identifying patients with AF analyzed with an AI model using 24-h Holter monitoring without AF documentation. We trained the AI using a Holter monitor, including supraventricular ectopy (SVE) events (setting 1) and excluding SVE events (setting 2). Additionally, we performed comparisons using the SVE burden recorded in Holter annotation data. Results: The area under the receiver operating characteristics curve (AUROC) of setting 1 was 0.85 (0.83-0.87) and that of setting 2 was 0.84 (0.82-0.86). The AUROC of the SVE burden with Holter annotation data was 0.73. According to the diurnal period, the AUROCs for daytime were 0.83 (0.78-0.88) for setting 1 and 0.83 (0.78-0.88) for setting 2, respectively, while those for nighttime were 0.85 (0.82-0.88) for setting 1 and 0.85 (0.80-0.90) for setting 2. Conclusion: We have demonstrated that an AI can identify occult paroxysmal AF using 24-h continuous ambulatory Holter monitoring during sinus rhythm. The performance of our AI model outperformed the use of SVE burden in the Holter exam to identify paroxysmal AF. According to the diurnal period, nighttime recordings showed more favorable performance compared to daytime recordings.

Evaluating the Risk of Paroxysmal Atrial Fibrillation in Noncardioembolic Ischemic Stroke Using Artificial Intelligence-Enabled ECG Algorithm.

Background: The identification of latent atrial fibrillation (AF) in patients with ischemic stroke (IS) attributed to noncardioembolic etiology may have therapeutic implications. An artificial intelligence (AI) model identifying the electrocardiographic signature of AF present during normal sinus rhythm (NSR; AI-ECG-AF) can identify individuals with a high likelihood of paroxysmal AF (PAF) with NSR electrocardiogram (ECG). Objectives: Using AI-ECG-AF, we aimed to compare the PAF risk between noncardioembolic IS subgroups and general patients of a university hospital after controlling for confounders. Further, we sought to compare the risk of PAF among noncardioembolic IS subgroups. Methods: After training AI-ECG-AF with ECG data of university hospital patients, model inference outputs were obtained for the control group (i.e., general patient population) and NSRs of noncardioembolic IS patients. We conducted multiple linear regression (MLiR) and multiple logistic regression (MLoR) analyses with inference outputs (for MLiR) or their binary form (set at threshold = 0.5 for MLoR) used as dependent variables and patient subgroups and potential confounders (age and sex) set as independent variables. Results: The number of NSRs inferenced for the control group, cryptogenic, large artery atherosclerosis (LAA), and small artery occlusion (SAO) strokes were 133,340, 133, 276, and 290, respectively. The regression analyses indicated that patients with noncardioembolic IS had a higher PAF risk based on AI-ECG-AF relative to the control group, after controlling for confounders with the "cryptogenic" subgroup having the highest risk (odds ratio [OR] = 1.974, 95% confidence interval [CI]: 1.371-2.863) followed by the "LAA" (OR = 1.592, 95% CI: 1.238-2.056) and "SAO" subgroups (OR = 1.400, 95% CI: 1.101-1.782). Subsequent regression analyses failed to illustrate the differences in PAF risk based on AI-ECG-AF among noncardioembolic IS subgroups. Conclusion: Using AI-ECG-AF, we found that noncardioembolic IS patients had a higher PAF risk relative to the general patient population. The results from our study imply the need for more vigorous cardiac monitoring in noncardioembolic IS patients. AI-ECG-AF can be a cost-effective screening tool to identify high-risk noncardioembolic IS patients of PAF on-the-spot to be candidates for receiving additional prolonged cardiac monitoring. Our study highlights the potential of AI in clinical practice.

Quick Sequential Organ Failure Assessment Score and the Modified Early Warning Score for Predicting Clinical Deterioration in General Ward Patients Regardless of Suspected Infection.

BACKGROUND: The quick sequential organ failure assessment (qSOFA) score is suggested to use for screening patients with a high risk of clinical deterioration in the general wards, which could simply be regarded as a general early warning score. However, comparison of unselected admissions to highlight the benefits of introducing qSOFA in hospitals already using Modified Early Warning Score (MEWS) remains unclear. We sought to compare qSOFA with MEWS for predicting clinical deterioration in general ward patients regardless of suspected infection. METHODS: The predictive performance of qSOFA and MEWS for in-hospital cardiac arrest (IHCA) or unexpected intensive care unit (ICU) transfer was compared with the areas under the receiver operating characteristic curve (AUC) analysis using the databases of vital signs collected from consecutive hospitalized adult patients over 12 months in five participating hospitals in Korea. RESULTS: Of 173,057 hospitalized patients included for analysis, 668 (0.39%) experienced the composite outcome. The discrimination for the composite outcome for MEWS (AUC, 0.777; 95% confidence interval [CI], 0.770-0.781) was higher than that for qSOFA (AUC, 0.684; 95% CI, 0.676-0.686; P < 0.001). In addition, MEWS was better for prediction of IHCA (AUC, 0.792; 95% CI, 0.781-0.795 vs. AUC, 0.640; 95% CI, 0.625-0.645; P < 0.001) and unexpected ICU transfer (AUC, 0.767; 95% CI, 0.760-0.773 vs. AUC, 0.716; 95% CI, 0.707-0.718; P < 0.001) than qSOFA. Using the MEWS at a cutoff of ≥ 5 would correctly reclassify 3.7% of patients from qSOFA score ≥ 2. Most patients met MEWS ≥ 5 criteria 13 hours before the composite outcome compared with 11 hours for qSOFA score ≥ 2. CONCLUSION: MEWS is more accurate that qSOFA score for predicting IHCA or unexpected ICU transfer in patients outside the ICU. Our study suggests that qSOFA should not replace MEWS for identifying patients in the general wards at risk of poor outcome.

Development and validation of a deep-learning-based pediatric early warning system: A single-center study.

BACKGROUND: Early detection and prompt intervention for clinically deteriorating events are needed to improve clinical outcomes. There have been several attempts at this, including the introduction of rapid response teams (RRTs) with early warning scores. We developed a deep-learning-based pediatric early warning system (pDEWS) and validated its performance. METHODS: This single-center retrospective observational cohort study reviewed, 50,019 pediatric patients admitted to the general ward in a tertiary-care academic children's hospital from January 2012 to December 2018. They were split by admission date into a derivation and a validation cohort. We developed a pDEWS for the early prediction of cardiopulmonary arrest and unexpected ward-to-pediatric intensive care unit (PICU) transfer. Then, we validated this system by comparing modified pediatric early warning score (PEWS), random forest (RF); an ensemble model of multiple decision trees and logistic regression (LR); a statistical model that uses a logistic function. RESULTS: For predicting cardiopulmonary arrest, the pDEWS (area under the receiver operating characteristic curve (AUROC), 0.923) outperformed modified PEWS (AUROC, 0.769) and reduced the mean alarm count per day (MACPD) and number needed to examine (NNE) by 82.0% (from 46.7 to 8.4 MACPD) and 89.5% (from 0.303 to 0.807), respectively. Furthermore, for predicting unexpected ward-to-PICU transfer pDEWS also showed superior performance compared to existing methods. CONCLUSION: Our study showed that pDEWS was superior to the modified PEWS and prediction models using RF and LR. This study demonstrates that the integration of the pDEWS into RRTs could increase operational efficiency and improve clinical outcomes.

Self-Supervised Learning with Electrocardiogram Delineation for Arrhythmia Detection.

Electrocardiogram (ECG) signals convey immense information that, when properly processed, can be used to diagnose various health conditions including arrhythmia and heart failure. Deep learning algorithms have been successfully applied to medical diagnosis, but existing methods heavily rely on abundant high-quality annotations which are expensive. Self-supervised learning (SSL) circumvents this annotation cost by pre-training deep neural networks (DNNs) on auxiliary tasks that do not require manual annotation. Despite its imminent need, SSL applications to ECG classification remain under-explored. In this work, we propose an SSL algorithm based on ECG delineation and show its effectiveness for arrhythmia classification. Our experiments demonstrate not only how the proposed algorithm enhances the DNN's performance across various datasets and fractions of labeled data, but also how features learnt via pre-training on one dataset can be trans-ferred when fine-tuned on a different dataset.

Automated Detection of Acute Myocardial Infarction Using Asynchronous Electrocardiogram Signals-Preview of Implementing Artificial Intelligence With Multichannel Electrocardiographs Obtained From Smartwatches: Retrospective Study.

BACKGROUND: When using a smartwatch to obtain electrocardiogram (ECG) signals from multiple leads, the device has to be placed on different parts of the body sequentially. The ECG signals measured from different leads are asynchronous. Artificial intelligence (AI) models for asynchronous ECG signals have barely been explored. OBJECTIVE: We aimed to develop an AI model for detecting acute myocardial infarction using asynchronous ECGs and compare its performance with that of the automatic ECG interpretations provided by a commercial ECG analysis software. We sought to evaluate the feasibility of implementing multiple lead-based AI-enabled ECG algorithms on smartwatches. Moreover, we aimed to determine the optimal number of leads for sufficient diagnostic power. METHODS: We extracted ECGs recorded within 24 hours from each visit to the emergency room of Ajou University Medical Center between June 1994 and January 2018 from patients aged 20 years or older. The ECGs were labeled on the basis of whether a diagnostic code corresponding to acute myocardial infarction was entered. We derived asynchronous ECG lead sets from standard 12-lead ECG reports and simulated a situation similar to the sequential recording of ECG leads via smartwatches. We constructed an AI model based on residual networks and self-attention mechanisms by randomly masking each lead channel during the training phase and then testing the model using various targeting lead sets with the remaining lead channels masked. RESULTS: The performance of lead sets with 3 or more leads compared favorably with that of the automatic ECG interpretations provided by a commercial ECG analysis software, with 8.1%-13.9% gain in sensitivity when the specificity was matched. Our results indicate that multiple lead-based AI-enabled ECG algorithms can be implemented on smartwatches. Model performance generally increased as the number of leads increased (12-lead sets: area under the receiver operating characteristic curve [AUROC] 0.880; 4-lead sets: AUROC 0.858, SD 0.008; 3-lead sets: AUROC 0.845, SD 0.011; 2-lead sets: AUROC 0.813, SD 0.018; single-lead sets: AUROC 0.768, SD 0.001). Considering the short amount of time needed to measure additional leads, measuring at least 3 leads-ideally more than 4 leads-is necessary for minimizing the risk of failing to detect acute myocardial infarction occurring in a certain spatial location or direction. CONCLUSIONS: By developing an AI model for detecting acute myocardial infarction with asynchronous ECG lead sets, we demonstrated the feasibility of multiple lead-based AI-enabled ECG algorithms on smartwatches for automated diagnosis of cardiac disorders. We also demonstrated the necessity of measuring at least 3 leads for accurate detection. Our results can be used as reference for the development of other AI models using sequentially measured asynchronous ECG leads via smartwatches for detecting various cardiac disorders.

A multicentre validation study of the deep learning-based early warning score for predicting in-hospital cardiac arrest in patients admitted to general wards.

BACKGROUND: The recently developed deep learning (DL)-based early warning score (DEWS) has shown potential in predicting deteriorating patients. We aimed to validate DEWS in multiple centres and compare the prediction, alarming and timeliness performance with the modified early warning score (MEWS) to identify patients at risk for in-hospital cardiac arrest (IHCA). METHOD/RESEARCH DESIGN: This retrospective cohort study included adult patients admitted to the general wards of five hospitals during a 12-month period. The occurrence of IHCA within 24 h of vital sign observation was the outcome of interest. We assessed the discrimination using the area under the receiver operating characteristic curve (AUROC). RESULTS: The study population consists of 173,368 patients (224 IHCAs). The predictive performance of DEWS was superior to that of MEWS in both the internal (AUROC: 0.860 vs. 0.754, respectively) and external (AUROC: 0.905 vs. 0.785, respectively) validation cohorts. At the same specificity, DEWS had a higher sensitivity than MEWS, and at the same sensitivity, DEWS reduced the mean alarm count by nearly half of MEWS. Additionally, DEWS was able to predict more IHCA patients in the 24-0.5 h before the outcome, and DEWS was reasonably calibrated. CONCLUSION: Our study showed that DEWS was superior to MEWS in three key aspects (IHCA predictive, alarming, and timeliness performance). This study demonstrates the potential of DEWS as an effective, efficient screening tool in rapid response systems (RRSs) to identify high-risk patients.

Artificial Intelligence Algorithm for Screening Heart Failure with Reduced Ejection Fraction Using Electrocardiography.

Although heart failure with reduced ejection fraction (HFrEF) is a common clinical syndrome and can be modified by the administration of appropriate medical therapy, there is no adequate tool available to perform reliable, economical, early-stage screening. To meet this need, we developed an interpretable artificial intelligence (AI) algorithm for HFrEF screening using electrocardiography (ECG) and validated its performance. This retrospective cohort study included two hospitals. An AI algorithm based on a convolutional neural network was developed using 39,371 ECG results from 17,127 patients. The internal validation included 3,470 ECGs from 2,908 patients. Furthermore, we conducted external validation using 4,362 ECGs from 4,176 patients from another hospital to verify the applicability of the algorithm across different centers. The end-point was to detect HFrEF, defined as an ejection fraction <40%. We also visualized the regions in 12 lead ECG that affected HFrEF detection in the AI algorithm and compared this to the previously documented literature. During the internal and external validation, the areas under the curves of the AI algorithm using a 12 lead ECG for detecting HFrEF were 0.913 (95% confidence interval, 0.902-0.925) and 0.961 (0.951-0.971), respectively, and the areas under the curves of the AI algorithm using a single-lead ECG were 0.874 (0.859-0.890) and 0.929 (0.911-0.946), respectively. The deep learning-based AI algorithm performed HFrEF detection well using not only a 12 lead but also a single-lead ECG. These results suggest that HFrEF can be screened not only using a 12 lead ECG, as is typical of a conventional ECG machine, but also with a single-lead ECG performed by a wearable device employing the AI algorithm, thereby preventing irreversible disease progression and mortality.

Graph Convolutional Networks-Based Noisy Data Imputation in Electronic Health Record.

OBJECTIVES: A deep learning-based early warning system is proposed to predict sepsis prior to its onset. DESIGN: A novel algorithm was devised to detect sepsis 6 hours prior to its onset based on electronic medical records. SETTING: Retrospective cohorts from three separate hospitals are used in this study. Sepsis onset was defined based on Sepsis-3. Algorithms are evaluated based on the score function used in the Physionet Challenge 2019. PATIENTS: Over 60,000 ICU patients with 40 clinical variables (vital signs, laboratory results) for each hour of a patient's ICU stay were used. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: The proposed algorithm predicted the onset of sepsis in the preceding n hours (where n = 4, 6, 8, or 12). Furthermore, the proposed method compared how many sepsis patients can be predicted in a short time with other methods. To interpret a given result in a clinical perspective, the relationship between input variables and the probability of the proposed method were presented. The proposed method achieved superior results (area under the receiver operating characteristic curve, area under the precision-recall curve, and score) and predicted more sepsis patients in advance. In official phase, the proposed method showed the utility score of -0.101, area under the receiver operating characteristic curve 0.782, area under the precision-recall curve 0.041, accuracy 0.786, and F-measure 0.046. CONCLUSIONS: Using Physionet Challenge 2019, the proposed method can accurately and early predict the onset of sepsis. The proposed method can be a practical early warning system in the environment of real hospitals.

Artificial intelligence algorithm to predict the need for critical care in prehospital emergency medical services.

BACKGROUND: In emergency medical services (EMSs), accurately predicting the severity of a patient's medical condition is important for the early identification of those who are vulnerable and at high-risk. In this study, we developed and validated an artificial intelligence (AI) algorithm based on deep learning to predict the need for critical care during EMS. METHODS: We conducted a retrospective observation cohort study. The algorithm was established using development data from the Korean national emergency department information system, which were collected during visits in real time from 151 emergency departments (EDs). We validated the algorithm using EMS run sheets from two EDs. The study subjects comprised adult patients who visited EDs. The endpoint was critical care, and we used age, sex, chief complaint, symptom onset to arrival time, trauma, and initial vital signs as the predicted variables. RESULTS: The number of patients in the development data was 8,981,181, and the validation data comprised 2604 EMS run sheets from two hospitals. The area under the receiver operating characteristic curve of the algorithm to predict the critical care was 0.867 (95% confidence interval, [0.864-0.871]). This result outperformed the Emergency Severity Index (0.839 [0.831-0.846]), Korean Triage and Acuity System (0.824 [0.815-0.832]), National Early Warning Score (0.741 [0.734-0.748]), and Modified Early Warning Score (0.696 [0.691-0.699]). CONCLUSIONS: The AI algorithm accurately predicted the need for the critical care of patients using information during EMS and outperformed the conventional triage tools and early warning scores.

Deep Learning-Based Algorithm for Detecting Aortic Stenosis Using Electrocardiography.

Background Severe, symptomatic aortic stenosis (AS) is associated with poor prognoses. However, early detection of AS is difficult because of the long asymptomatic period experienced by many patients, during which screening tools are ineffective. The aim of this study was to develop and validate a deep learning-based algorithm, combining a multilayer perceptron and convolutional neural network, for detecting significant AS using ECGs. Methods and Results This retrospective cohort study included adult patients who had undergone both ECG and echocardiography. A deep learning-based algorithm was developed using 39 371 ECGs. Internal validation of the algorithm was performed with 6453 ECGs from one hospital, and external validation was performed with 10 865 ECGs from another hospital. The end point was significant AS (beyond moderate). We used demographic information, features, and 500-Hz, 12-lead ECG raw data as predictive variables. In addition, we identified which region had the most significant effect on the decision-making of the algorithm using a sensitivity map. During internal and external validation, the areas under the receiver operating characteristic curve of the deep learning-based algorithm using 12-lead ECG for detecting significant AS were 0.884 (95% CI, 0.880-0.887) and 0.861 (95% CI, 0.858-0.863), respectively; those using a single-lead ECG signal were 0.845 (95% CI, 0.841-0.848) and 0.821 (95% CI, 0.816-0.825), respectively. The sensitivity map showed the algorithm focused on the T wave of the precordial lead to determine the presence of significant AS. Conclusions The deep learning-based algorithm demonstrated high accuracy for significant AS detection using both 12-lead and single-lead ECGs.

Detecting Patient Deterioration Using Artificial Intelligence in a Rapid Response System.

OBJECTIVES: As the performance of a conventional track and trigger system in a rapid response system has been unsatisfactory, we developed and implemented an artificial intelligence for predicting in-hospital cardiac arrest, denoted the deep learning-based early warning system. The purpose of this study was to compare the performance of an artificial intelligence-based early warning system with that of conventional methods in a real hospital situation. DESIGN: Retrospective cohort study. SETTING: This study was conducted at a hospital in which deep learning-based early warning system was implemented. PATIENTS: We reviewed the records of adult patients who were admitted to the general ward of our hospital from April 2018 to March 2019. INTERVENTIONS: The study population included 8,039 adult patients. A total 83 events of deterioration occurred during the study period. The outcome was events of deterioration, defined as cardiac arrest and unexpected ICU admission. We defined a true alarm as an alarm occurring within 0.5-24 hours before a deteriorating event. MEASUREMENTS AND MAIN RESULTS: We used the area under the receiver operating characteristic curve, area under the precision-recall curve, number needed to examine, and mean alarm count per day as comparative measures. The deep learning-based early warning system (area under the receiver operating characteristic curve, 0.865; area under the precision-recall curve, 0.066) outperformed the modified early warning score (area under the receiver operating characteristic curve, 0.682; area under the precision-recall curve, 0.010) and reduced the number needed to examine and mean alarm count per day by 69.2% and 59.6%, respectively. At the same specificity, deep learning-based early warning system had up to 257% higher sensitivity than conventional methods. CONCLUSIONS: The developed artificial intelligence based on deep-learning, deep learning-based early warning system, accurately predicted deterioration of patients in a general ward and outperformed conventional methods. This study showed the potential and effectiveness of artificial intelligence in an rapid response system, which can be applied together with electronic health records. This will be a useful method to identify patients with deterioration and help with precise decision-making in daily practice.

Validation of deep-learning-based triage and acuity score using a large national dataset.

AIM: Triage is important in identifying high-risk patients amongst many less urgent patients as emergency department (ED) overcrowding has become a national crisis recently. This study aims to validate that a Deep-learning-based Triage and Acuity Score (DTAS) identifies high-risk patients more accurately than existing triage and acuity scores using a large national dataset. METHODS: We conducted a retrospective observational cohort study using data from the Korean National Emergency Department Information System (NEDIS), which collected data on visits in real time from 151 EDs. The NEDIS data was split into derivation data (January 2014-June 2016) and validation data (July-December 2016). We also used data from the Sejong General Hospital (SGH) for external validation (January-December 2017). We predicted in-hospital mortality, critical care, and hospitalization using initial information of ED patients (age, sex, chief complaint, time from symptom onset to ED visit, arrival mode, trauma, initial vital signs and mental status as predictor variables). RESULTS: A total of 11,656,559 patients were included in this study. The primary outcome was in-hospital mortality. The Area Under the Receiver Operating Characteristic curve (AUROC) and Area Under the Precision and Recall Curve (AUPRC) of DTAS were 0.935 and 0.264. It significantly outperformed Korean triage and acuity score (AUROC:0.785, AUPRC:0.192), modified early warning score (AUROC:0.810, AUPRC:0.116), logistic regression (AUROC:0.903, AUPRC:0.209), and random forest (AUROC:0.910, AUPRC:0.179). CONCLUSION: Deep-learning-based Triage and Acuity Score predicted in-hospital mortality, critical care, and hospitalization more accurately than existing triages and acuity, and it was validated using a large, multicenter dataset.

An Algorithm Based on Deep Learning for Predicting In-Hospital Cardiac Arrest.

BACKGROUND: In-hospital cardiac arrest is a major burden to public health, which affects patient safety. Although traditional track-and-trigger systems are used to predict cardiac arrest early, they have limitations, with low sensitivity and high false-alarm rates. We propose a deep learning-based early warning system that shows higher performance than the existing track-and-trigger systems. METHODS AND RESULTS: This retrospective cohort study reviewed patients who were admitted to 2 hospitals from June 2010 to July 2017. A total of 52 131 patients were included. Specifically, a recurrent neural network was trained using data from June 2010 to January 2017. The result was tested using the data from February to July 2017. The primary outcome was cardiac arrest, and the secondary outcome was death without attempted resuscitation. As comparative measures, we used the area under the receiver operating characteristic curve (AUROC), the area under the precision-recall curve (AUPRC), and the net reclassification index. Furthermore, we evaluated sensitivity while varying the number of alarms. The deep learning-based early warning system (AUROC: 0.850; AUPRC: 0.044) significantly outperformed a modified early warning score (AUROC: 0.603; AUPRC: 0.003), a random forest algorithm (AUROC: 0.780; AUPRC: 0.014), and logistic regression (AUROC: 0.613; AUPRC: 0.007). Furthermore, the deep learning-based early warning system reduced the number of alarms by 82.2%, 13.5%, and 42.1% compared with the modified early warning system, random forest, and logistic regression, respectively, at the same sensitivity. CONCLUSIONS: An algorithm based on deep learning had high sensitivity and a low false-alarm rate for detection of patients with cardiac arrest in the multicenter study.

Deep Learning in the Medical Domain: Predicting Cardiac Arrest Using Deep Learning.

With the wider adoption of electronic health records, the rapid response team initially believed that mortalities could be significantly reduced but due to low accuracy and false alarms, the healthcare system is currently fraught with many challenges. Rule-based methods (e.g., Modified Early Warning Score) and machine learning (e.g., random forest) were proposed as a solution but not effective. In this article, we introduce the DeepEWS (Deep learning based Early Warning Score), which is based on a novel deep learning algorithm. Relative to the standard of care and current solutions in the marketplace, there is high accuracy, and in the clinical setting even when we consider the number of alarms, the accuracy levels are superior.