RESUMO
BackgroundAcute kidney injury (AKI) is frequently associated with COVID-19 and the need for kidney replacement therapy (KRT) is considered an indicator of disease severity. This study aimed to develop a prognostic score for predicting the need for KRT in hospitalized COVID-19 patients. MethodsThis study is part of the multicentre cohort, the Brazilian COVID-19 Registry. A total of 5,212 adult COVID-19 patients were included between March/2020 and September/2020. We evaluated four categories of predictor variables: (1) demographic data; (2) comorbidities and conditions at admission; (3) laboratory exams within 24 h; and (4) the need for mechanical ventilation at any time during hospitalization. Variable selection was performed using generalized additive models (GAM) and least absolute shrinkage and selection operator (LASSO) regression was used for score derivation. The accuracy was assessed using the area under the receiver operating characteristic curve (AUC-ROC). Risk groups were proposed based on predicted probabilities: non-high (up to 14.9%), high (15.0 - 49.9%), and very high risk ([≥] 50.0%). ResultsThe median age of the model-derivation cohort was 59 (IQR 47-70) years, 54.5% were men, 34.3% required ICU admission, 20.9% evolved with AKI, 9.3% required KRT, and 15.1% died during hospitalization. The validation cohort had similar age, sex, ICU admission, AKI, required KRT distribution and in-hospital mortality. Thirty-two variables were tested and four important predictors of the need for KRT during hospitalization were identified using GAM: need for mechanical ventilation, male gender, higher creatinine at admission, and diabetes. The MMCD score had excellent discrimination in derivation (AUROC = 0.929; 95% CI 0.918-0.939) and validation (AUROC = 0.927; 95% CI 0.911-0.941) cohorts an good overall performance in both cohorts (Brier score: 0.057 and 0.056, respectively). The score is implemented in a freely available online risk calculator (https://www.mmcdscore.com/). ConclusionThe use of the MMCD score to predict the need for KRT may assist healthcare workers in identifying hospitalized COVID-19 patients who may require more intensive monitoring, and can be useful for resource allocation.
RESUMO
ObjectiveTo provide a thorough comparative study among state-of-the-art machine learning methods and statistical methods for determining in-hospital mortality in COVID-19 patients using data upon hospital admission; to study the reliability of the predictions of the most effective methods by correlating the probability of the outcome and the accuracy of the methods; to investigate how explainable are the predictions produced by the most effective methods. Materials and MethodsDe-identified data were obtained from COVID-19 positive patients in 36 participating hospitals, from March 1 to September 30, 2020. Demographic, comorbidity, clinical presentation and laboratory data were used as training data to develop COVID-19 mortality prediction models. Multiple machine learning and traditional statistics models were trained on this prediction task using a folded cross-validation procedure, from which we assessed performance and interpretability metrics. ResultsThe Stacking of machine learning models improved over the previous state-of-the-art results by more than 26% in predicting the class of interest (death), achieving 87.1% of AUROC and macro F1 of 73.9%. We also show that some machine learning models can be very interpretable and reliable, yielding more accurate predictions while providing a good explanation for the why. ConclusionThe best results were obtained using the meta-learning ensemble model - Stacking. State-of the art explainability techniques such as SHAP-values can be used to draw useful insights into the patterns learned by machine-learning algorithms. Machine-learning models can be more explainable than traditional statistics models while also yielding highly reliable predictions.
RESUMO
ObjectiveTo develop and validate a rapid scoring system at hospital admission for predicting in-hospital mortality in patients hospitalized with coronavirus disease 19 (COVID-19), and to compare this score with other existing ones. DesignCohort study SettingThe Brazilian COVID-19 Registry has been conducted in 36 Brazilian hospitals in 17 cities. Logistic regression analysis was performed to develop a prediction model for in-hospital mortality, based on the 3978 patients that were admitted between March-July, 2020. The model was then validated in the 1054 patients admitted during August-September, as well as in an external cohort of 474 Spanish patients. ParticipantsConsecutive symptomatic patients ([≥]18 years old) with laboratory confirmed COVID-19 admitted to participating hospitals. Patients who were transferred between hospitals and in whom admission data from the first hospital or the last hospital were not available were excluded, as well those who were admitted for other reasons and developed COVID-19 symptoms during their stay. Main outcome measuresIn-hospital mortality ResultsMedian (25th-75th percentile) age of the model-derivation cohort was 60 (48-72) years, 53.8% were men, in-hospital mortality was 20.3%. The validation cohorts had similar age distribution and in-hospital mortality. From 20 potential predictors, seven significant variables were included in the in-hospital mortality risk score: age, blood urea nitrogen, number of comorbidities, C-reactive protein, SpO2/FiO2 ratio, platelet count and heart rate. The model had high discriminatory value (AUROC 0.844, 95% CI 0.829 to 0.859), which was confirmed in the Brazilian (0.859) and Spanish (0.899) validation cohorts. Our ABC2-SPH score showed good calibration in both Brazilian cohorts, but, in the Spanish cohort, mortality was somewhat underestimated in patients with very high (>25%) risk. The ABC2-SPH score is implemented in a freely available online risk calculator (https://abc2sph.com/). ConclusionsWe designed and validated an easy-to-use rapid scoring system based on characteristics of COVID-19 patients commonly available at hospital presentation, for early stratification for in-hospital mortality risk of patients with COVID-19. Summary boxesWhat is already known on this topic? O_LIRapid scoring systems may be very useful for fast and effective assessment of COVID-19 patients in the emergency department. C_LIO_LIThe majority of available scores have high risk of bias and lack benefit to clinical decision making. C_LIO_LIDerivation and validation studies in low- and middle-income countries, including Latin America, are scarce. C_LI What this study adds O_LIABC2-SPH employs seven well defined variables, routinely assessed upon hospital presentation: age, number of comorbidities, blood urea nitrogen, C reactive protein, Spo2/FiO2 ratio, platelets and heart rate. C_LIO_LIThis easy-to-use risk score identified four categories at increasing risk of death with a high level of accuracy, and displayed better discrimination ability than other existing scores. C_LIO_LIA free web-based calculator is available and may help healthcare practitioners to estimate the expected risk of mortality for patients at hospital presentation. C_LI