Current perspectives on the use of artificial intelligence in critical patient safety.

Intensive Care Units (ICUs) have undergone enhancements in patient safety, and artificial intelligence (AI) emerges as a disruptive technology offering novel opportunities. While the published evidence is limited and presents methodological issues, certain areas show promise, such as decision support systems, detection of adverse events, and prescription error identification. The application of AI in safety may pursue predictive or diagnostic objectives. Implementing AI-based systems necessitates procedures to ensure secure assistance, addressing challenges including trust in such systems, biases, data quality, scalability, and ethical and confidentiality considerations. The development and application of AI demand thorough testing, encompassing retrospective data assessments, real-time validation with prospective cohorts, and efficacy demonstration in clinical trials. Algorithmic transparency and explainability are essential, with active involvement of clinical professionals being crucial in the implementation process.

¿Podrían ayudarnos los algoritmos de machine learning en la predicción de hemorragia masiva a nivel prehospitalario? / Could machine learning algorithms help us in predicting massive hemorrhage at the prehospital level?

Objetivo: Comparación de la capacidad predictiva de diferentes algoritmos de machine learning (AML) respecto a escalas tradicionales de predicción de hemorragia masiva en pacientes con enfermedad traumática grave (ETG). Diseño: Sobre una base de datos de una cohorte retrospectiva con variables clínicas prehospitalarias y de resultado de hemorragia masiva se realizó un tratamiento de la base de datos para poder aplicar los AML, obteniéndose un conjunto total de 473 pacientes (80% entrenamiento, 20% validación). Para la modelización se realizó imputación proporcional y validación cruzada. El poder predictivo se evaluó con la métrica ROC y la importancia de las variables mediante los valores Shapley. Ámbito: Atención extrahospitalaria del paciente con ETG. Pacientes: Pacientes con ETG atendidos en el medio extrahospitalario por un servicio médico extrahospitalario desde enero de 2010 hasta diciembre de 2015 y trasladados a un centro de trauma en Madrid. Intervenciones: Ninguna. Variables de interés principales: Obtención y comparación de la métrica ROC de 4 AML: random forest, support vector machine, gradient boosting machine y neural network con los resultados obtenidos con escalas tradicionales de predicción. Resultados: Los diferentes AML alcanzaron valores ROC superiores al 0,85, teniendo medianas cercanas a 0,98. No encontramos diferencias significativas entre los AML. Cada AML ofrece un conjunto de variables diferentes, pero con predominancia de las variables hemodinámicas, de reanimación y de deterioro neurológico. Conclusiones: Los AML podrían superar a las escalas tradicionales de predicción en la predicción de hemorragia masiva. (AU)

Objective: Comparison of the predictive ability of various machine learning algorithms (MLA) versus traditional prediction scales for massive hemorrhage in patients with severe traumatic injury (ETG). Design: On a database of a retrospective cohort with prehospital clinical variables and massive hemorrhage outcome, a treatment of the database was performed to be able to apply the different MLA, obtaining a total set of 473 patients (80% training and 20% validation). For modeling, proportional imputation and cross validation were performed. The predictive power was evaluated with the ROC metric and the importance of the variables using the Shapley values. Setting: Out-of-hospital care of patients with ETG. Participants: Patients with ETG treated out-of-hospital by a prehospital medical service from January 2010 to December 2015 and transferred to a trauma center in Madrid. Interventions: None. Main variables of interest: Obtaining and comparing the ROC curve metric of 4 MLAs: random forest, support vector machine, gradient boosting machine and neural network with the results obtained with traditional prediction scales. Results: The different MLA reached ROC values higher than 0.85, having medians close to 0.98. We found no significant differences between MLAs. Each MLA offers a different set of more important variables with a predominance of hemodynamic, resuscitation variables and neurological impairment. Conclusions: MLA may be helpful in patients with massive hemorrhage by outperforming traditional prediction scales. (AU)

Shock Index and Physiological Stress Index for reestratifying patients with intermediate-high risk pulmonary embolism.

OBJECTIVE: Study and Evaluation of Two Scores: Shock Index (SI) and Physiological Stress Index (PSI) as discriminators for proactive treatment (reperfusion before decompensated shock) in a population of intermediate-high risk pulmonary embolism (PE). DESIGN: Using a database from a retrospective cohort with clinical variables and the outcome variable of "proactive treatment", a comparison of the populations was conducted. Optimal cut-off for "proactive treatment" points were obtained according to the SI and PSI. Comparisons were carried out based on the cut-off points of both indices. SETTING: Patients admitted to a mixed ICU for PE. PARTICIPANTS: Patients >18 years old admitted to the ICU with intermediate-high risk PE recruited from January 2015 to October 2022. INTERVENTIONS: None. MAIN VARIABLES OF INTEREST: Population comparison and metrics regarding predictive capacity when determining proactive treatment. RESULTS: SI and PSI independently have a substandard predictive capacity for discriminating patients who may benefit from an early reperfusion therapy. However, their combined use improves detection of sicker intermediate-high risk PE patients (Sensitivity = 0.66) in whom an early reperfusion therapy may improve outcomes (Specificity = 0.9). CONCLUSIONS: The use of the SI and PSI in patients with intermediate-high risk PE could be useful for selecting patients who would benefit from proactive treatment.

Could machine learning algorithms help us predict massive bleeding at prehospital level?

OBJECTIVE: Comparison of the predictive ability of various machine learning algorithms (MLA) versus traditional prediction scales (TPS) for massive hemorrhage (MH) in patients with severe traumatic injury (STI). DESIGN: On a database of a retrospective cohort with prehospital clinical variables and MH outcome, a treatment of the database was performed to be able to apply the different AML, obtaining a total set of 473 patients (80% training, 20% validation). For modeling, proportional imputation and cross validation were performed. The predictive power was evaluated with the ROC metric and the importance of the variables using the Shapley values. SETTING: Out-of-hospital care of patients with STI. PARTICIPANTS: Patients with STI treated out-of-hospital by a out-of-hospital medical service from January 2010 to December 2015 and transferred to a trauma center in Madrid. INTERVENTIONS: None. MAIN VARIABLES OF INTEREST: Obtaining and comparing the "Receiver Operating Characteristic curve" (ROC curve) metric of four MLAs: "random forest" (RF), "vector support machine" (SVM), "gradient boosting machine" (GBM) and "neural network" (NN) with the results obtained with TPS. RESULTS: The different AML reached ROC values higher than 0.85, having medians close to 0.98. We found no significant differences between AMLs. Each AML offers a different set of more important variables with a predominance of hemodynamic, resuscitation variables and neurological impairment. CONCLUSIONS: MLA may be helpful in patients with HM by outperforming TPS.