Assessing the impact of real-time random safety audits through full propensity score matching on reliable data from the clinical information system.

BACKGROUND: Evidence-based care processes are not always applied at the bedside in critically ill patients. Numerous studies have assessed the impact of checklists and related strategies on the process of care and patient outcomes. We aimed to evaluate the effects of real-time random safety audits on process-of-care and outcome variables in critical care patients. METHODS: This prospective study used data from the clinical information system to evaluate the impact of real-time random safety audits targeting 32 safety measures in two intensive care units during a 9-month period. We compared endpoints between patients attended with safety audits and those not attended with safety audits. The primary endpoint was mortality, measured by Cox hazard regression after full propensity-score matching. Secondary endpoints were the impact on adherence to process-of-care measures and on quality indicators. RESULTS: We included 871 patients; 228 of these were attended in ≥ 1 real-time random safety audits. Safety audits were carried out on 390 patient-days; most improvements in the process of care were observed in safety measures related to mechanical ventilation, renal function and therapies, nutrition, and clinical information system. Although the group of patients attended in safety audits had more severe disease at ICU admission [APACHE II score 21 (16-27) vs. 20 (15-25), p = 0.023]; included a higher proportion of surgical patients [37.3 % vs. 26.4 %, p = 0.003] and a higher proportion of mechanically ventilated patients [72.8 % vs. 40.3 %, p < 0.001]; averaged more days on mechanical ventilation, central venous catheter, and urinary catheter; and had a longer ICU stay [12.5 (5.5-23.3) vs. 2.9 (1.7-5.9), p < 0.001], ICU mortality did not differ significantly between groups (19.3 % vs. 18.8 % in the group without safety rounds). After full propensity-score matching, Cox hazard regression analysis showed real-time random safety audits were associated with a lower risk of mortality throughout the ICU stay (HR 0.31; 95 %CI 0.20-0.47). CONCLUSIONS: Real-time random safety audits are associated with a reduction in the risk of ICU mortality. Exploiting data from the clinical information system is useful in assessing the impact of them on the care process, quality indicators, and mortality.

Soporte a la organización de las Unidades de Cuidados Intensivos durante la pandemia, a través de mapas creados a partir de los Sistemas de Información Clínica / Support to the organization of the Intensive Care Units during the pandemic through maps created from the Clinical Information Systems

No disponible

Automatic generation of minimum dataset and quality indicators from data collected routinely by the clinical information system in an intensive care unit.

BACKGROUND: Quality indicators (QIs) are being increasingly used in medicine to compare and improve the quality of care delivered. The feasibility of data collection is an important prerequisite for QIs. Information technology can improve efforts to measure processes and outcomes. In intensive care units (ICU), QIs can be automatically measured by exploiting data from clinical information systems (CIS). OBJECTIVE: To describe the development and application of a tool to automatically generate a minimum dataset (MDS) and a set of ICU quality metrics from CIS data. METHODS: We used the definitions for MDS and QIs proposed by the Spanish Society of Critical Care Medicine and Coronary Units. Our tool uses an extraction, transform, and load process implemented with Python to extract data stored in various tables in the CIS database and create a new associative database. This new database is uploaded to Qlik Sense, which constructs the MDS and calculates the QIs by applying the required metrics. The tool was tested using data from patients attended in a 30-bed polyvalent ICU during a six-year period. RESULTS: We describe the definitions and metrics, and we report the MDS and QI measurements obtained through the analysis of 4546 admissions. The results show that our ICU's performance on the QIs analyzed meets the standards proposed by our national scientific society. CONCLUSIONS: This is the first step toward using a tool to automatically obtain a set of actionable QIs to monitor and improve the quality of care in ICUs, eliminating the need for professionals to enter data manually, thus saving time and ensuring data quality.

Validation of the ICU-DaMa tool for automatically extracting variables for minimum dataset and quality indicators: The importance of data quality assessment.

BACKGROUND: Big data analytics promise insights into healthcare processes and management, improving outcomes while reducing costs. However, data quality is a major challenge for reliable results. Business process discovery techniques and an associated data model were used to develop data management tool, ICU-DaMa, for extracting variables essential for overseeing the quality of care in the intensive care unit (ICU). OBJECTIVE: To determine the feasibility of using ICU-DaMa to automatically extract variables for the minimum dataset and ICU quality indicators from the clinical information system (CIS). METHODS: The Wilcoxon signed-rank test and Fisher's exact test were used to compare the values extracted from the CIS with ICU-DaMa for 25 variables from all patients attended in a polyvalent ICU during a two-month period against the gold standard of values manually extracted by two trained physicians. Discrepancies with the gold standard were classified into plausibility, conformance, and completeness errors. RESULTS: Data from 149 patients were included. Although there were no significant differences between the automatic method and the manual method, we detected differences in values for five variables, including one plausibility error and two conformance and completeness errors. Plausibility: 1) Sex, ICU-DaMa incorrectly classified one male patient as female (error generated by the Hospital's Admissions Department). Conformance: 2) Reason for isolation, ICU-DaMa failed to detect a human error in which a professional misclassified a patient's isolation. 3) Brain death, ICU-DaMa failed to detect another human error in which a professional likely entered two mutually exclusive values related to the death of the patient (brain death and controlled donation after circulatory death). Completeness: 4) Destination at ICU discharge, ICU-DaMa incorrectly classified two patients due to a professional failing to fill out the patient discharge form when thepatients died. 5) Length of continuous renal replacement therapy, data were missing for one patient because the CRRT device was not connected to the CIS. CONCLUSIONS: Automatic generation of minimum dataset and ICU quality indicators using ICU-DaMa is feasible. The discrepancies were identified and can be corrected by improving CIS ergonomics, training healthcare professionals in the culture of the quality of information, and using tools for detecting and correcting data errors.