Increasing the Reliability of Fully Automated Surveillance for Central Line-Associated Bloodstream Infections.

OBJECTIVE: To increase reliability of the algorithm used in our fully automated electronic surveillance system by adding rules to better identify bloodstream infections secondary to other hospital-acquired infections. METHODS: Intensive care unit (ICU) patients with positive blood cultures were reviewed. Central line-associated bloodstream infection (CLABSI) determinations were based on 2 sources: routine surveillance by infection preventionists, and fully automated surveillance. Discrepancies between the 2 sources were evaluated to determine root causes. Secondary infection sites were identified in most discrepant cases. New rules to identify secondary sites were added to the algorithm and applied to this ICU population and a non-ICU population. Sensitivity, specificity, predictive values, and kappa were calculated for the new models. RESULTS: Of 643 positive ICU blood cultures reviewed, 68 (10.6%) were identified as central line-associated bloodstream infections by fully automated electronic surveillance, whereas 38 (5.9%) were confirmed by routine surveillance. New rules were tested to identify organisms as central line-associated bloodstream infections if they did not meet one, or a combination of, the following: (I) matching organisms (by genus and species) cultured from any other site; (II) any organisms cultured from sterile site; (III) any organisms cultured from skin/wound; (IV) any organisms cultured from respiratory tract. The best-fit model included new rules I and II when applied to positive blood cultures in an ICU population. However, they didn't improve performance of the algorithm when applied to positive blood cultures in a non-ICU population. CONCLUSION: Electronic surveillance system algorithms may need adjustment for specific populations.

Electronic surveillance for healthcare-associated central line-associated bloodstream infections outside the intensive care unit.

BACKGROUND: Manual surveillance for central line-associated bloodstream infections (CLABSIs) by infection prevention practitioners is time-consuming and often limited to intensive care units (ICUs). An automated surveillance system using existing databases with patient-level variables and microbiology data was investigated. METHODS: Patients with a positive blood culture in 4 non-ICU wards at Barnes-Jewish Hospital between July 1, 2005, and December 31, 2006, were evaluated. CLABSI determination for these patients was made via 2 sources; a manual chart review and an automated review from electronically available data. Agreement between these 2 sources was used to develop the best-fit electronic algorithm that used a set of rules to identify a CLABSI. Sensitivity, specificity, predictive values, and Pearson's correlation were calculated for the various rule sets, using manual chart review as the reference standard. RESULTS: During the study period, 391 positive blood cultures from 331 patients were evaluated. Eighty-five (22%) of these were confirmed to be CLABSI by manual chart review. The best-fit model included presence of a catheter, blood culture positive for known pathogen or blood culture with a common skin contaminant confirmed by a second positive culture and the presence of fever, and no positive cultures with the same organism from another sterile site. The best-performing rule set had an overall sensitivity of 95.2%, specificity of 97.5%, positive predictive value of 90%, and negative predictive value of 99.2% compared with intensive manual surveillance. CONCLUSIONS: Although CLABSIs were slightly overpredicted by electronic surveillance compared with manual chart review, the method offers the possibility of performing acceptably good surveillance in areas where resources do not allow for traditional manual surveillance.

Automated surveillance for central line-associated bloodstream infection in intensive care units.

OBJECTIVE: To develop and evaluate computer algorithms with high negative predictive values that augment traditional surveillance for central line-associated bloodstream infection (CLABSI). SETTING: Barnes-Jewish Hospital, a 1,250-bed tertiary care academic hospital in Saint Louis, Missouri. METHODS: We evaluated all adult patients in intensive care units who had blood samples collected during the period from July 1, 2005, to June 30, 2006, that were positive for a recognized pathogen on culture. Each isolate recovered from culture was evaluated using the definitions for nosocomial CLABSI provided by the National Healthcare Safety Network of the Centers for Disease Control and Prevention. Using manual surveillance by infection prevention specialists as the gold standard, we assessed the ability of various combinations of dichotomous rules to determine whether an isolate was associated with a CLABSI. Sensitivity, specificity, and predictive values were calculated. RESULTS: Infection prevention specialists identified 67 cases of CLABSI associated with 771 isolates recovered from blood samples. The algorithms excluded approximately 40%-62% of the isolates from consideration as possible causes of CLABSI. The simplest algorithm, with 2 dichotomous rules (ie, the collection of blood samples more than 48 hours after admission and the presence of a central venous catheter within 48 hours before collection of blood samples), had the highest negative predictive value (99.4%) and the lowest specificity (44.2%) for CLABSI. Augmentation of this algorithm with rules for common skin contaminants confirmed by another positive blood culture result yielded in a negative predictive value of 99.2% and a specificity of 68.0%. CONCLUSIONS: An automated approach to surveillance for CLABSI that is characterized by a high negative predictive value can accurately identify and exclude positive culture results not representing CLABSI from further manual surveillance.