Development of an instrument for a primary airway provider's performance with an ICU multidisciplinary team in pediatric respiratory failure using simulation.

OBJECTIVE: To develop a scoring system that can assess the multidisciplinary management of respiratory failure in a pediatric ICU. METHODS: In a single tertiary pediatric ICU we conducted a simulation-based evaluation in a patient care area auxiliary to the ICU. The subjects were pediatric and emergency medicine residents, nurses, and respiratory therapists who work in the pediatric ICU. A multidisciplinary focus group with experienced providers in pediatric ICU airway management and patient safety specialists was formed. A task-based scoring instrument was developed to evaluate a primary airway provider's performance through Healthcare Failure Mode and Effect Analysis. Reliability and validity of the instrument were evaluated using multidisciplinary simulation-based airway management training sessions. Each session was evaluated by 3 independent expert raters. A global assessment of the team performance and the previous experience in training were used to evaluate the validity of the instrument. RESULTS: The Just-in-Time Pediatric Airway Provider Performance Scale (JIT-PAPPS) version 3, with 34 task-based items (14 technical, 20 behavioral), was developed. Eighty-five teams led by resident airway providers were evaluated by 3 raters. The intraclass correlation coefficient for raters was 0.64. The JIT-PAPPS score correlated well with the global rating scale (r = 0.71, P < .001). Mean total scores across the teams were positively associated with resident previous training participation (ß coefficient 7.1 ± 0.9, P < .001), suggesting good validity of the scale. CONCLUSIONS: A task-based scoring instrument for a primary airway provider's performance with a multidisciplinary pediatric ICU team on simulated pediatric respiratory failure was developed. Reliability and validity evaluation supports the developed scale.

Characterization of tracheal intubation process of care and safety outcomes in a tertiary pediatric intensive care unit.

OBJECTIVE: To characterize tracheal intubation process of care and safety outcomes in a large tertiary pediatric intensive care unit using a pediatric adaptation of the National Emergency Airway Registry. Variances in process of care and safety outcome of intubation in the pediatric intensive care unit have not been described. We hypothesize that tracheal intubation is a common but high-risk procedure and that the novel pediatric adaptation of the National Emergency Airway Registry is a feasible tool to capture variances in process of care and outcomes. DESIGN: Prospective descriptive study. SETTING: A single 45-bed tertiary noncardiac pediatric intensive care unit in a large university-affiliated children's hospital. PATIENTS: Critically ill children who required intubation in the pediatric intensive care unit. INTERVENTIONS: Airway management data were prospectively collected for all initial airway management from July 2007 through September 2008 using the National Emergency Airway Registry tool tailored for pediatric application with explicit operational definitions. MEASUREMENT AND MAIN RESULTS: One hundred ninety-seven initial intubation encounters were reported (averaging one every 2.3 days). The first course intubation method was oral intubation in 181 (91.9%) and nasal in 16 (9.1%). Unwanted tracheal intubation-associated events were frequently reported (n = 38 [19.3%]), but severe tracheal intubation-associated events were rare (n = 6 [3.0%]). Esophageal intubation with immediate recognition was the most common tracheal intubation-associated event (n = 22). Desaturation <80% was reported in 51 of 183 (27.7%) and more than two intubation attempts in 30 of 196 (15.3%), both associated with occurrence of a tracheal intubation-associated event (p < .001, p = .001, respectively). Interestingly, patient age, history of difficult airway, and first attempt by resident were not associated with tracheal intubation-associated events. CONCLUSIONS: Unwanted tracheal intubation-associated events occurred frequently, but severe tracheal intubation-associated events were rare. Our novel registry can be used to describe the pediatric intensive care unit tracheal intubation procedural process of care and safety outcomes.

Evaluation of multidisciplinary simulation training on clinical performance and team behavior during tracheal intubation procedures in a pediatric intensive care unit.

OBJECTIVE: Tracheal intubation in the pediatric intensive care unit is often performed in emergency situations with high risks. Simulation has been recognized as an effective methodology to train both technical and teamwork skills. Our objectives were to develop a feasible tool to evaluate team performance during tracheal intubation in the pediatric intensive care unit and to apply the tool in the clinical setting to determine whether multidisciplinary teams with a higher number of simulation-trained providers exhibit more proficient performance. DESIGN: Prospective, observational pilot study. SETTING: Single tertiary children's hospital pediatric intensive care unit. SUBJECTS: Pediatric and emergency medicine residents, pediatric intensive care unit nurses, and respiratory therapists from October 2007 to June 2008. INTERVENTIONS: A pediatric intensive care unit on-call resident, a pediatric intensive care unit nurse, and a respiratory therapist received simulation-based multidisciplinary airway management training every morning. An assessment tool for team technical and behavioral skills was developed. Independent trained observers rated actual intubations in the pediatric intensive care unit by using this tool. MEASUREMENTS AND MAIN RESULTS: For observer training, two independent raters (research assistants 1 and 2) evaluated a total of 53 training sessions (research assistant 1, 16; research assistant 2, 37). The correlation coefficient with the facilitator expert (surrogate standard) was .73 for research assistant 1 and .88 for research assistant 2 (p ≤ .001 for both) in the total score, .84 for research assistant 1 and .77 for research assistant 2 (p < .001 for both) in the technical domain, and .63 for research assistant 1 (p = .009) and .84 for research assistant 2 (p < .001) in the behavioral domain. The correlation coefficient was lower in video-based observation (.62 vs. .88, on-site). For clinical observation, 15 intubations were observed in real time by raters. The performance by a team with two or more simulation-trained members was rated higher compared with the team with fewer than two trained members (total score: 127 ± 6 vs. 116 ± 9, p = .012, mean ± sd). CONCLUSIONS: It is feasible to rate the technical and behavioral performance of multidisciplinary airway management teams during real intensive care unit intubation events by using our assessment tool. The presence of two or more multidisciplinary simulation-trained providers is associated with improved performance during real events.

Effect of just-in-time simulation training on tracheal intubation procedure safety in the pediatric intensive care unit.

BACKGROUND: Tracheal intubation-associated events (TIAEs) are common (20%) and life threatening (4%) in pediatric intensive care units. Physician trainees are required to learn tracheal intubation during intensive care unit rotations. The authors hypothesized that "just-in-time" simulation-based intubation refresher training would improve resident participation, success, and decrease TIAEs. METHODS: For 14 months, one of two on-call residents, nurses, and respiratory therapists received 20-min multidisciplinary simulation-based tracheal intubation training and 10-min resident skill refresher training at the beginning of their on-call period in addition to routine residency education. The rate of first attempt and overall success between refresher-trained and concurrent non-refresher-trained residents (controls) during the intervention phase was compared. The incidence of TIAEs between preintervention and intervention phase was also compared. RESULTS: Four hundred one consecutive primary orotracheal intubations were evaluated: 220 preintervention and 181 intervention. During intervention phase, neither first-attempt success nor overall success rate differed between refresher-trained residents versus concurrent non-refresher-trained residents: 20 of 40 (50%) versus 15 of 24 (62.5%), P = 0.44 and 23 of 40 (57.5%) versus 18 of 24 (75.0%), P = 0.19, respectively. The resident's first attempt and overall success rate did not differ between preintervention and intervention phases. The incidence of TIAE during preintervention and intervention phases was similar: 22.0% preintervention versus 19.9% intervention, P = 0.62, whereas resident participation increased from 20.9% preintervention to 35.4% intervention, P = 0.002. Resident participation continued to be associated with TIAE even after adjusting for the phase and difficult airway condition: odds ratio 2.22 (95% CI 1.28-3.87, P = 0.005). CONCLUSIONS: Brief just-in-time multidisciplinary simulation-based intubation refresher training did not improve the resident's first attempt or overall tracheal intubation success.

Kinetic therapy improves oxygenation in critically ill pediatric patients.

OBJECTIVE: To compare changes in oxygenation after manual turning and percussion (standard therapy) and after automated rotation and percussion (kinetic therapy). DESIGN: Randomized crossover trial. SETTING: General and cardiac pediatric intensive care units. PATIENTS: Intubated and mechanically ventilated pediatric patients who had an arterial catheter and no contraindications to using a PediDyne bed. INTERVENTIONS: Patients were placed on a PediDyne bed (Kinetic Concepts) and received 18 hrs blocks of standard and kinetic therapy in an order determined by randomization. MEASUREMENTS AND MAIN RESULTS: Arterial blood gases were measured every 2 hrs during each phase of therapy. Oxygenation index and arterial-alveolar oxygen tension difference [P(A-a)O(2)] were calculated. Indexes calculated at baseline and after each 18-hr phase of therapy were analyzed. Fifty patients were enrolled. Data from 15 patients were either not collected or not used due to reasons that included violation of protocol and inability to tolerate the therapies in the study. Indexes of oxygenation were not normally distributed and were compared using Wilcoxon signed rank testing. Both therapies led to improvements in oxygenation, but only those from kinetic therapy achieved statistical significance. In patients receiving kinetic therapy first, median oxygenation index decreased from 7.4 to 6.19 (p = .015). The median P(A-a)O(2) decreased from 165.2 to 126.4 (p = .023). There were continued improvements in oxygenation after the subsequent period of standard therapy, with the median oxygenation index decreasing to 5.52 and median P(A-a)O(2) decreasing to 116.0, but these changes were not significant (p = .365 and .121, respectively). When standard therapy was first, the median oxygenation index decreased from 8.83 to 8.71 and the median P(a-a)o(2) decreased from 195.4 to 186.6. Neither change was significant. Median oxygenation index after the subsequent period of kinetic therapy was significantly lower (7.91, p = .044) and median P(A-a)O(2) trended lower (143.4, p = .077). CONCLUSIONS: Kinetic therapy is more efficient than standard therapy at improving oxygenation and produces improvements in oxygenation that are more persistent.