"To Err Is Human" but Disclosure Must be Taught: A Simulation-Based Assessment Study.

INTRODUCTION: Although error disclosure is critical in promoting safety and patient-centered care, physicians are inconsistently trained in its practice, and few objective methods to assess competence exist. We used an immersive simulation scenario to determine whether providers with varying levels of clinical experience adhere to the disclosure safe practice guidelines when exposed to a serious adverse event simulation scenario. METHODS: This was a prospective cohort study with medical students, junior emergency medicine (EM) residents (PGY 1-2), senior EM residents (PGY 3-4), and attending EM physicians participating in a simulated case in which a scripted medication overdose resulted in an adverse event. Each scenario was videotaped and scored by two expert raters based on a 6-component, 21-point disclosure assessment instrument. RESULTS: There were 12 participants in each study group (N = 48). There was good interrater reliability (κ = 0.70). Total scores improved significantly as the level of training increased: medical student = 10.3 (2.7), PGY 1-2 = 12.3 (6.2), PGY 3-4 = 13.7 (3.2), and attending physicians = 12.8 (3.7) (P = 0.03). Seventy-five percent of participants did not address preventing recurrence of the error. Fifty-six percent offered no apology or only offered it with prompting from the patient; only 23% offered an apology with the initial disclosure. CONCLUSIONS: We demonstrated suboptimal adherence to best practices guidelines for error disclosure when providers are assessed in an immersive simulation setting. Despite a correlation in performance of medical error disclosure with increased physician experience, this study suggests that healthcare providers may need additional training to comply with safe practice guidelines for disclosure of unanticipated adverse events.

A comprehensive, simulation-based approach to teaching clinical skills: the medical students' perspective.

The purpose of this study was to determine if third-year medical students participating in a mandatory 12-week simulation course perceived improvement in decision-making, communication, and teamwork skills. Students participated in or observed 24 acute emergency scenarios. At 4-week intervals, students completed 0-10 point Likert scale questionnaires evaluating the curriculum and role of team leader. Linear contrasts were used to examine changes in outcomes. P-values were Bonferroni-corrected for multiple pairwise comparisons. Student evaluations (n = 96) demonstrated increases from week 4 to 12 in educational value (p = 0.006), decision-making (p < 0.001), communication (p = 0.02), teamwork (p = 0.01), confidence in management (p < 0.001), and translation to clinical experience (p < 0.001). Regarding the team leader role, students reported a decrease in stress (p = 0.001) and increase in ability to facilitate team function (p < 0.001) and awareness of team building (p = <0.001). Ratings demonstrate a positive impact of simulation on both clinical management skills and team leadership skills. A simulation curriculum can enhance the ability to manage acute clinical problems and translates well to the clinical experience. These positive perceptions increase as the exposure to simulation increases.

Use of ultrasound guidance improves central venous catheter insertion success rates among junior residents.

OBJECTIVES: The purpose of this study was to determine whether junior residents had higher rates of first cannulation and overall success at central venous catheter insertions with the use of ultrasound (US) guidance compared to the landmark technique. METHODS: We conducted a secondary analysis of data from a prospective randomized controlled study of junior residents from January 2007 through September 2008, which assessed the impact of simulation training on central venous catheter insertion success rates. Blinded independent raters observed in-hospital central venous catheter insertions using a procedural checklist. Success at first cannulation and successful insertion were the primary outcomes. Secondary outcomes included rates of technical errors and mechanical complications. RESULTS: Independent raters observed 480 central venous catheter insertions by 115 residents. Successful first cannulation occurred in 27% of landmark compared to 49% of dynamic US-guided (P < .01), and 50% of static US-guided (P = .01) cannulations. Insertion success occurred for 55% of landmark compared to 80% of dynamic US-guided (P < .01) and 80% of static US-guided (P < .01) cannulations. Dynamic US guidance was associated with increased odds of first cannulation success compared to the landmark technique (odds ratio [OR], 2.24; 95% confidence interval [CI], 1.37-3.67) and successful insertion (OR, 3.80; 95% CI, 2.34-6.19). Static US guidance was associated with increased odds of first cannulation success compared to the landmark technique (OR, 2.59; 95% CI, 1.25-5.39) and successful insertion (OR, 3.48; 95% CI, 1.54-7.87). The results were independent of central venous catheter insertion training, patient comorbidities, and resident specialties. There was no difference related to mechanical complications between the procedures. CONCLUSIONS: Dynamic and static US guidance during central venous catheter insertion was associated with improved in-hospital first cannulation rates and overall success rates of insertions by junior residents.

Simulation and patient safety: evaluative checklists for central venous catheter insertion.

In the advent of concerns for patient safety, simulation training is emerging as a method to train healthcare providers to perform invasive procedures such as central venous catheter (CVC) insertion while minimising harmful complications to the patient. New technologies in medical simulation have begun to shift research attention to the performance component of clinical competency. Accurate assessment of healthcare provider competence is a major priority in medical education necessitating the development of valid and reliable assessment tools. In the past year alone, nine evaluative tools, both global rating scales and procedural checklists, have been published in the research literature to evaluate the insertion of CVCs. A review of the advantages of published evaluation tools helps inform users with regard to the critical components necessary for a checklist. Ease of use, ability to be completed by a non-expert, categorical breakdown of critical actions involved in CVC insertion and the need for a comprehensive stepwise procedural checklist are discussed. The development of an ideal checklist may improve future competency-based training and performance evaluation in the clinical setting. A more thorough understanding of the status of checklists as evaluation tools in assessing performance of invasive procedures will lead to better training protocols and ultimately to improved patient safety.

Simulation training in central venous catheter insertion: improved performance in clinical practice.

PURPOSE: To determine whether simulation training of ultrasound (US)-guided central venous catheter (CVC) insertion skills on a partial task trainer improves cannulation and insertion success rates in clinical practice. METHOD: This prospective, randomized, controlled, single-blind study of first- and second-year residents occurred at a tertiary care teaching hospital from January 2007 to September 2008. The intervention group (n = 90) received a didactic and hands-on, competency-based simulation training course in US-guided CVC insertion, whereas the control group (n = 95) received training through a traditional, bedside apprenticeship model. Success at first cannulation and successful CVC insertion served as the primary outcomes. Secondary outcomes included reduction in technical errors and decreased mechanical complications. RESULTS: Blinded independent raters observed 495 CVC insertions by 115 residents over a 21-month period. Successful first cannulation occurred in 51% of the intervention group versus 37% of the control group (P = .03). CVC insertion success occurred for 78% of the intervention group versus 67% of the control group (P = .02). Simulation training was independently and significantly associated with success at first cannulation (odds ratio: 1.7; 95% confidence interval: 1.1-2.8) and with successful CVC insertion (odds ratio: 1.7; 95% confidence interval: 1.1-2.8)--both independent of US use, patient comorbidities, or resident specialty. No significant differences related to technical errors or mechanical complications existed between the two groups. CONCLUSIONS: Simulation training was associated with improved in-hospital performance of CVC insertion. Procedural simulation was associated with improved residents' skills and was more effective than traditional training.

Teaching and assessing procedural skills using simulation: metrics and methodology.

Simulation allows educators to develop learner-focused training and outcomes-based assessments. However, the effectiveness and validity of simulation-based training in emergency medicine (EM) requires further investigation. Teaching and testing technical skills require methods and assessment instruments that are somewhat different than those used for cognitive or team skills. Drawing from work published by other medical disciplines as well as educational, behavioral, and human factors research, the authors developed six research themes: measurement of procedural skills; development of performance standards; assessment and validation of training methods, simulator models, and assessment tools; optimization of training methods; transfer of skills learned on simulator models to patients; and prevention of skill decay over time. The article reviews relevant and established educational research methodologies and identifies gaps in our knowledge of how physicians learn procedures. The authors present questions requiring further research that, once answered, will advance understanding of simulation-based procedural training and assessment in EM.