Expanding scope of Kirkpatrick model from training effectiveness review to evidence-informed prioritization management for cricothyroidotomy simulation.

Modified Kirkpatrick model has been adopted to evaluate training effectiveness by 6 categories, including activity accounting (training objectives/success in organization change) at Level-0, reaction (satisfaction) at Level-1, learning (acquisition of surgical airway skills) at Level-2, behavior (post-training change in personal strengths) at Level-3, result (organizational or clinical outcomes) at Level-4, and Return on Investment (ROI) or Expectation (ROE) (monetary and societal values following training and other quality and safety related measures) at Level-5. The purpose of this hospital-based prospective observational study was twofold: i) To evaluate potential impacts on monetary and societal values and successful organization change following implementation of advanced Cricothyroidotomy simulator and standardized curriculum in healthcare simulation training, ii) To inform decisions of resource allocation by reviewing overall values and prioritization strategies for i) general surgeon/emergency physician ii) with seniority >5 years and iii) prior porcine training experience based on findings at Kirkpatrick Level-0, Level-4, and Level-5. Seventy doctors and 10 nurses completed Cricothyroidotomy training and follow-up questionnaires within 2021/22. All training usability scoring measured by Scales of Emergency Surgical Airway Simulator (SESAS-17) achieved over 4 out of 5 (Level-4) with effects in favor of emergency physicians or general surgeons (p < .5), regardless of seniority and prior training experience. Success in organization change (Level-0) and cost-effectiveness (Level-5) were hypothetically established using theoretical framework of Gleicher's formula and Roger's Diffusion of Innovation Theory. Overall training effectiveness, in terms of advantage in usability, cost-benefits and successful organizational changes, provided sound evidence to support continuous investment of new curriculum and innovative simulator and "Surgeon-and-emergency-physician-first" policy when it comes to resources allocation strategies for Cricothyroidotomy training. [ACGME competencies: Practice Based Learning and Improvement, Systems Based Practice.].

Harnessing power of simulation training effectiveness with Kirkpatrick model in emergency surgical airway procedures.

Objectives: Training effectiveness indicates how good a program has met pre-set training objectives or organizational goals for the best benefit of healthcare professionals and service users in the community. The study aimed to evaluate training effectiveness following implementation of new training curriculum of emergency surgical airway procedures (Cricothyroidotomy) organized by the Queen Elizabeth Hospital. Design: This training evaluation relied on observational descriptive study design. Timed task on Cricothyroidotomy procedures and standardized post-training questionnaire were applied to assess the first 3 levels of Kirkpatrick's model: (Level-1) Reaction by training satisfaction; (Level-2) Learning by acquisition of knowledge and skills assessment passing rate; (Level-3) Behavior by personal strengths. Setting: This program was operated in the Multi-Disciplinary Simulation and Skills Centre, a hospital-based high-fidelity simulation training center accredited by the Society for Simulation in Healthcare. Participants: The study recruited 80 trauma service providers, including 35 general surgeons, 15 emergency physicians, 10 anesthesiologists or intensivists, 6 neurosurgeons, 4 orthopedic surgeons, and 10 emergency nurses from five trauma centers under the Hospital Authority. All underwent the Advanced Trauma Life Support training in advance. Results: Compared with reference score from previous training sessions, the result of program using new training curriculum and simulator demonstrated significant training satisfaction of participants (Level-1), and high level of assertiveness, mental preparedness, self-efficacy, and internal locus of control and responsibility (p < .01, for all in Level-3). All participants (N = 80) completed entire Cricothyroidotomy procedure in 2 min without technical errors (Assessment passing rate = 100%) (Level-2). Conclusions: Under Kirkpatrick model, simulation training in Cricothyroidotomy procedure using new curriculum and simulators has been proven to be useful for healthcare professionals involved in trauma service management. The result suggests that application of a state-of-the-art training tools to advanced surgical skills training could improve training satisfaction, knowledge and skills acquisition, and personal strengths transferable to clinical practice. ACGME competencies: Practice Based Learning and Improvement.

Investigating effects of healthcare simulation on personal strengths and organizational impacts for healthcare workers during COVID-19 pandemic: A cross-sectional study.

INTRODUCTION: This cross-sectional study aimed at evaluating impacts of healthcare simulation training, either in-situ or lab-based, on personal strengths of healthcare workers (HCWs) and organizational outcomes during the COVID-19 pandemic. METHODS: COVID-19 Taskforce was established to formulate standardized scenario-based simulation training materials in late-January 2020. Post-training questionnaires made up of 5-point Likert scales were distributed to all participants to evaluate their personal strengths, in terms of i) assertiveness, ii) mental preparedness, iii) self-efficacy, iv) internal locus of control, and v) internal locus of responsibility. Independent sample t-tests were used to analyze between-group difference in "In-situ" and "Lab-based" group; and one-sample t-tests were used to compare change in personal strengths with reference point of 3 (Neutral). Kirkpatrick's Model served as the analytical framework for overall training effects. RESULTS: Between 05 February and 18 March 2020, 101 sessions of simulation training were conducted in "In-Situ" at either Accident & Emergency Department (20, 20%) or Intensive Care Unit (15, 14%) and "Lab-based" for Isolation (30, 30%) and General Wards (36, 36%). 1,415 hospital staff members, including 1,167 nurses (82%), 163 doctors (12%) and 85 patient care assistants (6%), were trained. All domains of personal strengths were scored 4.24 or above and statistically significantly increased when comparing with reference population (p < .001). However, no significant differences between in-situ and lab-based simulation were found (p > .05), for all domains of personal strengths. CONCLUSION: Healthcare simulation training enhanced healthcare workers' personal strengths critical to operational and clinical outcomes during the COVID-19 pandemic.

Simulation training on bedside veno-arterial extracorporeal membrane oxygenation decannulation.

Veno-arterial extracorporeal membrane oxygenation is a form of mechanical circulatory support for patients with refractory decompensated heart failure. Blood is drawn from a large vein and pumped back to a large artery, usually a femoral artery through large bore catheters. When the heart recovers, the extracorporeal membrane oxygenation support can be terminated and the catheters are decannulated. The bleeding at the venous side can be controlled by prolonged compression; however, the arteriotomy wound needs to be repaired. Conventionally, the arteriotomy wounds require open vascular repair in the operating theater. The novel application of percutaneous vascular closure devices, which have been commonly used in vascular operations and percutaneous structural heart interventions, could be applied for closure of arteriotomy wounds at the bedside after extracorporeal membrane oxygenation support. The post-close ProGlide (Abbott Vascular) technique was shown to be safe and could potentially save time and manpower. The wounds are much smaller as compared with the conventional open repair and potentially, the chance of wound infection can be reduced. However, the success of percutaneous bedside closure requires careful prior planning and technique training. Backup plans with vascular surgeons' standby are essential in case of failure of closure. Staffs in the extracorporeal membrane oxygenation centers need to be familiar with the preparation, the procedure as well as the device application technique for successful percutaneous closure. The long learning curve and the limited case load mean that such skills are best trained by simulation scenarios. This article described how this new technique and the team logistics can be trained by simulation.