Effects of Simulation Fidelity on Health Care Providers on Team Training-A Systematic Review.

ABSTRACT: This systematic review, following PRISMA standards, aimed to assess the effectiveness of higher versus lower fidelity simulation on health care providers engaged in team training. A comprehensive search from January 1, 2011 to January 24, 2023 identified 1390 studies of which 14 randomized (n = 1530) and 5 case controlled (n = 257) studies met the inclusion criteria. The certainty of evidence was very low due to a high risk of bias and inconsistency. Heterogeneity prevented any metaanalysis. Limited evidence showed benefit for confidence, technical skills, and nontechnical skills. No significant difference was found in knowledge outcomes and teamwork abilities between lower and higher fidelity simulation. Participants reported higher satisfaction but also higher stress with higher fidelity materials. Both higher and lower fidelity simulation can be beneficial for team training, with higher fidelity simulation preferred by participants if resources allow. Standardizing definitions and outcomes, as well as conducting robust cost-comparative analyses, are important for future research.

Cricothyrotomy in Acute Upper Gastrointestinal Bleed: A Difficult Airway Simulation Case for Anesthesiology Residents.

Introduction: Patients with acute upper gastrointestinal bleeding may have challenging airways. This simulation teaches anesthesiology residents the skill of cricothyrotomy as a surgical last resort while managing acute bleeding in the airway. Methods: The simulation involved a 55-year-old patient with history of alcohol abuse admitted to the ICU with hematemesis and acute blood loss for esophagogastroduodenoscopy in the ICU setting. The mannequin had tubing in the posterior oropharynx connected to a pressurized bag of simulated blood hidden from view. While conversing, the patient began to cough and gag, and the bag of fluid was opened, filling the posterior oropharynx with blood, which prompted immediate intubation attempts, designed to fail no matter what the learners attempted. When residents requested a surgical airway, they were provided with a cricothyrotomy kit and a task trainer to perform the procedure. Residents were evaluated using a behavior checklist, debriefed, then asked to complete a postsimulation survey. Results: Fifty-eight anesthesiology residents completed the simulation and provided feedback via a 5-point Likert scale of agreement. Most residents quickly recognized the need for emergency intubation. Eighty-eight percent of participants strongly agreed that the simulation was a valuable learning experience, with 99% stating it increased their confidence and clinical decision-making in handling similar scenarios in the future. Discussion: This simulation provides a chance to practice valuable airway management skills that increase resident confidence in cricothyrotomy. Future work may examine if these skills and confidence levels are sustainable over time and if they are applied in future patient encounters.

Development and Pilot Testing of a Programmatic System for Competency Assessment in US Anesthesiology Residency Training.

BACKGROUND: In 2018, a set of entrustable professional activities (EPAs) and procedural skills assessments were developed for anesthesiology training, but they did not assess all the Accreditation Council for Graduate Medical Education (ACGME) milestones. The aims of this study were to (1) remap the 2018 EPA and procedural skills assessments to the revised ACGME Anesthesiology Milestones 2.0, (2) develop new assessments that combined with the original assessments to create a system of assessment that addresses all level 1 to 4 milestones, and (3) provide evidence for the validity of the assessments. METHODS: Using a modified Delphi process, a panel of anesthesiology education experts remapped the original assessments developed in 2018 to the Anesthesiology Milestones 2.0 and developed new assessments to create a system that assessed all level 1 through 4 milestones. Following a 24-month pilot at 7 institutions, the number of EPA and procedural skill assessments and mean scores were computed at the end of the academic year. Milestone achievement and subcompetency data for assessments from a single institution were compared to scores assigned by the institution's clinical competency committee (CCC). RESULTS: New assessment development, 2 months of testing and feedback, and revisions resulted in 5 new EPAs, 11 nontechnical skills assessments (NTSAs), and 6 objective structured clinical examinations (OSCEs). Combined with the original 20 EPAs and procedural skills assessments, the new system of assessment addresses 99% of level 1 to 4 Anesthesiology Milestones 2.0. During the 24-month pilot, aggregate mean EPA and procedural skill scores significantly increased with year in training. System subcompetency scores correlated significantly with 15 of 23 (65.2%) corresponding CCC scores at a single institution, but 8 correlations (36.4%) were <30.0, illustrating poor correlation. CONCLUSIONS: A panel of experts developed a set of EPAs, procedural skill assessment, NTSAs, and OSCEs to form a programmatic system of assessment for anesthesiology residency training in the United States. The method used to develop and pilot test the assessments, the progression of assessment scores with time in training, and the correlation of assessment scores with CCC scoring of milestone achievement provide evidence for the validity of the assessments.

Lymphatic Leakage in Pediatric Heart Transplantation: Early Recognition and Timely Management with Interventional Radiologic and Endoscopic Therapy.

Protein-losing enteropathy (PLE) is a severe complication of the Fontan procedure that leads to systemic complications owing to enteric protein loss. Hepatoduodenal lymphatic leakage resulting from increased lymphatic pressure is one such complication. We present the case of a pediatric heart transplant patient who experienced refractory PLE symptoms requiring serial albumin infusions and exhibited lymphatic leakage into the duodenum. Using diagnostic lymphangiography and endoscopy, we identified the affected area and treated it successfully with endoscopic sclerotherapy using ethanolamine injection. This treatment allowed for the cessation of lymphatic fluid and may serve as a potential intervention for PLE-associated hepatoduodenal lymphatic leakage. The present case highlights the importance of early recognition and timely intervention with radiology and endoscopic therapy to manage PLE and its associated complications.

Fostering research in pediatric interventional radiology: needs assessment and suggestions for support.

BACKGROUND: Due to the rarity of pediatric diseases, collaborative research is the key to maximizing the impact of research studies. A research needs assessment survey was created to support initiatives to foster pediatric interventional radiology research. OBJECTIVE: To assess the status of pediatric interventional radiology research, identify perceived barriers, obtain community input on areas of research/education/support, and create metrics for evaluating changes/responses to programmatic initiatives. MATERIALS AND METHODS: A survey link was sent to approximately 275 members of the Society for Pediatric Interventional Radiology (SPIR) between May and October 2020. Data was collected using a web-based interface. Data collected included practice setting, clinical role, research experience, research barriers, and suggestions for future initiatives. RESULTS: Fifty-nine surveys were analyzed with a staff physician survey response rate of 28% (56/198). A wide range of practice sizes from 15 countries were represented. Respondents were predominantly staff physicians (95%; 56/59) with an average of 11 years (range: 1-25 years) of clinical experience working at academic or freestanding children's hospitals. A total of 100% (59/59) had research experience, and 70% (41/58) had published research with a mean of 30 peer-reviewed publications (range: 1-200). For job security, 56% (33/59) of respondents were expected or required to publish, but only 19% (11/58) had research support staff, and 42% (25/59) had protected research time, but of those, 36% (9/25) got the time "sometimes or never." Lack of support staff, established collaborative processes, and education were identified as top barriers to performing research. CONCLUSIONS: The needs assessment survey demonstrated active research output despite several identified barriers. There is a widespread interest within the pediatric interventional radiology community for collaborative research.

Intraoperative Neuromonitoring during Peripheral Arteriovenous Malformation Embolization.

PURPOSE: To evaluate whether intraoperative neuromonitoring (IONM), including pre-embolization lidocaine injection challenge ("provocative testing") is associated with reduced risk of irreversible nerve injury during embolization of peripheral arteriovenous malformations (AVMs). MATERIALS AND METHODS: Medical records of patients with peripheral AVMs who underwent embolotherapy with IONM with provocative testing between 2012 and 2021 were reviewed retrospectively. Data collected included patient demographic characteristics, AVM location and size, embolic agent used, IONM signal changes after lidocaine and embolic agent injections, postprocedural adverse events, and clinical outcomes. Decisions regarding whether embolization would proceed at specific locations were based on IONM findings after the lidocaine challenge and as embolization proceeded. RESULTS: A cohort of 17 patients (mean age, 27 years ± 19; 5 women) who underwent 59 image-guided embolization procedures with adequate IONM data was identified. No permanent neurologic deficits occurred. Transient neurologic deficits were observed in 3 patients (4 sessions), comprising skin numbness (2 patients), extremity weakness (1 patient), and extremity weakness and numbness (1 patient). All neurologic deficits resolved by postoperative day 4 without additional treatment. CONCLUSIONS: IONM, including provocative testing, during AVM embolization may minimize potential nerve injury.

Situation, Background, Assessment, Recommendation (SBAR) Education for Health Care Students: Assessment of a Training Program.

Introduction: Interprofessional communication failures are estimated to be a factor in two-thirds of serious health care-related accidents. Using a standardized communication protocol during transfer of patient information between providers improves patient safety. An interprofessional education (IPE) event for first-year health professions students was designed using the Situation, Background, Assessment, Recommendation (SBAR) tool as a structured communication framework. IPE literature, including a valid measurement tool specifically tailored for SBAR, was utilized to design the Interprofessional Team Training Day (ITTD) and evaluate learner gains in SBAR skills. Methods: Learners from six educational programs participated in ITTD, which consisted of didactics, small-group discussion, and role-play using the SBAR protocol. Individual learners were assessed using the SBAR Brief Assessment Rubric for Learner Assessment (SBAR-LA) on SBAR communication skills before and after the ITTD event. Learners received a written clinical vignette and submitted video recordings of themselves simulating the use of SBAR to communicate to another health care professional. Pre- and postrecordings were scored using the SBAR-LA rubric. Normalized gain scores were calculated to estimate the improvement attributable to ITTD. Results: SBAR-LA scores increased for 60% of participants. For skills not demonstrated before the event, the average learner acquired 44% of those skills from ITTD. Learners demonstrated statistically significant increases for five of 10 SBAR-LA skills. Discussion: The value to patient safety of utilizing structured communication between health care providers is proven; however, evaluating IPE teaching of communication skills effectiveness is challenging. Using SBAR-LA, communication skills were shown to improve following ITTD.

Postembolization Persistence of Pulmonary Arteriovenous Malformations: A Retrospective Comparison of Coils and Amplatzer and Micro Vascular Plugs Using Propensity Score Weighting.

BACKGROUND. Endovascular embolization of pulmonary arteriovenous malformations (PAVMs) was historically performed with embolic coils. The Amplatzer Vascular Plug device (AVP) was introduced for this purpose in 2007 and the Micro Vascular Plug device (MVP) in 2013. OBJECTIVE. The purpose of this study was to compare coils, AVPs, and MVPs in terms of risk of persistence after PAVM embolization by use of propensity score weighting to account for biases in device selection. METHODS. This retrospective study included 112 patients (78 women and girls, 34 men and boys; mean age, 45 years) who underwent embolization of 393 PAVMs with a single device type (coil, MVP, or AVP) from January 2003 to January 2020. Persistence was defined as less than 70% reduction in PAVM sac size or contrast enhancement of the sac on follow-up pulmonary CTA. A Cox proportional hazards regression model was used to assess associations between embolic device selection and PAVM persistence. Inverse propensity score weighting was used to account for differences in embolic device selection based on patient and PAVM characteristics. RESULTS. The median postembolization follow-up period was 1.5 years (IQR, 0.3-5.6 years). Persistence was found in 10% (41/393) of PAVMs, including 16% (34/207) of those treated with coils, 8% (7/88) of those treated with AVPs, and 0% (0/98) of those treated with MVPs. Variables associated with embolization device (p < .25) were age, sex, pediatric versus adult status, smoking status, PAVM complexity, PAVM laterality, number of feeding arteries, and feeding artery diameter. The Cox regression model incorporated inverse propensity score weighting to account for the differences between treatment groups in these variables and incorporated feeding artery diameter because of imbalance remaining after weighting. With coils as the referent, MVPs had a hazard ratio for persistence of less than 0.01 (95% CI, < 0.01 to < 0.01; p < .001), and AVPs had a hazard ratio of 0.37 (95% CI, 0.16-0.90; p = .03). CONCLUSION. The risk of persistence after PAVM embolization was significantly lower for MVPs alone than for coils or AVPs alone. In addition, the risk of persistence was lower for AVPs than for coils. CLINICAL IMPACT. The findings support the clinical use of MVPs as the preferred device for PAVM embolization over coils and polytetrafluoroethylene-covered plugs.

Intraoperative Accidental Extubation during Thyroidectomy in a Known Difficult-Airway Patient: An Adult Simulation Case for Anesthesiology Residents.

Intraoperative accidental extubation on a known difficult-airway patient requires prompt attention. A good understanding of the steps to re-establish the airway is critical, especially when the patient is known to have a difficult airway documented or discovered on induction or acquires a difficult airway secondary to intraoperative events. The situation becomes even more complicated if the case has been handed off to another anesthesiologist, where specific and detailed information may not have been conveyed. This simulation was designed to train first-year clinical anesthesia residents. It was a 50 min encounter that focused on the management of complete loss of an airway during a thyroidectomy on a known difficult-airway patient. The endotracheal tube dislodgement was simulated by deliberate tube manipulation through the cervical access window of the mannequin. Learners received a formative assessment of their performance during the debrief, and most of the residents met the educational objectives. Learners were asked to complete a survey of their experience, and the feedback was positive and constructive. The response rate was 68% (17/25). Our simulation program helped anesthesiology residents develop intraoperative emergency airway management skills in a safe environment, as well as foster communication skills among anesthesiologists and the surgery team.

Intraoperative Tension Pneumothorax in a Trauma Patient: An Adult Simulation Case for Anesthesia Residents.

Anesthesiologists may encounter multiple obstacles in communication when attempting to collect information for emergency surgeries. Occult tension pneumothorax that was asymptomatic in the emergency department (ED) could become apparent upon positive pressure ventilation and pose a critical threat to the patient intraoperatively. Here, we describe a simulation exercise that was developed as a curriculum module for the Indiana University (IU) Anesthesiology residency program. It is primarily designed for first-year clinical anesthesia residents (CA-1/PGY-2). It is a 50 min encounter with two scenarios. The first scenario focuses on information collection and communication with a non-cooperative patient with multiple distractors. The second scenario focuses on the early diagnosis of tension pneumothorax and subsequent treatment. The residents were given formative feedback and met the educational objectives. Commonly missed critical actions included misdiagnosing the tension pneumothorax as mainstem intubation, bronchospasm, pulmonary thromboembolism, and anaphylaxis. Residents rated the feedback and debriefing as "extremely useful" or "very useful." Time constraints limit the number of residents who can sit in the "hot seat." The structure of the mannequin limits the ability to diagnose pneumothorax by auscultation and ultrasound. In the future, the scenarios may also be utilized to educate student anesthesiologist assistants and other non-physician anesthesia learners.

Development of a simulation technical competence curriculum for medical simulation fellows.

BACKGROUND AND NEEDS: Medical educators with simulation fellowship training have a unique skill set. Simulation fellowship graduates have the ability to handle basic and common troubleshooting issues with simulation software, hardware, and equipment setup. Outside of formal training programs such as this, simulation skills are inconsistently taught and organically learned. This is important to address because there are high expectations of medical educators who complete simulation fellowships. To fill the gap, we offer one way of teaching and assessing simulation technical skills within a fellowship curriculum and reflect on lessons learned throughout the process. This report describes the instructional designs, implementation, and program evaluation of an educational intervention: a simulation technology curriculum for simulation fellows. CURRICULUM DESIGN: The current iteration of the simulation technical skill curriculum was introduced in 2018 and took approximately 8 months to develop under the guidance of expert simulation technology specialists, simulation fellowship-trained faculty, and simulation center administrators. Kern's six steps to curriculum development was used as the guiding conceptual framework. The curriculum was categorized into four domains, which emerged from the outcome of a qualitative needs assessment. Instructional sessions occurred on 5 days spanning a 2-week block. The final session concluded with summative testing. PROGRAM EVALUATION: Fellows were administered summative objective structured exams at three stations. The performance was rated by instructors using station-specific checklists. Scores approached 100% accuracy/completion for all stations. CONCLUSIONS: The development of an evidence-based educational intervention, a simulation technical skill curriculum, was highly regarded by participants and demonstrated effective training of the simulation fellows. This curriculum serves as a template for other simulationists to implement formal training in simulation technical skills.

Resilience matters: Student perceptions of the impact of COVID-19 on medical education.

INTRODUCTION: We assessed students' perception of the impact of the pandemic on their well-being, education, academic achievement, and whether grit and resilience alter students' ability to mitigate the stress associated with disruptions in education. We hypothesized that students would report a negative impact, and those with higher grit and resilience scores would be less impacted. METHODS: A multidisciplinary team of educators created and distributed a survey to medical students. Survey results were analyzed using descriptive statistics, ANOVA, and multivariate linear regressions. A p-value <.05 was considered statistically significant. RESULTS: A total of 195 students were included in the study. Approximately 92% reported that clinical education was negatively affected, including participants with higher grit scores. Students with higher resilience scores were more optimistic about clinical education. Those with higher resilience scores were less likely to report anxiety, insomnia, and tiredness. CONCLUSION: More resilient students were able to manage the stress associated with the disruption in their education. Resiliency training should be year-specific, and integrated into the UME curriculum due to the different demands each year presents.

SBAR-LA: SBAR Brief Assessment Rubric for Learner Assessment.

Introduction: Structured communication tools are associated with improvement in information transfer and lead to improved patient safety. Situation, Background, Assessment, Recommendation (SBAR) is one such tool. Because there is a paucity of instruments to measure SBAR effectiveness, we developed and validated an assessment tool for use with prepractice health professions students. Methods: We developed the SBAR Brief Assessment Rubric for Learner Assessment (SBAR-LA) by starting with a preliminary list of items based on the SBAR framework. During an interprofessional team training event, students were trained in the use of SBAR. Subsequently, they were assigned to perform a simulated communication scenario demonstrating use of SBAR principles. We used 10 videos from these scenarios to refine the items and scales over two rounds. Finally, we applied the instrument on another subset of 10 students to conduct rater calibration and measure interrater reliability. Results: We used a total of 20 out of 225 videos of student performance to create the 10-item instrument. Interrater reliability was .672, and for eight items, the Fleiss' kappa was considered good or fair. Discussion: We developed a scoring rubric for teaching SBAR communication that met criteria for validity and demonstrated adequate interrater reliability. Our development process provided evidence of validity for the content, construct, and response process used. Additional evidence from the use of SBAR-LA in settings where communication skills can be directly observed, such as simulation and clinical environments, may further enhance the instrument's accuracy. The SBAR-LA is a valid and reliable instrument to assess student performance.

Development and Pilot Testing of Entrustable Professional Activities for US Anesthesiology Residency Training.

BACKGROUND: Modern medical education requires frequent competency assessment. The Accreditation Council for Graduate Medical Education (ACGME) provides a descriptive framework of competencies and milestones but does not provide standardized instruments to assess and track trainee competency over time. Entrustable professional activities (EPAs) represent a workplace-based method to assess the achievement of competency milestones at the point-of-care that can be applied to anesthesiology training in the United States. METHODS: Experts in education and competency assessment were recruited to participate in a 6-step process using a modified Delphi method with iterative rounds to reach consensus on an entrustment scale, a list of EPAs and procedural skills, detailed definitions for each EPA, a mapping of the EPAs to the ACGME milestones, and a target level of entrustment for graduating US anesthesiology residents for each EPA and procedural skill. The defined EPAs and procedural skills were implemented using a website and mobile app. The assessment system was piloted at 7 anesthesiology residency programs. After 2 months, faculty were surveyed on their attitudes on usability and utility of the assessment system. The number of evaluations submitted per month was collected for 1 year. RESULTS: Participants in EPA development included 18 education experts from 11 different programs. The Delphi rounds produced a final list of 20 EPAs, each differentiated as simple or complex, a defined entrustment scale, mapping of the EPAs to milestones, and graduation entrustment targets. A list of 159 procedural skills was similarly developed. Results of the faculty survey demonstrated favorable ratings on all questions regarding app usability as well as the utility of the app and EPA assessments. Over the 2-month pilot period, 1636 EPA and 1427 procedure assessments were submitted. All programs continued to use the app for the remainder of the academic year resulting in 12,641 submitted assessments. CONCLUSIONS: A list of 20 anesthesiology EPAs and 159 procedural skills assessments were developed using a rigorous methodology to reach consensus among education experts. The assessments were pilot tested at 7 US anesthesiology residency programs demonstrating the feasibility of implementation using a mobile app and the ability to collect assessment data. Adoption at the pilot sites was variable; however, the use of the system was not mandatory for faculty or trainees at any site.

Modernizing Education of the Pediatric Anesthesiologist.

This article discusses modernizing the education of pediatric anesthesiologists in the United States. First, the current education requirements to become an American Board of Anesthesiology certified pediatric anesthesiologist are detailed and then, through a historical lens, the development of the subspecialty is examined. Gaps and challenges in the current training system are identified and interventions for improvement discussed. Additionally, suggestions are made and questions posed on how to move from a time-based model towards a competency-based curriculum.

Innovative Use of High-Fidelity Lung Simulators to Test a Ventilator Splitter Device.

The coronavirus disease 2019 (COVID-19) pandemic has rapidly exposed health care system inadequacies. Hospital ventilator shortages in Italy compelled US physicians to consider creative solutions, such as using Y-pieces or T-pieces, to preclude the need to make decisions of life or death based on medical equipment availability. We add to current knowledge and testing capacity for ventilator splitters by reporting the ability to examine the functionality of ventilator splitters by using 2 high-fidelity lung simulators. Data obtained by the high-fidelity lung simulators included: tidal volume, respiratory rate, minute ventilation, peak inspiratory pressure, peak plateau pressure, and positive end-expiratory pressure.

Intraoperative Sepsis: A Simulation Case for Anesthesiology Residents.

Introduction: Sepsis is a major cause of morbidity and mortality in medicine and is managed in ICUs daily. Critical care training is a vital part of anesthesiology residency, and understanding the presentation, management, and treatment of septic shock is fundamental to intraoperative patient care. Methods: This simulation involved a 58-year-old man undergoing surgical debridement of a peripancreatic cyst with hemodynamic instability and septic shock. We conducted the simulation yearly for clinical anesthesia year 2 residents (n = 26) in 1-hour sessions with three to five learners at a time. The simulation covered the six Anesthesiology Milestones related to sepsis and septic shock as outlined in the Anesthesiology Milestones Project. Results: To date, 155 anesthesiology residents have completed the simulation. Commonly missed critical actions included failure to recognize the need for invasive lines, provide appropriate volumes of fluid resuscitation, inquire about blood cultures and antibiotics, and recognize the need for the patient to remain intubated. Most participants could appropriately diagnose and treat intraoperative septic shock, but all had moments of action or inaction to discuss and improve upon, and all learned from this scenario. Discussion: Simulation is an optimal way to practice the more rare and life-threatening clinical events in medicine. Even though septic shock is commonly managed in the ICU, it is relatively uncommon for it to develop acutely in the OR. This simulation is an effective and educational way to discuss the most recent sepsis/septic shock definition and review evidence-based guidelines for treatment.