Setting an Agenda: Results of a Consensus Process on Research Directions in Distance Simulation.

BACKGROUND: The COVID-19 pandemic forced rapid implementation and refinement of distance simulation methodologies in which participants and/or facilitators are not physically colocated. A review of the distance simulation literature showed that heterogeneity in many areas (including nomenclature, methodology, and outcomes) limited the ability to identify best practice. In April 2020, the Healthcare Distance Simulation Collaboration was formed with the goal of addressing these issues. The aim of this study was to identify future research priorities in the field of distance simulation using data derived from this summit. METHODS: This study analyzed textual data gathered during the consensus process conducted at the inaugural Healthcare Distance Simulation Summit to explore participant perceptions of the most pressing research questions regarding distance simulation. Participants discussed education and patient safety standards, simulation facilitators and barriers, and research priorities. Data were qualitatively analyzed using an explicitly constructivist thematic analysis approach, resulting in the creation of a theoretical framework. RESULTS: Our sample included 302 participants who represented 29 countries. We identified 42 codes clustered within 4 themes concerning key areas in which further research into distance simulation is needed: (1) safety and acceptability, (2) educational/foundational considerations, (3) impact, and (4) areas of ongoing exploration. Within each theme, pertinent research questions were identified and categorized. CONCLUSIONS: Distance simulation presents several challenges and opportunities. Research around best practices, including educational foundation and psychological safety, are especially important as is the need to determine outcomes and long-term effects of this emerging field.

Patient Safety/Quality Improvement Primer, Part III: The Role of Simulation.

Simulation training has taken a prominent role in otolaryngology-head and neck surgery (OTO-HNS) as a means to ensure patient safety and quality improvement (PS/QI). While it is often equated to resident training, this tool has value in lifelong learning and extends beyond the individual otolaryngologists to include simulation-based learning for teams and health systems processes. Part III of this PS/QI primer provides an overview of simulation in medicine and specific applications within the field of OTO-HNS. The impact of simulation on PS/QI will be presented in an evidence-based fashion to include the use of run and statistical process control charts to assess the impact of simulation-guided initiatives. Last, steps in developing a simulation program focused on PS/QI will be outlined with future opportunities for OTO-HNS simulation.

Simulathon 2020: Integrating Simulation Period Prevalence Methodology Into the COVID-19 Disaster Management Cycle in India.

SUMMARY STATEMENT: The disaster management cycle is an accepted model that encompasses preparation for and recovery from large-scale disasters. Over the past decade, India's Pediatric Simulation Training and Research Society has developed a national-scale simulation delivery platform, termed the Simulathon , with a period prevalence methodology that integrates with core aspects of this model. As an exemplar of the effectiveness of this approach, we describe the development, implementation, and outcomes of the 2020 Simulathon, conducted from April 20 to May 20 in response to the nascent COVID-19 pandemic disaster. We conclude by discussing how aspects of the COVID-19 Simulathon enabled us to address key aspects of the disaster management cycle, as well as challenges that we encountered. We present a roadmap by which other simulation programs in low- and middle-income countries could enact a similar process.

Competency-Based Assessment Tool for Pediatric Esophagoscopy: International Modified Delphi Consensus.

OBJECTIVES/HYPOTHESIS: Create a competency-based assessment tool for pediatric esophagoscopy with foreign body removal. STUDY DESIGN: Blinded modified Delphi consensus process. SETTING: Tertiary care center. METHODS: A list of 25 potential items was sent via the Research Electronic Data Capture database to 66 expert surgeons who perform pediatric esophagoscopy. In the first round, items were rated as "keep" or "remove" and comments were incorporated. In the second round, experts rated the importance of each item on a seven-point Likert scale. Consensus was determined with a goal of 7 to 25 final items. RESULTS: The response rate was 38/64 (59.4%) in the first round and returned questionnaires were 100% complete. Experts wanted to "keep" all items and 172 comments were incorporated. Twenty-four task-specific and 7 previously-validated global rating items were distributed in the second round, and the response rate was 53/64 (82.8%) with questionnaires returned 97.5% complete. Of the task-specific items, 9 reached consensus, 7 were near consensus, and 8 did not achieve consensus. For global rating items that were previously validated, 6 reached consensus and 1 was near consensus. CONCLUSIONS: It is possible to reach consensus about the important steps involved in rigid esophagoscopy with foreign body removal using a modified Delphi consensus technique. These items can now be considered when evaluating trainees during this procedure. This tool may allow trainees to focus on important steps of the procedure and help training programs standardize how trainees are evaluated. LEVEL OF EVIDENCE: 5. Laryngoscope, 131:1168-1174, 2021.

Regionalization of ORL Boot Camps: Report of the Society of University Otolaryngologists Task Force.

OBJECTIVES: Simulation-based boot camps have emerged as timely vehicles to help novice residents develop the skills needed to manage medical emergencies. Geographically regional boot camps provide opportunities for interaction between residents and faculty from multiple otolaryngology programs. The Society of University Otolaryngologists (SUO) Boot Camp Task Force investigated the concept of regional access to otolaryngology boot camps with the goal of making more regional boot camps available for otolaryngology residents across the United States. STUDY DESIGN: Interviews. METHODS: The SUO Boot Camp Task Force assessed regional access to otolaryngology boot camps with a focus on geographic distribution, curricular content, and finances. Boot camp directors were contacted by email and telephone and interviewed to elicit information on all these areas. RESULTS: Data were available from 10 known regional simulation-based boot camps designed for novice residents. Individual boot camps included from 12 to 30 residents and 10 to 50 faculty members. Curricula included both technical (ie, procedural) and non-technical (eg, communication, leadership) skills for individuals and teams. Content was heavily weighted toward a variety of airway problems and management techniques, although various conditions involving hemorrhage, and airway fires were also addressed. Funding and expense structures had the greatest variability. CONCLUSIONS: Considerable variability was identified among the known regional boot camps in terms of numbers of participants and finances, but fewer differences in curriculum. Geographic opportunity for 9 to 10 new boot camps was identified. The SUO Task Force recommends that a consensus be developed for several individual skill and teamwork scenario objectives to be included in each boot camp. Laryngoscope, 131:737-743, 2021.

A Road Map for Simulation Based Medical Students Training in Pediatrics: Preparing the Next Generation of Doctors.

Current Medical training in India is generally didactic and pedagogical, and often does not systematically prepare newly graduated doctors to be competent, confident and compassionate. After much deliberation, the Medical Council of India (MCI) has recently introduced a new outcome-driven curriculum for undergraduate medical student training with specific milestones and an emphasis on simulation-based learning and guided reflection. Simulation-based education and debriefing (guided reflection) has transformed medical training in many countries by accelerating learning curves, improving team skills and behavior, and enhancing provider confidence and competence. In this article, we provide a broad framework and roadmap suggesting how simulation-based education might be incorporated and contextualized by undergraduate medical institutions, especially for pediatric training, using local resources to achieve the goals of the new MCI competency-based and simulation-enhanced undergraduate curriculum.

Do Fellows and Faculty Share the Same Perception of Simulation Fidelity? A Pilot Study.

INTRODUCTION: Simulation is increasingly integrated into graduate medical education, and simulation faculty generally attempt to optimize the fidelity of simulators and simulations on behalf of trainees, so as to approach the realism of actual patient care experiences. As residents and fellows participate as learners in simulations, which faculty design, this investigation sought to address whether fellows and faculty have similar perceptions of fidelity by comparing ratings of 2 types of simulation experiences. METHODS: Prospective single-center observational study comparing surveys completed by fellows and faculty participating in multiple simulation sessions during a one-day simulation-based boot camp. RESULTS: Overall, both the fellows and the faculty provided moderate to high ratings of fidelity for both a technical skill and a teamwork simulation session. Fellows' ratings of an airway skills session were significantly higher than faculty ratings in 4 of 6 questions but similar to faculty ratings of a teamwork scenario session. CONCLUSIONS: Pediatric anesthesia fellows' ratings of simulation fidelity were at least as high as faculty ratings during an annual boot camp, suggesting that faculty in this setting developed simulations that the fellows found to be realistic. Faculty were relatively more critical of the fidelity of a skill session, compared with a teamwork scenario session. If this finding is generalizable, this may reassure faculty designing simulations for fellows. Continued inspection of the entwined nature of fidelity and simulation will help inform more effective learning for this growing educational modality.

SimTube: A National Simulation Training and Research Project.

OBJECTIVE: To test the feasibility and impact of a simulation training program for myringotomy and tube (M&T) placement. STUDY DESIGN: Prospective randomized controlled. SETTING: Multi-institutional. SUBJECTS AND METHODS: An M&T simulator was used to assess the impact of simulation training vs no simulation training on the rate of achieving competency. Novice trainees were assessed using posttest simulator Objective Structured Assessment of Technical Skills (OSATS) scores, OSATS score for initial intraoperative tube insertion, and number of procedures to obtain competency. The effect of simulation training was analyzed using χ2 tests, Wilcoxon-Mann-Whitney tests, and Cox proportional hazards regression. RESULTS: A total of 101 residents and 105 raters from 65 institutions were enrolled; however, just 63 residents had sufficient data to be analyzed due to substantial breaches in protocol. There was no difference in simulator pretest scores between intervention and control groups; however, the intervention group had better OSATS global scores on the simulator (17.4 vs 13.7, P = .0003) and OSATS task scores on the simulator (4.5 vs 3.6, P = .02). No difference in OSATS scores was observed during initial live surgery rating (P = .73 and P = .41). OSATS scores were predictive of the rate at which residents achieved competence in performing myringotomy; however, the intervention was not associated with subsequent OSATS scores during live surgeries (P = .44 and P = .91) or the rate of achieving competence (P = .16). CONCLUSIONS: A multi-institutional simulation study is feasible. Novices trained using the M&T simulator achieved higher scores on simulator but not initial intraoperative OSATS, and they did not reach competency sooner than those not trained on the simulator.

Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus.

OBJECTIVES/HYPOTHESIS: Create a competency-based assessment tool for pediatric tracheotomy. STUDY DESIGN: Blinded, modified, Delphi consensus process. METHODS: Using the REDCap database, a list of 31 potential items was circulated to 65 expert surgeons who perform pediatric tracheotomy. In the first round, items were rated as "keep" or "remove," and comments were incorporated. In the second round, experts were asked to rate the importance of each item on a seven-point Likert scale. Consensus criteria were determined a priori with a goal of 7 to 25 final items. RESULTS: The first round achieved a response rate of 39/65 (60.0%), and returned questionnaires were 99.5% complete. All items were rated as "keep," and 137 comments were incorporated. In the second round, 30 task-specific and seven previously validated global rating items were distributed, and the response rate was 44/65 (67.7%), with returned questionnaires being 99.3% complete. Of the Task-Specific Items, 13 reached consensus, 10 were near consensus, and 7 did not achieve consensus. For the 7 previously validated global rating items, 5 reached consensus and two were near consensus. CONCLUSIONS: It is feasible to reach consensus on the important steps involved in pediatric tracheotomy using a modified Delphi consensus process. These items can now be considered to create a competency-based assessment tool for pediatric tracheotomy. Such a tool will hopefully allow trainees to focus on the important aspects of this procedure and help teaching programs standardize how they evaluate trainees during this procedure. LEVEL OF EVIDENCE: 5 Laryngoscope, 130:2700-2707, 2020.

Prevalence of Errors in Anaphylaxis in Kids (PEAK): A Multicenter Simulation-Based Study.

BACKGROUND: Multi-institutional, international practice variation of pediatric anaphylaxis management by health care providers has not been reported. OBJECTIVE: To characterize variability in epinephrine administration for pediatric anaphylaxis across institutions, including frequency and types of medication errors. METHODS: A prospective, observational, study using a standardized in situ simulated anaphylaxis scenario was performed across 28 health care institutions in 6 countries. The on-duty health care team was called for a child (patient simulator) in anaphylaxis. Real medications and supplies were obtained from their actual locations. Demographic data about team members, institutional protocols for anaphylaxis, timing of epinephrine delivery, medication errors, and systems safety issues discovered during the simulation were collected. RESULTS: Thirty-seven in situ simulations were performed. Anaphylaxis guidelines existed in 41% (15 of 37) of institutions. Teams used a cognitive aid for medication dosing 41% (15 of 37) of the time and 32% (12 of 37) for preparation. Epinephrine autoinjectors were not available in 54% (20 of 37) of institutions and were used in only 14% (5 of 37) of simulations. Median time to epinephrine administration was 95 seconds (interquartile range, 77-252) for epinephrine autoinjector and 263 seconds (interquartile range, 146-407.5) for manually prepared epinephrine (P = .12). At least 1 medication error occurred in 68% (25 of 37) of simulations. Nursing experience with epinephrine administration for anaphylaxis was associated with fewer preparation (P = .04) and administration (P = .01) errors. Latent safety threats were reported by 30% (11 of 37) of institutions, and more than half of these (6 of 11) involved a cognitive aid. CONCLUSIONS: A multicenter, international study of simulated pediatric anaphylaxis reveals (1) variation in management between institutions in the use of protocols, cognitive aids, and medication formularies, (2) frequent errors involving epinephrine, and (3) latent safety threats related to cognitive aids among multiple sites.

Patient Safety in Anesthesia.

Anesthesiologists and otolaryngologists share the airway in an elegant ballet that requires communication, collaboration, and mutual respect. This article addresses principles to prevent or manage challenging conditions such as airway fires, anatomically difficult airways, and post-tonsillectomy hemorrhage. Discussion includes rationales for the use of simulation and resilience engineering principles to achieve the safest patient care.

An IDEA: Safety Training to Improve Critical Thinking by Individuals and Teams.

Errors in thinking contribute to harm, delays in diagnosis, incorrect treatments, or failures to recognize clinical changes. Models of cognition are useful in understanding error occurrence and avoidance. Intra-team conflict can represent failures in joint cognitive processing. The authors developed training focused on recognizing and managing cognitive bias and resolving conflicts. The program provides context and introduces models of cognition, concepts of bias, team cognition, conflict resolution, and 2 tools. "IDEA" incorporates 4 de-biasing strategies: Identify assumptions; Don't assume correctness; Explore expectations; Assess alternatives. "TLA" presents strategies for resolving conflicts: Tell your thoughts; Listen actively, and Ask questions. A total of 4941 care providers participated in training using didactic presentations, group discussion, and simulation. Learners rated training effectiveness at 4.68 on a scale of 1 to 5 (5 as optimum) and perceived improvement in recognizing or managing errors. Nonphysician caregivers reported greatest improvement. Training to improve critical thinking is feasible, well received, and effective.

Simulation Saves the Day (and Patient).

Surgeons can use simulation to improve the safety of the systems they work within, around, because of, and despite. Health care is a complex adaptive system that can never be completely knowable; simulation can expose aspects of patient care delivery that are not necessarily evident prospectively, during planning, or retrospectively, during investigations or audits. The constraints of patient care processes and adaptive capacity of health care providers may become most evident during simulations conducted "in situ" using real teams and real equipment, in actual patient care locations.

Staying Well in a Sea of Harm.

Physician psychological wellness is an emergent outcome resulting from dynamic interactions among complex conditions. We may enhance opportunities for physician wellness by applying principles developed to improve another emergent outcome: patient safety. The Safety I approach to patient safety focuses on "what went wrong" and considers humans a liability. Safety II is a powerful complementary approach that focuses on "what went right" and values human creativity. These contrasting perspectives are described in the context of patient safety, but the underlying principles have relevance for physician psychological wellness. We can create conditions that interfere with wellness and conditions that support wellness. We can learn from exploring and reinforcing successes and improving routine processes; together, these approaches may have a greater cumulative positive impact than just addressing problems. In addition to learning from failures, there is much we can learn from success.

Wrong-site nerve blocks: A systematic literature review to guide principles for prevention.

STUDY OBJECTIVE: Wrong-site nerve blocks (WSBs) are a significant, though rare, source of perioperative morbidity. WSBs constitute the most common type of perioperative wrong-site procedure reported to the Pennsylvania Patient Safety Authority. This systematic literature review aggregates information about the incidence, patient consequences, and conditions that contribute to WSBs, as well as evidence-based methods to prevent them. DESIGN: A systematic search of English-language publications was performed, using the PRISMA process. MAIN RESULTS: Seventy English-language publications were identified. Analysis of four publications reporting on at least 10,000 blocks provides a rate of 0.52 to 5.07 WSB per 10,000 blocks, unilateral blocks, or "at risk" procedures. The most commonly mentioned potential consequence was local anesthetic toxicity. The most commonly mentioned contributory factors were time pressure, personnel factors, and lack of site-mark visibility (including no site mark placed). Components of the block process that were addressed include preoperative nerve-block verification, nerve-block site marking, time-outs, and the healthcare facility's structure and culture of safety. DISCUSSION: A lack of uniform reporting criteria and divergence in the data and theories presented may reflect the variety of circumstances affecting when and how nerve blocks are performed, as well as the infrequency of a WSB. However, multiple authors suggest three procedural steps that may help to prevent WSBs: (1) verify the nerve-block procedure using multiple sources of information, including the patient; (2) identify the nerve-block site with a visible mark; and (3) perform time-outs immediately prior to injection or instillation of the anesthetic. Hospitals, ambulatory surgical centers, and anesthesiology practices should consider creating site-verification processes with clinician input and support to develop sustainable WSB-prevention practices.

Using Simulation to Improve Systems.

Attempts to understand and improve health care delivery often focus on the characteristics of the patient and the characteristics of the health care providers, but larger systems surround and integrate with patients and providers. Components of health care delivery systems can support or interfere with efforts to provide optimal health care. Simulation in situ, involving real teams participating in simulations in real care settings, can be used to identify latent safety threats and improve the work environment while simultaneously supporting participant learning. Thoughtful planning and skilled debriefing are essential.

Are All Manikins Created Equal? A Pilot Study of Simulator Upper Airway Anatomic Fidelity.

This study evaluates the anatomic fidelity of several commercially available pediatric and adult manikins, including airway task trainers, which could be used in aerodigestive procedure training. Twenty-three experienced otolaryngologists assessed the aerodigestive anatomy of 5 adult and 5 pediatric manikins in a passive state, using rigid and flexible endoscopy. Anatomic fidelity was rated on a 5-point scale for the following: nasal cavity, nasopharynx, oral cavity, oropharynx, larynx, trachea, esophagus, and neck. Mean scores and standard deviations were tabulated for each manikin at each anatomic site. Ratings by survey participants demonstrated variation in the anatomic fidelity of the aerodigestive tract in a range of manikins. Radar chart display of the results allows comparison of manikin fidelity by anatomic site. Differences in scores may allow instructors to select manikins with the best anatomic fidelity for specific educational purposes, and they may contribute to recommendations to improve future manikin design.