Debriefing Methods for Simulation in Healthcare: A Systematic Review.

ABSTRACT: Debriefing is a critical component in most simulation experiences. With the growing number of debriefing concepts, approaches, and tools, we need to understand how to debrief most effectively because there is little empiric evidence to guide us in their use. This systematic review explores the current literature on debriefing in healthcare simulation education to understand the evidence behind practice and clarify gaps in the literature. The PICO question for this review was defined as "In healthcare providers [P], does the use of one debriefing or feedback intervention [I], compared to a different debriefing or feedback intervention [C], improve educational and clinical outcomes [O] in simulation-based education?" We included 70 studies in our final review and found that our current debriefing strategies, frameworks, and techniques are not based on robust empirical evidence. Based on this, we highlight future research needs.

Clinical triggers and vital signs influencing crisis acknowledgment and calls for help by anesthesiologists: A simulation-based observational study.

STUDY OBJECTIVE: In a perioperative emergency, anesthesiologists must acknowledge the unfolding crisis promptly, call for timely assistance, and avert patient harm. We aimed to identify vital signs and qualitative factors prompting crisis acknowledgment and to compare responses between observers and participants in simulation. DESIGN: Prospective, simulation-based, observational study. SETTING: An anesthesia crisis resource management course at a freestanding simulation center. SUBJECTS: Sixty attending anesthesiologists from a variety of practice settings. INTERVENTIONS: In each case, a primary anesthesiologist in charge (PAIC) managed a simulated patient undergoing a uniformly scripted sequence of perioperative anaphylaxis and called for help from another anesthesiologist when a crisis began. Anesthesiologist observers (AOs) viewed the case separately and recorded times of crisis onset. MEASUREMENTS: Simulation footage was reviewed by investigators for patient vital signs and participant behaviors at times of crisis acknowledgment, with the call for help as an explicit proxy for PAIC crisis acknowledgment. These factors were categorized, and group-level data were compared. RESULTS: Nineteen PAICs and 41 AOs were included. Clinicians acknowledged crises around a mean arterial pressure (MAP) of 65 mmHg and oxygen saturation of 94% as anaphylactic shock progressed. PAICs acknowledged crises at a higher respiratory rate than AOs (20 vs. 18 breaths/min, p = 0.038). Other vitals and timing of crisis acknowledgment did not differ between PAICs and AOs. Nearly half of all participants (45%) identified crises at MAP <65 mmHg. Timing of crisis acknowledgment varied widely (range: 421 s). CONCLUSIONS: Despite overall heterogeneity in clinical performance, anesthesiologists acknowledged crises per standard definitions of hypotension. Thresholds for crisis acknowledgment did not significantly differ between PAICs and AOs, suggesting minimal effect from active care responsibility. Many indicated crises at MAP <65 mmHg or after significant deterioration, risking failure-to-rescue events. We suggest that crisis management instruction should address triggers for requesting help.

Transforming Team Culture: A Case Study From Critical Care.

Interprofessional team conflict amplifies division and impedes patient care. Normal differences of opinion escalate to frank conflicts when members respond with indignation or resentment. These behaviors engender a workplace culture that degrades collaborative clinical management and patient safety. We describe the impacts of dysfunctional team culture along with interventions that can lead to more productive teams. In our case study, an interprofessional group of critical care clinicians recognized that their interactions impaired collaborative care and requested support. Two experts, a nurse and a physician, facilitated two 2-h workshops with 18 critical care physicians, nurses, and fellows to begin transforming their dysfunctional unit culture. After establishing psychological safety, facilitators introduced the learning pathways grid to explore (1) how faulty assumptions lead to dysfunctional interactions and suboptimal results and (2) how new assumptions informed by new insights enable teams to redesign their interactions. Through reflection and analysis, clinicians concluded that understanding other clinicians' goals and perspectives benefits patients and families, helps clinicians feel valued, and fosters mutual trust. This exercise supports interprofessional teams to transform dysfunctional interactions by helping team members to develop a mindset of humility and inquiry and to remind themselves about the good intentions in others. To address conflict, we offer a conversational approach grounded in curiosity, respect, and transparency. Ultimately, the most important communication strategy for effective critical care is caring about the perspectives and experiences of other members of the interprofessional team.

Strategy to Develop a Common Simulation Training Program: Illustration with Anesthesia and Intensive Care Residency in France.

Phenomenon: The urgency of having fair and trustworthy competency-based assessment in medical training is growing. Simulation is increasingly recognized as a potent method for building and assessing applied competencies. The growing use of simulation and its application in summative assessment calls for comprehensive and rigorously designed programs. Defining the current baseline of what is available and feasible is a crucial first step. This paper uses anesthesia and intensive care (AIC) in France as a case study in how to document this baseline. Approach: An IRB-approved, online anonymous closed survey was submitted to AIC residency program directors and AIC simulation program directors in France from January to February 2021. The researcher-developed survey consisted of 65 questions across five sections: centers' characteristics, curricular characteristics, courses' characteristics, instructors' characteristics, and simulation perceptions and perspectives. Findings: The participation rate was 31/31 (100%) with 29 centers affiliated with a university hospital. All centers had AIC simulation activities. Resident training was structured in 94% of centers. Simulation uses were training (100%), research and development (61%), procedural or organizational testing (42%), and summative assessment (13%). Interprofessional full-scale simulation training existed in 90% of centers. Procedural training on simulators prior to clinical patients' care was performed "always" in 16%, "most often" in 45%, "sometimes" in 29% and "rarely" or "not" in 10% of centers. Simulated patients were used in 61% of centers. Main themes were identified for procedural skills, full-scale and simulated patient simulation training. Simulation activity was perceived as increasing in 68% of centers. Centers expressed a desire to participate in developing and using a national common AIC simulation program. Insights: Based on our findings in AIC, we demonstrated a baseline description of nationwide simulation activities. We now have a clearer perspective on a decentralized approach in which individual institutions or regional consortia conduct simulation for a discipline in a relatively homogeneous way, suggesting the feasibility for national guidelines. This approach provides useful clues for AIC and other disciplines to develop a comprehensive and meaningful program matching existing expectations and closing the identified gaps.

Simulation-based summative assessment in healthcare: an overview of key principles for practice.

BACKGROUND: Healthcare curricula need summative assessments relevant to and representative of clinical situations to best select and train learners. Simulation provides multiple benefits with a growing literature base proving its utility for training in a formative context. Advancing to the next step, "the use of simulation for summative assessment" requires rigorous and evidence-based development because any summative assessment is high stakes for participants, trainers, and programs. The first step of this process is to identify the baseline from which we can start. METHODS: First, using a modified nominal group technique, a task force of 34 panelists defined topics to clarify the why, how, what, when, and who for using simulation-based summative assessment (SBSA). Second, each topic was explored by a group of panelists based on state-of-the-art literature reviews technique with a snowball method to identify further references. Our goal was to identify current knowledge and potential recommendations for future directions. Results were cross-checked among groups and reviewed by an independent expert committee. RESULTS: Seven topics were selected by the task force: "What can be assessed in simulation?", "Assessment tools for SBSA", "Consequences of undergoing the SBSA process", "Scenarios for SBSA", "Debriefing, video, and research for SBSA", "Trainers for SBSA", and "Implementation of SBSA in healthcare". Together, these seven explorations provide an overview of what is known and can be done with relative certainty, and what is unknown and probably needs further investigation. Based on this work, we highlighted the trustworthiness of different summative assessment-related conclusions, the remaining important problems and questions, and their consequences for participants and institutions of how SBSA is conducted. CONCLUSION: Our results identified among the seven topics one area with robust evidence in the literature ("What can be assessed in simulation?"), three areas with evidence that require guidance by expert opinion ("Assessment tools for SBSA", "Scenarios for SBSA", "Implementation of SBSA in healthcare"), and three areas with weak or emerging evidence ("Consequences of undergoing the SBSA process", "Debriefing for SBSA", "Trainers for SBSA"). Using SBSA holds much promise, with increasing demand for this application. Due to the important stakes involved, it must be rigorously conducted and supervised. Guidelines for good practice should be formalized to help with conduct and implementation. We believe this baseline can direct future investigation and the development of guidelines.

Teaching, coaching, or debriefing With Good Judgment: a roadmap for implementing "With Good Judgment" across the SimZones.

Simulation-based learning occurs in multiple contexts, and one teaching style cannot adequately cover the needs at each learning level. For example, reflective debriefing, often used following a complex simulation case, is not what is needed when learning new skills. When to use which facilitation style is a question that educators often overlook or struggle to determine. SimZones is a framework used to clarify the multiple contexts in simulation. This framework, combined with elements of Debriefing With Good Judgment, can help educators match the appropriate facilitation style with learner needs and learning context. We have distilled the core elements of the "with good judgment" approach to debriefing and applied them to the SimZones framework to guide educators with (1) what type of learning can be expected with each learning context, (2) what behaviors and activities can be expected of the learners in each learning context, (3) what instructional strategies are most effectively used at each stage, and (4) what are the implications for the teacher-learner relationship.

Innovative Tele-Instruction Approach Impacts Basic Life Support Performance: A Non-inferiority Trial.

Background: Sustaining Basic Life Support (BLS) training during the COVID-19 pandemic bears substantial challenges. The limited availability of highly qualified instructors and tight economic conditions complicates the delivery of these life-saving trainings. Consequently, innovative and resource-efficient approaches are needed to minimize or eliminate contagion while maintaining high training standards and managing learner anxiety related to infection risk. Methods: In a non-inferiority trial 346 first-year medical, dentistry, and physiotherapy students underwent BLS training at AIXTRA-Competence Center for Training and Patient Safety at the University Hospital RWTH Aachen. Our objectives were (1) to examine whether peer feedback BLS training supported by tele-instructors matches the learning performance of standard instructor-guided BLS training for laypersons; and (2) to minimize infection risk during BLS training. Therefore, in a parallel group design, we compared arm (1) Standard Instructor Feedback (SIF) BLS training (Historical control group of 2019) with arm (2) a Tele-Instructor Supported Peer-Feedback (TPF) BLS training (Intervention group of 2020). Both study arms were based on Peyton's 4-step approach. Before and after each training session, objective data for BLS performance (compression depth and rate) were recorded using a resuscitation manikin. We also assessed overall BLS performance via standardized instructor evaluation and student self-reports of confidence via questionnaire. Non-inferiority margins for the outcome parameters and sample size calculation were based on previous studies with SIF. Two-sided 95% confidence intervals were employed to determine significance of non-inferiority. Results: The results confirmed non-inferiority of TPF to SIF for all tested outcome parameters. A follow-up after 2 weeks found no confirmed COVID-19 infections among the participants. Conclusion: Tele-instructor supported peer feedback is a powerful alternative to in-person instructor feedback on BLS skills during a pandemic, where infection risk needs to be minimized while maximizing the quality of BLS skill learning. Trial registration: https://www.drks.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00025199, Trial ID: DRKS00025199.

Setting the stage for speaking up: psychological safety and directing care in acute care collaboration.

Managing a safe and efficient anaesthetic induction within a team involves the challenge of when, if, and how to surface, discuss, and implement the best plan on how to proceed. The Lemke and colleagues study in this issue of the British Journal of Anaesthesia is a unique view into real-world conversations that naturally occur in anaesthesia teams in moments of high task and cognitive load, such as induction of anaesthesia. The study spotlights important small moments of physician, nurse, and trainee team coordination. It illuminates key patterns of conversation in naturally occurring anaesthesia teams, and raises important questions about what the speaking up standard should be and the psychological safety-shaping role consultants play in setting the norms for speaking up.

First steps towards international competency goals for residency training: a qualitative comparison of 3 regional standards in anesthesiology.

BACKGROUND: Competency-based medical education (CBME) has revolutionized approaches to training by making expectations more concrete, visible, and relevant for trainees. Designing, applying, and updating CBME requirements challenges residency programs, which must address many aspects of training simultaneously. This challenge also exists for educational regulatory bodies in creating and adjusting national competencies to standardize training expectations. We propose that an international approach for mapping residency training requirements may provide a baseline for assessing commonalities and differences. This approach allows us to take our first steps towards creating international competency goals to enhance sharing of best practices in education and clinical work. METHODS: We chose anesthesiology residency training as our example discipline. Using two rounds of content analysis, we qualitatively compared published anesthesiology residency competencies for the European Union (The European Training Requirement), United States (ACGME Milestones), and Canada (CanMEDS Competence By Design), focusing on similarities and differences in representation (round one) and emphasis (round two) to generate hypotheses on practical solutions regarding international educational standards. RESULTS: We mapped the similarities and discrepancies between the three repositories. Round one revealed that 93% of competencies were common between the three repositories. Major differences between European Training Requirement, US Milestones, and Competence by Design competencies involved critical emergency medicine. Round two showed that over 30% of competencies were emphasized equally, with notable exceptions that European Training Requirement emphasized Anaesthesia Non-Technical Skills, Competence by Design highlighted more granular competencies within specific anesthesiology situations, and US Milestones emphasized professionalism and behavioral practices. CONCLUSIONS: This qualitative comparison has identified commonalities and differences in anesthesiology training which may facilitate sharing broader perspectives on diverse high-quality educational, clinical, and research practices to enhance innovative approaches. Determining these overlaps in residency training can prompt international educational societies responsible for creating competencies to collaborate to design future training programs. This approach may be considered as a feasible method to build an international core of residency competency requirements for other disciplines.

Rapid cycle system improvement for COVID-19 readiness: integrating deliberate practice, psychological safety and vicarious learning.

Introduction: In the face of a rapidly advancing pandemic with uncertain pathophysiology, pop-up healthcare units, ad hoc teams and unpredictable personal protective equipment supply, it is difficult for healthcare institutions and front-line teams to invent and test robust and safe clinical care pathways for patients and clinicians. Conventional simulation-based education was not designed for the time-pressured and emergent needs of readiness in a pandemic. We used 'rapid cycle system improvement' to create a psychologically safe learning oasis in the midst of a pandemic. This oasis provided a context to build staff technical and teamwork capacity and improve clinical workflows simultaneously. Methods: At the Department of Anaesthesia and Intensive Care in Prince of Wales Hospital, a tertiary institution, in situ simulations were carried out in the operating theatres and intensive care unit (ICU). The translational simulation design leveraged principles of psychological safety, rapid cycle deliberate practice, direct and vicarious learning to ready over 200 staff with 51 sessions and achieve iterative system improvement all within 7 days. Staff evaluations and system improvements were documented postsimulation. Results/Findings: Staff in both operating theatres and ICU were significantly more comfortable and confident in managing patients with COVID-19 postsimulation. Teamwork, communication and collective ability to manage infectious cases were enhanced. Key system issues were also identified and improved. Discussion: To develop readiness in the rapidly progressing COVID-19 pandemic, we demonstrated that 'rapid cycle system improvement' can efficiently help achieve three intertwined goals: (1) ready staff for new clinical processes, (2) build team competence and confidence and (3) improve workflows and procedures.

What's the headline on your mind right now? How reflection guides simulation-based faculty development in a master class.

Introduction: The demand for highly skilled simulation-based healthcare educators (SBEs) is growing. SBEs charged with developing other SBEs need to be able to model and conduct high-quality feedback conversations and 'debrief the debriefing'. Direct, non-threatening feedback is one of the strongest predictors of improved performance in health professions education. However, it is a difficult skill to develop. Developing SBEs who can coach and support other SBEs is an important part of the faculty development pipeline. Yet we know little about how they get better at skilled feedback and the ability to reflect on it. There is scant evidence about their thoughts, feelings and dilemmas about this advanced learning process. To address this gap, we examined advanced SBE's subjective experience as they grappled with challenges in a 4-day advanced SBE course. Their reflections will help target faculty development efforts. Methods: Using a repeated, identical free-writing task, we asked "What is the headline for what is on your mind right now?" Results: A five-theme mosaic of self-guiding reflections emerged: (1) metacognitions about one's learning process, (2) evaluations of sessions or tools, (3) notes to self, (4) anticipations of applying the new skills in the future, and (5) tolerating the tension between pleasant and unpleasant emotions. Conclusions: The results extend simulation-based education science by advocating the motivational role of noting inconsistencies between one's intention and impact and the central role of self-regulation, emotion, and experiencing feedback and debriefing from multiple perspectives for improving advanced skills of SBEs. Recommendations for faculty development are discussed.

A behaviourally anchored rating scale for evaluating the use of the WHO surgical safety checklist: development and initial evaluation of the WHOBARS.

BACKGROUND: Realising the full potential of the WHO Surgical Safety Checklist (SSC) to reduce perioperative harm requires the constructive engagement of all operating room (OR) team members during its administration. To facilitate research on SSC implementation, a valid and reliable instrument is needed for measuring OR team behaviours during its administration. We developed a behaviourally anchored rating scale (BARS) for this purpose. METHODS: We used a modified Delphi process, involving 16 subject matter experts, to compile a BARS with behavioural domains applicable to all three phases of the SSC. We evaluated the instrument in 80 adult OR cases and 30 simulated cases using two medical student raters and seven expert raters, respectively. Intraclass correlation coefficients were calculated to assess inter-rater reliability. Internal consistency and instrument discrimination were explored. Sample size estimates for potential study designs using the instrument were calculated. RESULTS: The Delphi process resulted in a BARS instrument (the WHOBARS) with five behavioural domains. Intraclass correlation coefficients calculated from the OR cases exceeded 0.80 for 80% of the instrument's domains across the SSC phases. The WHOBARS showed high internal consistency across the three phases of the SSC and ability to discriminate among surgical cases in both clinical and simulated settings. Fewer than 20 cases per group would be required to show a difference of 1 point between groups in studies of the SSC, where α=0.05 and ß=0.8. CONCLUSION: We have developed a generic instrument for comprehensively rating the administration of the SSC and informing initiatives to realise its full potential. We have provided data supporting its capacity for discrimination, internal consistency and inter-rater reliability. Further psychometric evaluation is warranted.

Improving Anesthesiologists' Ability to Speak Up in the Operating Room: A Randomized Controlled Experiment of a Simulation-Based Intervention and a Qualitative Analysis of Hurdles and Enablers.

PURPOSE: The authors addressed three questions: (1) Would a realistic simulation-based educational intervention improve speaking-up behaviors of practicing nontrainee anesthesiologists? (2) What would those speaking-up behaviors be when the issue emanated from a surgeon, a circulating nurse, or an anesthesiologist colleague? (3) What were the hurdles and enablers to speaking up in those situations? METHOD: The authors conducted a simulation-based randomized controlled experiment from March 2008-February 2011 at the Center for Medical Simulation, Boston, Massachusetts. During a mandatory crisis management course for practicing nontrainee anesthesiologists from five Boston institutions, a 50-minute workshop on speaking up was conducted for intervention (n = 35) and control (n = 36) groups before or after, respectively, an experimental scenario with three events. The authors analyzed videos of the experimental scenarios and debriefing sessions. RESULTS: No statistically significant differences between the intervention and control group subjects with respect to speaking-up actions were observed in any of the three events. The five most frequently mentioned hurdles to speaking up were uncertainty about the issue, stereotypes of others on the team, familiarity with the individual, respect for experience, and the repercussion expected. The five most frequently mentioned enablers were realizing the speaking-up problem, having a speaking-up rubric, certainty about the consequences of speaking up, familiarity with the individual, and having a second opinion or getting help. CONCLUSIONS: An educational intervention alone was ineffective in improving the speaking-up behaviors of practicing nontrainee anesthesiologists. Other measures to change speaking-up behaviors could be implemented and might improve patient safety.

Teorías y estilos de debriefing: el método con buen juicio como herramienta de evaluación formativa en salud / Theories and styles of debriefing: the good judgment method as a tool for formative assessment in healthcare

No disponible

Establishing a safe container for learning in simulation: the role of the presimulation briefing.

Summary statement: In the absence of theoretical or empirical agreement on how to establish and maintain engagement in instructor-led health care simulation debriefings, we organize a set of promising practices we have identified in closely related fields and our own work. We argue that certain practices create a psychologically safe context for learning, a so-called safe container. Establishing a safe container, in turn, allows learners to engage actively in simulation plus debriefings despite possible disruptions to that engagement such as unrealistic aspects of the simulation, potential threats to their professional identity, or frank discussion of mistakes. Establishing a psychologically safe context includes the practices of (1) clarifying expectations, (2) establishing a "fiction contract" with participants, (3) attending to logistic details, and (4) declaring and enacting a commitment to respecting learners and concern for their psychological safety. As instructors collaborate with learners to perform these practices, consistency between what instructors say and do may also impact learners' engagement.

Helping without harming: the instructor's feedback dilemma in debriefing--a case study.

INTRODUCTION: Simulation instructors often feel caught in a task-versus-relationship dilemma. They must offer clear feedback on learners' task performance without damaging their relationship with those learners, especially in formative simulation settings. Mastering the skills to resolve this dilemma is crucial for simulation faculty development. METHODS: We conducted a case study of a debriefer stuck in this task-versus-relationship dilemma. DATA: The "2-column case" captures debriefing dialogue and instructor's thoughts and feelings or the "subjective experience." ANALYSIS: The "learning pathways grid" guides a peer group of faculty in a step-by-step, retrospective analysis of the debriefing. The method uses vivid language to highlight the debriefer's dilemmas and how to surmount them. RESULTS: The instructor's initial approach to managing the task-versus-relationship dilemma included (1) assuming that honest critiques will damage learners, (2) using vague descriptions of learner actions paired with guess-what-I-am-thinking questions, and (3) creating a context she worried would leave learners feeling neither safe nor clear how they could improve. This case study analysis identified things the instructor could do to be more effective including (1) making generous inferences about the learners' qualities, (2) normalizing the challenges posed by the simulation, (3) assuming there are different understandings of what it means to be a team. CONCLUSIONS: There are key assumptions and ways of interacting that help instructors resolve the task-versus-relationship dilemma. The instructor can then provide honest feedback in a rigorous yet empathic way to help sustain good or improve suboptimal performance in the future.

Speaking across the drapes: communication strategies of anesthesiologists and obstetricians during a simulated maternal crisis.

INTRODUCTION: Organizational behavior and management fields have long realized the importance of teamwork and team-building skills, but only recently has health care training focused on these critical elements. Communication styles and strategies are a common focus of team training but have not yet been consistently applied to medicine. We sought to determine whether such communication strategies, specifically "advocacy" and "inquiry," were used de novo by medical professionals in a simulation-based teamwork and crisis resource management course. Explicit expression of a jointly managed clinical plan between providers, a strategy shown to improve patient safety, was also evaluated. METHODS: Forty-four of 54 videotaped performances of an ongoing team-building skills course were viewed and analyzed for presence of advocacy and/or inquiry that related to information or a plan; inclusion criteria were participation of a nonconfederate obstetrician and an anesthesiologist. Verbal statement of a jointly managed clinical plan was also recorded. RESULTS: Anesthesiologists advocated information in 100% of cases and advocated their plans in 93% of cases but inquired information in 30% of cases and inquired about the obstetricians' plans in 11% of cases. Obstetricians advocated information in 73% of cases, advocated their plans in 73% of cases, inquired information in 75% of cases, and inquired about the anesthesiologists' plans in 59% of cases. An explicitly stated joint team plan was formed in 45% of cases. CONCLUSIONS: Anesthesiologists advocated more frequently than obstetricians, while obstetricians inquired and advocated in more balanced proportions. However, fewer than half of the teams explicitly agreed on a joint plan. Increasing awareness of communication styles, and possibly incorporating these skills into medical training, may help teams arrive more efficiently at jointly managed clinical plans in crisis situations.

Learning from accident and error: avoiding the hazards of workload, stress, and routine interruptions in the emergency department.

This article presents a model of how a build-up of interruptions can shift the dynamics of the emergency department (ED) from an adaptive, self-regulating system into a fragile, crisis-prone one. Drawing on case studies of organizational disasters and insights from the theory of high-reliability organizations, the authors use computer simulations to show how the accumulation of small interruptions could have disproportionately large effects in the ED. In the face of a mounting workload created by interruptions, EDs, like other organizational systems, have tipping points, thresholds beyond which a vicious cycle can lead rather quickly to the collapse of normal operating routines and in the extreme to a crisis of organizational paralysis. The authors discuss some possible implications for emergency medicine, emphasizing the potential threat from routine, non-novel demands on EDs and raising the concern that EDs are operating closer to the precipitous edge of crisis as ED crowding exacerbates the problem.