Shifts in Students' Attitudes Towards Pain Patients, Pain, and Opioid Management Following a Dedicated Medical School Pain Curriculum.

Objective: To examine the immediate effects of a comprehensive pain course on medical students' pre-existing perceptions and attitudes toward pain patients and opioid management. Methods: First-year medical students at a major academic medical center enrolled in a required pre-clerkship pain course in June 2020 and completed pre- and post-course online surveys with Likert-scale questions about their attitudes toward pain management and opioid-related issues. Additionally, the surveys included a free-text question where the students listed the first five words that came to mind when hearing the word "opioids". These words were categorized as "professional" or "lay" words and further as having "positive", "negative", or "neutral" connotations. Data analyses included descriptive statistics, as well as non-parametric and parametric tests. Results: Fifty-four of the 119 students responded to pretest and posttest surveys and were included in paired analyses. There was a significant difference between the number of professional words used before (M=1.21, SD=0.97) and after the course (M=2.40 SD=1.33); t(52)=-6.39, P<0.001. Students also used more lay-positive words after the course (M=0.81, SD=0.63) than they used pre-course (M=0.23, SD=0.43); t(51)=-5.98, P<0.001. Students' post-course responses to several key Likert-scale questions showed significant shifts toward more positive attitudes about caring for patients with pain. For example, students acknowledged greater comfort in providing opioids for chronic pain (P<0.001) where appropriate, and enhanced interest in handling complex pain cases (P<0.001). Conclusion: Results showed that a comprehensive, multi-disciplinary pain course could greatly enhance first-year medical students' attitudes toward pain management, chronic pain patients, and the complex issues surrounding opioids.

Introduction of a formative assessment tool in a post-graduate training program in India: a mixed methods evaluation.

BACKGROUND: Our institution has longstanding post-graduate education and training partnership programs in Emergency Medicine (EM) across India. A programmatic challenge has been the integration and uptake of evidence-based medicine and lifelong learning concepts. Formative assessment (FA) is intended to enable learners to monitor learning, identify strengths and weaknesses, and target areas of growth. As part of a program improvement initiative, we introduced an online FA tool to existing summative assessments. This study investigates how the FA tool was used and perceived by trainees. METHODS: 246 trainees across 19 sites were given access to the FA tool. Usage metrics were monitored over 12 months. Semi-structured interviews were conducted in person with trainees using a purposive sampling methodology. A hybrid thematic analysis approach was used to determine themes. Interviews were coded independently by two blinded researchers using NVivo software. The study was deemed exempt by our institutional review board. RESULTS: There was high variability in trainees' utilization of the FA tool. Trainees who used the FA tool more performed better on summative exams (r = 0.35, p < 0.001). Qualitative analysis revealed that trainees were motivated to learn for improved clinical knowledge and to be a good physician, not only passing exams. Benefits of the tool included the relationship to clinical practice and thorough explanation of answers, while disadvantages included topics unrelated to India. CONCLUSION: The integration of a FA tool has provided positive outcomes for trainees in EM education programs in India. Lessons learned may apply globally to other contexts and programs.

Does Extended Reality Simulation Improve Surgical/Procedural Learning and Patient Outcomes When Compared With Standard Training Methods?: A Systematic Review.

INTRODUCTION: The use of extended reality (XR) technologies, including virtual, augmented, and mixed reality, has increased within surgical and procedural training programs. Few studies have assessed experiential learning- and patient-based outcomes using XR compared with standard training methods. METHODS: As a working group for the Society for Simulation in Healthcare, we used Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and a PICO strategy to perform a systematic review of 4238 articles to assess the effectiveness of XR technologies compared with standard training methods. Outcomes were grouped into knowledge, time-to-completion, technical proficiency, reactions, and patient outcomes. Because of study heterogeneity, a meta-analysis was not feasible. RESULTS: Thirty-two studies met eligibility criteria: 18 randomized controlled trials, 7 comparative studies, and 7 systematic reviews. Outcomes of most studies included Kirkpatrick levels of evidence I-III (reactions, knowledge, and behavior), while few reported level IV outcomes (patient). The overall risk of bias was low. With few exceptions, included studies showed XR technology to be more effective than standard training methods in improving objective skills and performance, shortening procedure time, and receiving more positive learner ratings. However, XR use did not show significant differences in gained knowledge. CONCLUSIONS: Surgical or procedural XR training may improve technical skill development among trainees and is generally favored over standard training methods. However, there should be an additional focus on how skill development translates to clinically relevant outcomes. We recommend longitudinal studies to examine retention and transfer of training to clinical settings, methods to improve timely, adaptive feedback for deliberate practice, and cost analyses.

Neurocognitive Correlates of Clinical Decision Making: A Pilot Study Using Electroencephalography.

The development of sound clinical reasoning, while essential for optimal patient care, can be quite an elusive process. Researchers typically rely on a self-report or observational measures to study decision making, but clinicians' reasoning processes may not be apparent to themselves or outside observers. This study explored electroencephalography (EEG) to examine neurocognitive correlates of clinical decision making during a simulated American Board of Anesthesiology-style standardized oral exam. Eight novice anesthesiology residents and eight fellows who had recently passed their board exams were included in the study. Measures included EEG recordings from each participant, demographic information, self-reported cognitive load, and observed performance. To examine neurocognitive correlates of clinical decision making, power spectral density (PSD) and functional connectivity between pairs of EEG channels were analyzed. Although both groups reported similar cognitive load (p = 0.840), fellows outperformed novices based on performance scores (p < 0.001). PSD showed no significant differences between the groups. Several coherence features showed significant differences between fellows and residents, mostly related to the channels within the frontal, between the frontal and parietal, and between the frontal and temporal areas. The functional connectivity patterns found in this study could provide some clues for future hypothesis-driven studies in examining the underlying cognitive processes that lead to better clinical reasoning.

Developing cognitive workload and performance evaluation models using functional brain network analysis.

Cognition, defined as the ability to learn, remember, sustain attention, make decisions, and solve problems, is essential in daily activities and in learning new skills. The purpose of this study was to develop cognitive workload and performance evaluation models using features that were extracted from Electroencephalogram (EEG) data through functional brain network and spectral analyses. The EEG data were recorded from 124 brain areas of 26 healthy participants conducting two cognitive tasks on a robot simulator. The functional brain network and Power Spectral Density features were extracted from EEG data using coherence and spectral analyses, respectively. Participants reported their perceived cognitive workload using the SURG-TLX questionnaire after each exercise, and the simulator generated actual performance scores. The extracted features, actual performance scores, and subjectively assessed cognitive workload values were used to develop linear models for evaluating performance and cognitive workload. Furthermore, the Pearson correlation was used to find the correlation between participants' age, performance, and cognitive workload. The findings demonstrated that combined EEG features retrieved from spectral analysis and functional brain networks can be used to evaluate cognitive workload and performance. The cognitive workload in conducting only Matchboard level 3, which is more challenging than Matchboard level 2, was correlated with age (0.54, p-value = 0.01). This finding may suggest playing more challenging computer games are more helpful in identifying changes in cognitive workload caused by aging. The findings could open the door for a new era of objective evaluation and monitoring of cognitive workload and performance.

Needs-based novel digital curriculum for the neuromodulation training deficit: Pain Rounds.

This study reports the needs-based development, effectiveness and feasibility of a novel, comprehensive spinal cord stimulation (SCS) digital curriculum designed for pain medicine trainees. The curriculum aims to address the documented systematic variability in SCS education and empower physicians with SCS expertise, which has been linked to utilization patterns and patient outcomes. Following a needs assessment, the authors developed a three-part SCS e-learning video curriculum with baseline and postcourse knowledge tests. Best practices were used for educational video production and test-question development. The study period was from 1 February 2020 to 31 December 2020. A total of 202 US-based pain fellows across two cohorts (early-fellowship and late-fellowship) completed the baseline knowledge assessment, while 122, 96 and 88 participants completed all available post-tests for Part I (Fundamentals), Part II (Cadaver Lab) and Part III (Decision Making, The Literature and Critical Applications), respectively. Both cohorts significantly increased knowledge scores from baseline to immediate post-test in all curriculum parts (p<0.001). The early-fellowship cohort experienced a higher rate of knowledge gain for Parts I and II (p=0.045 and p=0.027, respectively). On average, participants viewed 6.4 out of 9.6 hours (67%) of video content. Self-reported prior SCS experience had low to moderate positive correlations with Part I and Part III pretest scores (r=0.25, p=0.006; r=0.37, p<0.001, respectively). Initial evidence suggests that Pain Rounds provides an innovative and effective solution to the SCS curriculum deficit. A future controlled study should examine this digital curriculum's long-term impact on SCS practice and treatment outcomes.

Using electroencephalography to explore neurocognitive correlates of procedural proficiency: A pilot study to compare experts and novices during simulated endotracheal intubation.

The objective of this study was to explore the use of EEG as a measure of neurocognitive engagement during a procedural task. In this observational study, self-reported cognitive load, observed performance, and EEG signatures in experts and novices were compared during simulated endotracheal intubation. Twelve medical students (novices) and eight senior anesthesiology trainees (experts) were included in the study. Experts reported significantly lower cognitive load (P < 0.001) and outperformed novices based on the observational checklist (P < 0.001). EEG signatures differed significantly between the experts and novices. Experts showed a greater increase in delta and theta band amplitudes, especially in temporal and frontal locations and in right occipital areas for delta. A machine learning algorithm showed 83.3 % accuracy for expert-novice skill classification using the selected EEG features. Performance scores were positively correlated (P < 0.05) with event-related amplitudes for delta and theta bands at locations where experts and novices showed significant differences. Increased delta and frontal/midline theta oscillations on EEG suggested that experts had better attentional control than novices. This pilot study provides initial evidence that EEG may be a useful, noninvasive measure of neurocognitive engagement in operational settings and that it has the potential to complement traditional clinical skills assessment.

Pediatric Code Cart Challenge for Emergency Medicine Trainees in Emergency Departments in India.

BACKGROUND: Code carts provide accessible emergency medication, supplies, and equipment to resuscitate a child. Unfortunately, there are limited studies on pediatric code cart use in resource-limited settings, including in India. METHODS: This was a Pediatric Code Cart Challenge for emergency medicine (EM) trainees in India. After receiving education on pediatric code carts, participants created their code carts and submitted a video showcasing their project. Reviewers evaluated each team's code cart using a rubric. A six-month follow-up survey assessed participants' use of code carts and their perception and satisfaction. RESULTS: Forty-nine participants across six sites completed the survey. The median number of pediatric code cart uses in the past six months was two. Materials frequently used from the code cart included medications (76%), followed by airway equipment (59%), and intravenous (IV) equipment (57%). Only 4% of respondents used an intraosseous (IO) catheter. Two of six sites reported modifying their code cart within the past six months by rearranging and/or adding equipment and medications. Local protocols, pediatric advanced life support guidelines, and references from other hospitals led to changes. Most respondents rated the pediatric code cart useful and appreciated its accessibility, ease of use, organization, and equipment. Respondents said they would add more pediatric equipment, including IO supplies, to improve their code cart. CONCLUSION: Participating sites now have pediatric medications and equipment accessible and organized in their code carts. Additionally, EM trainees learned what is needed and how to improve their current pediatric code carts. Future steps include expanding this pilot project to additional sites in low- and middle-income countries.

A Multimodal Evaluation of Podcast Learning, Retention, and Electroencephalographically Measured Attention in Medical Trainees.

INTRODUCTION: Podcasts have become popular among medical trainees. However, it is unclear how well learners retain information from podcasts compared to traditional educational modalities, and whether multitasking affects the learner's ability to pay attention and learn. This study attempted to examine the effectiveness of podcast learning by using electroencephalography (EEG) to measure learner attention, in addition to test performance, task load, and preferences. METHODS: The study used a repeated measures design with three conditions: podcast listening on a treadmill, podcast listening seated, and textbook reading seated. Participants were anesthesiology residents and medical students at a large United States academic medical center. Three topics were chosen: allergic response, liver physiology, and statistics. Each participant studied all three topics that were randomly assigned to one of three learning conditions - in random order. Participants completed a knowledge test at baseline, after each condition, and at four-week follow-up, and reported preferred learning modality and task load under each modality. Activation levels in alerting, orienting, and executive attentional networks were examined using EEG.  Results: Sixty-one participants (11 anesthesiology residents and 50 medical students) were included in the study. Of the 61, six were excluded from the EEG analyses due to corrupted recordings. EEG results showed that mean attention network activation scores did not differ between the study conditions. Trainees preferred podcast learning over reading for all three topics. When compared to textbook reading, podcast learning (seated or on a treadmill) produced significantly better learning gain, and equivalent retention for two of the three topics. CONCLUSIONS: Our study is the first to use neurocognitive data, self-reported satisfaction, and knowledge test performance to demonstrate that podcasts are at least equivalent to textbooks for maintaining attention, immediate learning, and retention - even while exercising.

Podcasting as a Learning Tool in Medical Education: Prior to and During the Pandemic Period

Podcasting as a Learning Tool in Medical Education: Before and During the Pandemic Period Podcasts have seen significant growth as a medium for medical education over the last 15 years. The COVID-19 pandemic altered the way in which medical education is delivered to learners, including medical students, resident physicians, fellows, and practicing clinicians in the form of continuing medical education. A literature search using Google Scholar, PubMed, and NCBI was conducted to analyze and discuss how podcasts are utilized in medical education-both before and during the pandemic-and how this form of asynchronous education may influence clinical decision-making and patient outcomes. Finally, this review discusses how learners' habits while using podcasts may affect the way in which the information is internalized and the future of using podcasts to supplement medical education.

Feasibility Study of a Fully Synchronous Virtual Critical Care Elective Focused on Learner Engagement.

BACKGROUND: The COVID-19 pandemic disrupted clinical education for medical students. With the rise of variants, meaningful in-person clinical experiences remain threatened. This report describes the design, implementation, and evaluation of a fully synchronous virtual critical care elective for medical students focused on learner engagement. METHODS: The two-week elective was offered during June and July 2020 in the COVID-19 extracorporeal membrane oxygenation (ECMO) unit. Medical students remotely participated in multidisciplinary rounds with the attending physician connected from the bedside via a head-mounted camera providing the first-person video view. Other team members connected outside the negative pressure area. Learners electronically completed daily intensive care unit (ICU) goals sheet (GS) for each patient. The daily completion percentage of the GS assessed the learner engagement, and the learners evaluated the experience with a five-point Likert scale survey. RESULTS: Nine medical students participated in two separate cohorts. Cohort A had 53 patient encounters, and Cohort B had 45 patient encounters totaling 301.5 total hours of supervised virtual patient interaction. The mean completion percentage of the daily ICU GS for the combined cohorts was 77.8%, (with a standard deviation of 9.6%), with sustained or increased completion from start to finish for all learners. All medical students agreed that the daily ICU GS was helpful for following rounds, organizing patient assessments and plans, and participating in patient care. The majority (88.9%) agreed that the elective increased their comfort in caring for critically ill patients. CONCLUSIONS: During the COVID-19 pandemic, a fully synchronous virtual critical care elective successfully utilized the first-person view and daily ICU GS to promote and assess learner engagement.

Practice what you teach: An approach to integrate airway education for experienced anesthesia clinicians.

BACKGROUND: The COVID-19 pandemic has disrupted clinician education. To address this challenge, our divisional difficult airway program (AirEquip) designed and implemented small-group educational workshops for experienced clinicians. Our primary aim was to test the feasibility and acceptability of a small-group, flexible-curriculum skills workshop conducted during the clinical workday. Secondary objectives were to evaluate whether our workshop increased confidence in performing relevant skills and to assess the work-effort required for the new program. METHODS: We implemented a 1:1 and 2:1 (participant to facilitator ratio) airway skills workshop for experienced clinicians during the workday. A member of the AirEquip team temporarily relieved the attendee of clinical duties to facilitate participation. Attendance was encouraged but not required. Feasibility was assessed by clinician attendance, and acceptability was assessed using three Likert scale questions and derived from free-response feedback. Participants completed pre and postworkshop surveys to assess familiarity and comfort with various aspects of airway management. A work-effort analysis was conducted and compared to the effort to run a previously held larger-format difficult airway conference. RESULTS: Fifteen workshops were conducted over 7 weeks; members of AirEquip were able to temporarily assume participants' clinical duties. Forty-seven attending anesthesiologists and 17 CRNAs attended the workshops, compared with six attending anesthesiologists and five CRNAs who attended the most recent larger-format conference. There was no change in confidence after workshop participation, but participants overwhelmingly expressed enthusiasm and satisfaction with the workshops. The number of facilitator person-hours required to operate the workshops (105 h) was similar to that required to run a single all-day larger-format conference (104.5 h). CONCLUSION: It is feasible and acceptable to incorporate expert-led skills training into the clinical workday. Alongside conferences and large-format instruction, this modality enhances the way we are able to share knowledge with our colleagues. This concept can likely be applied to other skills in various clinical settings.

Feasibility, implementation, and outcomes of in situ simulation-based curriculum to manage common emergencies in the pediatric post-anesthesia care unit.

PURPOSE: Studies have shown that most critical events that occur in the post-anesthesia care unit (PACU), including cardiac arrests, are preventable and respiratory in origin. Admission to the PACU necessitates transfer of care from anesthesiology staff to PACU nurses. The aim of the study is to assess a) feasibility in implementing an in-situ curriculum for PACU nurses to manage common pediatric emergencies, b) the effectiveness of the curriculum in improving self-confidence of the PACU nurses in performing essential skills c) nurses'' perception of such an offering. DESIGN AND METHODS: This was a single center curricular evaluation study. Anonymous surveys were used to assess curriculum effectiveness by comparing self-reported confidence in the execution of key technical skills and application of knowledge in a real clinical environment at three time points: baseline, immediately post-simulation, and 3 months later. RESULTS: Of 50 PACU nurses, 80%, 98% and 58% responded to the targeted needs assessment, post-simulation and follow up (at 3 months) survey respectively. Self-reported confidence levels for most of the essential skills were significantly increased immediately after simulation and at 3 months. Most of the participants responded that the simulation training helped them improve care of hypoxic (83%) and hypotensive (62%) patients in the PACU. CONCLUSION: Implementation of in situ curriculum for PACU nurses was feasible. The self-reported confidence in performing essential skills increased significantly and the nurses could apply these skills in real clinical environment. PRACTICE IMPLICATIONS: Interprofessional simulation should be implemented in all high risk units to optimize safety of children.

Use of neuroimaging to measure neurocognitive engagement in health professions education: a scoping review.

PURPOSE: To map the current literature on functional neuroimaging use in medical education research as a novel measurement modality for neurocognitive engagement, learning, and expertise development. METHOD: We searched PubMed, Embase, Cochrane, ERIC, and Web of Science, and hand-searched reference lists of relevant articles on April 4, 2019, and updated the search on July 7, 2020. Two authors screened the abstracts and then full-text articles for eligibility based on inclusion criteria. The data were then charted, synthesized, and analyzed descriptively. RESULTS: Sixty-seven articles published between 2007 and 2020 were included in this scoping review. These studies used three main neuroimaging modalities: functional magnetic resonance imaging, functional near-infrared spectroscopy, and electroencephalography. Most of the publications (90%, n = 60) were from the last 10 years (2011-2020). Although these studies were conducted in 16 countries, 68.7% (n = 46) were from three countries: the USA (n = 21), UK (n = 15), and Canada (n = 10). These studies were mainly non-experimental (74.6%, n = 50). Most used neuroimaging techniques to examine psychomotor skill development (57%, n = 38), but several investigated neurocognitive correlates of clinical reasoning skills (22%, n = 15). CONCLUSION: This scoping review maps the available literature on functional neuroimaging use in medical education. Despite the heterogeneity in research questions, study designs, and outcome measures, we identified a few common themes. Included studies are encouraging of the potential for neuroimaging to complement commonly used measures in education research and may help validate/challenge established theoretical assumptions and provide insight into training methods. This review highlighted several areas for further research. The use of these emerging technologies appears ripe for developing precision education, establishing viable study protocols for realistic operational settings, examining team dynamics, and exploring applications for real-time monitoring/intervention during critical clinical tasks.

A novel approach to operating room readiness for airborne precautions using simulation-based clinical systems testing.

BACKGROUND: The emergence of the COVID-19 disease as a global pandemic caused major challenges and strained busy operating room environments. This required institutions to rethink current system functioning and urgently develop safe medical practices and protocols. PURPOSE: To use a novel approach combining simulation-based clinical system testing with rapid cycle deliberate practice concepts for identifying latent safety threats presented by newly developed operating room COVID-19 protocols and collecting frontline staff recommendations for mitigation. METHODS: This study design combined a training/education approach with probing the systems function. The primary outcomes were the number of latent safety threats and staff evaluations of this approach for feasibility and utility on immediate and four-month post surveys. Participants started the simulation which took place in the operating room, in the assistant role before graduating to the primary airway manager. Simulation staff members observed the simulations and noted whether elements in the protocols/checklists were followed and whether latent safety threats were present using an observation form. Solutions to latent safety threats were sought during the debriefing period. RESULTS: This approach identified 17 latent safety threats not foreseen during the planning stages and allowed for corrections to the protocols prior to impacting patient outcomes. Post-simulation surveys indicated that the program was well received and all who responded agreed that it was worth the time it took. Fifty-seven percent of respondents to four-month follow-up survey reported using the work products to care for an actual COVID-19 patient. CONCLUSIONS: This study demonstrated a flexible methodology that effectively integrated simulation-based training and systems tests to train staff and detect latent safety threats in the new workflows and provide recommendations for mitigation. While COVID was the specific prompt, this approach can be applicable in diverse clinical settings for training medical staff, testing system function, and mitigating potential latent safety threats.

Resident Preparation for the American Board of Anesthesiology Objective Standardized Clinical Examination: A Comparison of Virtual Telesimulation With In-person Simulation.

BACKGROUND: The Objective Structured Clinical Examination (OSCE) is part of the American Board of Anesthesiology (ABA) certification process. A simulated OSCE can aid examination preparation, but the COVID-19 pandemic prevented in-person simulation training. Therefore, we adapted our in-person simulated OSCE (SOSCE) as a Zoom-based telesimulation OSCE (ZOSCE), permitting examinees to participate remotely. Comparing this process with historical in-person SOSCE cohorts, we hypothesized that this telesimulation-based format would still be well received by the trainees as a substitute when it was not possible to provide in-person practice and formative assessment. Subsequently, the ABA proposed a virtual-format OSCE. METHODS: We conducted our 7-station ZOSCE according to the ABA content outline for all graduating third-year clinical anesthesia residents (CA-3) in 2020. From a main meeting room, the facilitator paired each CA-3 with a faculty proctor, assigned them to their own breakout room for each station, and rotated standardized patients in. The faculty proctor observed the CA-3's performance in real time using an assessment tool with objectives graded on a 0-2 scale. At the conclusion of the ZOSCE, proctors reviewed the assessment tool with the CA-3 and provided personalized global feedback. Assessment tool scores were used to calculate performance data for the study group that were compared with a SOSCE historical cohort from 2017 and 2018. All parties completed a Likert-style evaluation specific to the ZOSCE. RESULTS: A total of 22 CA-3 residents participated. Mean performance scores ranged from 82.2%-94.9% (minimum = 38%, maximum = 100%). Compared with the historical SOSCE cohort, ZOSCE scores for 5 of 7 stations were not different, but scores in communication with professionals (P = .007) and ultrasound (P < .001) stations were lower. Overall, CA-3 participants rated the learning experience positively and felt it was a reasonable substitution for in-person simulation, with responses similar to those of a historical in-person SOSCE cohort. CONCLUSIONS: A telesimulation-based practice ZOSCE for formative examination preparation for the ABA OSCE resulted in similar institutional scoring for most stations compared with in-person SOSCE, but some stations may be better practiced in person or require modifications. The virtual format may permit flexible scheduling during nonclinical times or for learners in remote locations. These findings have implications for future formative exercises and the formal summative examination process.

Evaluating Rapid-cycle Deliberate Practice Versus Mastery Learning in Training Nurse Anesthetists on the Universal Anaesthesia Machine Ventilator in Sierra Leone.

BACKGROUND: Underserved sub-Saharan countries have 0.1 to 1.4 anesthesia providers per 100 000 citizens, below the Lancet Commission's target of 20 per 100 000 needed for safe surgery. Most of these anesthesia providers are nurse anesthetists, with anesthesiologists numbering as few as zero in some nations and 2 per 7 million in others, such as Sierra Leone. In this study, we compared 2 simulation-based techniques for training nurse anesthetists on the Universal Anaesthesia Machine Ventilator-rapid-cycle deliberate practice and mastery learning. METHODS: A 2-week Universal Anaesthesia Machine Ventilator course was administered to 17 participants in Sierra Leone. Seven were randomized to the rapid-cycle deliberate practice group and 10 to the mastery learning group. Participants underwent baseline and posttraining evaluations in 3 scenarios: general anesthesia, intraoperative power failure, and postoperative pulmonary edema. Performance was analyzed based on checklist performance scores and the number of times participants were stopped for a mistake. Statistical significance to 0.05 was determined with the Mann-Whitney U Test. RESULTS: Checklist performance scores did not differ significantly between the 2 groups. When the groups were combined, simulation-based training resulted in a statistically significant improvement in performance. The highest-frequency problem areas were preoxygenation, switching from spontaneous to mechanical ventilation, and executing appropriate treatment interventions for a postoperative emergency. CONCLUSION: Both rapid-cycle deliberate practice and mastery learning are effective methods for simulation-based training to improve nurse anesthetist performance with the Universal Anaesthesia Machine Ventilator in 3 separate scenarios. The data did not indicate any difference between these methods; however, a larger sample size may support or refute our findings.

Examining novice anaesthesia trainee simulation performance: a tale of two clusters.

Introduction: Understanding performance differences between learners may provide useful context for optimising medical education. This pilot study aimed to explore a technique to contextualise performance differences through retrospective secondary analyses of two randomised controlled simulation studies. One study focused on speaking up (non-technical skill); the other focused on oxygen desaturation management (technical skill). Methods: We retrospectively analysed data from two independent simulation studies conducted in 2017 and 2018. We used multivariate hierarchical cluster analysis to explore whether participants in each study formed homogenous performance clusters. We then used mixed-design analyses of variance and χ2 analyses to examine whether reported task load differences or demographic variables were associated with cluster membership. Results: In both instances, a two-cluster solution emerged; one cluster represented trainees exhibiting higher performance relative to peers in the second cluster. Cluster membership was independent of experimental allocation in each of the original studies. There were no discernible demographic differences between cluster members. Performance differences between clusters persisted for at least 8 months for the non-technical skill but quickly disappeared following simulation training for the technical skill. High performers in speaking up initially reported lower task load than standard performers, a difference that disappeared over time. There was no association between performance and task load during desaturation management. Conclusion: This pilot study suggests that cluster analysis can be used to objectively identify high-performing trainees for both a technical and a non-technical skill as observed in a simulated clinical setting. Non-technical skills may be more difficult to teach and retain than purely technical ones, and there may be an association between task load and initial non-technical performance. Further study is needed to understand what factors may confer inherent performance advantages, whether these advantages translate to clinical performance and how curricula can best be designed to drive targeted improvement for individual trainees.