The efficacy of high-fidelity simulation on knowledge and performance in undergraduate nursing students: An umbrella review of systematic reviews and meta-analysis.

OBJECTIVES: This umbrella review aimed to consolidate the evidence base on the impact of high-fidelity simulation on knowledge and performance among undergraduate nursing students. DESIGN: Umbrella review with meta-analyses of pooled effect sizes, followed by an additional meta-analysis of primary studies from the included systematic reviews, excluding overlapping results. DATA SOURCES: Systematic searches were performed up to August 2023 in PubMed, Embase, and Cochrane Library. We included reviews that compared high-fidelity simulation against other learning strategies. REVIEW METHODS: The risk of bias was assessed for each included systematic review (ROBIS tool) and primary study (RoB 2 or ROBINS-I as appropriate). Random-effect meta-analyses of meta-analyses were performed to estimate the pooled effects of high-fidelity simulation on knowledge and performance. Further random-effect meta-analyses of primary studies were conducted, with overlapping studies excluded (12 %). Subgroup analyses were performed to provide a more comprehensive analysis of the findings. Trim-and-fill analyses were conducted to adjust for potential publication bias. RESULTS: Six systematic reviews were included and encompassed 133 primary studies (2767 and 3231 participants concerning performance and knowledge, respectively). The adjusted pooled effects for knowledge (SMD = 0.877, 95 % CI: 0.182 to 1.572) and performance (SMD = 0.738, 95 % CI: 0.466 to 1.010) closely aligned with those obtained from meta-analyzing the primary studies for knowledge (SMD = 0.980) and performance (SMD = 0.540), both showing high statistical heterogeneity. Traditional lectures represented the more common comparison. The subgroup analysis revealed significant differences in effect sizes across geographic locations, topics, types of control, and how interventions were reported. CONCLUSIONS: The results provide robust evidence supporting the integration of high-fidelity simulation into undergraduate nursing programs to enhance students' knowledge and performance. The high reported heterogeneity may be attributed to variations in study contexts or methodologies. Future research should explore the optimal use of high-fidelity simulation in different educational and cultural contexts.

Developing emotional preparedness and mental resilience through high-fidelity simulation: a 'bridge too far' for institutions teaching major trauma management and mass-casualty medicine?

BACKGROUND: Clinical acumen represents only part of being adequately equipped to attend a major incident. The emotive sights, sounds and smells of these dynamic environments are all-encompassing experiences, and responders must also be armed with the emotional preparedness to perform their clinical or managerial duties effectively, as well as the mental resilience to facilitate professional continuance. Despite this, limited training and a sparsity of evidence exists to guide developments within this domain. Historically, major incident training has focused on clinical theory acquisition, but irrespective of how comprehensive the learning materials, they are of little consequence if tandem steps to cultivate mental resilience and emotional preparedness are absent. High-Fidelity Simulation (HFS) has a growing reputation as an effective means of bridging important gaps between theory and practice. This pilot study aimed to measure student's self-reported perception of their readiness to respond to a major incident following a large-scale HFS. METHODS: Quantitative data was obtained from a sample of 108 students undertaking paramedic science, physician associate studies and adult nursing degree programmes. A bespoke questionnaire was developed to measure self-reported clinical acumen, mental and emotional preparedness. RESULTS: 91% of students agreed the combination of theoretical training and HFS provided made them feel clinically prepared to attend a real major incident; 86% agreed this experience had developed their mental resilience and 90% agreed that they felt emotionally prepared to attend a major incident. CONCLUSION: Within this pilot study, the blend of theoretical training and HFS contributed to self-reported clinical acumen, mental and emotional preparation, in learners training to work in disaster environments or emergency medicine settings.

Teaching nursing students: As an umbrella review of the effectiveness of using high-fidelity simulation.

AIM: To conduct an umbrella review of the effectiveness of using high-fidelity simulation in nursing student teaching, thereby supporting continuous improvement in teaching practitioners' implementation of high-fidelity simulation intervention strategies. BACKGROUND: Several systematic reviews have investigated the effectiveness of high-fidelity simulation in nursing student teaching in recent years. However, conclusions vary and a systematic assessment is lacking. DESIGN: This review encompasses an umbrella review. METHODS: A search of PubMed, Embase, Cochrane Library, Web of Science and OVID databases was conducted to retrieve data on an umbrella review of high-fidelity simulation effectiveness in nursing student teaching from database inception to November 2023. The quality of the included systematic reviews was independently assessed by two reviewers using the AMSTAR 2 and PRISMA scales. Outcome indicators from the included systematic reviews were graded using the GRADE system. RESULTS: Twelve systematic reviews focusing on high-fidelity simulation effectiveness in nursing student teaching were included. Notably, all 12 systematic reviews exhibited very-low methodological quality, with 9 exhibiting some degree of reporting deficiencies, 2 exhibiting severe information deficiencies and 1 reporting relatively complete information. A total of 22 outcome indicators and 53 pieces of evidence were included. The results revealed 15 pieces of low-quality evidence and 38 pieces of very-low-quality evidence. Mounting evidence suggests that high-fidelity simulation teaching effectively enhances nursing students' theoretical performance, practical skills and various clinical comprehensive abilities, highlighting a positive teaching effect. However, further validation through high-quality, large-sample studies is warranted. CONCLUSION: The overall evidence quality of the current systematic reviews evaluating high-fidelity simulation effectiveness in nursing student teaching is low. Additionally, the methodological quality and the degree of reporting standardization require further improvement. Therefore, high-quality, large-sample randomized controlled trials are essential for further substantiating high-fidelity simulation effectiveness in nursing student teaching.

High-fidelity simulation versus case-based discussion for training undergraduate medical students in pediatric emergencies: a quasi-experimental study.

OBJECTIVE: To evaluate the effect of high-fidelity simulation of pediatric emergencies compared to case-based discussion on the development of self-confidence, theoretical knowledge, clinical reasoning, communication, attitude, and leadership in undergraduate medical students. METHODS: 33 medical students were allocated to two teaching methods: high-fidelity simulation (HFS, n = 18) or case-based discussion (CBD, n = 15). Self-confidence and knowledge tests were applied before and after the interventions and the effect of HFS on both outcomes was estimated with mixed-effect models. An Objective Structured Clinical Examination activity was conducted after the interventions, while two independent raters used specific simulation checklists to assess clinical reasoning, communication, attitude, and leadership. The effect of HFS on these outcomes was estimated with linear and logistic regressions. The effect size was estimated with the Hedge's g. RESULTS: Both groups had an increase in self-confidence (HFS 59.1 × 93.6, p < 0.001; CDB 50.5 × 88.2, p < 0.001) and knowledge scores over time (HFS 45.1 × 63.2, p = 0.001; CDB 43.5 × 56.7, p-value < 0.01), but no difference was observed between groups (group*time effect in the mixed effect models adjusted for the student ranking) for both tests (p = 0.6565 and p = 0.3331, respectively). The simulation checklist scores of the HFS group were higher than those of the CBD group, with large effect sizes in all domains (Hedges g 1.15 to 2.20). CONCLUSION: HFS performed better than CBD in developing clinical reasoning, communication, attitude, and leadership in undergraduate medical students in pediatric emergency care, but no significant difference was observed in self-confidence and theoretical knowledge.

Feasibility and evaluation of high-fidelity simulation education for acute clinical toxicology.

To prepare medical students appropriately for the management of toxicological emergencies, we have developed a simulation-based medical education (SBME) training in acute clinical toxicology. Our aim is to report on the feasibility, evaluation and lessons learned of this training. Since 2019, each year approximately 180 fifth-year medical students are invited to participate in the SBME training. The training consists of an interactive lecture and two SBME stations. For each station, a team of students had to perform the primary assessment and management of an intoxicated patient. After the training, the students completed a questionnaire about their experiences and confidence in clinical toxicology. Overall, the vast majority of students agreed that the training provided a fun, interactive and stimulating way to teach about clinical toxicology. Additionally, they felt more confident regarding their skills in this area. Our pilot study shows that SBME training was well-evaluated and feasible over a longer period.

Emergency Crisis Resource Management de la Sociedad Española de Medicina de Urgencias y Emergencias: curso de gestión en crisis basado en simulación para estudiantes de ciencias de la salud / Emergency crisis resource management: a simulation-based course developed by the Spanish Society of Emergency Medicine (SEMES) for health sciences students

Objetivo. Los programas educativos dirigidos a la adquisición de competencias no técnicas, tales como el Crisis Resource Management (CRM), basado en simulación de alta fidelidad, implican un aumento de las competencias del alumno en el manejo de situaciones de crisis. El objetivo del presente trabajo es evaluar la eficacia del programa Emergency CRM (E-CRM) de la Sociedad Española de Medicina de Urgencias y Emergencias, dirigido a estudiantes de último año de los grados de ciencias de la salud. Método. Se llevó a cabo un estudio cuasiexperimental con medidas pre y posintervención, que consistió en un programa de E-CRM con simulación de alta fidelidad, en un único grupo. Participaron un total de 209 estudiantes que completaron dos instrumentos autoadministrados sobre la autoeficacia hacia las competencias no técnicas y la resiliencia. Además, a través de observadores externos se evaluó sus competencias no técnicas con instrumentos de evaluación objetivos. Resultados. El alumnado mejoró las puntuaciones de resiliencia (F = 25,90; p < 0,001) y autoeficacia (F = 68,02; p < 0,001) tras la intervención, con diferencias estadísticamente significativas para la resiliencia en la línea basal en función del grupo de estudios (t = 2,67; p = 0,008). Por otro lado, se encontraron mejoras de las puntuaciones obtenidas tanto para el instrumento Mayo High Performance Teamwork Scale (F = 6,18; p < 0,001; eta2 = 0,20) como para el Ottawa Global Rating Scale Crisis Resource Management (F = 5,58; p < 0,005; eta2 = 0,19). Conclusión. El programa de E-CRM, basado en simulación de alta fidelidad, con un equipo interprofesional coordinado, mejora la autoeficacia en todas las competencias no técnicas medidas y aumenta la resiliencia. (AU)

Objetivo. Los programas educativos dirigidos a la adquisición de competencias no técnicas, tales como el Crisis Resource Management (CRM), basado en simulación de alta fidelidad, implican un aumento de las competencias del alumno en el manejo de situaciones de crisis. El objetivo del presente trabajo es evaluar la eficacia del programa Emergency CRM (E-CRM) de la Sociedad Española de Medicina de Urgencias y Emergencias, dirigido a estudiantes de último año de los grados de ciencias de la salud. Método. Se llevó a cabo un estudio cuasiexperimental con medidas pre y posintervención, que consistió en un programa de E-CRM con simulación de alta fidelidad, en un único grupo. Participaron un total de 209 estudiantes que completaron dos instrumentos autoadministrados sobre la autoeficacia hacia las competencias no técnicas y la resiliencia. Además, a través de observadores externos se evaluó sus competencias no técnicas con instrumentos de evaluación objetivos. Resultados. El alumnado mejoró las puntuaciones de resiliencia (F = 25,90; p < 0,001) y autoeficacia (F = 68,02; p < 0,001) tras la intervención, con diferencias estadísticamente significativas para la resiliencia en la línea basal en función del grupo de estudios (t = 2,67; p = 0,008). Por otro lado, se encontraron mejoras de las puntuaciones obtenidas tanto para el instrumento Mayo High Performance Teamwork Scale (F = 6,18; p < 0,001; eta2 = 0,20) como para el Ottawa Global Rating Scale Crisis Resource Management (F = 5,58; p < 0,005; eta2 = 0,19). Conclusión. El programa de E-CRM, basado en simulación de alta fidelidad, con un equipo interprofesional coordinado, mejora la autoeficacia en todas las competencias no técnicas medidas y aumenta la resiliencia. (AU)

Emergency Crisis Resource Management de la Sociedad Española de Medicina de Urgencias y Emergencias: curso de gestión en crisis basado en simulación para estudiantes de ciencias de la salud / Emergency crisis resource management: a simulation-based course developed by the Spanish Society of Emergency Medicine (SEMES) for health sciences students

Objetivo. Los programas educativos dirigidos a la adquisición de competencias no técnicas, tales como el Crisis Resource Management (CRM), basado en simulación de alta fidelidad, implican un aumento de las competencias del alumno en el manejo de situaciones de crisis. El objetivo del presente trabajo es evaluar la eficacia del programa Emergency CRM (E-CRM) de la Sociedad Española de Medicina de Urgencias y Emergencias, dirigido a estudiantes de último año de los grados de ciencias de la salud. Método. Se llevó a cabo un estudio cuasiexperimental con medidas pre y posintervención, que consistió en un programa de E-CRM con simulación de alta fidelidad, en un único grupo. Participaron un total de 209 estudiantes que completaron dos instrumentos autoadministrados sobre la autoeficacia hacia las competencias no técnicas y la resiliencia. Además, a través de observadores externos se evaluó sus competencias no técnicas con instrumentos de evaluación objetivos. Resultados. El alumnado mejoró las puntuaciones de resiliencia (F = 25,90; p < 0,001) y autoeficacia (F = 68,02; p < 0,001) tras la intervención, con diferencias estadísticamente significativas para la resiliencia en la línea basal en función del grupo de estudios (t = 2,67; p = 0,008). Por otro lado, se encontraron mejoras de las puntuaciones obtenidas tanto para el instrumento Mayo High Performance Teamwork Scale (F = 6,18; p < 0,001; eta2 = 0,20) como para el Ottawa Global Rating Scale Crisis Resource Management (F = 5,58; p < 0,005; eta2 = 0,19). Conclusión. El programa de E-CRM, basado en simulación de alta fidelidad, con un equipo interprofesional coordinado, mejora la autoeficacia en todas las competencias no técnicas medidas y aumenta la resiliencia. (AU)

Objetivo. Los programas educativos dirigidos a la adquisición de competencias no técnicas, tales como el Crisis Resource Management (CRM), basado en simulación de alta fidelidad, implican un aumento de las competencias del alumno en el manejo de situaciones de crisis. El objetivo del presente trabajo es evaluar la eficacia del programa Emergency CRM (E-CRM) de la Sociedad Española de Medicina de Urgencias y Emergencias, dirigido a estudiantes de último año de los grados de ciencias de la salud. Método. Se llevó a cabo un estudio cuasiexperimental con medidas pre y posintervención, que consistió en un programa de E-CRM con simulación de alta fidelidad, en un único grupo. Participaron un total de 209 estudiantes que completaron dos instrumentos autoadministrados sobre la autoeficacia hacia las competencias no técnicas y la resiliencia. Además, a través de observadores externos se evaluó sus competencias no técnicas con instrumentos de evaluación objetivos. Resultados. El alumnado mejoró las puntuaciones de resiliencia (F = 25,90; p < 0,001) y autoeficacia (F = 68,02; p < 0,001) tras la intervención, con diferencias estadísticamente significativas para la resiliencia en la línea basal en función del grupo de estudios (t = 2,67; p = 0,008). Por otro lado, se encontraron mejoras de las puntuaciones obtenidas tanto para el instrumento Mayo High Performance Teamwork Scale (F = 6,18; p < 0,001; eta2 = 0,20) como para el Ottawa Global Rating Scale Crisis Resource Management (F = 5,58; p < 0,005; eta2 = 0,19). Conclusión. El programa de E-CRM, basado en simulación de alta fidelidad, con un equipo interprofesional coordinado, mejora la autoeficacia en todas las competencias no técnicas medidas y aumenta la resiliencia. (AU)

The improvement and retention of skills in shoulder dystocia management with the use of high-fidelity simulation: The SAFE (SimulAtion high-FidElity) study.

BACKGROUND: Shoulder dystocia is a relatively uncommon but serious childbirth-related emergency. AIM: To explore the improvement and retention of skills in shoulder dystocia management through high-fidelity simulation training. METHODS: The SAFE (SimulAtion high-FidElity) study was a prospective cohort study that utilised a high-fidelity birth simulator. Registered midwives and final year midwifery students were invited to participate in a one-day workshop at 6-monthly intervals. There was a 30-minute initial assessment, a 30-minute theoretical and hands-on training, and a 30-minute post-training assessment on shoulder dystocia management. Pre-training and post-training values for the predetermined outcomes were compared. In each workshop we assessed the proportion of successful simulated births, the performance of manoeuvres to manage shoulder dystocia, the head-to-body birth time, the fetal head traction force, the quality of communication, the perception of time-to-birth, and the self-reported confidence levels. FINDINGS: The baseline workshop recruited 101 participants that demonstrated a significant increase in the proportion of successful simulated births (8.9% vs 93.1%), and a two-fold to three-fold increase in the score of manoeuvres, communication, and confidence after training. Those with low pre-training levels of competency and confidence improved the most post-training at baseline. There was a retention of manoeuvres, communication skills and confidence at 6 months. There was no reduction in fetal head traction force over time. Those being proficient before initial training retained and performed best at the 6-month follow-up. CONCLUSION: The SAFE study found a significant improvement in skills and confidence after the initial high-fidelity simulation training that were retained after 6 months.

User Perceptions of Visual Clot in a High-Fidelity Simulation Study: Mixed Qualitative-Quantitative Study.

BACKGROUND: Viscoelastic hemostatic assays, such as rotational thromboelastometry (ROTEM) or thromboelastography, enable prompt diagnosis and accelerate targeted treatment. However, the complex interpretation of the results remains challenging. Visual Clot-a situation awareness-based visualization technology-was developed to assist clinicians in interpreting viscoelastic tests. OBJECTIVE: Following a previous high-fidelity simulation study, we analyzed users' perceptions of the technology, to identify its strengths and limitations from clinicians' perspectives. METHODS: This is a mixed qualitative-quantitative study consisting of interviews and a survey. After solving coagulation scenarios using Visual Clot in high-fidelity simulations, we interviewed anesthesia personnel about the perceived advantages and disadvantages of the new tool. We used a template approach to identify dominant themes in interview responses. From these themes, we defined 5 statements, which were then rated on Likert scales in a questionnaire. RESULTS: We interviewed 77 participants and 23 completed the survey. We identified 9 frequently mentioned topics by analyzing the interview responses. The most common themes were "positive design features," "intuitive and easy to learn," and "lack of a quantitative component." In the survey, 21 respondents agreed that Visual Clot is easy to learn and 16 respondents stated that a combination of Visual Clot and ROTEM would help them manage complex hemostatic situations. CONCLUSIONS: A group of anesthesia care providers found Visual Clot well-designed, intuitive, and easy to learn. Participants highlighted its usefulness in emergencies, especially for clinicians inexperienced in coagulation management. However, the lack of quantitative information is an area for improvement.

Satisfacción y desarrollo de competencias en escenarios de simulación clínica de alta fidelidad en estudiantes de Obstetricia / Satisfaction and development of skills in high-fidelity clinical simulation scenarios in Obstetrics students

Introducción: La simulación clínica ha surgido como un método de aprendizaje y de evaluación que genera la adquisición de destrezas y habilidades en las ciencias de la salud. El aprendizaje bajo escenarios de simulación clínica se asocia con mayores niveles de satisfacción, confianza y logro de contenidos al poder practicar las habilidades sin perjuicio al paciente, lo cual es una clara respuesta a la necesidad actual de proteger la seguridad del paciente, y asegurar una formación continua y eficiente. Este estudio busca analizar la relación entre la satisfacción y la adquisición de competencias generadas en estudiantes de Obstetricia de la Universidad Andrés Bello a través de escenarios de simulación clínica de alta fidelidad. Sujetos y métodos: Cuarenta y dos estudiantes de cuarto año de Obstetricia de la Universidad Andrés Bello se enfrentaron a seis escenarios de simulación de alta fidelidad que evaluaron la adquisición de habilidades técnicas para la asistencia del parto y una encuesta de satisfacción para escenarios de simulación de fidelidad.Resultados: La evaluación de las habilidades contó con un promedio de cumplimiento para el primer escenario de un 59,78%; para el segundo, de un 70,29%; para el tercero, de un 71,42%; para el cuarto, de un 81,32%; para el quinto, de un 87,71%; y para el sexto, de un 96,86%. Las estudiantes coinciden en que la simulación es un método útil para el aprendizaje (100%), que es una herramienta que mejora las habilidades técnicas (97,6%), que ha aumentado la seguridad y confianza (100%), y que los escenarios de alta fidelidad fueron satisfactorios (100%). Conclusiones: Los estudiantes de Obstetricia mejoraron sus competencias clínicas, que involucran habilidades comunicacionales y razonamiento clínico, y además perciben altos niveles de satisfacción al realizar seis escenarios de alta fidelidad.(AU)

Introduction: Clinical simulation has emerged as a learning and evaluation method that generates the acquisition of skills and abilities in the field of health sciences. Learning under clinical simulation scenarios is associated with higher levels of satisfaction, confidence, ability to provide information, and content achievement by being able to practice the skills without harming the patient, which is a clear response to the current need to protect the safety of the patient and ensure continuous and efficient training. This study seeks to analyze the relationship between satisfaction and the acquisition of competencies in Obstetrics students at the Andrés Bello University, through high-fidelity clinical simulation scenarios. Subjects and methods: Forty-two Obstetrics students from the Andrés Bello University faced six high-fidelity simulation scenarios that evaluated the acquisition of technical skills for childbirth assistance through an evaluation rubric and a satisfaction survey for high fidelity simulation scenarios.Results: The evaluation of the skills had an average compliance for the first scenario of 59.78%, for the second 70.29%, for the third 71.42%, the fourth 81.32%, the fifth 87 71% and the sixth 96.86%. Regarding the satisfaction in the highfidelity clinical simulation scenarios, the students agree that simulation is a useful method for learning (100%), that it is a tool that improves technical skills (97.6%), that has felt security and confidence (100%) and that the high-fidelity scenarios were satisfactory (100%). High fidelity simulation scenarios prove to be a satisfactory tool for skill acquisition. Conclusion: Obstetrics students improved their clinical competencies, which involve communication skills and clinical reasoning, and also, perceived high levels of satisfaction after 6 high-fidelity scenarios.(AU)

Comparison of simulation and video-based training for acute asthma.

BACKGROUND: Emergency medicine is particularly well suited to simulation training. However, evidence for the efficacy of simulation-based medical training remains limited especially to manage high-risk cases such as acute asthma. OBJECTIVE: The objective of our study was to compare the performance of high-fidelity simulation (HFS) and interactive video-case challenge-based training (IVC) for final-year medical students in the management of acute asthma. METHODS: This was a prospective randomized controlled study conducted at the emergency department (ED) of Monastir University hospital ( Tunisia). 69 final-year medical students were randomized to HFS (n = 34) and IVC (n = 35) training on acute asthma topic. The study was conducted over a 1-week period. Efficacy of each teaching method was compared through the use of multiple-choice questionnaires (MCQ) before (pre-test), after (post-test) training and a simulation scenario test conducted 1 week later. The scenario was based on acute asthma management graded on predefined critical actions using two scores: the checklist clinical score (range 0 to 30), and the team skills score (range 0 to 16). Student satisfaction was also evaluated with the Likert 5 points scale. Two years after the post-test, both groups underwent a third MCQ testing to assess sustainability of knowledge. RESULTS: There were no differences in age between groups. There was no statistically significant difference between the HFS and IVC groups pre-test scores (p = 0.07). Both groups demonstrated improvement in MCQ post-test from baseline after training session; the HFS MCQ post-test score increased significantly more than the IVC score (p < 0.001). The HFS group performed better than the IVC group on the acute asthma simulation scenario (p < 0.001). Mean checklist clinical score and mean team skills score were significantly higher in HFS group compared to IVC group (respectively 22.9 ± 4.8 and 11.5 ± 2.5 in HFS group vs 19.1 ± 3 and 8.4 ± 3.1 in IVC group) (p < 0.001). After 2 years, MCQ post-test scores decreased in both groups but the decrease was lower in HFS group compared to the IVC group. CONCLUSION: High-fidelity simulation-based training was superior to interactive video-case challenge for teaching final year medical students,and led to more long-term knowledge retention in the management of simulated acute asthma patients. TRIAL REGISTRATION: The study was registered at www. CLINICALTRIALS: gov NCT02776358 on 18/05/2016.

Deep Learning Model for Automated Trainee Assessment During High-Fidelity Simulation.

PROBLEM: Implementation of competency-based medical education has necessitated more frequent trainee assessments. Use of simulation as an assessment tool is limited by access to trained examiners, cost, and concerns with interrater reliability. Developing an automated tool for pass/fail assessment of trainees in simulation could improve accessibility and quality assurance of assessments. This study aimed to develop an automated assessment model using deep learning techniques to assess performance of anesthesiology trainees in a simulated critical event. APPROACH: The authors retrospectively analyzed anaphylaxis simulation videos to train and validate a deep learning model. They used an anaphylactic shock simulation video database from an established simulation curriculum, integrating a convenience sample of 52 usable videos. The core part of the model, developed between July 2019 and July 2020, is a bidirectional transformer encoder. OUTCOMES: The main outcome was the F1 score, accuracy, recall, and precision of the automated assessment model in analyzing pass/fail of trainees in simulation videos. Five models were developed and evaluated. The strongest model was model 1 with an accuracy of 71% and an F1 score of 0.68. NEXT STEPS: The authors demonstrated the feasibility of developing a deep learning model from a simulation database that can be used for automated assessment of medical trainees in a simulated anaphylaxis scenario. The important next steps are to (1) integrate a larger simulation dataset to improve the accuracy of the model; (2) assess the accuracy of the model on alternative anaphylaxis simulations, additional medical disciplines, and alternative medical education evaluation modalities; and (3) gather feedback from education leadership and clinician educators surrounding the perceived strengths and weaknesses of deep learning models for simulation assessment. Overall, this novel approach for performance prediction has broad implications in medical education and assessment.

Assessment of high fidelity simulation with actors in palliative care in nursing students: a mixed methods study.

OBJECTIVE: The most effective training methods are experiential, including those focused on experiences and emotions. Clinical simulation, especially high-fidelity simulation, is one of the most effective methodologies for the acquisition of competencies in care like palliative care. The simulation with actors can train future healthcare science professionals: in technical, intellectual, or interpersonal skills. The objective is to evaluate high-fidelity simulation with actors as a tool in palliative care training for nursing students. METHOD: Over three years, the study was conducted in a Faculty of Nursing of the south of Spain with nursing students. A mixed methods study with sequential explanatory design in three moments was conducted: (1) Quasi-experimental study in a single group (n = 12) before and after attending the palliative care course with Clinical Simulation with actors to assess the communication skills (CICAA scale), (2) Qualitative study with phenomenological perspective after Clinical Simulation (174 reflective students' narratives), (3) Cross-sectional observational study, one year later, to assess the transfer of knowledge and skills to the clinical practice (71 students). RESULTS: Students who interacted with actors in Clinical Simulation improved their communication skills and the ability to establish an effective helping relationship with both end-of-life patients and their families. The students perceived the Clinical Simulation as an innovative learning methodology that is useful to encourage reflection and transfer of learning during their clinical internship. CONCLUSIONS: Standardization of the use of active learning methodologies is recommended for a better acquisition of transversal skills such as communication skills in palliative care.

Coagulation Management of Critically Bleeding Patients With Viscoelastic Testing Presented as a 3D-Animated Blood Clot (The Visual Clot): Randomized Controlled High-Fidelity Simulation Study.

BACKGROUND: Guidelines recommend using viscoelastic coagulation tests to guide coagulation management, but interpreting the results remains challenging. Visual Clot, a 3D animated blood clot, facilitates interpretation through a user-centered and situation awareness-oriented design. OBJECTIVE: This study aims to compare the effects of Visual Clot versus conventional viscoelastic test results (rotational thrombelastometry [ROTEM] temograms) on the coagulation management performance of anesthesia teams in critical bleeding situations. METHODS: We conducted a prospective, randomized, high-fidelity simulation study in which anesthesia teams (consisting of a senior anesthesiologist, a resident anesthesiologist, and an anesthesia nurse) managed perioperative bleeding scenarios. Teams had either Visual Clot or ROTEM temograms available to perform targeted coagulation management. We analyzed the 15-minute simulations with post hoc video analysis. The primary outcome was correct targeted coagulation therapy. Secondary outcomes were time to targeted coagulation therapy, confidence, and workload. In addition, we have conducted a qualitative survey on user acceptance of Visual Clot. We used Poisson regression, Cox regression, and mixed logistic regression models, adjusted for various potential confounders, to analyze the data. RESULTS: We analyzed 59 simulations. Teams using Visual Clot were more likely to deliver the overall targeted coagulation therapy correctly (rate ratio 1.56, 95% CI 1.00-2.47; P=.05) and administer the first targeted coagulation product faster (hazard ratio 2.58, 95% CI 1.37-4.85; P=.003). In addition, participants showed higher decision confidence with Visual Clot (odds ratio 3.60, 95% CI 1.49-8.71; P=.005). We found no difference in workload (coefficient -0.03, 95% CI -3.08 to 2.88; P=.99). CONCLUSIONS: Using Visual Clot led to a more accurate and faster-targeted coagulation therapy than using ROTEM temograms. We suggest that relevant viscoelastic test manufacturers consider augmenting their complex result presentation with intuitive, easy-to-understand visualization to ease users' burden from unnecessary cognitive load and enhance patient care.

Influence of the embedded participant on learners' performance during high-fidelity simulation sessions in healthcare.

BACKGROUND: The embedded participant (EP) plays a key role during a full scale/high-fidelity simulation (HFS) session. He/she is expected to guide the learner towards the achievement of the educational objectives of the scenario. However, his/her influence on learners' performance stands undetermined and this effect remains briefly addressed in the literature. This study primarily aims to assess whether the EP could have an influence on the performance of the learner during a HFS scenario. The secondary aim was to establish an inventory of the EP practices in France. METHODS: This retrospective study was conducted in Lyon Claude Bernard University Health Simulation Centre (France). Anaesthesia and critical care residents in postgraduate years 1 to 5 who were scheduled for their HFS sessions during the 2016 to 2021 academic years were included. Two investigators independently evaluated the resident performance regarding both technical and non-technical skills from video recordings. In addition, a nationwide survey was sent out by email through the networks of the Francophone Healthcare Simulation Society (SoFraSimS, Société Francophone de Simulation en Santé) to collect information on EP practices in French-speaking Simulation centres. RESULTS: From a total of 344 HFS videos analysed, a cohort of 19 experienced EPs was identified. The EPs had an influence on the technical and non-technical performances of the learners. The 147 responses to the survey showed that predefined rules of EP good practice existed in only 36% of the simulation centres and 65% of respondents believed that specific EP training would be justified. CONCLUSION: The EP can exert an influence on the performance of the learners during HFS. For acting as an EP, a great variability of practices and a lack of training are reported by professionals working in simulation centres. These results suggest that more attention must be paid to EP training and attitudes during simulation, especially if summative simulations are extensively developed.

Efficacy of high-fidelity simulation in advanced life support training: a systematic review and meta-analysis of randomized controlled trials.

BACKGROUND: Simulation is an increasingly used novel method for the education of medical professionals. This study aimed to systematically review the efficacy of high-fidelity (HF) simulation compared with low-fidelity (LF) simulation or no simulation in advanced life support (ALS) training. METHODS: A comprehensive search of the PubMed, Chinese Biomedicine Database, Embase, CENTRAL, ISI, and China Knowledge Resource Integrated Database was performed to identify randomized controlled trials (RCTs) that evaluated the use of HF simulation in ALS training. Quality assessment was based on the Cochrane Handbook for Systematic Reviews of Interventions version 5.0.1. The primary outcome was the improvement of knowledge and skill performance. The secondary outcomes included the participants' confidence and satisfaction at the course conclusion, skill performance at one year, skill performance in actual resuscitation, and patient outcomes. Data were synthesized using the RevMan 5.4 software. RESULTS: Altogether, 25 RCTs with a total of 1,987 trainees were included in the meta-analysis. In the intervention group, 998 participants used HF manikins, whereas 989 participants received LF simulation-based or traditional training (classical training without simulation). Pooled data from the RCTs demonstrated a benefit in improvement of knowledge [standardized mean difference (SMD) = 0.38; 95% confidence interval (CI): 0.18-0.59, P = 0.0003, I2 = 70%] and skill performance (SMD = 0.63; 95% CI: 0.21-1.04, P = 0.003, I2 = 92%) for HF simulation when compared with LF simulation and traditional training. The subgroup analysis revealed a greater benefit in knowledge with HF simulation compared with traditional training at the course conclusion (SMD = 0.51; 95% CI: 0.20-0.83, P = 0.003, I2 = 61%). Studies measuring knowledge at three months, skill performance at one year, teamwork behaviors, participants' satisfaction and confidence demonstrated no significant benefit for HF simulation. CONCLUSIONS: Learners using HF simulation more significantly benefited from the ALS training in terms of knowledge and skill performance at the course conclusion. However, further research is necessary to enhance long-term retention of knowledge and skill in actual resuscitation and patient's outcomes.

Changes in Student Perceptions after Participating in a High-Fidelity Simulation-Based Interprofessional Education Activity at a Historically Black University.

OBJECTIVE: This study aimed to assess the impact of a high-fidelity simulation interprofessional education (IPE) activity at a large, historically Black university (HBU) on perceptions of IPE. PARTICIPANTS: Student participants represented various allied health care professions; the majority were female and enrolled in the pharmacy professional program. Health administration, nutrition and dietetics, nursing, respiratory therapy, and clinical lab science programs were also represented. METHODS: Participants were randomly assigned to IPE teams of 6-7 individuals. The 1-day activity transpired at a high-fidelity simulation facility and included a pre-briefing, simulated scenario with high-fidelity mannequins, and a faculty-guided video-assisted debriefing session. The patient scenario was designed by subject area faculty experts and featured an adult patient on hemodialysis. Participants completed pre and post-activity questionnaires that included the Student Perceptions of Interprofessional Clinical Education-Revised (SPICE-R) instrument. RESULTS: Participants completed pre (n=107) and post-activity (n=81) questionnaires. There was a significant increase from the pre-event (M=3.90, SD 0.91) and post-event score (M=4.22, SD 0.84) for the SPICE-R item regarding understanding "the roles of other professionals within the interdisciplinary team"; t(186)= -2.471, p=0.01. The SPICE-R item score for "health professionals should collaborate in teams" also significantly increased from the pre-event (M=4.28, SD 0.80) to the post-event (M=4.53, SD 0.73); t(186)= -2.209, p=0.03. CONCLUSIONS: Participation in a 1-day high-fidelity simulation-based IPE activity at a HBU has the potential to positively change students' perceptions of IPE. Future studies should consider the impact of IPE on perceptions of diversity.

Design and Implementation of a Multidisciplinary High-Fidelity Simulation Course for the Management of Malignant Spinal Cord Compression.

High-fidelity simulation (HFS) training is suited to high-stakes, uncommon situations such as malignant spinal cord compression (MSCC), allowing for rare hands-on practice. This pilot study was created as the first of its kind to examine educational outcomes of a radiation therapist (RTT)-led multidisciplinary radiation oncology (RO) emergency simulation course. A multidisciplinary course design team composed of RO residents, radiation oncologists, RTT course instructors, and medical physicists created a high-fidelity MSCC simulation course using collaboratively developed learning goals. Fifteen learners including RO residents, senior RTT students, and a medical physics (MP) resident participated in a live, RTT-facilitated simulation. Participants completed anonymized pre- and post-simulation standard interdisciplinary education perception (IEP) scales and a course evaluation assessing educational outcomes. Standard IEP questionnaire results showed highly favorable perceptions of respondents' own specialty and other allied specialties, with mean total pre-simulation scores of 91.76 and post-simulation scores of 94.23. The course evaluation assessed 10 learning objective domains, with significant improvements seen in self-rated post-course knowledge in 9 domains. Pre-course evaluations showed that 6/15 participants agreed or strongly agreed that they felt comfortable in their knowledge of all included domains; after course completion, 14/15 participants agreed or strongly agreed they felt comfortable in all domains. Collaboratively designed and led HFS courses are not only viable but can be an effective means of improving learning outcomes for RO residents, RTT students, and MP residents.

Programa de entrenamiento basado en TeamSTEPPS® mediante simulación clínica en profesionales de cuidados intensivos: un estudio con metodología mixta / TeamSTEPPS®-based clinical simulation training program for critical care professionals: A mixed-methodology study

Introducción: El programa Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS®) ha demostrado mejorar el trabajo interprofesional entre los profesionales sanitarios mejorando el trabajo en equipo. Se formó a profesionales de cuidados intensivos en esta metodología mediante el Curso «Instructor/a en simulación: Mejorando el Trabajo en Equipo a Través de TeamSTEPPS®». Objetivos: Analizar el desempeño del trabajo en equipo y las buenas prácticas en simulación de los profesionales de cuidados intensivos asistentes al curso y explorar sus percepciones sobre la experiencia formativa llevada a cabo durante el mismo. Métodos: Se llevó a cabo un estudio descriptivo transversal y fenomenológico mediante una metodología mixta. Se aplicaron a los 18 asistentes al curso los cuestionarios «TeamSTEPPS™ 2.0 Team Performance Observation Tool» para evaluar el desempeño del trabajo en equipo y «Educational Practices Questionnaire» para las buenas prácticas en simulación tras los escenarios simulados. Posteriormente se realizó una entrevista grupal a través de un grupo focal a ocho asistentes mediante la plataforma de videoconferencias Zoom™. Se realizó un análisis temático y de contenido de los discursos desde el paradigma interpretativo. Los datos cuantitativos y cualitativos se analizaron mediante los programas IBM SPSS Statistics™ 27.0 y MAXQDA Analytics Pro™, respectivamente. Resultados: Tanto el nivel de desempeño del trabajo en equipo (media = 96,25; DT = 8.257) como las buenas prácticas en simulación (media = 75; DT = 1.632) tras los escenarios simulados fueron adecuados. Se identificaron los siguientes temas principales: satisfacción con la metodología TeamSTEPPS®, utilidad de la metodología, barreras de implementación de la misma y habilidades no técnicas mejoradas a través del TeamSTEPPS®. Conclusiones: La metodología TeamSTEPPS® puede ser una buena estrategia de educación interprofesional para la mejora de la comunicación el...(AU)

Introduction: The Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS®) programme has been shown to improve interprofessional work among healthcare professionals by enhancing teamwork. Intensive care professionals were trained in this methodology through the course «Simulation Trainer: Improving Teamwork through TeamSTEPPS®». Objectives: To analyse the teamwork performance and good practice in simulation of the intensive care professionals attending the course and to explore their perceptions of the training experience carried out during the course. Methods: A cross-sectional descriptive and phenomenological study was carried out using a mixed methodology. The 18 course participants were administered the questionnaires «TeamSTEPPS™ 2.0 Team Performance Observation Tool» to evaluate teamwork performance and «Educational Practices Questionnaire» for good practices in simulation after the simulated scenarios. Subsequently, a group interview was conducted through a focus group with 8 attendees using the Zoom™ videoconferencing platform. A thematic and content analysis of the discourses was carried out using the interpretative paradigm. Quantitative and qualitative data were analysed using IBM SPSS Statistics™ 27.0 and MAXQDA Analytics Pro™, respectively. Results: Both the level of teamwork performance (mean = 96.25; SD = 8.257) and good practice in simulation (mean = 75; SD = 1.632) following the simulated scenarios were adequate. The following main themes were identified: satisfaction with the TeamSTEPPS® methodology, usefulness of the methodology, barriers to methodology implementation and non-technical skills improved through TeamSTEPPS®. Conclusions: TeamSTEPPS® methodology can be a good interprofessional education strategy for the improvement of communication and teamwork in intensive care professionals, both at the care level (through on-site simulation strategies)...(AU)