Intraoperative fluoroscopy skills in distal radius fracture surgery: valid and reliable assessment on a novel immersive virtual reality simulator.

BACKGROUND AND PURPOSE:  Orthopedic trainees must be able to perform intraoperative fluoroscopy imaging to assess the surgical result after volar locking plate surgeries of distal radius fractures. Guided by Messick's contemporary validity framework, the aim of our study was to gather evidence of validity for a test of proficiency for intraoperative imaging of a distal radius fracture using a novel immersive virtual reality simulator. METHODS:  11 novices and 9 experienced surgeons employed at orthopedic departments completed 2 individual simulator sessions. At each session the participants performed 3 repetitions of an intraoperative fluoroscopic control of a distal radius fracture, consisting of 5 different fluoroscopic views. Several performance metrics were automatically recorded by the simulator and compared between the 2 groups. RESULTS:  Simulator metrics for 3 of the 5 fluoroscopic views could discriminate between novices and experienced surgeons. An estimated composite score based on these 3 views showed good test-retest reliability, ICC = 0.82 (confidence interval 0.65-0.92; P < 0.001). A discriminatory standard was set at a composite score of 6.15 points resulting in 1 false positive (i.e., novice scoring better than the standard), and 1 false negative (i.e., experienced surgeon scoring worse than the standard). CONCLUSION:  This study provided validity evidence from all 5 sources of Messick's contemporary validity framework (content, response process, internal structure, relationship with other variables, and consequences) for a simulation-based test of proficiency in intraoperative fluoroscopic control of a distal radius fracture fixated by a volar locking plate.

Setting proficiency standards for simulation-based mastery learning of short antegrade femoral nail osteosynthesis: a multicenter study.

BACKGROUND AND PURPOSE: Orthopedic trainees frequently perform short antegrade femoral nail osteosynthesis of trochanteric fractures, but virtual reality simulation-based training (SBT) with haptic feedback has been unavailable. We explored a novel simulator, with the aim of gathering validity evidence for an embedded test and setting a credible pass/fail standard allowing trainees to practice to proficiency. PATIENTS AND METHODS: The research, conducted from May to September 2020 across 3 Danish simulation centers, utilized the Swemac TraumaVision simulator for short antegrade femoral nail osteosynthesis. The validation process adhered to Messick's framework, covering all 5 sources of validity evidence. Participants included novice groups, categorized by training to plateau (n = 14) or to mastery (n = 10), and experts (n = 9), focusing on their performance metrics and training duration. RESULTS: The novices in the plateau group and experts had hands-on training for 77 (95% confidence interval [CI] 59-95) and 52 (CI 36-69) minutes while the plateau test score, defined as the average of the last 4 scores, was 75% (CI 65-86) and 96% (CI 94-98) respectively. The pass/fail standard was established at the average expert plateau test score of 96%. All novices in the mastery group could meet this standard and interestingly without increased hands-on training time (65 [CI 46-84] minutes). CONCLUSION: Our study provides supporting validity evidence from all sources of Messick's framework for a simulation-based test in short antegrade nail osteosynthesis of intertrochanteric hip fracture and establishes a defensible pass/fail standard for mastery learning of SBT. Novices who practiced using mastery learning were able to reach the pre-defined pass/fail standard and outperformed novices without a set goal for external motivation.

A view from the top: A qualitative exploration of top-level health care leaders' perceptions on the implementation of simulation-based education in postgraduate medical education.

INTRODUCTION: Although there is substantial evidence supporting the benefits of simulation-based education (SBE), its widespread and effective implementation remains challenging. The aim of this study was to explore the perceptions of top-level health care leaders regarding SBE and the barriers and facilitators that influence its wide implementation as part of the postgraduate surgical curricula in Denmark. METHODS: We conducted semi-structured interviews with top-level health care leaders who were chosen based on their roles in ensuring high-quality patient care delivery and developing strategies to achieve the goals of the entire health care system. The interview transcripts were translated into English, and a thematic approach was used to code and inductively analyse the data. We used the Consolidated Framework for Implementation Research to identify and understand the determinants to a successful implementation of SBE. RESULTS: We interviewed 13 participants from different political and administrative levels. We found that the participants had limited knowledge about SBE, which highlighted a disconnection between these leaders and the educational environment. This was further compounded by a lack of effective communication and inadequate information dissemination between simulation centres and higher-level organisations. While participants recognised the benefits of SBE for doctors in training, they expressed concerns about the implementation given the already strained health care system and limited resources. The need for evidence, particularly in the context of patient safety, was emphasised to facilitate SBE implementation. Although participants supported the implementation of SBE, it was unclear who should initiate action. DISCUSSION: This study highlighted the perspectives of top-level health care leaders regarding SBE and identified the determinant factors for a successful implementation. Effective communication channels are crucial to enhance collaborations and reduce the disconnection between the different health care organisational levels. Strategic implementation processes, including the roles and responsibilities, should be defined and established. These will inform decisions regarding the implementation strategies to effectively integrate SBE into the residency training curricula.

Assessment of Technical Competence in Distal Radius Fracture Fixation by a Volar Locking Plate: A Global Delphi Consensus Study.

PURPOSE: Volar locking plate fixation of distal radius fractures is a common orthopedic procedure and should be mastered by graduating orthopedic residents. Surgical education is transitioning from a traditional time-based approach to competency-based medical education. Valid and objective assessment is essential for successful transition. The purpose of this study was to develop a comprehensive, procedure-specific assessment tool to evaluate technical competence in volar locking plate osteosynthesis of a distal radius fracture. METHODS: International orthopedic/trauma experts involved in resident education participated as panelists in a four-round online Delphi process to reach consensus on the content of the assessment tool. Round 1 was an item-generating round, in which the panelists identified potential assessment parameters. In round 2, the panelists rated the importance of each suggested assessment parameter and reached consensus on which to include in the assessment tool. Round 3 yielded specific assessment score intervals for specific bone and fracture models and is not reported in this study. In round 4, the panelists assigned weights to the assessment parameters on a 1-10 scale to determine how each parameter should have an impact on the overall results. RESULTS: Eighty-seven surgeons, representing 42 countries, participated in the study. Round 1 resulted in 45 assessment parameters, grouped into five procedural steps. After round 2, the number of parameters was reduced to 39. After the final round, an additional parameter was removed and weights were assigned to the remaining parameters. CONCLUSIONS: Using a systematic methodology, a preliminary assessment tool to evaluate technical competence in distal radius fracture fixation was developed. A consensus of international experts supports the content validity of the assessment tool. CLINICAL RELEVANCE: This assessment tool represents the first step in the evidence-based assessment essential for competency-based medical education. Before implementation, further studies exploring validity of variations of the assessment tool in different educational contexts are required.

Practicing Procedural Skills Is More Effective Than Basic Psychomotor Training in Knee Arthroscopy: A Randomized Study.

BACKGROUND: Simulator-assisted arthroscopy education traditionally consists of initial training of basic psychomotor skills before advancing to more complex procedural tasks. PURPOSE: To explore and compare the effects of basic psychomotor skills training versus procedural skills training on novice surgeons' subsequent simulated knee arthroscopy performance. STUDY DESIGN: Controlled laboratory study. METHODS: Overall, 22 novice orthopaedic surgeons and 11 experienced arthroscopic surgeons participated in this study, conducted from September 2015 to January 2017. Novices received a standardized introductory lesson on knee arthroscopy before being randomized into a basic skills training group or a procedural skills training group. Each group performed 2 sessions on a computer-assisted knee arthroscopy simulator: The basic skills training group completed 1 session consisting of basic psychomotor skills modules and 1 session of procedural modules (diagnostic knee arthroscopy and meniscal resection), whereas the procedural skills training group completed 2 sessions of procedural modules. Performance of the novices was compared with that of the experienced surgeons to explore evidence of validity for the basic psychomotor training skills modules and the procedural modules. The effect of prior basic psychomotor skills training and procedural skills training was explored by comparing pre- and posttraining performances of the randomized groups using a mixed-effects regression model. RESULTS: Validity evidence was found for the procedural modules, as test results were reliable and experienced surgeons significantly outperformed novices. We found no evidence of validity for the basic psychomotor skills modules, as test scores were unreliable and there was no difference in performance between the experienced surgeons and novices. We found no statistical effect of basic psychomotor skills training as compared with no training (P = .49). We found a statistically significant effect of prior procedural skills training (P < .001) and a significantly larger effect of procedural skills training as compared with basic psychomotor skills training (P = .019). CONCLUSION: Procedural skills training was significantly more effective than basic psychomotor skills training regarding improved performance in diagnostic knee arthroscopy and meniscal resection on a knee arthroscopy simulator. Furthermore, the basic psychomotor skills modules lacked validity evidence. CLINICAL RELEVANCE: On the basis of these results, we suggest that future competency-based curricula focus their training on full knee arthroscopy procedures. This could improve future education programs.

Identifying Technical Procedures in Orthopaedic Surgery and Traumatology That Should Be Integrated in a Simulation-Based Curriculum: A National General Needs Assessment in Denmark.

BACKGROUND: Simulation-based training is emerging within the orthopaedic field to alleviate the challenges that trainees face such as work-hour restrictions, limited exposure to procedures, and increasing pressures to reduce risk to patients. This training modality has grown increasingly popular over the last 2 decades. However, integration into the curriculum often fails to follow a structured educational plan. The development of simulation-based curricula should follow a structured and stepwise approach that starts with a general needs assessment. This study aimed to identify and prioritize procedures within orthopaedic surgery to be included in a simulation-based curriculum on a national basis. METHODS: A national needs assessment was conducted using the Delphi method. Ninety-five experts who are involved in the training of orthopaedic surgeons from all orthopaedic departments in Denmark were selected to participate in the assessment. Round 1 was a brainstorming phase to identify technical procedures that are relevant for orthopaedic surgeons in training. Round 2 was performed on a departmental basis; it explored the frequency of procedures, the number of surgeons performing each procedure, the risk and/or discomfort to patients, and the feasibility for simulation-based training to prioritize and eliminate some of the procedures that were determined in round 1. During round 3, the experts eliminated and reprioritized procedures from round 2 to produce a final prioritized list. RESULTS: During the first round, 194 procedures were identified. These were reduced to 62 in round 2, and the final list after round 3 consisted of 33 prioritized procedures that are relevant for simulation-based training in orthopaedic surgery. The response rates were 63 of 95 physicians for round 1, 26 of 26 departments for round 2, and 64 of 97 physicians for round 3. The highest prioritized procedures were basic surgical techniques and principles for osteosynthesis, osteosynthesis of proximal femoral fracture, and surgical exposure of the upper and lower extremities. CONCLUSIONS: The prioritized list of technical procedures in orthopaedic surgery that are suitable for simulation-based training can aid in the development of a simulation-based curriculum. CLINICAL RELEVANCE: This article offers insights into needs assessment and curriculum development of simulation-based training in orthopaedic surgery and traumatology.

[Implementation of evidence-based simulation training].

Simulation-based medical education (SBME) has become a cornerstone in technical skills training. SBME is associated with large effects on trainees' learning and behaviours in the clinical setting but has proven difficult to adopt and implement for all relevant technical procedures. This is a review of evidence-based principles for effective learning in the simulated setting, and based on these, some of the challenges associated with the successful implementation of SBME for different types of technical skills training in Denmark are discussed.

Hip-fracture osteosynthesis training: exploring learning curves and setting proficiency standards.

Background and purpose - Orthopedic surgeons must be able to perform internal fixation of proximal femoral fractures early in their career, but inexperienced trainees prolong surgery and cause increased reoperation rates. Simulation-based virtual reality (VR) training has been proposed to overcome the initial steep part of the learning curve but it is unknown how much simulation training is necessary before trainees can progress to supervised surgery on patients. We determined characteristics of learning curves for novices and experts and a pass/fail mastery-learning standard for junior trainees was established. Methods - 38 first-year residents and 8 consultants specialized in orthopedic trauma surgery performed cannulated screws, Hansson pins, and sliding hip screw on the Swemac TraumaVision VR simulator. A previously validated test was used. The participants repeated the procedures until they reached their learning plateau. Results - The novices and the experts reached their learning plateau after an average of 169 minutes (95% CI 152-87) and 143 minutes (CI 109-177), respectively. Highest achieved scores were 92% (CI 91-93) for novices and 96% (CI 94-97) for experts. Plateau score, defined as the average of the 4 last scores, was 85% (CI 82-87) and 92% (CI 89-96) for the novices and the experts, respectively. Interpretation - Training time to reach plateau varied widely and it is paramount that simulation-based training continues to a predefined standard instead of ending after a fixed number of attempts or amount of time. A score of 92% comparable to the experts' plateau score could be used as a mastery learning pass/fail standard.

Medical students' perception of dyad practice.

Training in pairs (dyad practice) has been shown to improve efficiency of clinical skills training compared with single practice but little is known about students' perception of dyad practice. The aim of this study was to explore the reactions and attitudes of medical students who were instructed to work in pairs during clinical skills training. A follow-up pilot survey consisting of four open-ended questions was administered to 24 fourth-year medical students, who completed four hours of dyad practice in managing patient encounters. The responses were analyzed using thematic analysis. The students felt dyad practice improved their self-efficacy through social interaction with peers, provided useful insight through observation, and contributed with shared memory of what to do, when they forgot essential steps of the physical examination of the patient. However, some students were concerned about decreased hands-on practice and many students preferred to continue practising alone after completing the initial training. Dyad practice is well received by students during initial skills training and is associated with several benefits to learning through peer observation, feedback and cognitive support. Whether dyad training is suited for more advanced learners is a subject for future research.

Improving efficiency of clinical skills training: a randomized trial.

BACKGROUND: The rising number of medical students and the impact this has on students' learning of clinical skills is a matter of concern. Cooperative learning in pairs, called dyad training, might help address this situation. OBJECTIVE: The aim of this study was to evaluate the effect of dyad training on students' patient encounter skills. DESIGN: Experimental, randomized, observer-blinded trial. PARTICIPANTS: Forty-nine pre-clerkship medical students without prior clinical experience. INTERVENTION: All students underwent a 4-h course on how to manage patient encounters. Subsequently, the students were randomized into a dyad practice group (n = 24) or a single practice group (n = 25). Both groups practiced for 4 h on four different case scenarios, using simulated patients. Students in the dyad group practiced together and took turns as the active participant, whereas students in the single group practiced alone. MAIN MEASURE: Performance tests of patient encounter skills were conducted 2 weeks after the training by two blinded raters. Students had no clinical training during those weeks. A questionnaire-based evaluation surveyed students' confidence in their patient management skills. KEY RESULTS: The dyad group scored significantly higher on the performance test, mean 40.7 % (SD 6.6), than the single group, mean 36.9 % (SD 5.8), P = 0.04, effect size 0.61. Inter-rater reliability was 0.69. The dyad group expressed significantly higher confidence in managing future clinical patient encounters than the single group, mean 7.6 (SD 0.9) vs. mean 6.5 (SD 1.1), respectively, P < 0.001, effect size 1.16. CONCLUSION: Dyad training of pre-clerkship medical students' patient encounter skills is effective, efficient, and prompts higher confidence in managing future patient encounters compared to training alone. This training format may help maintain high-quality medical training in the face of an increasing number of students in medical schools.

[Students as teachers]. / Studerende som undervisere.

The concept of near-peer teaching is reviewed in this article. Theories of learning support the rationale for using students as teachers by explaining how near-peers as opposed to experts may have a superior understanding of the needs of the taught students and a better basis for identifying and addressing their problems. Empirical studies support these theories and show that high levels of satisfaction are associated with near-peer teaching without compromising the learning outcome. In addition, student teachers achieve a substantial learning benefit from teaching. Much more research is needed into the pros and cons of this concept.

Student teachers can be as good as associate professors in teaching clinical skills.

AIM: The aim of this study is to compare student teachers and clinical associate professors regarding the quality of procedural skills teaching in terms of participants' technical skills, knowledge and satisfaction with the teaching. METHODS: This is an experimental, randomized, controlled study comparing the teaching of student teachers and associate professors regarding participants' learning outcome and satisfaction with the teaching. Two skills are chosen for the experiment, i.v.-access and bladder catheterization. Learning outcome is assessed by a pre- and post testing of the participants' knowledge and skills. Participants evaluate satisfaction with teaching on nine statements immediately after the teaching. RESULTS: In total 59 first year medical students are included as participants in the experiment. The students taught by student teachers perform just as well as the students taught by associate professors and in one skill--catheterization--they perform even better, mean post- minus pre-test scores 65.5 (SD 12.9) vs. 35.0 (SD 23.3), One-way ANOVA, p < 0.0001, effect size 1.62. Student teachers receive significantly more positive evaluations than associate professors on several statements. CONCLUSION: Trained student teachers can be as good as associate professors in teaching clinical skills.