Comparing the impact of surgical expert versus non-ophthalmologist instructors on virtual-reality surgical performance: A randomized controlled trial.

PURPOSE: To compare Manual Small Incision Cataract Surgery (MSICS) microsurgical performance in course participants who received virtual reality simulation-based training by either a surgical expert or a non-ophthalmologist instructor. SETTING: Copenhagen Academy for Medical Education and Simulation, Copenhagen, Denmark. DESIGN: Randomized controlled trial. METHODS: Residents and specialists in ophthalmology with no prior MSICS experience were included to receive virtual reality simulation training in MSICS using the HelpMeSee simulator. The participants were randomly allocated to receive training from either an experienced MSICS surgeon or a non-ophthalmologist, also known as near-peer teaching. The performances of the participants were evaluated at baseline and post-training using a MSICS proficiency-based test with evidence of validity. RESULTS: Thirty participants were included in the study and 29 completed the course. There was no significant difference in final test score between the two groups (p = 0.13). The performance score of both groups of participants increased significantly after receiving the training (p < 0.001). All participants passed the proficiency-based test after receiving the training. CONCLUSION: We found no significant difference in surgical proficiency-level whether the participants were trained by a surgical expert or a non-ophthalmologist instructor for MSICS in a virtual-reality based setting. The findings of this study suggest that near-peer teaching within microsurgical performance potentially could be applied with teaching outcomes comparable to a surgical expert-instructor.

Setting proficiency standards for simulation-based mastery learning of short antegrade femoral nail osteosynthesis: a multicenter study.

BACKGROUND AND PURPOSE: Orthopedic trainees frequently perform short antegrade femoral nail osteosynthesis of trochanteric fractures, but virtual reality simulation-based training (SBT) with haptic feedback has been unavailable. We explored a novel simulator, with the aim of gathering validity evidence for an embedded test and setting a credible pass/fail standard allowing trainees to practice to proficiency. PATIENTS AND METHODS: The research, conducted from May to September 2020 across 3 Danish simulation centers, utilized the Swemac TraumaVision simulator for short antegrade femoral nail osteosynthesis. The validation process adhered to Messick's framework, covering all 5 sources of validity evidence. Participants included novice groups, categorized by training to plateau (n = 14) or to mastery (n = 10), and experts (n = 9), focusing on their performance metrics and training duration. RESULTS: The novices in the plateau group and experts had hands-on training for 77 (95% confidence interval [CI] 59-95) and 52 (CI 36-69) minutes while the plateau test score, defined as the average of the last 4 scores, was 75% (CI 65-86) and 96% (CI 94-98) respectively. The pass/fail standard was established at the average expert plateau test score of 96%. All novices in the mastery group could meet this standard and interestingly without increased hands-on training time (65 [CI 46-84] minutes). CONCLUSION: Our study provides supporting validity evidence from all sources of Messick's framework for a simulation-based test in short antegrade nail osteosynthesis of intertrochanteric hip fracture and establishes a defensible pass/fail standard for mastery learning of SBT. Novices who practiced using mastery learning were able to reach the pre-defined pass/fail standard and outperformed novices without a set goal for external motivation.

More than 20 procedures are necessary to learn small bowel capsule endoscopy: Learning curve pilot study of 535 trainee cases.

Background and study aims The number of procedures needed to acquire a sufficient level of skills to perform an unassisted evaluation of small bowel capsule endoscopy (SBCE) is unknown. We aimed to establish learning curves, diagnostic accuracy, and the number of procedures needed for reviewing small bowel capsule endoscopies unassisted. Methods An expert panel developed a 1-day course including lessons (examination, anatomy, and pathology) and hands-on training. After completing the course, participants received 50 cases in a randomized sequence. An interactive questionnaire about landmarks, findings, and diagnosis followed each case. After submitting the questionnaire, participants received feedback. Data are presented using CUSUM (cumulative sum control chart) learning curves and sensitivity/specificity analyses compared with expert opinions. Results We included 22 gastroenterologists from 11 different Danish hospitals. A total of 535 cases were reviewed (mean: 28; range: 11-50). CUSUM plots demonstrated learning progression for diagnosis and findings during the course, but none of the participants reached a learning plateau with sufficient competencies. The sensitivity for all findings was 65% (95% confidence interval [CI] 0.51-0.82) for the first 20 procedures and 67% (95% CI 0.58-0.73) from case 21 until completion or dropout. The specificity was 63% (95% CI 0.52-0.74) for the first 20 procedures and 57% (95% CI 0.37-0.77) for the rest. Conclusions Our data indicate that learning SBCE may be more difficult than previously recognized due to low discriminative abilities after 20 cases except for the identification of CD. This indicates that 20 SBCE cases may not be sufficient to achieve competency for reviewing SBCE without supervision.

The good lecture.

Postgraduate medical education often relies on the traditional lecture model with low knowledge retention rates of 5-20%. Cognitive overload from excessive information during lectures diminishes learning efficacy. To optimise learning, evidence suggests prioritising active engagement, streamlining visual aids, introducing clinical scenarios, and incorporating audience response systems may further enhance retention and comprehension. In conclusion, the traditional lecture must evolve into more interactive and engaging modalities to facilitate increased participant long-term learning as summarised in this review.

Computer-aided quality assessment of endoscopist competence during colonoscopy: A systematic review.

BACKGROUND AND AIMS: Endoscopists' competence can vary widely, as shown in the variation in adenoma detection rate (ADR). Computer-aided quality assessment (CAQ) can automatically assess performance during individual procedures. This review aims to identify and describe different CAQ systems for colonoscopy. METHODS: A systematic review of the literature was done using MEDLINE, EMBASE, and SCOPUS based on three blocks of terms according to the inclusion criteria: Colonoscopy, Competence assessment, and Automatic evaluation. Articles were systematically reviewed by two reviewers, first by abstract and then in full text. The methodological quality was assessed using the Medical Education Research Study Quality Instrument (MERSQI). RESULTS: 12,575 studies were identified, 6,831 remained after removal of duplicates, and 6,806 did not pass the eligibility criteria and were excluded, leaving thirteen studies for final analysis. Five categories of CAQ systems were identified: Withdrawal speedometer (seven studies), Scope movement analysis (three studies), Effective withdrawal time (one study), Fold examination quality (one study), and Visual gaze pattern (one study). The withdrawal speedometer was the only CAQ system that tested its feedback by examining changes in ADR. Three studies observed an improvement in ADR, and two studies did not. The methodological quality of the studies was high (mean MERSQI 15.2 points, maximum 18 points). CONCLUSIONS: Thirteen studies developed or tested CAQ systems, most frequently by correlating it to ADR. Only five studies tested feedback by implementing the CAQ system. A meta-analysis was impossible due to the heterogeneous study designs, and more studies are warranted.

Using neuroimaging to assess brain activity and areas associated with surgical skills: a systematic review.

BACKGROUND: Surgical skills acquisition is under continuous development due to the emergence of new technologies, and there is a need for assessment tools to develop along with these. A range of neuroimaging modalities has been used to map the functional activation of brain networks while surgeons acquire novel surgical skills. These have been proposed as a method to provide a deeper understanding of surgical expertise and offer new possibilities for the personalized training of future surgeons. With studies differing in modalities, outcomes, and surgical skills there is a need for a systematic review of the evidence. This systematic review aims to summarize the current knowledge on the topic and evaluate the potential use of neuroimaging in surgical education. METHODS: We conducted a systematic review of neuroimaging studies that mapped functional brain activation while surgeons with different levels of expertise learned and performed technical and non-technical surgical tasks. We included all studies published before July 1st, 2023, in MEDLINE, EMBASE and WEB OF SCIENCE. RESULTS: 38 task-based brain mapping studies were identified, consisting of randomized controlled trials, case-control studies, and observational cohort or cross-sectional studies. The studies employed a wide range of brain mapping modalities, including electroencephalography, functional magnetic resonance imaging, positron emission tomography, and functional near-infrared spectroscopy, activating brain areas involved in the execution and sensorimotor or cognitive control of surgical skills, especially the prefrontal cortex, supplementary motor area, and primary motor area, showing significant changes between novices and experts. CONCLUSION: Functional neuroimaging can reveal how task-related brain activity reflects technical and non-technical surgical skills. The existing body of work highlights the potential of neuroimaging to link task-related brain activity patterns with the individual level of competency or improvement in performance after training surgical skills. More research is needed to establish its validity and usefulness as an assessment tool.

The bibliometric analysis of extended reality in surgical training: Global and Chinese perspective.

Objectives: The prospect of extended reality (XR) being integrated with surgical training curriculum has attracted scholars. However, there is a lack of bibliometric analysis to help them better understand this field. Our aim is to analyze relevant literature focusing on development trajectory and research directions since the 21st century to provide valuable insights. Methods: Papers were retrieved from the Web of Science Core Collection. Microsoft Excel, VOSviewer, and CiteSpace were used for bibliometric analysis. Results: Of the 3337 papers published worldwide, China contributed 204, ranking fifth. The world's enthusiasm for this field has been growing since 2000, whereas China has been gradually entering since 2001. Although China had a late start, its growth has accelerated since around 2016 due to the reform of the medical postgraduate education system and the rapid development of Chinese information technology, despite no research explosive period has been yet noted. International institutions, notably the University of Toronto, worked closely with others, while Chinese institutions lacked of international and domestic cooperation. Sixteen stable cooperation clusters of international scholars were formed, while the collaboration between Chinese scholars was not yet stable. XR has been primarily applied in orthopedic surgery, cataract surgery, laparoscopic training and intraoperative use in neurosurgery worldwide. Conclusions: There is strong enthusiasm and cooperation in the international research on the XR-based surgical training. Chinese scholars are making steady progress and have great potential in this area. There has not been noted an explosive research phase yet in the Chinese pace. The research on several surgical specialties has been summarized at the very first time. AR will gradually to be more involved and take important role of the research.

How experienced robotic nurses adapt to the Hugo™ RAS system.

No studies have reported on the impact at team level of the Medtronic Hugo™ RAS system. We described the work patterns and learning curves of an experienced robotic nurse team adapting to the new robotic system. We prospectively recorded the robotic nurse team's preoperative, perioperative, and postoperative tasks on the first 30 robotic procedures performed. The data were descriptively analyzed, and Gantt Charts were created for a timeline overview of the work patterns. We compared the operative times between the Medtronic Hugo™ RAS and the Davinci® system. The preoperative phase seemed to improve with a median time of 94 min (IQR 81-107). After 20 surgeries, the work pattern became more consistent where the scrub and circulating nurses worked simultaneously. There was no noticeable improvement for the perioperative and postoperative phases with a stable median time of 170 min (IQR 135-189) and 26 min (IQR 22-31). We found that the work pattern seemed to stabilize after 20 surgeries but with a continued decrease in preoperative time without a learning curve plateau. The robotic nurse team suffered from few breaks and long working hours because only a few nurses at our facility were trained in the Hugo™ system.

Training and assessment for colorectal surgery and appendicectomy- a systematic review.

AIM: There is currently an increased focus on competency-based training, in which training and assessment play a crucial role. The aim of this systematic review is to create an overview of hands-on training methods and assessment tools for appendicectomy and colon and rectal surgery procedures using either an open, laparoscopic or robot-assisted approach. METHOD: A systematic review of Medline, Embase, Cochrane and Scopus databases was conducted following the PRISMA guidelines. We conducted the last search on 9 March 2023. All published papers describing hands-on training, evaluation of performance data and development of assessment tools were eligible. The quality of studies and the validity evidence of assessment tools are reported. RESULTS: Fifty-one studies were identified. Laparoscopic assessment tools are abundant, but the literature still lacks good-quality assessment tools for open appendicectomy, robotic colectomy and open rectal surgery. Overall, there is a lack of discussion regarding the establishment of pass/fail standards and the consequences of assessment. Virtual reality simulation is used more for appendicectomy than colorectal procedures. Only a few of the studies investigating training were of acceptable quality. There is a need for high-quality studies in open and robotic-assisted colon surgery and all approaches to rectal surgery. CONCLUSION: This review provides an overview of current training methods and assessment tools and identifies where more research is needed based on the quality of the studies and the current validity evidence.

Variable practice is superior to self-directed training for laparoscopic simulator training: a randomized trial.

BACKGROUND: Mastering laparoscopy is challenging-it requires specific psychomotor skills which are difficult to obtain in the operating room without potentially compromising patient safety. Proficiency-based training programs using virtual reality simulators allow novices to practice and develop their skills in a patient-safe learning environment. Variable practice leads to stronger retention and skills transfer in a non-surgical setting. The objective of this trial was to investigate if variable practice was superior to self-directed training. METHODS: A randomized trial where participants (n = 36) were randomized to proficiency-based laparoscopic simulator training of basic skills using either variable practice or self-directed training, followed by a transfer test with proficiency-based training on a procedural task (a salpingectomy). All participants returned after a period of 3-5 weeks to perform a retention test. RESULTS: The mean time to proficiency for the basic skills tasks were 119 min (SD: 93) for the variable practice group versus 182 min (SD: 46) for the self-directed training group (p = 0.015). The time to reach proficiency during the transfer test was 103 min (SD: 57) versus 183 min (SD: 64) for the variable practice group versus the self-directed training group, respectively (p < 0.001). The mean time to proficiency for the retention test was 51 min (SD: 26) and 109 min (SD: 53) for the variable practice group and self-directed training group, respectively (p < 0.001). CONCLUSION: Variable practice is superior to self-directed training for proficiency-based laparoscopic training. With variable time to practice proficiency is reduced, there is higher transfer to a procedural task, and retention is improved.

Head and neck ultrasound training improves the diagnostic performance of otolaryngology residents.

Objective: Surgeon-performed head and neck ultrasound (US) is increasingly used among otolaryngologists in office-based and surgical settings. However, it is unknown how formal US training affects otolaryngology residents' diagnostic workup of patients with cervical pathology. This study examined how a formal US course for residents affected their outpatient clinic US performance and diagnostic accuracy. Methods: We conducted a randomized cross-over trial, where 13 otolaryngology residents participated in a 6-h formal US course. Participants were randomized to perform head and neck US on four patient cases before and after completing the course. Eight patients with and without neck pathology were invited to participate as test cases. The ultrasound examinations were video recorded and anonymized before two consultants rated the US performance using the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale. Otolaryngology residents wrote an ultrasound report with a diagnosis based on their US examination, which was used to calculate the specificity and sensitivity. Results: We found a statistically significant difference in the OSAUS score before compared to after the hands-on training (p = .035). The diagnostic accuracy also increased from 62% before the course to 75% after the course (p = .02). Specificity increased from 54% prior to the course to 62% following the course, and sensitivity increased from 64% prior to the course to 79% following the course. The intraclass correlation coefficient with "absolute agreement" was 0.63. Conclusion: This study demonstrates that short, formal ultrasound training can improve otolaryngology residents' ultrasound skills and diagnostic accuracy in an outpatient clinic setting. Lay summary: This study looks at the change of otolaryngology residents' diagnostic workup of patients after they take a formal ultrasound course and shows that they get better at using ultrasound and make more accurate diagnoses if they take a formal course. Level of Evidence: Level 2.

Developing a phantom for simulating robotic-assisted complete mesocolic excision using 3D printing and medical imaging.

BACKGROUND: Robotic-assisted complete mesocolic excision is an advanced procedure mainly because of the great variability in anatomy. Phantoms can be used for simulation-based training and assessment of competency when learning new surgical procedures. However, no phantoms for robotic complete mesocolic excision have previously been described. This study aimed to develop an anatomically true-to-life phantom, which can be used for training with a robotic system situated in the clinical setting and can be used for the assessment of surgical competency. METHODS: Established pathology and surgical assessment tools for complete mesocolic excision and specimens were used for the phantom development. Each assessment item was translated into an engineering development task and evaluated for relevance. Anatomical realism was obtained by extracting relevant organs from preoperative patient scans and 3D printing casting moulds for each organ. Each element of the phantom was evaluated by two experienced complete mesocolic excision surgeons without influencing each other's answers and their feedback was used in an iterative process of prototype development and testing. RESULTS: It was possible to integrate 35 out of 48 procedure-specific items from the surgical assessment tool and all elements from the pathological evaluation tool. By adding fluorophores to the mesocolic tissue, we developed an easy way to assess the integrity of the mesocolon using ultraviolet light. The phantom was built using silicone, is easy to store, and can be used in robotic systems designated for patient procedures as it does not contain animal-derived parts. CONCLUSIONS: The newly developed phantom could be used for training and competency assessment for robotic-assisted complete mesocolic excision surgery in a simulated setting.

Assessment of Basic Thoracic Ultrasound Skills in Immersive Virtual Reality: Gathering Validity Evidence.

OBJECTIVE: Operator skills are essential for thoracic ultrasound (TUS) to ensure diagnostic accuracy. Immersive virtual reality (IVR) has shown potential within medical education but never for assessment of TUS skills. This study was aimed at developing an IVR test for assessing TUS skills, gathering validity evidence and establishing a pass/fail score. METHODS: An expert panel developed a test based on the TUS protocol by the European Respiratory Society (ERS), including a tutorial and two clinical cases (pleural effusion and interstitial syndrome), using an IVR platform (VitaSim, Odense, Denmark). Four anterior, four lateral and six posterior zones were available for examination and decision of diagnosis. Each correct examination equaled one point. The contrasting groups' method was used to set a pass/fail score. RESULTS: Data were collected during the 2022 ERS Congress. We included 13 novices (N, experience: 0 TUS), 22 intermediates (I, 1-50 TUS) and 11 experienced clinicians (E, >50 TUS). Cronbach's α was 0.86. The total mean point scores in case 1 (C1) were (N) 5.0 ± 2.7, (I) 7.3 ± 2.4 and (E) 8.7 ± 1.3, and the scores in case 2 (C2) were (N) 4.5 ± 1.8, (I) 6.7 ± 2.3 and (E) 8.5 ± 2.1. Significant differences were found between N and I for C1 (p = 0.007) and C2 (p = 0.02), I and E for C1 (p = 0.04) and C2 (p = 0.019) and N and E for C1 (p < 0.001) and C2 (p < 0.001). The pass/fail score was 7 points in each case. CONCLUSION: We established an IVR test that can distinguish between operators with different TUS skills. This enables a standardized, objective and evidence-based approach to assessment of TUS skills.

Development and validation of a new tool for assessment of trainees' interventional musculoskeletal ultrasound skills.

OBJECTIVES: Interventional musculoskeletal ultrasound (MSUS) procedures are routinely performed in rheumatology practice. However, the efficacy and safety of the procedures rely on the competence of the physician, and assessment of skills is crucial. Thus, this study aimed to develop and establish validity evidence for a tool assessing trainees' interventional MSUS skills. METHODS: An expert panel of rheumatologists modified an existing tool for assessing competences in invasive abdominal and thoracic ultrasound procedures. The new tool (the Assessment of Interventional Musculoskeletal Ultrasound Skills (AIMUS) tool) reflects the essential steps in interventional MSUS. To establish validity evidence, physicians with different levels of interventional MSUS experience were enrolled and performed two procedures on a rubber fantom, simulating real patient cases. All performances were video recorded, anonymized, and assessed in random order by two blinded raters using the AIMUS tool. RESULTS: Sixty-five physicians from 21 different countries were included and categorized into groups based on their experience, resulting in 130 videos for analysis. The internal consistency of the tool was excellent, with a Cronbach's alpha of 0.96. The inter-case reliability was good with a Pearson's correlation coefficient (PCC) of 0.74 and the inter-rater reliability was moderate to good (PCC 0.58). The ability to discriminate between different levels of experience was highly significant (p< 0.001). CONCLUSIONS: We have developed and established validity evidence for a new interventional MSUS assessment tool. The tool can be applied in future competency-based educational programs, provide structured feedback to trainees in daily clinical practice, and ensure end-of-training competence.

Lack of stereopsis does not reduce surgical performance but prolongs the learning curve of vitreoretinal surgery.

PURPOSE: To investigate whether individuals with long-term reduced stereopsis were able to obtain the same level of surgical skills in simulated vitreoretinal surgery on the Eyesi Surgical Simulator as individuals with normal stereopsis. METHODS: Twenty-four medical students were recruited and divided into two groups according to their degree of stereopsis: Group 1 (n = 12) included subjects with normal stereopsis (60 arcsec or lower) and Group 2 (n = 12) included subjects with reduced stereopsis (120 arcsec or higher). Stereopsis was tested using the TNO test (Lameris Ootech BV, Nieuwegein, the Netherlands). The participants were trained in virtual reality-simulated vitreoretinal surgery and continuously measured using a test with solid validity evidence and a pre-defined pass-fail score. All data were analysed using the Wilcoxon rank sum test. RESULTS: We observed no differences in overall performance scores for any of the four modules. The participants with reduced stereopsis used 5.8 more attempts in bimanual training (p = 0.04), 8.8 more attempts in removal of posterior hyaloid (p = 0.04), 9.1 more attempts in navigation training (p = 0.20) and 0.3 fewer attempts in removal of internal limiting membrane (p = 0.69). CONCLUSION: The final performance scores on the Eyesi Surgical Simulator were independent of the degree of stereopsis. However, the number of attempts to achieve the pre-defined pass-fail score increased significantly with reduced stereopsis in two of four modules. These results indicate that a high degree of stereopsis is not necessary to become proficient in microsurgery but may prolong the learning curve.

Surgical gestures can be used to assess surgical competence in robot-assisted surgery : A validity investigating study of simulated RARP.

To collect validity evidence for the assessment of surgical competence through the classification of general surgical gestures for a simulated robot-assisted radical prostatectomy (RARP). We used 165 video recordings of novice and experienced RARP surgeons performing three parts of the RARP procedure on the RobotiX Mentor. We annotated the surgical tasks with different surgical gestures: dissection, hemostatic control, application of clips, needle handling, and suturing. The gestures were analyzed using idle time (periods with minimal instrument movements) and active time (whenever a surgical gesture was annotated). The distribution of surgical gestures was described using a one-dimensional heat map, snail tracks. All surgeons had a similar percentage of idle time but novices had longer phases of idle time (mean time: 21 vs. 15 s, p < 0.001). Novices used a higher total number of surgical gestures (number of phases: 45 vs. 35, p < 0.001) and each phase was longer compared with those of the experienced surgeons (mean time: 10 vs. 8 s, p < 0.001). There was a different pattern of gestures between novices and experienced surgeons as seen by a different distribution of the phases. General surgical gestures can be used to assess surgical competence in simulated RARP and can be displayed as a visual tool to show how performance is improving. The established pass/fail level may be used to ensure the competence of the residents before proceeding with supervised real-life surgery. The next step is to investigate if the developed tool can optimize automated feedback during simulator training.

First experience with the Hugo™ robot-assisted surgery system for endometriosis: A descriptive study.

INTRODUCTION: The Medtronic Hugo™ Robot-assisted Surgery (RAS) system was recently approved for clinical use. We explored the safety and feasibility of this system for endometriosis surgery. The primary outcome was safe case completion without major surgical complications (Clavien-Dindo grade ≤2) and no conversion to open surgery or laparoscopy. MATERIAL AND METHODS: Surgeries for endometriosis performed at the Department of Gynecology, Rigshospitalet, on the Medtronic Hugo™ RAS system were included. Two experienced robotic surgeons performed all surgeries with their usual robotic team. The variables included were patient demographics, peri- and postoperative data, complications and 30-day readmission rate. We used the IDEAL framework 1/2a for surgical innovation in this descriptive study. RESULTS: The first 12 patients were included. All cases were completed without intraoperative complications or conversion. Four patients experienced Clavien-Dindo grade 1 postoperative complications. No patients were re-admitted within 30 days. Median docking time (17 minutes), console time (87.5 minutes), blood loss (40 mL) and length of hospital stay (1 day) were acceptable compared with previous literature. CONCLUSIONS: In this pilot study, we found the Medtronic Hugo™ RAS system safe and feasible for robot-assisted surgery for endometriosis. The advent of new robotic systems is welcomed to accelerate the development of technology that will advance surgical care for patients across the globe.

Solid validity evidence for two tools assessing competences in musculoskeletal ultrasound: a validity study.

OBJECTIVES: Musculoskeletal ultrasound (MSUS) is increasingly used by rheumatologists in daily clinical practice. However, MSUS is only valuable in trained hands, and assessment of trainee competences is therefore essential before independent practice. Thus, this study aimed to establish validity evidence for the EULAR and the Objective Structured Assessment of Ultrasound Skills (OSAUS) tools used for assessing MSUS competences. METHODS: Thirty physicians with different levels of MSUS experience (novices, intermediates, and experienced) performed four MSUS examinations of different joint areas on the same rheumatoid arthritis patient. All examinations were video recorded (n = 120), anonymized, and subsequently assessed in random order by two blinded raters using first the OSAUS assessment tool followed by the EULAR tool 1 month after. RESULTS: The inter-rater reliability between the two raters was high for both the OSAUS and EULAR tools, with a Pearson correlation coefficient (PCC) of 0.807 and 0.848, respectively. Both tools demonstrated excellent inter-case reliability, with a Cronbach's alpha of 0.970 for OSAUS and 0.964 for EULAR. Furthermore, there was a strong linear correlation between the OSAUS and the EULAR performance scores and the participants' experience levels (R2 = 0.897 and R2 = 0.868, respectively) and a significant discrimination between different MSUS experience levels (P < 0.001 for both). CONCLUSIONS: MSUS operator competences can be assessed reliably and valid using either the OSAUS or the EULAR assessment tool, thereby allowing a uniform competency-based MSUS education in the future. Although both tools demonstrated high inter-rater reliability, the EULAR tool was superior to OSAUS. TRIAL REGISTRATION: ClinicalTrials.gov, http://clinicaltrials.gov, NCT05256355.

Artificial Intelligence Improves Novices' Bronchoscopy Performance: A Randomized Controlled Trial in a Simulated Setting.

BACKGROUND: Navigating through the bronchial tree and visualizing all bronchial segments is the initial step toward learning flexible bronchoscopy. A novel bronchial segment identification system based on artificial intelligence (AI) has been developed to help guide trainees toward more effective training. RESEARCH QUESTION: Does feedback from an AI-based automatic bronchial segment identification system improve novice bronchoscopists' end-of-training performance? STUDY DESIGN AND METHODS: The study was conducted as a randomized controlled trial in a standardized simulated setting. Novices without former bronchoscopy experience practiced on a mannequin. The feedback group (n = 10) received feedback from the AI, and the control group (n = 10) trained according to written instructions. Each participant decided when to end training and proceed to performing a full bronchoscopy without any aids. RESULTS: The feedback group performed significantly better on all three outcome measures (median difference, P value): diagnostic completeness (3.5 segments, P < .001), structured progress (13.5 correct progressions, P < .001), and procedure time (-214 seconds, P = .002). INTERPRETATION: Training guided by this novel AI makes novices perform more complete, more systematic, and faster bronchoscopies. Future studies should examine its use in a clinical setting and its effects on more advanced learners.