More than 20 procedures are necessary to learn small bowel capsule endoscopy: Learning curve pilot study of 535 trainee cases.

Background and study aims The number of procedures needed to acquire a sufficient level of skills to perform an unassisted evaluation of small bowel capsule endoscopy (SBCE) is unknown. We aimed to establish learning curves, diagnostic accuracy, and the number of procedures needed for reviewing small bowel capsule endoscopies unassisted. Methods An expert panel developed a 1-day course including lessons (examination, anatomy, and pathology) and hands-on training. After completing the course, participants received 50 cases in a randomized sequence. An interactive questionnaire about landmarks, findings, and diagnosis followed each case. After submitting the questionnaire, participants received feedback. Data are presented using CUSUM (cumulative sum control chart) learning curves and sensitivity/specificity analyses compared with expert opinions. Results We included 22 gastroenterologists from 11 different Danish hospitals. A total of 535 cases were reviewed (mean: 28; range: 11-50). CUSUM plots demonstrated learning progression for diagnosis and findings during the course, but none of the participants reached a learning plateau with sufficient competencies. The sensitivity for all findings was 65% (95% confidence interval [CI] 0.51-0.82) for the first 20 procedures and 67% (95% CI 0.58-0.73) from case 21 until completion or dropout. The specificity was 63% (95% CI 0.52-0.74) for the first 20 procedures and 57% (95% CI 0.37-0.77) for the rest. Conclusions Our data indicate that learning SBCE may be more difficult than previously recognized due to low discriminative abilities after 20 cases except for the identification of CD. This indicates that 20 SBCE cases may not be sufficient to achieve competency for reviewing SBCE without supervision.

Assessment of Basic Thoracic Ultrasound Skills in Immersive Virtual Reality: Gathering Validity Evidence.

OBJECTIVE: Operator skills are essential for thoracic ultrasound (TUS) to ensure diagnostic accuracy. Immersive virtual reality (IVR) has shown potential within medical education but never for assessment of TUS skills. This study was aimed at developing an IVR test for assessing TUS skills, gathering validity evidence and establishing a pass/fail score. METHODS: An expert panel developed a test based on the TUS protocol by the European Respiratory Society (ERS), including a tutorial and two clinical cases (pleural effusion and interstitial syndrome), using an IVR platform (VitaSim, Odense, Denmark). Four anterior, four lateral and six posterior zones were available for examination and decision of diagnosis. Each correct examination equaled one point. The contrasting groups' method was used to set a pass/fail score. RESULTS: Data were collected during the 2022 ERS Congress. We included 13 novices (N, experience: 0 TUS), 22 intermediates (I, 1-50 TUS) and 11 experienced clinicians (E, >50 TUS). Cronbach's α was 0.86. The total mean point scores in case 1 (C1) were (N) 5.0 ± 2.7, (I) 7.3 ± 2.4 and (E) 8.7 ± 1.3, and the scores in case 2 (C2) were (N) 4.5 ± 1.8, (I) 6.7 ± 2.3 and (E) 8.5 ± 2.1. Significant differences were found between N and I for C1 (p = 0.007) and C2 (p = 0.02), I and E for C1 (p = 0.04) and C2 (p = 0.019) and N and E for C1 (p < 0.001) and C2 (p < 0.001). The pass/fail score was 7 points in each case. CONCLUSION: We established an IVR test that can distinguish between operators with different TUS skills. This enables a standardized, objective and evidence-based approach to assessment of TUS skills.

Lack of stereopsis does not reduce surgical performance but prolongs the learning curve of vitreoretinal surgery.

PURPOSE: To investigate whether individuals with long-term reduced stereopsis were able to obtain the same level of surgical skills in simulated vitreoretinal surgery on the Eyesi Surgical Simulator as individuals with normal stereopsis. METHODS: Twenty-four medical students were recruited and divided into two groups according to their degree of stereopsis: Group 1 (n = 12) included subjects with normal stereopsis (60 arcsec or lower) and Group 2 (n = 12) included subjects with reduced stereopsis (120 arcsec or higher). Stereopsis was tested using the TNO test (Lameris Ootech BV, Nieuwegein, the Netherlands). The participants were trained in virtual reality-simulated vitreoretinal surgery and continuously measured using a test with solid validity evidence and a pre-defined pass-fail score. All data were analysed using the Wilcoxon rank sum test. RESULTS: We observed no differences in overall performance scores for any of the four modules. The participants with reduced stereopsis used 5.8 more attempts in bimanual training (p = 0.04), 8.8 more attempts in removal of posterior hyaloid (p = 0.04), 9.1 more attempts in navigation training (p = 0.20) and 0.3 fewer attempts in removal of internal limiting membrane (p = 0.69). CONCLUSION: The final performance scores on the Eyesi Surgical Simulator were independent of the degree of stereopsis. However, the number of attempts to achieve the pre-defined pass-fail score increased significantly with reduced stereopsis in two of four modules. These results indicate that a high degree of stereopsis is not necessary to become proficient in microsurgery but may prolong the learning curve.

Retention of emergency cricothyroidotomy skills: A multicenter randomized controlled trial.

Objectives: Emergency cricothyroidotomy is the final approach to establishing a secure airway. The procedure is acute and highly infrequent, making it difficult to achieve and maintain competence in the clinic. Simulation-based training in emergency cricothyroidotomy is effective but it is unknown how often training should be repeated to maintain skills. This study aimed to assess novices' retention of technical skills in emergency cricothyroidotomy after completing SBT. Methods: Novices in emergency cricothyroidotomy completed a structured, simulation-based training program and were randomized to retention tests after 1, 3, or 6 months. Participants completed two emergency cricothyroidotomy tests at end-of-training and follow-up retention testing. Test performances were video recorded and evaluated by two experienced blinded raters using a structured assessment tool. Differences in the performances and the pass/fail rates were analyzed. Results: Eighty-two medical students from two different Danish universities were included from April 2021 to February 2022. Paired t-tests showed skills decay significantly after 1 month (mean loss 6.7 points, p < 0.001). The mean loss of points, representing the difference in global score points, from the end-of-training to retention test was 6.7 points (95% confidence interval [CI] 4.5-8.8) for the 1-month group, 8.2 points (95% CI 5.8-10.0) for the 3-months group, and 9.9 points (95% CI 8.1-11.7) for the 6-months group. Six participants in both the 1-month group (23.1%) and the 3-month group (24%) passed the first retention test, but no one in the 6-months group had a passing performance. Conclusions: Novices' technical skills performance in emergency cricothyroidotomy decay significantly already after 1 month. This initial loss of skill seems to be stable until 3 months, after which there is a further significant loss of skills. Recurring training should be implemented for the benefit of patient safety and outcomes.

Exploring training needs of newly graduated medical doctors to inform the undergraduate simulation-based curriculum: a national Delphi consensus study.

PURPOSE: Mastering technical procedures is a key component in succeeding as a newly graduated medical doctor and is of critical importance to ensure patient safety. The efficacy of simulation-based education has been demonstrated but medical schools have different requirements for undergraduate curricula. We aimed to identify and prioritize the technical procedures needed by newly graduated medical doctors. METHODS: We conducted a national needs assessment survey using the Delphi technique to gather consensus from key opinion leaders in the field. In the first round, a brainstorm was conducted to identify all potential technical procedures. In the second round, respondents rated the need for simulation-based training of each procedure using the Copenhagen Academy for Medical Education and Simulation Needs Assessment Formula (CAMES-NAF). The third round was a final elimination and prioritization of the procedures. RESULTS: In total, 107 experts from 21 specialties answered the first round: 123 unique technical procedures were suggested. Response rates were 58% and 64% in the second and the third round, respectively. In the third round, 104 procedures were eliminated based on the consensus criterion, and the remaining 19 procedures were included and prioritized. The top five procedures were: (i) insert peripheral intravenous catheter, (ii) put on personal protection equipment, (iii) perform basic airway maneuvers, (iv) perform basic life support, and (v) perform radial artery puncture. CONCLUSION: Based on the Delphi process a final list of 19 technical procedures reached expert consensus to be included in the undergraduate curriculum for simulation-based education.

Objective structured clinical examination in basic thoracic ultrasound: a European study of validity evidence.

BACKGROUND: Basic thoracic ultrasound is being used more frequently by clinicians in several settings due to its high diagnostic accuracy for many common causes of respiratory failure and dyspnoea. However, ultrasound examinations are operator-dependent, and sufficient competences are needed to obtain high sensitivity and specificity of examinations. Additionally, it is crucial for ultrasound operators to perceive the competence to interpret the images and integrate them into the patient history and other examinations. This study aims to explore and gather validity evidence for an objective structured clinical examination test of basic thoracic ultrasound competences and establish a pass/fail score. METHODS: An expert panel created the test which included two theoretical and five practical stations representing cases with different diagnoses that cause respiratory symptoms and which are possible to establish by basic thoracic ultrasound. Twenty-five participants with different levels of experience in basic thoracic ultrasound completed the test. Data of the test scores were used for item analysis, and exploring validity evidence was done according to Messick's framework which is recommended. The contrasting groups' standard setting method was used to establish a pass/fail score. RESULTS: The summarised internal consistency reliability was high with a Cronbach's alpha of 0.87. The novice group (n = 4) had a mean test score of 42 ± 10.1 points, the intermediate group (n = 8) scored 79.1 ± 8.1 points, and the experienced group (n = 13) 89.0 ± 6.2 points (one-way ANOVA, p < 0.001). A pass/fail score of 71 points was thus derived (maximum test score = 105 points). CONCLUSION: We developed a test for the assessment of clinical competences in basic thoracic ultrasound with solid validity evidence, and a pass/fail standard with no false positives or false negatives.

The European Respiratory Society led training programme improves self-reported competency and increases the use of thoracic ultrasound.

Thoracic ultrasound has become a well-implemented diagnostic tool for assessment and monitoring of patients with respiratory symptoms or disease. However, ultrasound examinations are user dependent and sufficient competencies are needed. The European Respiratory Society (ERS) hosts a structured and evidence-based training programme in thoracic ultrasound. This study aimed to explore and discuss the self-reported activity and self-reported competency of the participants during the ERS course. Online surveys were sent to the training programme participants before the second part of the course (practical part of the course), and before and 3 months after the third part of the course (final certification exam). A total of 77 participants completed the surveys. The self-reported frequency of thoracic ultrasound examinations increased during the course, and in the final survey more than 90% of the participants used thoracic ultrasound on weekly basis. The self-reported competency (on technical execution of the thoracic ultrasound examination and overall competency) also increased. The ERS thoracic ultrasound training programme forms the basis of broad theoretical knowledge and sufficient practical skills that seem to lead to behavioural changes, whereby a large proportion of the participants implemented ultrasound in their clinical practice.

Assessment of esophagogastroduodenoscopy skills on simulators before real-life performance.

Background and study aims Operator competency is essential for esophagogastroduodenoscopy (EGD) quality, which makes appropriate training with a final test important. The aims of this study were to develop a test for assessing skills in performing EGD, gather validity evidence for the test, and establish a credible pass/fail score. Methods An expert panel developed a practical test using the Simbionix GI Mentor II simulator (3 D Systems) and an EGD phantom (OGI 4, CLA Medical) with a diagnostic (DP) and a technical skills part (TSP) for a prospective validation study. During the test a supervisor measured: 1) total time; 2) degree of mucosal visualization; and 3) landmarks and pathology identification. The contrasting groups standard setting method was used to establish a pass/fail score. Results We included 15 novices (N), 10 intermediates (I), and 10 experienced endoscopists (E). The internal structure was high with a Cronbach's alpha of 0.76 for TSP time consumption and 0.74 for the identification of landmarks. Mean total times, in minutes, for the DP were N 15.7, I 11.3, and E 7.0, and for TSP., they were N 7.9, I 8.9, and E 2.9. The total numbers of identified landmarks were N 26, I 41, and E 48. Mean visualization percentages were N 80, I 71, and E 71. A pass/fail standard was established requiring identification of all landmarks and performance of the TSP in < 5 minutes. All experienced endoscopists passed, while none of the endoscopists in the other categories did. Conclusions We established a test that can distinguish between participants with different competencies. This enables an objective and evidence-based approach to assessment of competencies in EGD.

The effectiveness of improving healthcare teams' human factor skills using simulation-based training: a systematic review.

BACKGROUND: Simulation-based training used to train healthcare teams' skills and improve clinical practice has evolved in recent decades. While it is evident that technical skills training is beneficial, the potential of human factor training has not been described to the same extent. Research on human factor training has been limited to marginal and acute care scenarios and often to validate instruments. This systematic review aimed to investigate the effectiveness of simulation-based training in improving in-hospital qualified healthcare teams' human factor skills. METHOD: A review protocol outlining the study was registered in PROSPERO. Using the PRISMA guidelines, the systematic search was conducted on September 28th, 2021, in eight major scientific databases. Three independent reviewers assessed title and abstract screening; full texts were evaluated by one reviewer. Content analysis was used to evaluate the evidence from the included studies. RESULTS: The search yielded 19,767 studies, of which 72 were included. The included studies were published between 2004 and 2021 and covered research from seven different in-hospital medical specialisms. Studies applied a wide range of assessment tools, which made it challenging to compare the effectiveness of human factor skills training across studies. The content analysis identified evidence for the effectiveness. Four recurring themes were identified: (1) Training human factor skills in qualified healthcare teams; (2) assessment of human factor skills; (3) combined teaching methods, and (4) retention and transfer of human factor skills. Unfortunately, the human factor skills assessments are variable in the literature, affecting the power of the result. CONCLUSION: Simulation-based training is a successful learning tool to improve qualified healthcare teams' human factor skills. Human factor skills are not innate and appear to be trainable similar to technical skills, based on the findings of this review. Moreover, research on retention and transfer is insufficient. Further, research on the retention and transfer of human factor skills from simulation-based training to clinical practice is essential to gain knowledge of the effect on patient safety.

[Acute appendicitis after colonoscopy].

Severe complications following colonoscopy are rare. This is a case report of a 44-year-old woman, who presented to an emergency department (ED) 24 hours following an uncomplicated colonoscopy performed in an out-patient clinic. Acute contrast-enhanced CT (CECT) was performed, showing acute appendicitis, which was later confirmed by a laparoscopy and histology. Weeks prior, the patient had been admitted to the ED with lower abdominal pain. On this occasion, CECT was performed, showing acute inflammation of the sigmoid colon.

Using virtual-reality simulation to ensure basic competence in hysteroscopy.

BACKGROUND: Hysteroscopy is a technically challenging procedure. Specialty curricula of obstetrics and gynaecology appraise hysteroscopy for trainees but there is no present evidence-based training program that certifies the fundamental technical skills before performance on patients. The objectives of this study were to develop and gather validity evidence for a simulation-based test that can ensure basic competence in hysteroscopy. METHODS: We used the virtual-reality simulator HystMentor™. Six experts evaluated the feasibility and clinical relevance of the simulator modules. Six modules were selected for the test and a pilot study was carried out. Subsequently, medical students, residents, and experienced gynaecologists were enrolled for testing. Outcomes were based on generated simulator metrics. Validity evidence was explored for all five sources of evidence (content, response process, internal structure, relations to other variables, consequences of testing). RESULTS: Inter-case reliability was high for four out of five metrics (Cronbach's alpha ≥ 0.80). Significant differences were identified when comparing the three groups' performances (p values < 0.05). Participants' clinical experience was significantly correlated to their simulator test score (Pearson's r = 0.49, p < 0.001). A single medical student managed to achieve the established pass/fail score (6.7% false positive) and three experienced gynaecologists failed the test (27.3% false negative). CONCLUSIONS: We developed a virtual-reality simulation-based test in hysteroscopy with supporting validity evidence. The test is intended to ensure competency in a mastery learning program where trainees practise on the simulator until they are able to pass before they proceed to supervised training on patients.