Setting proficiency standards for simulation-based mastery learning of short antegrade femoral nail osteosynthesis: a multicenter study.

BACKGROUND AND PURPOSE: Orthopedic trainees frequently perform short antegrade femoral nail osteosynthesis of trochanteric fractures, but virtual reality simulation-based training (SBT) with haptic feedback has been unavailable. We explored a novel simulator, with the aim of gathering validity evidence for an embedded test and setting a credible pass/fail standard allowing trainees to practice to proficiency. PATIENTS AND METHODS: The research, conducted from May to September 2020 across 3 Danish simulation centers, utilized the Swemac TraumaVision simulator for short antegrade femoral nail osteosynthesis. The validation process adhered to Messick's framework, covering all 5 sources of validity evidence. Participants included novice groups, categorized by training to plateau (n = 14) or to mastery (n = 10), and experts (n = 9), focusing on their performance metrics and training duration. RESULTS: The novices in the plateau group and experts had hands-on training for 77 (95% confidence interval [CI] 59-95) and 52 (CI 36-69) minutes while the plateau test score, defined as the average of the last 4 scores, was 75% (CI 65-86) and 96% (CI 94-98) respectively. The pass/fail standard was established at the average expert plateau test score of 96%. All novices in the mastery group could meet this standard and interestingly without increased hands-on training time (65 [CI 46-84] minutes). CONCLUSION: Our study provides supporting validity evidence from all sources of Messick's framework for a simulation-based test in short antegrade nail osteosynthesis of intertrochanteric hip fracture and establishes a defensible pass/fail standard for mastery learning of SBT. Novices who practiced using mastery learning were able to reach the pre-defined pass/fail standard and outperformed novices without a set goal for external motivation.

Using a novel virtual-reality simulator to assess performance in lumbar puncture: a validation study.

BACKGROUND: A lumbar puncture procedure's success depends on a competent physician minimizing the risk of failing to get a sample and avoiding complications such as post-dural headache. A new virtual-reality simulator might be helpful in deciding when a physician is competent to perform lumbar puncture. We aimed to investigate validity evidence for a simulator-based test in lumbar puncture and establish a pass/fail standard to allow a mastery learning training program. METHODS: Validity evidence was investigated using Messick's framework by including participants who were novices, intermediates, or experienced in lumbar puncture. Each participant performed two lumbar puncture procedures on the simulator, and fifty-nine predefined simulator metrics were automatically recorded. Cronbach's alpha was used to explore internal consistency reliability. Intergroup comparisons were made using independent sample t-tests with Tukey's correction for multiple comparisons. The learning effect was explored using paired sample t-test analysis, and a pass/fail standard was established using the contrasting groups' method. RESULTS: 73 novices, 18 intermediates, and 19 physicians performed the test resulting in a total of 220 procedures. 25 metrics (42.4%) had good discriminatory ability, and the reliability of these metrics was good, Cronbach's α = 0.81. The experienced physicians were significantly better than the novices (18.3 vs. 13.3, p < 0.001), and the pass/fail standard was established at 16 points. This standard resulted in 22 (30.1%) novices passing (i.e., false positives) and 5 (26.3%) physicians failing (i.e., false negatives). CONCLUSION: This study provides validity evidence for a simulator-based test of lumbar puncture competence. The test can help ensure basic competence at the end of a simulation-based training program for trainees, i.e., a mastery learning training program.

The left upper lobe challenge in video-assisted thoracoscopic surgery-use of a composite score to improve the assessment of simulated lobectomy.

AIM: The aim of this study is to develop a reliable composite score based on simulator metrics to assess competency in virtual reality video-assisted thoracoscopic surgery lobectomy and explore the benefits of combining it with expert rater assessments. METHODS: Standardized objective assessments (time, bleeding, economy of movement) and subjective expert rater assessments from 2 previous studies were combined. A linear mixed model including experience level, lobe and the number of previous simulated procedures was applied for the repeated measurements. Reliability for each of the 4 assessments was calculated using Cronbach's alpha. The Nelder-Mead numerical optimization algorithm was used for optimal weighting of scores. A pass-fail standard for the composite score was determined using the contrasting groups' method. RESULTS: In total, 123 virtual reality video-assisted thoracoscopic surgery lobectomies were included. Across the 4 different assessments, there were significant effects (P < 0.01) of experience, lobe, and simulator experience, but not for simulator attempts on bleeding (P = 0.98). The left upper lobe was significantly more difficult compared to other lobes (P = 0.02). A maximum reliability of 0.92 could be achieved by combining the standardized simulator metrics with standardized expert rater scores. The pass/fail level for the composite score when including 1 expert rater was 0.33. CONCLUSIONS: Combining simulator metrics with 1 or 2 raters increases reliability and can serve as a more objective method for assessing surgical trainees. The composite score may be used to implement a standardized and feasible simulation-based mastery training program in video-assisted thoracoscopic surgery lobectomy.

Surgical experience is predictive for bladder tumour resection quality.

OBJECTIVES: To assess the resection quality of transurethral bladder tumour resection (TURBT) and the association to surgeon experience depending on the presence of detrusor muscle. METHODS: A retrospective study on 640 TURBT procedures performed at Zealand University Hospital, Denmark, from 1 January 2015 - 31 December 2016. Data included patient characteristics, procedure type, surgeon category, supervisor presence, surgical report data, pathological data, complications data and recurrence data. Analysis was performed using simple and multiple logistic regression on the association between surgeon experience and the presence of detrusor muscle in resected tissue from TURBT. RESULTS: Supervised junior residents had significant lower detrusor muscle presence (73%) compared with consultants (83%) (OR = 0.4, 95% CI = 0.21-0.83). Limitations were the retrospective design and the diversity of included TURBT. CONCLUSIONS: It was found that surgical experience predicts detrusor muscle presence and supervised junior residents performing TURBT on patients resulted in less detrusor muscle than consultants.

Does computer use affect the incidence of distal arm pain? A one-year prospective study using objective measures of computer use.

PURPOSE: To study how objectively recorded mouse and keyboard activity affects distal arm pain among computer workers. METHODS: Computer activities were recorded among 2,146 computer workers. For 52 weeks mouse and keyboard time, sustained activity, speed and micropauses were recorded with a software program installed on the participants' computers. Participants reported weekly pain scores via the software program for elbow, forearm and wrist/hand as well as in a questionnaire at baseline and 1-year follow up. Associations between pain development and computer work were examined for three pain outcomes: acute, prolonged and chronic pain. RESULTS: Mouse time, even at low levels, was associated with acute pain in a similar way for all the examined regions. There were no exposure-response threshold patterns. Keyboard time had no effect. Mouse and keyboard sustained activity, speed and micropauses were not risk factors for acute pain, nor did they modify the effects of mouse or keyboard time. Computer usage parameters were not associated with prolonged or chronic pain. A major limitation of the study was low keyboard times. CONCLUSION: Computer work was not related to the development of prolonged or chronic pain. Mouse time was associated with acute distal arm pain, but the impact was quite small.