Consensus on technical procedures for simulation-based training in thoracic surgery: an international needs assessment.

OBJECTIVES: To identify and prioritize technical procedures for simulation-based training to be integrated into the thoracic surgical curriculum. METHODS: A 3-round Delphi survey was conducted from February 2022 to June 2022 among 34 key opinion leaders in thoracic surgery from 14 countries worldwide. The 1st round was a brainstorming phase to identify technical procedures that a newly qualified thoracic surgeon should be able to perform. All the suggested procedures were categorized, qualitatively analysed and sent to the 2nd round. The second round investigated: the frequency of the identified procedure at each institution, the number of thoracic surgeons that should be able to perform these procedures, the degree of risk to the patient if the procedure is performed by a non-competent thoracic surgeon and the feasibility of simulation-based education. In the 3rd round, elimination and re-ranking of the procedures from the 2nd round were performed. RESULTS: Response rates in the 3 iterative rounds were 80% (28 out of 34), 89% (25 out of 28) and 100% (25 out of 25) in the 1st, 2nd and 3rd round, respectively. Seventeen technical procedures were included for simulation-based training in the final prioritized list. The top 5 procedures were Video-Assisted Thoracoscopic Surgery (VATS) lobectomy, VATS segmentectomy, VATS mediastinal lymph node dissection, diagnostic flexible bronchoscopy and robotic-assisted thoracic surgery port placement, robotic-assisted thoracic surgery docking and undocking. CONCLUSIONS: The prioritized list of procedures represents a consensus of key thoracic surgeons worldwide. These procedures are suitable for simulation-based training and should be integrated in the thoracic surgical curriculum.

The left upper lobe challenge in video-assisted thoracoscopic surgery-use of a composite score to improve the assessment of simulated lobectomy.

AIM: The aim of this study is to develop a reliable composite score based on simulator metrics to assess competency in virtual reality video-assisted thoracoscopic surgery lobectomy and explore the benefits of combining it with expert rater assessments. METHODS: Standardized objective assessments (time, bleeding, economy of movement) and subjective expert rater assessments from 2 previous studies were combined. A linear mixed model including experience level, lobe and the number of previous simulated procedures was applied for the repeated measurements. Reliability for each of the 4 assessments was calculated using Cronbach's alpha. The Nelder-Mead numerical optimization algorithm was used for optimal weighting of scores. A pass-fail standard for the composite score was determined using the contrasting groups' method. RESULTS: In total, 123 virtual reality video-assisted thoracoscopic surgery lobectomies were included. Across the 4 different assessments, there were significant effects (P < 0.01) of experience, lobe, and simulator experience, but not for simulator attempts on bleeding (P = 0.98). The left upper lobe was significantly more difficult compared to other lobes (P = 0.02). A maximum reliability of 0.92 could be achieved by combining the standardized simulator metrics with standardized expert rater scores. The pass/fail level for the composite score when including 1 expert rater was 0.33. CONCLUSIONS: Combining simulator metrics with 1 or 2 raters increases reliability and can serve as a more objective method for assessing surgical trainees. The composite score may be used to implement a standardized and feasible simulation-based mastery training program in video-assisted thoracoscopic surgery lobectomy.

Assessing VATS competence based on simulated lobectomies of all five lung lobes.

OBJECTIVES: To determine the number of procedures and expert raters necessary to provide a reliable assessment of competence in Video-Assisted Thoracoscopic Surgery (VATS) lobectomy. METHODS: Three randomly selected VATS lobectomies were performed on a virtual reality simulator by participants with varying experience in VATS. Video recordings of the procedures were independently rated by three blinded VATS experts using a modified VATS lobectomy assessment tool (VATSAT). The unitary framework of validity was used to describe validity evidence, and generalizability theory was used to explore the reliability of different assessment options. RESULTS: Forty-one participants (22 novices, 10 intermediates, and 9 experienced) performed a total of 123 lobectomies. Internal consistency reliability, inter-rater reliability, and test-retest reliability were 0.94, 0.85, and 0.90, respectively. Generalizability theory found that a minimum of two procedures and four raters or three procedures and three raters were needed to ensure the overall reliability of 0.8. ANOVA showed significant differences in test scores between the three groups (P < 0.001). A pass/fail level of 19 out of 25 points was established using the contrasting groups' standard setting method, leaving one false positive (one novice passed) and zero false negatives (all experienced passed). CONCLUSION: We demonstrated validity evidence for a VR simulator test with different lung lobes, and a credible pass/fail level was identified. Our results can be used to implement a standardized mastery learning training program for trainees in VATS lobectomies that ensures that everyone reaches basic competency before performing supervised operations on patients.

Simulation-based VATS resection of the five lung lobes: a technical skills test.

BACKGROUND: Video-Assisted Thoracoscopic Surgery (VATS) lobectomy is an advanced procedure and to maximize patient safety it is important to ensure the competency of thoracic surgeons before performing the procedure. The objective of this study was to investigate validity evidence for a virtual reality simulator-based test including multiple lobes of the lungs. METHOD: VATS experts from the department of Cardiothoracic Surgery at Rigshospitalet, Copenhagen, Denmark, worked with Surgical Science (Gothenburg, Sweden) to develop VATS lobectomy modules for the LapSim® virtual reality simulator covering all five lobes of the lungs. Participants with varying experience in VATS were recruited and classified as either novice, intermediate, or experienced surgeons. Each participant performed VATS lobectomy on the simulator for three different randomly chosen lobes. Nine predefined simulator metrics were automatically recorded on the simulator. RESULTS: Twenty-two novice, ten intermediate, and nine experienced surgeons performed the test resulting in a total of 123 lobectomies. Analysis of Variances (ANOVA) found significant differences between the three groups for parameters: blood loss (p < 0.001), procedure time (p < 0.001), and total instrument path length (p = 0.03). These three metrics demonstrated high internal consistency and significant test-retest reliability was found between each of them. Relevant pass/fail levels were established for each of the three metrics, 541 ml, 30 min, and 71 m, respectively. CONCLUSION: This study provides validity evidence for a simulator-based test of VATS lobectomy competence including multiple lobes of the lungs. The test can be used to ensure basic competence at the end of a simulation-based training program for thoracic surgery trainees.