Validity and reliability of a virtual reality upper gastrointestinal simulator and cross validation using structured assessment of individual performance with video playback.

BACKGROUND: This study aims to evaluate the ability of an upper gastrointestinal virtual reality simulator to assess skills in endoscopy, and to validate its metrics using a video-endoscopic (VES) technique. METHODS: The 32 participants in this study were requested to undertake two cases on the simulator (Simbionix, Israel). Each module was repeated twice. The simulator's metrics of performance were used for analysis. two blinded observers rated performance watching the simulator's playback feature. RESULTS: There were 11 novices (group 1), 11 trainees with intermediate experience (10-50 procedures, group 2), and 10 experienced endoscopists (>200 procedures, group 3). There was a significant difference in the total time required to perform the procedure (p < 0.001), percentage of mucosa visualized (p < 0.001), percentage of pathologies visualized (p < 0.001), and number of inappropriate retroflexions (p = 0.015) across the three groups. The reliability of assessment on the simulator was greater than 0.80 for all parameters. The VES assessment also was able to discriminate performance across the groups (p < 0.001). There was a significant correlation between the VES score and the percentage of mucosa visualized (rho = 0.60; p < 0.001). CONCLUSIONS: The upper gastrointestinal simulator may be a useful tool for determining whether a trainee has achieved a desired level of competence in endoscopy. The next step will be to validate the VES score in real procedures.

Validation of a web-based training tool for lumbar puncture.

WebSET is an Internet based educational tool that can be used on any standard personal computer. It has been developed by a European collaboration and integrates high quality courseware, self-assessment exercises, video clips and VR simulation. This pilot study was carried out to validate the lumbar puncture (LP) module in training. Subjects who had never performed an LP participated in the study. The subjects were randomized into 2 groups: 1) underwent training and 2) control group. Both groups performed a pre-test and post-test LP on a synthetic mannequin. There was a significant improvement in the training group in terms of performance assessment as compared to the control group. This study showed that there was a significant improvement in the performance of the procedure and in procedural knowledge after training with WebSET.