Bimanual Psychomotor Performance in Neurosurgical Resident Applicants Assessed Using NeuroTouch, a Virtual Reality Simulator.

OBJECTIVE: Current selection methods for neurosurgical residents fail to include objective measurements of bimanual psychomotor performance. Advancements in computer-based simulation provide opportunities to assess cognitive and psychomotor skills in surgically naive populations during complex simulated neurosurgical tasks in risk-free environments. This pilot study was designed to answer 3 questions: (1) What are the differences in bimanual psychomotor performance among neurosurgical residency applicants using NeuroTouch? (2) Are there exceptionally skilled medical students in the applicant cohort? and (3) Is there an influence of previous surgical exposure on surgical performance? DESIGN: Participants were instructed to remove 3 simulated brain tumors with identical visual appearance, stiffness, and random bleeding points. Validated tier 1, tier 2, and advanced tier 2 metrics were used to assess bimanual psychomotor performance. Demographic data included weeks of neurosurgical elective and prior operative exposure. SETTING: This pilot study was carried out at the McGill Neurosurgical Simulation Research and Training Center immediately following neurosurgical residency interviews at McGill University, Montreal, Canada. PARTICIPANTS: All 17 medical students interviewed were asked to participate, of which 16 agreed. RESULTS: Performances were clustered in definable top, middle, and bottom groups with significant differences for all metrics. Increased time spent playing music, increased applicant self-evaluated technical skills, high self-ratings of confidence, and increased skin closures statistically influenced performance on univariate analysis. A trend for both self-rated increased operating room confidence and increased weeks of neurosurgical exposure to increased blood loss was seen in multivariate analysis. CONCLUSIONS: Simulation technology identifies neurosurgical residency applicants with differing levels of technical ability. These results provide information for studies being developed for longitudinal studies on the acquisition, development, and maintenance of psychomotor skills. Technical abilities customized training programs that maximize individual resident bimanual psychomotor training dependant on continuously updated and validated metrics from virtual reality simulation studies should be explored.

Assessing bimanual performance in brain tumor resection with NeuroTouch, a virtual reality simulator.

BACKGROUND: Validated procedures to objectively measure neurosurgical bimanual psychomotor skills are unavailable. The NeuroTouch simulator provides metrics to determine bimanual performance, but validation is essential before implementation of this platform into neurosurgical training, assessment, and curriculum development. OBJECTIVE: To develop, evaluate, and validate neurosurgical bimanual performance metrics for resection of simulated brain tumors with NeuroTouch. METHODS: Bimanual resection of 8 simulated brain tumors with differing color, stiffness, and border complexity was evaluated. Metrics assessed included blood loss, tumor percentage resected, total simulated normal brain volume removed, total tip path lengths, maximum and sum of forces used by instruments, efficiency index, ultrasonic aspirator path length index, coordination index, and ultrasonic aspirator bimanual forces ratio. Six neurosurgeons and 12 residents (6 senior and 6 junior) were evaluated. RESULTS: Increasing tumor complexity impaired resident bimanual performance significantly more than neurosurgeons. Operating on black vs glioma-colored tumors resulted in significantly higher blood loss and lower tumor percentage, whereas altering tactile cues from hard to soft decreased resident tumor resection. Regardless of tumor complexity, significant differences were found between neurosurgeons, senior residents, and junior residents in efficiency index and ultrasonic aspirator path length index. Ultrasonic aspirator bimanual force ratio outlined significant differences between senior and junior residents, whereas coordination index demonstrated significant differences between junior residents and neurosurgeons. CONCLUSION: The NeuroTouch platform incorporating the simulated scenarios and metrics used differentiates novice from expert neurosurgical performance, demonstrating NeuroTouch face, content, and construct validity and the possibility of developing brain tumor resection proficiency performance benchmarks.