Augmenting mental imagery for robotic surgery using neurofeedback: results of a randomized controlled trial.

Background: Mental imagery (MI) can enhance surgical skills. Research has shown that through brain-computer interface (BCI), it is possible to provide feedback on MI strength. We hypothesized that adding BCI to MI training would enhance robotic skill acquisition compared with controls. Methods: Surgical novices were recruited. At baseline, participants completed the Mental Imagery Questionnaire (MIQ) and the Vandenburg Mental Rotation Test (MRT). Students also performed several tasks on a robotic simulator. Participants were stratified based on MIQ and robotic skill and randomized into three groups: controls, MI, and MI and BCI training. All participants completed five 2-h training sessions. One hour was devoted to practicing robotic skill on the simulator. Additionally, controls completed crosswords for one hour, the MI group completed MI training and crosswords for one hour, and the MI + BCI group completed MI training and MI-related BCI training. Following training, participants completed the same baseline assessments. A Kruskal-Wallis test was used to determine differences between groups. Mann-Whitney U tests were performed to determine specific differences between groups. Results: Twenty-seven undergraduates participated. There were post-test differences on the MRT and knot tying task. Sub-analyses revealed that the MI + BCI group significantly outperformed the other groups on knot tying. There were no appreciable differences between the control and MI groups on any measures. Conclusions: Augmenting MI training with BCI led to significantly enhanced MI and robotic skill acquisition than traditional MI or robotic training methods. To optimize surgical skill acquisition in robotic and other surgical skills curricula, educators should consider utilizing MI with BCI training.

Neuropsychological Differences Between Surgery Interns and Age-Matched Adults.

OBJECTIVE: The purpose of this study was to assess how neuropsychological factors differ between general surgery interns and normative data from age-matched adults in the general population. DESIGN: Participants completed a comprehensive neuropsychological assessment battery. Neuropsychological factors assessed included: executive function (Behavioral Rating Inventory of Executive Function, BRIEF), working memory (Wechsler Adult Intelligence Scale, or WAIS, digit span), psychomotor speed (WAIS coding, Trails A and B), selective attention (D2 Test of Attention), and problem solving (Tower of London, TOL). Data for all measures was compared to previously published normative data for age-matched, healthy adults in the general population using one-sample t-tests. SETTING: This study was completed at Indiana University School of Medicine in Indianapolis, IN, which is a large academic healthcare training institution. PARTICIPANTS: Postgraduate year 1 general surgery residents (PGY1s) voluntarily participated in this study. RESULTS: Twenty-six general surgery PGY1s completed all measures. We found that PGY1s had significantly better behavioral inhibition, working memory, selective attention, problem solving, and psychomotor speed than their counterparts in the general population (Table 1). Conversely, we found that PGY1s had significantly lower cognitive flexibility (p = 0.02) and ability to monitor task progress (p = 0.006) than the general population. CONCLUSIONS: The results from this study indicate that there are several neuropsychological factors that may help explain the high achievement of general surgery PGY1s. Assessment of these factors could aid general surgery programs in the selection and training of high-caliber residents. However, there are indicators that PGY1s struggle from cognitive inflexibility and task monitoring compared to the general population. These skills are needed to manage the complex and dynamic nature of surgical performance, so educators should consider methods to enhance junior residents' development of these characteristics.

Relationship between stress and resident non-technical skills during interdisciplinary trauma simulations.

BACKGROUND: Non-technical skills, such as communication and situation awareness, are vital for patient care and effective surgical team performance. Previous research has found that residents' perceived stress is associated with poorer non-technical skills; however, few studies have investigated the relationship between objectively assessed stress and non-technical skills. Accordingly, the purpose of this study was to assess the relationship between objectively assessed stress and non-technical skills. METHODS: Emergency medicine and surgery residents voluntarily participated in this study. Residents were randomly assigned to trauma teams to manage critically ill patients. Acute stress was assessed objectively using a chest-strap heart rate monitor, which measured average heart rate and heart rate variability. Participants also evaluated perceived stress and workload using the 6-item version of the State-Trait Anxiety Inventory and the Surgery Task Load Index. Non-technical skills were assessed by faculty raters using the non-technical skills scale for trauma. Pearson's correlation coefficients were used to examine relationships between all variables. RESULTS: Forty-one residents participated in our study. Heart rate variability (where higher values reflect lower stress) was positively correlated with residents' non-technical skills overall and leadership, communication, and decision-making. Average heart rate was negatively correlated with residents' communication. CONCLUSION: Higher objectively assessed stress was associated with poorer non-technical skills in general and nearly all non-technical skills domains of the T-NOTECHS. Clearly, stress has a deleterious effect on residents' non-technical skills during trauma situations, and given the importance of non-technical skills in surgical care, educators should consider implementing mental skills training to reduce residents' stress and optimize non-technical skills during trauma situations.

Detailing experienced nurse decision making during acute patient care simulations.

INTRODUCTION: Nurse decision making (DM) is critical for patient safety. Eye-tracking methods can effectively assess nurse DM. The purpose of this pilot study was to use eye-tracking methods to assess nurse DM during a clinical simulation. MATERIALS AND METHODS: Experienced nurses managed a simulated patient manikin who suffered from a stroke mid-simulation. We assessed nurses' gaze patterns prior to and after the stroke. DM in general was assessed by nursing faculty using a clinical judgement rubric, and dichotomously based on recognition of the stroke or not. RESULTS: Data from eight experienced nurses was examined. For the nurses who recognized the stroke, visual attention was focused on the vital sign monitor and patient's head, which suggest those locations were consistently examined for correct decision-makers. CONCLUSIONS: Dwell time on general AOIs was associated with poorer DM, which may reflect poorer pattern recognition. Eye-tracking metrics may be effective to objectively assess nurse DM.

Utilizing Eye Tracking to Assess Medical Student Non-Technical Performance During Scenario-Based Simulation: Results of a Pilot Study.

Background: Non-technical skills (NTS) are essential for safe surgical patient management. However, assessing NTS involves observer-based ratings, which can introduce bias. Eye tracking (ET) has been proposed as an effective method to capture NTS. The purpose of the current study was to determine if ET metrics are associated with NTS performance. Methods: Participants wore a mobile ET system and participated in two patient care simulations, where they managed a deteriorating patient. The scenarios featured several challenges to leadership, which were evaluated using a 4-point Likert scale. NTS were evaluated by trained raters using the Non-Technical Skills for Surgeons (NOTSS) scale. ET metrics included percentage of fixations and visits on areas of interest. Results: Ten medical students participated. Average visit duration on the patient was negatively correlated with participants' communication and leadership. Average visit duration on the patient's intravenous access was negatively correlated with participants' decision making and situation awareness. Conclusions: Our preliminary data suggests that visual attention on the patient was negatively associated with NTS and may indicate poor comprehension of the patient's status due to heightened cognitive load. In future work, researchers and educators should consider using ET to objectively evaluate and provide feedback on their NTS.

Objective Nontechnical Skills Measurement Using Sensor-based Behavior Metrics in Surgical Teams.

OBJECTIVE: The purpose of this study was to identify objective measures that predict surgeon nontechnical skills (NTS) during surgery. BACKGROUND: NTS are cognitive and social skills that impact operative performance and patient outcomes. Current methods for NTS assessment in surgery rely on observation-based tools to rate intraoperative behavior. These tools are resource intensive (e.g., time for observation or manual labeling) to perform; therefore, more efficient approaches are needed. METHOD: Thirty-four robotic-assisted surgeries were observed. Proximity sensors were placed on the surgical team and voice recorders were placed on the surgeon. Surgeon NTS was assessed by trained observers using the NonTechnical Skills for Surgeons (NOTSS) tool. NTS behavior metrics from the sensors included communication, speech, and proximity features. The metrics were used to develop mixed effect models to predict NOTSS score and in machine learning classifiers to distinguish between exemplar NTS scores (highest NOTSS score) and non-exemplar scores. RESULTS: NTS metrics were collected from 16 nurses, 12 assistants, 11 anesthesiologists, and four surgeons. Nineteen behavior features and overall NOTSS score were significantly correlated (12 communication features, two speech features, five proximity features). The random forest classifier achieved the highest accuracy of 70% (80% F1 score) to predict exemplar NTS score. CONCLUSION: Sensor-based measures of communication, speech, and proximity can potentially predict NOTSS scores of surgeons during robotic-assisted surgery. These sensing-based approaches can be utilized for further reducing resource costs of NTS and team performance assessment in surgical environments. APPLICATION: Sensor-based assessment of operative teams' behaviors can lead to objective, real-time NTS measurement.

Emotional Regulation in Surgery: Fostering Well-Being, Performance, and Leadership.

Emotional regulation is increasingly gaining acceptance as a means to improve well-being, performance, and leadership across high-stakes professions, representing innovation in thinking within the field of surgical education. As one part of a broader cognitive skill set that can be trained and honed, emotional regulation has a strong evidence base in high-stress, high-performance fields. Nevertheless, even as Program Directors and surgical educators have become increasingly aware of this data, with emerging evidence in the surgical education literature supporting efficacy, hurdles to sustainable implementation exist. In this white paper, we present evidence supporting the value of emotional regulation training in surgery and share case studies in order to illustrate practical steps for the development, adaptation, and implementation of emotional regulation curricula in three key developmental contexts: basic cognitive skills training, technical skills acquisition and performance, and preparation for independence. We focus on the practical aspects of each case to elucidate the challenges and opportunities of introducing and adopting a curricular innovation into surgical education. We propose an integrated curriculum consisting of all three applied contexts for emotional regulation skills and advocate for the dissemination of such a longitudinal curriculum on a national level.

Resilience matters: Student perceptions of the impact of COVID-19 on medical education.

INTRODUCTION: We assessed students' perception of the impact of the pandemic on their well-being, education, academic achievement, and whether grit and resilience alter students' ability to mitigate the stress associated with disruptions in education. We hypothesized that students would report a negative impact, and those with higher grit and resilience scores would be less impacted. METHODS: A multidisciplinary team of educators created and distributed a survey to medical students. Survey results were analyzed using descriptive statistics, ANOVA, and multivariate linear regressions. A p-value <.05 was considered statistically significant. RESULTS: A total of 195 students were included in the study. Approximately 92% reported that clinical education was negatively affected, including participants with higher grit scores. Students with higher resilience scores were more optimistic about clinical education. Those with higher resilience scores were less likely to report anxiety, insomnia, and tiredness. CONCLUSION: More resilient students were able to manage the stress associated with the disruption in their education. Resiliency training should be year-specific, and integrated into the UME curriculum due to the different demands each year presents.

A Competency-based Laparoscopic Cholecystectomy Curriculum Significantly Improves General Surgery Residents' Operative Performance and Decreases Skill Variability: Cohort Study.

OBJECTIVE: To demonstrate the feasibility of implementing a CBE curriculum within a general surgery residency program and to evaluate its effectiveness in improving resident skill. SUMMARY OF BACKGROUND DATA: Operative skill variability affects residents and practicing surgeons and directly impacts patient outcomes. CBE can decrease this variability by ensuring uniform skill acquisition. We implemented a CBE LC curriculum to improve resident performance and decrease skill variability. METHODS: PGY-2 residents completed the curriculum during monthly rotations starting in July 2017. Once simulator proficiency was reached, residents performed elective LCs with a select group of faculty at 3 hospitals. Performance at curriculum completion was assessed using LC simulation metrics and intraoperative operative performance rating system scores and compared to both baseline and historical controls, comprised of rising PGY-3s, using a 2-sample Wilcoxon rank-sum test. PGY-2 group's performance variability was compared with PGY-3s using Levene robust test of equality of variances; P < 0.05 was considered significant. RESULTS: Twenty-one residents each performed 17.52 ± 4.15 consecutive LCs during the monthly rotation. Resident simulated and operative performance increased significantly with dedicated training and reached that of more experienced rising PGY-3s (n = 7) but with significantly decreased variability in performance ( P = 0.04). CONCLUSIONS: Completion of a CBE rotation led to significant improvements in PGY-2 residents' LC performance that reached that of PGY-3s and decreased performance variability. These results support wider implementation of CBE in resident training.

Does the advanced training in laparoscopic suturing enhance laparoscopic suturing skill beyond fundamentals of laparoscopic surgery?

BACKGROUND: Laparoscopic suturing is associated with a steep learning curve. Hence, many general surgery graduate residents entering fellowship have reportedly not been able to proficiently suture laparoscopically despite achieving Fundamentals of Laparoscopic Surgery certification. To address this deficiency, the Advanced Training in Laparoscopic Suturing curriculum was developed. This study aimed to compare the effectiveness of the Advanced Training in Laparoscopic Suturing curriculum in improving laparoscopic suturing skills compared with Fundamentals of Laparoscopic Surgery training. METHODS: Novices were enrolled in a prospective randomized controlled study. All novices followed proficiency-based training on Fundamentals of Laparoscopic Surgery peg-transfer and intracorporeal suturing. Students were then stratified based on their peg-transfer performance and randomized into an Advanced Training in Laparoscopic Suturing or Fundamentals of Laparoscopic Surgery group. The Advanced Training in Laparoscopic Suturing group trained on 3 of the 6 Advanced Training in Laparoscopic Suturing tasks (needle handling, offset forehand suturing, confined space suturing), while the Fundamentals of Laparoscopic Surgery group was assigned more stringent suturing performance goals. Each group trained for an additional 6 hours, after which the laparoscopic suturing performance of the 2 groups was compared on a Nissen fundoplication porcine model. RESULTS: Thirty-nine medical students were enrolled in the study; 17 (11 males and 6 females) completed the study protocol (44%). Controlling for confounders including the student suturing performance at the end of stage-1 training, the Advanced Training in Laparoscopic Suturing group at the porcine model was significantly faster/safer (coefficient = 102.7, P = .037), and more skilled (coefficient = 19.1, P = .048) compared with the Fundamentals of Laparoscopic Surgery group. CONCLUSION: Compared with Fundamentals of Laparoscopic Surgery training alone the Advanced Training in Laparoscopic Suturing curriculum further enhances the laparoscopic suturing skill of novices. These findings support incorporating Advanced Training in Laparoscopic Suturing into existing skills curricula.

Stress and resident interdisciplinary team performance: Results of a pilot trauma simulation program.

BACKGROUND: Excessive stress negatively impacts surgical residents' technical performance. The effect of stress on trainee nontechnical skills, however, is less well studied. Given that nontechnical skills are known to impact clinical performance, the purpose of this study was to assess the relationship between residents' perceived stress and nontechnical skills during multidisciplinary trauma simulations. METHODS: First-year surgery and emergency medicine residents voluntarily participated in this study. Residents participated in 3 trauma simulations across 2 training sessions in randomly assigned teams. Each team's nontechnical skills were evaluated by faculty using the Trauma Nontechnical Skills scale. The Trauma Nontechnical Skills scale consists of 5 items: leadership, cooperation, communication, assessment, and situation awareness/coping with stress. After each scenario, residents completed the 6-item version of the State-Trait Anxiety Inventory and the Surgery Task Load Index to detail their perceived stress and workload during scenarios. Linear regressions were run to assess relationships between stress, workload, and nontechnical skills. RESULTS: Twenty-five residents participated in the first simulation day, and 24 residents participated in the second simulation day. Results from regressions revealed that heightened stress and workload predicted significantly lower nontechnical skills performance during trauma scenarios. In regard to specific aspects of nontechnical skills, residents' heightened stress and workload predicted statistically significant lower situation awareness and decision-making during trauma scenarios. CONCLUSION: Residents' perceived stress and workload significantly impaired their nontechnical skills during trauma simulations. This finding highlights the need to offer stress management and performance-optimizing mental skills training to trainees to lower their stress and optimize nontechnical skills performance during challenging situations.

Mastering Stress: Mental Skills and Emotional Regulation for Surgical Performance and Life.

Mental skills and emotional regulation training are gaining acceptance in surgical education as vital elements of surgeon development. These skills can effectively enhance technical skill development, improve well-being, and promote career longevity. There is evidence emerging in the surgical education literature to support the incorporation of mental skills and emotional regulation training curricula in residency training. In this study, we present the existing evidence supporting the use of this training with high performers to reduce stress and optimize well-being and performance. We also consider the recent research emerging in surgical education that offers validity evidence for use of mental skills training with surgeons. Finally, we provide a framework to guide the incorporation of these skills throughout the career of a surgeon and suggest methods to promote the development of mental skills training efforts nationally.

Characterizing robotic surgical expertise: An exploratory study of neural activation during mental imagery of robotic suturing.

BACKGROUND: Mental imagery (MI) aids skill acquisition, however, it is unclear to what extend MI is used by experienced surgeons. The purpose of this study was to assess differences in MI of participants with varying surgical expertise in robotic surgery. METHODS: Students, residents, and surgeons completed the Mental Imagery Questionnaire to assess MI for robotic suturing. Participants then completed robotic simulator tasks, and imagined performing robotic suturing while being assessed with electroencephalogram (EEG). RESULTS: Attending surgeons reported higher MI for robotic suturing, and EEG revealed higher neural activation during imagery of robotic suturing than other groups. CONCLUSIONS: Experienced surgeons displayed higher MI ability for robotic suturing, and displayed higher cortical activity in the frontal and parietal areas of the brain, which is associated with more advanced motor imagery. MI appears to be a component of robotic surgery expertise.

Surgeon stress negatively affects their non-technical skills in the operating room.

BACKGROUND: Poor surgeons' non-technical skills (NTS) and excessive stress and workload are known contributors to surgical errors. Our aim was to examine the relationship between surgeons' stress and workload, and their observed NTS intraoperatively. METHODS: Surgeon's NTS were rated in the operating room (OR) by trained observers. Surgeon stress, workload, familiarity with the OR team, prior experience, and case difficulty were captured. Relationships between variables were assessed. RESULTS: Fifteen surgeons participated in our study. Agreement among raters was high for NTS observations (ICC range = 0.56-0.96). Stress was negatively correlated with situation awareness, and workload was negatively correlated with decision making. Less familiarity among the team was correlated with higher stress. CONCLUSIONS: Surgeons' stress and workload negatively affected their NTS in the OR. Further, unfamiliarity with the surgical team contributed to surgeon's stress. Methods to reduce surgeons' stress and workload such as mental skills training should be considered.

Association of Medical Students' Stress and Coping Skills With Simulation Performance.

INTRODUCTION: Medical students are vulnerable to experience stress, as they are routinely confronted with stressors. Acute stress can reduce students' performance on examinations, and chronic stress can contribute to cognitive disorders. Conversely, stress coping skills can reduce trainees' anxiety. Thus, stress coping skills may help students manage stress effectively and better maintain clinical performance. The goal of this study was to assess the relationship between medical students' stress, workload, stress coping skills, performance-enhancing mental skills, and clinical performance during a simulated clinical scenario. METHODS: During their surgery clerkship rotation, third-year medical students participated in a simulated scenario designed to assess their ability to care for an acutely ill surgical patient. Participants' physiological stress was assessed using heart rate (HR) monitors during the simulation, their perceived stress using the State-Trait Anxiety Inventory, and workload using the NASA-Task Load Index immediately after. Clinical performance was assessed using a global rating scale. Stress coping skills were also assessed. The relationship between performance, stress level, workload, and coping skills was examined. RESULTS: Forty-one third-year medical students voluntarily participated in the study. Participants' clinical performance was negatively correlated with perceived stress and workload during the scenario (P < 0.05). A stepwise linear regression model revealed that higher HR was the main predictor of poorer clinical performance (P < 0.05). CONCLUSIONS: In this study, medical students' HR was associated with poorer performance during a simulated clinical scenario. Adaptive stress coping skills may allow medical students to manage stressful situations and better maintain performance.

How resilient is your team? Exploring healthcare providers' well-being during the COVID-19 pandemic.

BACKGROUND: The global COVID-19 pandemic has placed tremendous physical and mental strain on the US healthcare system. Studies examining the effects of outbreaks have demonstrated both an increased prevalence and long-term development of Post-Traumatic Stress Disorder (PTSD) symptoms in healthcare providers. We sought to assess the impact of the COVID-19 pandemic on the psychological well-being of medical providers, medical trainees, and administrators at a large academic center to identify stressors and moderators to guide future mental health and hospital-system interventions. METHODS: A 42-item survey examining specific stressors, grit, and resilience was widely distributed to physicians, residents, fellows, and administrators a large academic institution for departmental distribution. Survey results were analyzed using descriptive statistics, ANOVA, and multivariate linear regressions. A p-value <0.05 was considered statistically significant. RESULTS: A total of 785 participants completed the survey. The majority of respondents rated their stress to be significantly increased during the pandemic. Respondents' fear of transmitting the virus to their family members was a significant stressor. Higher resilience was associated with lower stress, anxiety, fatigue, and sleep disturbances. Overall, respondents felt supported by their departments and institution and felt contingency plans and personal protective equipment were adequate. CONCLUSIONS: Healthcare workers have increased resilience in the face of heightened stress during a pandemic. Higher resilience and grit were protective factors in managing personal and system-level stressors at the peak of the COVID-19 pandemic in our institution. Implementing an intervention designed to enhance healthcare workers' resilience in response to the COVID-19 pandemic is warranted.

A video anchored rating scale leads to high inter-rater reliability of inexperienced and expert raters in the absence of rater training.

BACKGROUND: Our objective was to assess the impact of incorporating videos in a behaviorally anchored performance rating scale on the inter-rater reliability (IRR) of expert, intermediate and novice raters. METHODS: The Intra-corporeal Suturing Assessment Tool (ISAT) was modified to include short video clips demonstrating poor, average, and expert performances. Blinded raters used this tool to assess videos of trainees performing suturing on a porcine model. Three attending surgeons, 4 residents, and 4 novice raters participated; no rater training was provided. The IRR was then compared among rater groups. RESULTS: The IRR using the modified ISAT was high at 0.80 (p < 0.001). Ratings were significantly correlated with trainee objective suturing scores for all rater groups (experts: R = 0.84, residents: R = 0.81, and novices: R = 0.69; p < 0.001). CONCLUSIONS: Incorporating video anchors (to define performance) in the ISAT led to high IRR and enabled novices to achieve similar consistency in their ratings as experts.

Optimizing learner engagement during mental skills training: A pilot study of small group vs. individualized training.

BACKGROUND: Mental skills limit surgical residents' skill decay resulting from stress. However, optimal mental skills delivery is unknown. We sought to compare the impact of implementing our curriculum in small groups and individually. METHODS: At baseline, residents completed assessments of mental skills and laparoscopic suturing. Residents then participated in a comprehensive mental skills curriculum at two institutions. At the first institution, residents completed small group training, whereas residents at the second institution trained individually. Following mental skills training, residents completed FLS training, at which time they completed the Short State Stress Questionnaire detailing their engagement. At post-test, residents completed baseline assessments again. RESULTS: Twenty-one residents completed training. Small groups were less engaged after training than individuals (Group average engagement: 26.4 vs. Individual average engagement: 29.6, p = 0.06). CONCLUSIONS: Delivering mental skills individually facilitates greater engagement than training in small groups, but regardless of delivery method, our MSC can achieve the same outcomes on surgical performance.

Development of a fundamentals of endoscopic surgery proficiency-based skills curriculum for general surgery residents.

BACKGROUND: Fundamentals of Endoscopic Surgery (FES) has become a board certification requirement for general surgery residents. While the FES program provides a robust didactic curriculum, an endoscopic skills curriculum is lacking for this high stakes assessment. The aims of this study were to develop a proficiency-based endoscopic skills curriculum and assess its effectiveness on success in the FES exam. METHODS: Endoscopy experts developed a multiple-choice questionnaire based on the FES online didactics. Five training cases from the GI Mentor II simulator were selected, and expert performance defined proficiency levels for each case. Participating surgery residents were required to review online didactics and achieve proficiency twice on selected simulator cases. The multiple-choice questionnaire, simulator-generated metrics of two endoscopy cases, Global Assessment of Gastrointestinal Endoscopic Skills (GAGES), NASA-Task Load Index (TLX), and the manual portion of the FES exam were used for assessment before and after training. The curriculum was implemented either alongside a clinical endoscopy rotation or independent of the rotation. Clinical endoscopic skills of participants with a dedicated rotation were assessed using GAGES. RESULTS: Twenty-eight general surgery residents (PGY 2-5) participated in the study, of which 25 (89%) completed the curriculum. Scores of the multiple-choice questionnaire and all simulator-generated metrics improved in the post-training assessment, with the exception of the percentage of mucosal surface examined, which was slightly decreased. Simulated and clinical GAGES scores and the NASA-TLX score improved after training. Performance scores on four of five FES exam tasks were significantly improved. CONCLUSIONS: The proficiency-based endoscopic skills curriculum was successfully implemented both alongside the clinical endoscopy rotation and independent of the rotation. Participating residents acquired skills to pass the FES exam. This curriculum will be valuable to general surgery residency programs.