Comprehensive Multicenter Graduate Surgical Education Initiative Incorporating Entrustable Professional Activities, Continuous Quality Improvement Cycles, and a Web-Based Platform to Enhance Teaching and Learning.

BACKGROUND: It is increasingly important for faculty to teach deliberately and provide timely, detailed, and formative feedback on surgical trainee performance. We initiated a multicenter study to improve resident evaluative processes and enhance teaching and learning behaviors while engaging residents in their education. STUDY DESIGN: Faculty from 7 US postgraduate training programs rated resident operative performances using the perioperative briefing, intraoperative teaching, debriefing model, and rated patient visits/academic performances using the entrustable professional activities model via a web-based platform. Data were centrally analyzed and iterative changes made based on participant feedback, individual preferences, and database refinements, with trends addressed using the Plan, Do, Check, Act improvement methodology. RESULTS: Participants (92 surgeons, 150 residents) submitted 3,880 assessments during July 2014 through September 2017. Evidence of preoperative briefings improved from 33.9% ± 2.5% to 95.5% ± 1.5% between April and September 2014 compared with April and September 2017 (p < 0.001). Postoperative debriefings improved from 10.6% ± 2.7% to 90.2% ± 2.5% (p < 0.001) for the same period. Meaningful self-reflection by residents improved from 28.6% to 67.4% (p < 0.001). The number of assessments received per resident during a 6-month period increased from 6.4 ± 6.2 to 13.4 ± 10.1 (p < 0.003). Surgeon-entered assessments increased from 364 initially to 685 in the final period, and the number of resident assessments increased from 308 to 445. We showed a 4-fold increase in resident observed activities being rated. CONCLUSIONS: By adopting recognized educational models with repeated Plan, Do, Check, Act cycles, we increased the quality of preoperative learning objectives, showed more frequent, detailed, and timely assessments of resident performance, and demonstrated more effective self-reflection by residents. We monitored trends, identified opportunities for improvement and successfully sustained those improvements over time, applying a team-based approach.

Perioperative self-reflection among surgical residents.

BACKGROUND: We studied prevalence and predictors of meaningful self-reflection among surgical residents and with prompting/structured interventions, sought to improve/sustain resident skills. METHODS: Residents from six programs recorded 1032 narrative self-reflective comments (120 residents), using a web-based platform. If residents identified something learned or to be improved, self-reflection was deemed meaningful. Independent variables PGY level, resident/surgeon gender, study site/Phase1: July2014-August2015 vs. Phase2: September2015-September2016) were analyzed. RESULTS: Meaningful self-reflection was documented in 40.6% (419/1032) of entries. PGY5's meaningfully self-reflected less than PGY1-4's, 26.1% vs. 49.6% (p = 0.002). In multivariate analysis, resident narratives during Phase 2 were 4.7 times more likely to engage in meaningful self-reflection compared to Phase1 entries (p < 0.001). Iterative changes during Phase2 showed a 236% increase in meaningful self-reflection, compared to Phase1. CONCLUSIONS: Surgical residents uncommonly practice meaningful self-reflection, even when prompted, and PGY5/chief residents reflect less than more junior residents. Substantial/sustained improvements in resident self-reflection can occur with both training and interventions.

Do female surgeons learn or teach differently?

BACKGROUND: Gender and/or gender-stereotypes might influence surgical education. We hypothesized that female surgeons might focus their learning and teaching differently from male surgeons. METHODS: Residents and surgeons (multi-institutional) individually recorded preoperatively discussed learning objectives (LO) for matching cases. Narratives were classified as knowledge-based, skill-based, or attitude-based. Multinomial logistic regression analyses, LO = dependent variable; independent variables = resident/surgeon gender, PGY level, timing of entry-to-procedure date, and quarters-of-year. RESULTS: 727 LOs from 125 residents (41% female) and 49 surgeons (20% female) were classified. Female residents were 1.4 times more likely to select knowledge over skill. With female surgeons, residents were 1.6 and 2.1 times more likely to select knowledge over skill and attitude over skill than if the surgeon was male. PGY 4/5 residents chose attitude-based LOs over junior residents. CONCLUSION: Resident, surgeon gender and year-of-training influence learning objectives. Whether this reflects gender stereotyping by residents or differences in attending teaching styles awaits further exploration.

A taxonomy of perioperative surgical learning: Trending resident skill acquisition.

BACKGROUND: Resident and curriculum evaluation require tracking surgical resident operative performance, yet what and when to measure remains unclear. METHODS: From a multi-institutional database, we reviewed 611 resident/surgeon-paired assessments of ACGME Milestones and modified OPRS ratings for different cases and postgraduate years. RESULTS: Faculty Milestone ratings increased with each PGY (p=<0.001) and correlated with resident self-ratings (ICC = 0.83). Mean OPRS scores increased in small increments with substantial intra-year variability. Progression among individual OPRS subcategories was not apparent from more global analyses. Interestingly, male faculty offered lower ratings than female faculty. CONCLUSIONS: Milestones and modified mean OPRS ratings suggest residents are learning, yet lack sufficient discrimination for promotion or curricular analysis. Differential progression through OPRS subcategories suggests a taxonomy of surgical learning that can be tailored to focus on different skills at each point in the training continuum. The effect of faculty gender on resident ratings awaits further study.