Evaluating Performance and Autonomy Levels of Previous Preliminary Surgery Interns.

INTRODUCTION: Surgery residents who complete a nondesignated preliminary year have an additional year of training compared to those who begin as categorical residents. While this additional year is sometimes perceived negatively, these more experienced residents may outperform traditional categorical (TC) residents in their first year of training. METHODS: Operative assessment ratings were recorded for first year categorical general surgery residents in the United States between 2015 and 2023 using the Society for Improving Medical and Professional Learning assessment platform. Residents were categorized based on the completion of a nondesignated preliminary year ("Previous Prelim" [PP]) or not ("Traditional Categorical"). Ratings were analyzed using generalized mixed effects models. Performance and autonomy outcomes were dichotomized: "less experience" or "more experience" and "no autonomy" or "some autonomy", respectively. Fixed effects included academic month and case complexity, while random effects included resident, faculty, program, and procedure. RESULTS: A total of 34,353 evaluations from 86 general surgery programs were collected. Of these, 829 were evaluations from PP residents. Faculty ratings of PP versus TC revealed no differences in adjusted probabilities of achieving a "more experience" rating (82% versus 76%, P = 0.26) but a higher adjusted probability of achieving a "some autonomy" rating (88% versus 80%, P = 0.04) for PP compared to TC. Analysis of resident self-reported ratings revealed higher adjusted probabilities of a "more experience" rating (77% versus 50%, P = 0.01) and "some autonomy" rating (87% versus 73%; P = 0.02) for PP compared to TC. CONCLUSIONS: First year general surgery residents who previously completed a preliminary year have similar operative performance faculty ratings when compared to their peers.

National Profile of the ACGME Milestones 1.0 and 2.0 within General Surgery: A Seven-Year National Study from 2014 to 2021.

PURPOSE: The Accreditation Council for Graduate Medical Education (ACGME) introduced General Surgery Milestones 1.0 in 2014 and Milestones 2.0 in 2020 as steps toward competency-based training. Analysis will inform residency programs on curriculum development, assessment, feedback, and faculty development. This study describes the distributions and trends for Milestones 1.0 and 2.0 ratings and proportion of residents not achieving the level 4.0 graduation target. METHODS: A deidentified dataset of milestone ratings for all ACGME-accredited General Surgery residency programs in the United States was used. Medians and interquartile ranges (IQR) were reported for milestone ratings at each PGY level. Percentages of PGY-5s receiving final year ratings of less than 4.0 were calculated. Wilcoxon rank sum tests were used to compare 1.0 and 2.0 median ratings. Kruskal-Wallis and Bonferroni post-hoc tests were used to compare median ratings across time periods and PGY levels. Chi-squared tests were used to compare the proportion of level 4.0 nonachievement under both systems. RESULTS: Milestones 1.0 data consisted of 13,866 residents and Milestones 2.0 data consisted of 7,633 residents. For 1.0 and 2.0, all competency domain median ratings were higher for subsequent years of training. Milestones 2.0 had significantly higher median ratings at all PGY levels for all competency domains except Medical Knowledge. Percentages of PGY-5 residents not achieving the graduation target in Milestones 1.0 ranged from 27% to 42% and in 2.0 from 5% to 13%. For Milestones 1.0, all subcompetencies showed an increased number of residents achieving the graduation target from 2014 to 2019. CONCLUSIONS: This study of General Surgery Milestones 1.0 and 2.0 data uncovered significant increases in average ratings and significantly fewer residents not achieving the graduation target under the 2.0 system. We hypothesize that these findings may be related more to rating bias given the change in rating scales, rather than a true increase in resident ability.

Preclinical Immersion Experiences Improve Medical Student Perceptions of Surgery.

INTRODUCTION: Medical students historically receive little to no preclinical exposure to surgery and surgical subspecialties. As a result, by the time they reach their clinical clerkship time, students often have already found interest in other specialties. The goal of this study is to utilize the knowledge to action (KTA) implementation framework to design and refine a clinical immersion experience during the second year of medical school. METHODS: A total of 94 second-year Harvard Medical School students underwent the surgical immersion experience between 2019 and 2022 (the program was postponed in 2020 due to COVID). The development and refinement of the curriculum were nicely modeled by the KTA implementation framework. We identified a gap in medical student preclinical education, adapted a curriculum for preclinical medical students at Massachusetts General Hospital , selected the curriculum components to provide a high-level overview of surgery, monitored the student experience, and evaluated outcomes using the student surveys. Based on the survey results, inductive thematic analysis was utilized to identify prominent positive and negative themes. The feedback was then used to tailor subsequent iterations of the immersion experience. RESULTS: Eighty-eight medical students completed the survey (RR = 93.6%), and 85% rated the immersion experience as "excellent", 11% "very good", 4% "good", and 0% "fair" or "poor". There was no significant difference in ratings between sessions. Several key themes were identified, including changed perceptions, diversity of surgical fields, teamwork, surgery clerkship preparedness, and the need for more preclinical exposure. CONCLUSIONS: Preclinical medical students gave overwhelmingly positive reviews of the surgical immersion experience. A half-day intervention is sufficient to begin changing students' views toward surgery, disproving stereotypes, and even inspiring some to consider a surgical field themselves. In addition, the KTA implementation framework is a useful model for the development and refinement of medical education curricula.

The Big Sibling program: Impact of a medical student-resident mentorship program during the surgery clerkship.

BACKGROUND: We created a Big Sibling mentorship program for medical students and studied the program effects. METHODS: Between July 2019 to December 2020, students completing their surgery clerkship were paired with a Big Sibling surgical research resident. Participation in and perceptions of the program were assessed by survey. RESULTS: 81 medical students and 25 residents participated with a 79% and 95% survey response rate, respectively. The most valuable topics discussed included ward skills, personal development and career advising. Students who interacted >2 times with their Big Sibling were more likely to perceive the operating room as a positive learning environment, view attendings as role models, and receive mentoring and feedback from residents and attendings (p = 0.03, 0.02, 0.01 respectively). 78% of residents thought the program was a positive experience and no residents found it burdensome. CONCLUSION: The Big Siblings program enhances the surgery clerkship learning environment. Students who engaged with their Big Sibling had a more positive view of the clerkship and the mentorship provided by residents and attendings.