The Effect and Use of Milestones in the Assessment of Neurological Surgery Residents and Residency Programs.

OBJECTIVES: The purpose of this study was to determine the effect of the Accreditation Council for Graduate Medical Education Milestones on the assessment of neurological surgery residents. The authors sought to determine the feasibility, acceptability, and utility of this new framework in making judgments of progressive competence, its implementation within programs, and the influence on curricula. Residents were also surveyed to elicit the effect of Milestones on their educational experience and professional development. DESIGN, SETTING, AND PARTICIPANTS: In 2015, program leadership and residents from 21 neurological surgery residency programs participated in an online survey and telephone interview in which they reflected on their experiences with the Milestones. Survey data were analyzed using descriptive statistics. Interview transcripts were analyzed using grounded theory. RESULTS: Response themes were categorized into 2 groups: outcomes of the Milestones implementation process, and facilitators and barriers. Because of Milestones implementation, participants reported changes to the quality of the assessment process, including the ability to identify struggling residents earlier and design individualized improvement plans. Some programs revised their curricula based on training gaps identified using the Milestones. Barriers to implementation included limitations to the adoption of a developmental progression model in the context of rotation block schedules and misalignment between progression targets and clinical experience. The shift from time-based to competency-based evaluation presented an ongoing adjustment for many programs. Organized preparation before clinical competency committee meetings and diverse clinical competency committee composition led to more productive meetings and perceived improvement in promotion decisions. CONCLUSIONS: The results of this study can be used by program leadership to help guide further implementation of the Milestones and program improvement. These results also help to guide the evolution of Milestones language and their implementation across specialties.

An ACGME Duty Hour Compliant 3-Person Night Float System for Neurological Surgery Residency Programs.

BACKGROUND: In 2003, the Accreditation Council for Graduate Medical Education (ACGME) instituted the 24+6-hour work schedule and 80-hour workweek, and in 2011, it enhanced work hour and supervision standards. INNOVATION: In response, Oregon Health & Science University's (OHSU) neurological surgery residency instituted a 3-person night float system. METHODS: We analyzed work hour records and operative experience for 1 year before and after night float implementation in a model that shortened a combined introductory research and basic clinical neurosciences rotation from 12 to 6 months. We analyzed residents' perception of the system using a confidential survey. The ACGME 2011 work hour standards were applied to both time periods. RESULTS: AFTER NIGHT FLOAT IMPLEMENTATION, THE NUMBER OF DUTY HOUR VIOLATIONS WAS REDUCED: 28-hour shift (11 versus 235), 8 hours off between shifts (2 versus 20), 80 hours per week (0 versus 17), and total violations (23 versus 275). Violations increased only for the less than 4 days off per 4-week interval rule (10 versus 3). No meaningful difference was seen in the number of operative cases performed per year at any postgraduate year (PGY) training level: PGY-2 (336 versus 351), PGY-3 (394 versus 354), PGY-4 (803 versus 802), PGY-5 (1075 versus 1040), PGY-7 (947 versus 913), and total (3555 versus 3460). Residents rated the new system favorably. CONCLUSIONS: To meet 2011 ACGME duty hour standards, the OHSU neurological surgery residency instituted a 3-person night float system. A nearly complete elimination of work hour violations did not affect overall resident operative experience.