Improvement in Context: Exploring Aims, Improvement Priorities, and Environmental Considerations in a National Sample of Programs Using "Small Data".

BACKGROUND: In 2013, the Accreditation Council for Graduate Medical Education (ACGME) transitioned into a new accreditation system to reduce burden, focus on outcomes, and promote innovation and improvement. One component is a self-study that includes aims, an environmental assessment, and setting improvement priorities. The ACGME initiated voluntary site visits following the self-study. OBJECTIVE: We explored common themes in program aims and assessment of their environment. METHODS: Using grounded theory, inductive and deductive qualitative methods, and truth grounding, we analyzed data from voluntary site visits of 396 core and subspecialty programs between June 2015 and September 2017, with a focus on common themes. RESULTS: We report common themes for aims and the dimensions of the environmental assessment. Themes for strengths include a collegial, supportive learning environment; responsive leaders; and experiences that prepare residents for unsupervised practice. Improvement priorities encompass low learner engagement and "content mismatch" in didactic education, balancing education and service at a time of growing clinical volumes, and improving the utility of assessment systems. Common opportunities encompass collaborations that improve education, involving alumni and harnessing technology to enrich education, while threats include an unsustainable effort for many program leaders, clinical pressures on faculty, and loss of external sites important for education. Linked dimensions of the environmental assessment suggest benefit in a growing focus on learners, and approaches to ensure a humanistic learning environment that allows for growth, self-determination, and inclusion. CONCLUSIONS: The findings highlight actionable themes for the environmental assessment. We discuss implications for programs, institutions, and the ACGME.

Implementation and evaluation of a new surgical residency model.

BACKGROUND: The Accreditation Council for Graduate Medical Education (ACGME) duty-hour requirements prompted program directors to rethink the organizational structure of their residency programs. Many surgical educators have expressed concerns that duty-hour restrictions would negatively affect quality of resident education. This article summarizes evaluation research results collected to study the impact of our reengineered residency program designed to preserve important educational activities while meeting duty-hour accreditation requirements. STUDY DESIGN: The traditional residency structure was redesigned to include a mixture of apprenticeship, small team, and night-float models. Impact evaluation data were collected using operative case logs, standardized test scores, quality assurance data, resident perception surveys, a faculty survey, and process evaluation measures. RESULTS: PGY1s and PGY2s enjoyed a substantial increase in operative cases. Operative cases increased overall and no resident has failed to meet ACGME volume or distribution requirements. American Board of Surgery In-Training Examination performance improved for PGY1s and PGY2s. Patient outcomes measures, including monthly mortality and number of and charges for admissions, showed no changes. Anonymously completed rotation evaluation forms showed stable or improved resident perceptions of case load, continuity, operating room teaching, appropriate level of faculty involvement and supervision, encouragement to attend conferences, and general assessment of the learning environment. A quality-of-life survey completed by residents before and after implementation of the new program structure showed substantial improvements. Faculty surveys showed perceived increases in work hours and job dissatisfaction. New physician assistant and nurse positions directly attributed to duty-hour restrictions amounted to about 0.2 full-time equivalent per resident. CONCLUSIONS: Duty-hour restrictions produce new challenges and might require additional resources but need not cause a deterioration of surgical residents' educational experience.