Creation of an Automated and Comprehensive Resident Progress System for Residents and to Save Hours of Faculty Time: Mixed Methods Study.

ABSTRACT

BACKGROUND: It is vital for residents to have a longitudinal view of their educational progression, and it is crucial for the medical education team to have a clear way to track resident progress over time. Current tools for aggregating resident data are difficult to use and do not provide a comprehensive way to evaluate and display resident educational advancement. OBJECTIVE: This study aims to describe the creation and assessment of a system designed to improve the longitudinal presentation, quality, and synthesis of educational progress for trainees. We created a new system for residency progress management with 3 goals in mind, that are (1) a long-term and centralized location for residency education data, (2) a clear and intuitive interface that is easy to access for both the residents and faculty involved in medical education, and (3) automated data input, transformation, and analysis. We present evaluations regarding whether residents find the system useful, and whether faculty like the system and perceive that it helps them save time with administrative duties. METHODS: The system was created using a suite of Google Workspace tools including Forms, Sheets, Gmail, and a collection of Apps Scripts triggered at various times and events. To assess whether the system had an effect on the residents, we surveyed and asked them to self-report on how often they accessed the system and interviewed them as to whether they found it useful. To understand what the faculty thought of the system, we conducted a 14-person focus group and asked the faculty to self-report their time spent preparing for residency progress meetings before and after the system debut. RESULTS: The system went live in February 2022 as a quality improvement project, evolving through multiple iterations of feedback. The authors found that the system was accessed differently by different postgraduate years (PGY), with the most usage reported in the PGY1 class (weekly), and the least amount of usage in the PGY3 class (once or twice). However, all of the residents reported finding the system useful, specifically for aggregating all of their evaluations in the same place. Faculty members felt that the system enabled a more high-quality biannual clinical competency committee meeting and they reported a combined time savings of 8 hours in preparation for each clinical competency committee as a result of reviewing resident data through the system. CONCLUSIONS: Our study reports on the creation of an automated, instantaneous, and comprehensive resident progress management system. The system has been shown to be well-liked by both residents and faculty. Younger PGY classes reported more frequent system usage than older PGY classes. Faculty reported that it helped facilitate more meaningful discussion of training progression and reduced the administrative burden by 8 hours per biannual session.