Rapid, collaborative generation and review of COVID-19 pandemic-specific competencies for family medicine residency training.

BACKGROUND: In March 2020, the COVID-19 pandemic disrupted competency-based medical education in Family Medicine programs across Canada. Faculty and residents identified a need for clear, relevant, and specific competencies to frame teaching, learning, supervision and feedback during the pandemic. METHODS: A rapid, iterative, educational quality improvement process was launched. Phase 1 involved experienced educators defining gaps in our program's existing competency-database, reviewing emerging public health and regulatory guidelines, and drafting competencies. Phase 2 involved translation, member-checking, and anonymous feedback and editing of draft competencies by residents and other educational leaders. Phase 3 involved wider dissemination, collaborative editing and feedback from residents and faculty throughout the department. RESULTS: A total of 44 physicians including residents and faculty from multiple contexts provided detailed feedback, review, and editing of an ultimate list of 33 competencies organized by CanMEDS-FM roles. Broad agreement was obtained that the competencies form reasonable learning outcomes during the COVID-19 pandemic. CONCLUSIONS: These competencies represent learning objectives reflecting the initial educational mindsets of a wide range of teachers and learners experiencing a global pandemic. The project illustrates a novel collaboration across educational portfolios as a rapid educational response to a public health crisis.

CONTEXTE: En mars 2020, la pandémie de la COVID-19 a perturbé la formation médicale basée sur les compétences des programmes de médecine familiale partout au Canada. Le corps professoral et les résidents ont identifié la nécessité d'avoir des compétences claires, pertinentes et précises pour encadrer l'enseignement, l'apprentissage, la supervision et la rétroaction durant la pandémie. MÉTHODES: Un processus rapide et itératif d'amélioration de la qualité de l'éducation a été lancé. Au cours de la Phase 1, des éducateurs d'expérience ont identifié les lacunes en lien avec la base de données actuelle des compétences du programme, et fait une ébauche de compétences à partir d'une revue des lignes directrices émergentes en santé publique et des organismes de régulation. La Phase 2 a consisté en la traduction, la révision par les membres ainsi que la rétroaction anonyme et la révision des compétences provisoires par les résidents et autres leaders en éducation. Durant la Phase 3, on a procédé à la diffusion à plus large échelle, à la révision en collaboration et au recueil des commentaires des résidents et du corps professoral dans tout le département. RÉSULTATS: En tout, quarante-quatre (44) médecins comportant des résidents et des membres du corps professoral de multiples contextes, ont fourni une rétroaction détaillée et procédé à l'examen et à la révision d'une liste finale de 33 compétences classées par rôles CanMEDS. Une très vaste majorité a convenu que les compétences produisent des résultats d'apprentissage raisonnables durant la pandémie de la COVID-19. CONCLUSIONS: Ces compétences représentent des objectifs d'apprentissage qui reflètent la perspective éducative initiale d'une vaste gamme de d'enseignants et d'apprenants aux prises avec une pandémie mondiale. Le projet représente une nouvelle collaboration entre les programmes d'études comme une réponse éducative rapide à une crise de santé publique.

Practice simulated office orals as a predictor of Certification examination performance in family medicine.

OBJECTIVE: To determine if performance on practice simulated office orals (SOOs) conducted during residency training could predict residents' performance on the SOO component of the College of Family Physicians of Canada's (CFPC's) final Certification examination. DESIGN: Prospective cohort study. SETTING: University of Ottawa in Ontario. PARTICIPANTS: Family medicine residents enrolled in the University of Ottawa's Family Medicine Residency program between July 1, 2012, and June 30, 2014, who were eligible to write the CFPC Certification examination in the spring of 2014 and who had participated in all 4 practice SOO examination sessions; 23 residents met these criteria. MAIN OUTCOME MEASURES: Scores on practice SOO sessions during fall 2012, spring 2013, fall 2013, and spring 2014; and the SOO component score on the spring 2014 administration of the CFPC Certification examination. RESULTS: Weighted least squares regression analysis using the 4 practice SOO session scores significantly predicted the final Certification examination SOO score (P < .05), with an adjusted R2 value of 0.29. Additional analysis revealed that the mean scores for the cohort generated at each time point were statistically different from each other (P < .001) and that the relationship over time could be represented by either a linear relationship or a quadratic relationship. A generalizability study generated a relative generalizability coefficient of 0.63. CONCLUSION: Our results confirm the usefulness of practice SOOs as a progress test and demonstrate the feasibility of using them to predict final scores on the SOO component of the CFPC's Certification examination.

Progress testing in family medicine--A novel use for simulated office oral exams.

BACKGROUND: Simulated office orals (SOOs) are used by the College of Family Physicians of Canada as a method to evaluate family medicine resident readiness for clinical practice. The use of SOOs as a progress test would provide residency programs with useful information to determine resident readiness for challenging the certification exam. The data from a progress test could then be easily manipulated to generate a risk assessment plot. METHODS: During a prospective cohort study conducted at the University of Ottawa, the feasibility of using practice SOO sessions, a structured clinical exam, as a progress test was explored. Twenty-three residents participated in all four practice SOO sessions and their results were entered into a risk assessment plot. RESULTS: Repeated measures analysis of the data using ANOVA demonstrated that the residents' scores at each time point were statistically different from each other, generating an F(3, 66) = 27.52, p < 0.001, η(2) = 0.55.and that the relationship over time was linear with an F(1, 22) = 123.80, p < 0.001, η(2) = 0.85. At the final time point, a risk assessment resulted in no learners mapping to quadrants III or IV. CONCLUSIONS: Our results demonstrate the feasibility of utilizing a SOO exam, a clinical exam, as a progress test. In addition, we propose generating a risk assessment plot, using the data from the Fall 2013 and Spring 2014 practice SOO sessions, as a means of identifying residents at risk. Further studies will be needed to confirm the utility of this analysis. Combined with other measures acquired during in-training evaluation, the utilization of practice SOOs as a progress test will provide program directors with valuable information on resident progression.