Myth or Reality: Self-Assessment Is Central to Effective Curriculum in Anatomical Pathology Graduate Medical Education.

Self-assessment, a personal evaluation of one's professional attributes and abilities against a perceived norm, has frequently been cited as a necessary component of self-directed learning and the maintenance of competency within regulated health professions, including the medical professions. However, education research literature has consistently shown uninformed personal global assessment of performance to be inaccurate in a variety of contexts, and have limited value in a workplace-based curriculum. Incorporating known standards of performance with internal and external data on the performance improves a learner's ability to accurately self-assess. Selecting content suitable for self-assessment, providing explicit assessment standards, encouraging feedback-seeking behaviors, supporting a growth mindset, and providing quality feedback in a supportive context are all strategies that can support learner self-assessment, learner engagement in reflection, and action on feedback in Anatomical Pathology graduate medical education.

Collective Wisdom in Faculty Development for Competency-Based Medical Education: A Needs Assessment and Survey.

This article was migrated. The article was marked as recommended. Background: As programs transition to competency-based medical education (CBME), faculty development (FD) will be a key component of supporting successful implementation. Methods: Faculty at the University of Toronto (UofT) with leadership roles in residency education were invited to complete an online survey to explore their experiences with FD for CBME. Descriptive statistics were collected. Results were analyzed using thematic, frequency and comparative analyses between respondent subgroups to identify trends and theme categories relevant to the perceived most effective FD activities, most helpful FD topics as well as program/department needs for future FD initiatives. Results: The overall survey response rate was 44.6%. The most effective FD activity identified by survey respondents was a small group format. Perceived top FD topics included implementing CBME, assessment tools, feedback and coaching along with competence committees. The majority of programs felt that the ideal timing for CBME implementation was 6-12 months prior to implementation. The main perceived barrier to FD was lack of time amongst faculty. Conclusions: This data helped drive FD at UofT by supporting strategic planning for implementing competency based curricular reforms. The results have also informed the need for additional resources and enable focused FD on barriers and needs.

Practical solutions for implementation of Transition to Practice curricula in a competency-based medical education model.

BACKGROUND: Although transition from residency to practice represents a critical learning stage, there is a paucity of literature to inform local curriculum development and implementation. OBJECTIVES: To describe local curriculum development for Transition to Practice (TTP) for use within a competency-based medical education model, including important content and suitable teaching and assessment strategies. DESIGN: We reviewed the literature to construct a definition and develop initial curriculum content for TTP. We then gathered local residency program directors' views on TTP content, teaching, and assessment via online survey and an international educational conference workshop. RESULTS: We identified 21 important TTP content areas in the literature and analyzed 35 survey responses, representing 33 residency programs. Survey participants viewed Further sophistication of clinical skills, How to set up a practice, and Time management skills as the three most important content areas. Views on content importance varied by program. For teaching and assessment strategies, most respondents preferred: assessing what residents could do, providing real-life practice opportunities, and offering workplace-based assessments. CONCLUSIONS: TTP curricula implementation should reflect nationally set, specialty-specific curriculum elements; locally developed priority content; and assessment and teaching strategies. Individual learner needs and imminent practice context should guide faculty approaches to curriculum delivery.Résumé.

CONTEXTE: Bien que la transition de la résidence à la pratique représente une étape d'apprentissage essentielle, on retrouve peu de littérature pour informer le développement et l'implantation des cursus locaux. OBJECTIFS: Décrire le développement d'un cursus local de Transition vers la pratique (TVP) pour un modèle d'éducation médicale par compétences, incluant le contenu important et des stratégies d'enseignement et d'évaluation adaptées. CONCEPTION: Nous avons recensé les écrits afin d'établir une définition et de développer le contenu initial du cursus de TVP. Nous avons ensuite recueilli l'opinion des directions de programmes de résidence locaux sur le contenu, l'enseignement et l'évaluation du cursus TVP par le biais d'un sondage en ligne et un atelier offert dans le cadre d'une conférence pédagogique internationale. RÉSULTATS: Nous avons identifié 21 sujets importants pour la TVP dans la littérature et nous avons analysé les réponses de 35 sondages représentant 33 programmes de résidence. Les trois sujets considérés les plus importants par les participants au sondage étaient le Perfectionnement avancé des compétences cliniques; Comment débuter sa pratique médicale et les Aptitudes de gestion du temps. Les opinions sur l'importance du contenu variaient selon les programmes. Pour ce qui est des stratégies d'apprentissage et d'enseignement, la plupart des personnes sondées ont exprimé les préférences suivantes : évaluer ce que les résidents sont en mesure de faire; fournir des occasions réelles de pratiquer ; offrir des évaluations en milieu de travail. CONCLUSIONS: La mise en œuvre des cursus TVP devrait refléter des éléments des curriculums propres aux spécialités et définis à l'échelle nationale; des sujets prioritaires développés localement; des stratégies d'enseignement et d'évaluation. Les besoins personnels des étudiants et le contexte imminent du début de pratique devraient orienter les approches du corps professoral utilise dans l'enseignement de ce cursus.

Managing residents in difficulty within CBME residency educational systems: a scoping review.

BACKGROUND: Best practices in managing residents in difficulty (RID) in the era of competency-based medical education (CBME) are not well described. This scoping review aimed to inventory the current literature and identify major themes in the articles that address or employ CBME as part of the identification and remediation of residents in difficulty. METHODS: Articles published between 2011 to 2017 were included if they were about postgraduate medical education, RID, and offered information to inform the structure and/or processes of CBME. All three reviewers performed a primary screening, followed by a secondary screening of abstracts of the chosen articles, and then a final comprehensive sub-analysis of the 11 articles identified as using a CBME framework. RESULTS: Of 165 articles initially identified, 92 qualified for secondary screening; the 63 remaining articles underwent full-text abstracting. Ten themes were identified from the content analysis with "identification of RID" (41%) and "defining and classifying deficiencies" (30%) being the most frequent. In the CBME article sub-analysis, the most frequent themes were: need to identify RID (64%), improving assessment tools (45%), and roles and responsibilities of players involved in remediation (27%). Almost half of the CBME articles were published in 2016-2017. CONCLUSIONS: Although CBME programs have been implemented for many years, articles have only recently begun specifically addressing RID within a competency framework. Much work is needed to describe the sequenced progression, tailored learning experiences, and competency-focused instruction. Finally, future research should focus on the outcomes of remediation in CBME programs.

Taking stock of what is known about faculty development in competency-based medical education: A scoping review paper.

Purpose: The primary objective was to inventory what is currently known about faculty development (FD) for competency-based medical educations (CBME) and identify gaps in the literature.Methods: A scoping review methodology was employed. Inclusion criteria for article selection were established with two reviewers completing a full-text analysis. Quality checks were included, along with iterative consultation on data collection and consensus decision making via a grounded theory approach.Results: The review identified 19 articles published between 2009 and 2018. Most articles (N = 15) offered suggestions as to what should happen with FD in CBME, but few (N = 4) adopted an experimental design. Six main themes were identified with three main features of FD noted across themes: (1) The importance of direct and timely feedback to faculty members on their teaching and assessment skills. (2) The role of establishing shared mental models for CBME curricula. (3) That FD is thought of longitudinally, not as a one-time bolus.Conclusion: This work illustrates that there is limited, high quality research in FD for CBME. Future FD activities should consider employing a longitudinal and multi-modal program format that includes feedback for the faculty participants on their teaching and assessments skills, including the development of faculty coaching skills.

Feedback Frequency in Competence by Design: A Quality Improvement Initiative.

BACKGROUND: Otolaryngology-head and neck surgery is in the first wave of residency training programs in Canada to adopt Competence by Design (CBD), a model of competency-based medical education. CBD is built on frequent, low-stakes assessments and requires an increase in the number of feedback interactions. The University of Toronto otolaryngology-head and neck surgery residents piloted the CBD model but were completing only 1 assessment every 4 weeks, which was insufficient to support CBD. OBJECTIVE: This project aimed to increase assessment completion to once per resident per week using quality improvement methodology. METHODS: Stakeholder engagement activities had residents and faculty characterize barriers to assessment completion. Brief electronic assessment forms were completed by faculty on residents' personal mobile devices in face-to-face encounters, and the number completed per resident was tracked for 10 months during the 2016-2017 pilot year. Response to the intervention was analyzed using statistical process control charts. RESULTS: The first bundled intervention-a rule set dictating which clinical instance should be assessed, combined with a weekly reminder implemented for 10 weeks-was unsuccessful in increasing the frequency of assessments. The second intervention was a leaderboard, designed on an audit-and-feedback system, which sent weekly comparison e-mails of each resident's completion rate to all residents and the program director. The leaderboard demonstrated significant improvement from baseline over 10 weeks, increasing the assessment completion rate from 0.22 to 2.87 assessments per resident per week. CONCLUSIONS: A resident-designed audit-and-feedback leaderboard system improved the frequency of CBD assessment completion.

Twelve tips for developing key-feature questions (KFQ) for effective assessment of clinical reasoning.

Clinical reasoning is the cognitive process that makes it possible for us to reach conclusions from clinical data. "A key feature (KF) is defined as a significant step in the resolution of a clinical problem. Examinations using key-feature questions (KFQs) focus on a challenging aspect in the diagnosis and management of a clinical problem where the candidates are most likely to make errors." KFs have been used at different levels of medical education and practice, from undergraduate to certification examinations. KFQs illuminate the strengths and limits of an individual's clinical problem-solving ability. These types of items are more likely than other forms of assessment to discriminate among stronger or weaker candidates in the area of clinical reasoning. The 12 tips in this article will provide guidance to faculty who wish to develop KFQs for their tests.

Eight-year outcomes of a competency-based residency training program in orthopedic surgery.

Background: The Division of Orthopaedic Surgery at the University of Toronto implemented a pilot residency training program that used a competency-based framework in July of 2009. The competency-based curriculum (CBC) deployed an innovative, modularized approach that dramatically intensified both the structured learning elements and the assessment processes. Methods: This paper discusses the initial curriculum design of the CBC pilot program; the refinement of the curriculum using curriculum mapping that allowed for efficiencies in educational delivery; details of evaluating resident competence; feedback from external reviews by accrediting bodies; and trainee and program outcomes for the first eight years of the program's implementation. Results: Feedback from the residents, the faculty, and the postgraduate residency training accreditation bodies on the CBC has been positive and suggests that the essential framework of the program may provide a valuable tool to other programs that are contemplating embarking on transition to competency-based education. Conclusions: While the goal of the program was not to shorten training per se, efficiencies gained through a modular, competency-based program have resulted in shortened time to completion of residency training for some learners.

Who's connected to whom and how: a model of evolving relationships and roles in faculty development and curriculum development during curriculum renewal and innovation.

This article was migrated. The article was marked as recommended. Faculty development and curriculum development are essential to the work of academic health sciences institutions. Through collegial conversations, more intense dialogue, and 'workshopping', we have identified a new model of how these two practices can be effectively integrated. We propose that this new model can create a system of knowledge mobilization and quality improvement that will greatly enhance curricular renewal and innovation. We invite and welcome comments and feedback from the health professions education community.

Epidemiology of competence: a scoping review to understand the risks and supports to competence of four health professions.

OBJECTIVES: This study examined the risks and supports to competence discussed in the literature related to occupational therapists, pharmacists, physical therapists and physicians, using epidemiology as a conceptual model. DESIGN: Articles from a scoping literature review, published from 1975 to 2014 inclusive, were included if they were about a risk or support to the professional or clinical competence of one of four health professions. Descriptive and regression analyses identified potential associations between risks and supports to competence and the location of study, type of health profession, competence life-cycle and the domain(s) of competence (organised around the CanMEDS framework). RESULTS: A total of 3572 abstracts were reviewed and 943 articles analysed. Most focused on physicians (n=810, 86.0%) and 'practice' (n=642, 68.0%). Fewer articles discussed risks to competence (n=418, 44.3%) than supports (n=750, 79.5%). The top four risks, each discussed in over 15% of articles, were: transitions in practice, being an international graduate, lack of clinical exposure/experience (ie, insufficient volume of procedures or patients) and age. The top two supports (over 35%) were continuing education participation and educational information/programme features. About 60% of all the articles discussed medical expert and about 25% applied to all roles. Articles focusing on residents had a greater probability of reporting on risks. CONCLUSIONS: Articles about physicians were dominant. The majority of articles were written in the last decade and more discussed supports than risks to competence. An epidemiology-based conceptual model offers a helpful organising framework for exploring and explaining the competence of health professions.

Exploring the experience of residents during the first six months of family medicine residency training.

BACKGROUND: The shift from undergraduate to postgraduate education signals a new phase in a doctor's training. This study explored the resident's perspective of how the transition from undergraduate to postgraduate (PGME) training is experienced in a Family Medicine program as they first meet the reality of feeling and having the responsibility as a doctor. METHODS: Qualitative methods explored resident experiences using interpretative inquiry through monthly, individual in-depth interviews with five incoming residents during the first six months of training. Focus groups were also held with residents at various stages of training to gather their reflection about their experience of the first six months. Residents were asked to describe their initial concerns, changes that occurred and the influences they attributed to those changes. RESULTS: Residents do not begin a Family Medicine PGME program knowing what it means to be a Family Physician, but learn what it means to fulfill this role. This process involves adjusting to significant shifts in responsibility in the areas of Knowledge, Practice Management, and Relationships as they become more responsible for care outcomes. CONCLUSION: This study illuminated the resident perspective of how the transition is experienced. This will assist medical educators to better understand the early training experiences of residents, how these experiences contribute to consolidating their new professional identity, and how to better align teaching strategies with resident learning needs.

What do I do? Developing a competency inventory for postgraduate (residency) program directors.

BACKGROUND: Few new Residency Program Directors (PD) are formally trained for the demands and responsibilities of the leadership aspect of their role. Currently, there are no comprehensive frameworks that describe specific leadership competencies that can inform PD self-reflection or faculty development. METHODS: The authors developed a Postgraduate Program Director Competency Inventory (PPDCI) in order to frame the performance of PDs for a multisource feedback (MSF) program. The development of the PPDCI occurred in five phases which involved: development of an initial inventory, implementation of a key informant survey of national opinion leaders, execution of a validity survey with postgraduate education leaders and committee members and implementation of a further refined inventory with 17 PD and 147 raters as part of a pilot MSF program. OUTCOMES: Five distinct domains of leadership competence were identified which included: Communication and relationship management, leadership, professionalism and self-management, environmental engagement, and management skills and knowledge. The content validity of the PPDCI was endorsed by 85% of the key informants. The validity survey indicated strong endorsement of the PPDCI domains and recognition of its utility for both orientation of new PD as well as a frame for self-assessment. The pilot MSF program yielded a further refined and reduced inventory of 26 items of competence as well as recommendations for its utility. CONCLUSIONS: Use of this leadership inventory has the potential to ensure effective leadership of postgraduate programs.

Safety and Efficacy of Botulinum Toxin A in Children Undergoing Lower Limb Lengthening and Deformity Correction: Results of a Double-blind, Multicenter, Randomized Controlled Trial.

BACKGROUND: Lengthening of the lower limb is a complex procedure in which pain management and complications such as pin-site infections and muscle contractures impact the family and affect the child's quality of life. As a result, the paralytic and antinociceptive actions of neurotoxins may be indicated in managing these complications; however, few studies have explored ways to improve outcomes after lengthenings. The objective of this study was to evaluate the safety and efficacy of botulinum toxin A (BTX-A) in children undergoing lower limb lengthenings and deformity correction. METHODS: Participants with a congenital or acquired deformity of the lower extremity requiring surgery to one limb were randomized to receiving either BTX-A as a single dose of 10 units per kilogram body weight, or an equivalent volume of saline solution. Pain, medication, quality of life, and physical function were assessed at different time-points. Adverse events were recorded in all participants. T test and χ tests were used to compare potential differences across both groups. RESULTS: Mean age of the 125 participants was 12.5 years (range, 5 to 21 y), and lengthenings averaged 4.2 cm. Maximum pain scores on day 1 postoperatively were lower in the BTX-A group (P=0.03) than in the placebo group, and remained significant favoring botox when stratifying by location of lengthening (femur vs. tibia). Clinical benefits for BTX-A were found for 3 quality of life domains at mid-distraction and end-distraction. When stratifying according to location of lengthening, there were significantly fewer pin-site infections in the tibia favoring botox (P=0.03). The amount of adverse events and bone healing indices were no different in both groups. CONCLUSIONS: The clinical differences in quality of life, the lower pain on the first postoperative day, and the lower number of pin-site infections in the tibia favoring BTX-A support its use as an adjunctive treatment to the lengthening process. The detailed analyses of pain patterns help inform families on the pain expectations during lower limb lengthenings. The amount of adverse events were no different in both groups, and bone healing rates were similar, indicating that the use of BTX-A in children undergoing limb lengthening and deformity correction is safe. LEVEL OF EVIDENCE: Level I.

How to assess communication, professionalism, collaboration and the other intrinsic CanMEDS roles in orthopedic residents: use of an objective structured clinical examination (OSCE).

BACKGROUND: Assessing residents' understanding and application of the 6 intrinsic CanMEDS roles (communicator, professional, manager, collaborator, health advocate, scholar) is challenging for postgraduate medical educators. We hypothesized that an objective structured clinical examination (OSCE) designed to assess multiple intrinsic CanMEDS roles would be sufficiently reliable and valid. METHODS: The OSCE comprised 6 10-minute stations, each testing 2 intrinsic roles using case-based scenarios (with or without the use of standardized patients). Residents were evaluated using 5-point scales and an overall performance rating at each station. Concurrent validity was sought by correlation with in-training evaluation reports (ITERs) from the last 12 months and an ordinal ranking created by program directors (PDs). RESULTS: Twenty-five residents from postgraduate years (PGY) 0, 3 and 5 participated. The interstation reliability for total test scores (percent) was 0.87, while reliability for each of the communicator, collaborator, manager and professional roles was greater than 0.8. Total test scores, individual station scores and individual CanMEDS role scores all showed a significant effect by PGY level. Analysis of the PD rankings of intrinsic roles demonstrated a high correlation with the OSCE role scores. A correlation was seen between ITER and OSCE for the communicator role, while the ITER medical expert and total scores highly correlated with the communicator, manager and professional OSCE scores. CONCLUSION: An OSCE designed to assess the intrinsic CanMEDS roles was sufficiently valid and reliable for regular use in an orthopedic residency program.

CONTEXTE: Évaluer la compréhension et l'application des 6 rôles intrinsèques CanMEDS (communicateur, professionnel, gestionnaire, collaborateur, promoteur de la santé, érudit) chez les résidents pose un défi pour les responsables de la formation médicale postdoctorale. Nous avons émis l'hypothèse selon laquelle un examen clinique objectif structuré (ECOS) conçu pour évaluer plusieurs rôles CanMEDS intrinsèques serait suffisamment fiable et valide. MÉTHODES: L'ECOS comportait 6 stations de 10 minutes, permettant chacune d'évaluer 2 rôles intrinsèques à l'aide de scénarios basés sur des cas (avec ou sans recours à des patients standardisés). Les résidents ont été notés au moyen d'échelles en 5 points et d'une évaluation globale de leur rendement à chacune des stations. La validité convergente a été vérifiée par corrélation avec les rapports d'évaluation en cours de formation (RÉF) des 12 mois précédents et un classement chiffré créé par les directeurs du programme (DP). RÉSULTATS: Vingt-cinq résidents des années 0, 3 et 5 y ont participé. La fiabilité interstation pour les scores totaux aux tests (en pourcentage) a été de 0,87, tandis que la fiabilité pour chacun des rôles de communicateur, collaborateur, gestionnaire et professionnel, a été supérieure à 0,8. Les scores totaux aux tests, les scores aux stations individuelles et les scores pour les rôles CanMEDS individuels ont tous fait état d'un effet significatif selon le niveau des résidents. L'analyse des classements établis par les DP quant aux rôles intrinsèques a révélé une forte corrélation avec les scores au test ECOS pour les rôles. On a observé une corrélation entre les RÉF et l'ECOS pour le rôle de communicateur, tandis que les RÉF pour le rôle d'expert médical et les scores totaux ont été en forte corrélation avec les scores de l'ECOS pour les rôles de communicateur, de gestionnaire et de professionnel. CONCLUSION: Un ECOS conçu pour évaluer les rôles CanMEDS intrinsèques s'est révélé suffisamment valide et fiable pour un usage régulier dans un programme de résidence en orthopédie.

Key-feature questions for assessment of clinical reasoning: a literature review.

OBJECTIVES: Key-feature questions (KFQs) have been developed to assess clinical reasoning skills. The purpose of this paper is to review the published evidence on the reliability and validity of KFQs to assess clinical reasoning. METHODS: A literature review was conducted by searching MEDLINE (1946-2012) and EMBASE (1980-2012) via OVID and ERIC. The following search terms were used: key feature; question or test or tests or testing or tested or exam; assess or evaluation, and case-based or case-specific. Articles not in English were eliminated. RESULTS: The literature search resulted in 560 articles. Duplicates were eliminated, as were articles that were not relevant; nine articles that contained reliability or validity data remained. A review of the references and of citations of these articles resulted in an additional 12 articles to give a total of 21 for this review. Format, language and scoring of KFQ examinations have been studied and modified to maximise reliability. Internal consistency reliability has been reported as being between 0.49 and 0.95. Face and content validity have been shown to be moderate to high. Construct validity has been shown to be good using vector thinking processes and novice versus expert paradigms, and to discriminate between teaching methods. The very modest correlations between KFQ examinations and more general knowledge-based examinations point to differing roles for each. Importantly, the results of KFQ examinations have been shown to successfully predict future physician performance, including patient outcomes. CONCLUSIONS: Although it is inaccurate to conclude that any testing format is universally reliable or valid, published research supports the use of examinations using KFQs to assess clinical reasoning. The review identifies areas of further study, including all categories of evidence. Investigation into how examinations using KFQs integrate with other methods in a system of assessment is needed.

Postgraduate anaesthesiology education: protocol for a scoping review.

INTRODUCTION: The link between education and clinical practice is vital, yet the current state of research suggests there is a substantial gap between medical education research and practice. This too is the case in the domain of anaesthesiology education research, as much of the research focuses on simulation studies, and a narrow range of research methods. The aim of this study is to comprehensively review the existing literature in postgraduate anaesthesiology education research in order to identify key research priorities. The findings from this review will be used to establish a base for developing a strategic research programme in anaesthesia education and practice. METHODS AND ANALYSIS: We will employ the scoping review methodology outlined by Arksey and O'Malley (2005) to comprehensively search the literature pertaining to postgraduate anaesthesiology education. We will search relevant electronic databases (eg, MEDLINE, EMBASE) and grey literature. After conducting calibration exercises, two authors will independently apply inclusion criteria to all titles and abstracts and perform full-text review of all eligible articles. Data to be extracted will include basic information about the study (eg, location, design) as well as detailed information regarding the context of the research and type of education examined. Our results will be used to develop a framework of themes that outline the research currently being conducted and identify gaps in research. ETHICS AND DISSEMINATION: This review is the first step in a strategic research plan in postgraduate anaesthesiology education. We plan to disseminate this research through publications, presentations and meetings with relevant stakeholders. Ethical approval was not sought for this scoping review.

The epidemiology of competence: protocol for a scoping review.

INTRODUCTION: Factors that are important to the competence of healthcare providers have important consequences for quality of healthcare. Although some previous research has discussed risks or supports to the competence of clinicians, a thorough exploration is currently lacking. The purpose of this review is to examine the literature examining risks and supports to clinical competence of healthcare practitioners and trainees engaged in field-based education. In this study, field-based education refers to teaching or training in a real-world/work-based setting. METHODS AND ANALYSIS: We will employ an established scoping review methodology. Eligible studies will include those that mention (1) a healthcare professional, (2) competence from field-based education throughout the lifespan/career and (3) a risk or support to competence. Four authors will independently apply the inclusion criteria to all studies, regardless of study design. Our data extraction will include information on study design, location and type of study and we will develop a comprehensive list of risks and supports that are discussed in the literature. ETHICS AND DISSEMINATION: Since this is a review of the literature, ethics approval is not indicated. We will disseminate the findings from this study in publications in peer-reviewed journals as well as presentations at relevant national and international conferences.

Remediation of residents in difficulty: a retrospective 10-year review of the experience of a postgraduate board of examiners.

PURPOSE: To determine, through a 10-year review, (1) the prevalence of residents in difficulty, (2) characteristics of these residents, (3) areas of residents' weakness, and (4) outcomes of residents who undergo remediation. METHOD: A retrospective review of resident records for the University of Toronto Faculty of Medicine's (UT-FOM) Board of Examiners for Postgraduate Programs (BOE-PG) was done from July 1, 1999 to June 30, 2009 using predetermined data elements entered into a standardized form and analyzed for trends and significance. Outcomes for residents in difficulty were tracked through university registration systems and licensure databases. RESULTS: During 10 years, 103 UT-FOM residents were referred to the BOE-PG, representing 3% of all residents enrolled. The annual prevalence of residents referred to the BOE-PG ranged from 0.2% to 1.5%. The CanMEDS framework was used to classify areas of residents' weaknesses and organize remediation plans. All 100 residents studied had either medical expertise (85%) or professionalism (15%) weaknesses or both. Residents had difficulties with an average of 2.6 CanMEDS Roles, with highest frequencies of Medical Expert (85%) Professional (51%), Communicator (49%), Manager (43%), and Collaborator (20%). Often, there were multiple remediation periods, with an average of six months' duration. Usually, remediation was successful; 78% completed residency education, 17% were unsuccessful, and 5% remained in training. CONCLUSION: Residents in difficulty have multiple areas of weakness. The CanMEDS framework is an effective approach to classifying problems and designing remediation plans. Successful completion of residency education after remediation is the most common outcome.

Competency-based education in family medicine.

BACKGROUND: As a way of demonstrating an objective assessment of trainee competence, the College of Family Physicians of Canada has recently approved a competency-based framework known as CanMEDS-FM. All training programs in family medicine in Canada will be required to demonstrate the development of curriculum and evaluation methods based on the roles defined by the framework. AIM: This article describes the rationale and the approach used to develop a competency-based education curriculum in the postgraduate family medicine program at the University of Toronto. METHOD: The authors describe a systematic approach to curriculum development which includes the formation of a central steering committee, content development by faculty experts, mapping of curriculum to an accreditation framework, and a faculty consensus exercise. We discuss challenges to development and implementation of a competency-based framework as well as areas that require further work and development. CONCLUSIONS: The competency-based curriculum is both a new method of learning for residents and, a new method of teaching for faculty. While there are many potential benefits and challenges, this article focuses on the model's utility in terms of flexible learner-centered educational design, as well as its ability to identify learners' strengths and needs.