Dutch dismissal practices: characteristics, consequences, and contrasts in residents' case law in community-based practice versus hospital-based specialties.

BACKGROUND: In the Netherlands, 2 to 10% of the residents terminate training prematurely. Infrequently, termination of training is by dismissal. Incidentally, residents may disagree, dispute and challenge these decisions from the programme directors. Resident dismissal is always a difficult decision, most commonly made after, repeated assessments, and triangulation of the resulting assessment data and one or more remediation attempts. Nevertheless, the underlying reasons for dismissal and the policies for remediation and dismissal may differ between training programmes. Such differences may however impact the chance of remediation success, the chance of dismissal and subsequent residents' appeals. METHOD: We included a total of 70 residents from two groups (community-based and hospital-based specialties) during 10 years of appeals. Subsequently, we compared these groups on factors potentially associated with the outcome of the conciliation board decision regarding the residents' dismissal. We focused herein on remediation strategies applied, and reasons reported to dismiss residents. RESULTS: In both groups, the most alleged reason to dismiss residents was lack of trainability, > 97%. This was related to deficiencies in professionalism in community-based practice and medical expertise in hospital-based specialties respectively. A reason less frequently mentioned was endangerment of patient care, < 26%. However, none of these residents accused of endangerment, actually jeopardized the patients' health, probably due to the vigilance of their supervisors. Remediation strategies varied between the two groups, whereas hospital-based specialties preferred formal remediation plans in contrast to community-based practice. A multitude of remediation strategies per competency (medical expertise, professionalism, communication, management) were applied and described in these law cases. DISCUSSION: Residents' appeals in community-based practice were significantly less likely to succeed compared to hospital-based specialties. Hypothesised explanatory factors underlying these differences include community-based practices' more prominent attention to the longitudinal assessment of professionalism, the presence of regular quarterly progress meetings, precise documentation of deficiencies, and discretion over the timing of dismissal in contrast to dismissal in the hospital-based specialties which is only formally possible during scheduled formal summative assessment meetings.

Development of Somaliland national harmonised medical curriculum.

BACKGROUND AND OBJECTIVES: The rational for the Somaliland national harmonised curriculum (NHC) was driven by shared concern about the quality of medical education. PROCESS: The Ministry of Education and Science and the Ministry of Health Development produced a Medical Education Policy 2018. Policy objectives included the development of the NHC and accreditation for medical schools that met the standards of the World Federation for Medical Education (WFME). Two bodies were asked to oversee these aims: the National Health Professions' Commission (NHPC) and the National Commission of Higher Education (NCHE). Between 2018 and 2020, a collaborative approach between the Somaliland government, medical school stakeholders, King's Global Health Partnership's (KGHP) volunteers and the Tropical Health Education Trust (THET) team was used to design the 6-years NHC. The NHC structure, content and delivery were grounded by WFME standards, health needs of the local population, student focused and active learning methods, and feasibility of implementation in medical schools. OUTCOMES: The NHC comprises details about the educational outcomes, curriculum model and framework, educational principles, instructional and learning methods, core as well as optional content, and assessment strategy. CONCLUSIONS: The approach used to develop the NHC ensured it is bespoken for Somaliland. Ongoing evaluation of patient and population needs, each medical school's review of programme implementation and outcomes will inform continuous revision and renewal.

How can peer teaching influence the development of medical students? a descriptive, longitudinal interview study.

BACKGROUND: Peer-assisted learning (PAL) - where students take up a teaching role at an early stage of their training-is widely used in medical curricula. Many qualitative studies have investigated the perceptions and benefits of PAL, but no studies have longitudinally explored how peer teachers experienced their development. This could allow for a better understanding of PAL. In this study, we explored the perceived impact of being a peer teacher on the development of personal and professional competencies as a medical student. METHODS: We longitudinally conducted semi-structured interviews with peer teachers, during their 2-year teaching period in the skills lab at the University of Antwerp and applied descriptive thematic analysis. RESULTS: In total we gathered 47 interviews in 13 peer teachers (9 female, 4 male,. 1-7 interviews each). Peer teachers reported an increase in self-confidence, which gradually transformed into self-efficacy in clinical and teaching skills., Participants told us to be inspired by the previous generation of peer teachers. Their motivation shifted from personal benefits to benefiting others while becoming a role model themselves. The peer teachers illustrated how they developed maturity by integrating different CanMEDS roles. They grew in reflection, changed/transformed an initial mark-driven study drive into more patient-centered ambitions, and started developing a personal style. CONCLUSIONS: Our study suggests that being a peer teacher leads to more self-efficacy, in clinical and teaching skills, to become a role model with as motivation to benefit others and to grow towards a good doctor maturity. Although the task is to teach peers, this opportunity nurtures the practice and integration of various CanMEDS roles, not only that of scholar but also communicator, collaborator and leader, thereby positively influencing their personal and professional development and their identity as a doctor (professional role).

World Psychiatric Association-Asian Journal of Psychiatry Commission on Psychiatric Education in the 21st century.

Psychiatric practice faces many challenges in the first quarter of 21st century. Society has transformed, as have training requirements and patient expectations, underlining an urgent need to look at educational programmes. Meanwhile, awareness has grown around psychiatric disorders and there are evolving workforce trends, with more women going to medical school and specialising in psychiatry. Trainee psychiatrists carry different expectations for work-life balance and are increasingly becoming conscious of their own mental health. A tendency to see health as a commodity and the litigious nature of society has elicited additional pressures for healthcare professionals. Cartesian mind-body dualism has created further complexity and this can often be frustrating for patients and care-partners alike. In many cultures across Asia and beyond, patients can present with physical symptoms to express underlying psychological distress with increasing physical investigations. Simultaneously, in various countries, a shift from asylums to community-based interventions and then home treatments have changed psychiatric care in remarkable ways. These changes have added to pressures faced by mental healthcare professionals. However, trainees and other mental healthcare professionals continue to receive similar training as they did a generation ago. The tensions and differences in ideology/orientation between different branches of psychiatry have made responses to patient needs challenging. Recognising that it is difficult to predict the future, this World Psychiatric Association-Asian Journal of Psychiatry Commission makes recommendations that could help institutions and individuals enhance psychiatric education. This Commission draws from existing resources and recent developments to propose a training framework for future psychiatrists.

Peering Into the Future: A First Look at the CBME Transition to Practice Stage in Diagnostic Radiology.

RATIONALE AND OBJECTIVES: Queen's University (Kingston, ON, Canada) adopted a competency-based medical education (CBME) curriculum for Diagnostic Radiology residency training in an accelerated manner in 2017, with the curriculum comprised of four stages of training. This article focuses on the final stage (Transition to Practice), during which assessment methods of the new national curriculum (implemented in July 2022) were piloted. This study aims to highlight the challenges and opportunities associated with the implementation of CBME in Diagnostic Radiology training and specific considerations for programs undergoing this curricular transition. MATERIALS AND METHODS: Ethics approval was provided by the affiliated hospital Research Ethics Board. All relevant electronic assessments pertaining to all trainees who had completed the Transition to Practice stage (n = 3) were collated, deidentified, analyzed, and presented in tabulated format. RESULTS: A total of 39 evaluations completed by 13 assessors were assessed, with an average time of 3 minutes and 6 seconds to complete an assessment form. Also, 95% of evaluations were rated as entrustments. However, no residents met the minimum number of required entrustments for all five stage-specific Entrustable Professional Activities. These 39 evaluations included 219 milestone rating scores, with 86% rated as "achieved." Following review by the residency program Competence Committee, all three residents were promoted from the Transition to Practice stage. CONCLUSION: Challenges in CBME implementation include the number and quality of resident assessments. Strategies for success may include providing clear guidelines and training for both faculty and residents, early identification and intervention, and adopting a holistic evaluation strategy. CBME has the potential to enhance medical education quality by emphasizing learner progress toward competency and providing personalized feedback and support.

The Use of Web-Based Patient Reviews to Assess Medical Oncologists' Competency: Mixed Methods Sequential Explanatory Study.

BACKGROUND: Patients increasingly use web-based evaluation tools to assess their physicians, health care teams, and overall medical experience. OBJECTIVE: This study aimed to evaluate the extent to which the standardized physician competencies of the CanMEDS Framework are present in web-based patient reviews (WPRs) and to identify patients' perception of important physician qualities in the context of quality cancer care. METHODS: The WPRs of all university-affiliated medical oncologists in midsized cities with medical schools in the province of Ontario (Canada) were collected. Two reviewers (1 communication studies researcher and 1 health care professional) independently assessed the WPRs according to the CanMEDS Framework and identified common themes. Comment scores were then evaluated to identify κ agreement rates between the reviewers, and a descriptive quantitative analysis of the cohort was completed. Following the quantitative analysis, an inductive thematic analysis was performed. RESULTS: This study identified 49 actively practicing university-affiliated medical oncologists in midsized urban areas in Ontario. A total of 473 WPRs reviewing these 49 physicians were identified. Among the CanMEDS competencies, those defining the roles of medical experts, communicators, and professionals were the most prevalent (303/473, 64%; 182/473, 38%; and 129/473, 27%, respectively). Common themes in WPRs include medical skill and knowledge, interpersonal skills, and answering questions (from the patient to the physician). Detailed WPRs tend to include the following elements: experience and connection; discussion and evaluation of the physician's knowledge, professionalism, interpersonal skills, and punctuality; in positive reviews, the expression of feelings of gratitude and a recommendation; and in negative reviews, discouragement from seeking the physician's care. Patients' perception of medical skills is less specific than their perception of interpersonal qualities, although medical skills are the most commented-on element of care in WPRs. Patients' perception of interpersonal skills (listening, compassion, and overall caring demeanor) and other experiential phenomena, such as feeling rushed during appointments, is often specific and detailed. Details about a physician's interpersonal skills or "bedside manner" are highly perceived, valued, and shareable in an WPR context. A small number of WPRs reflected a distinction between the value of medical skills and that of interpersonal skills. The authors of these WPRs claimed that for them, a physician's medical skills and competence are more important than their interpersonal skills. CONCLUSIONS: CanMEDS roles and competencies that are explicitly patient facing (ie, those directly experienced by patients in their interactions with physicians and through the care that physicians provide) are the most likely to be present and reported on in WPRs. The findings demonstrate the opportunity to learn from WPRs, not simply to discern physicians' popularity but to grasp what patients may expect from their physicians. In this context, WPRs can represent a method for the measurement and assessment of patient-facing physician competency.

5 Slides in 5 Minutes: Incorporating CanMEDS Competencies on Acute Care Surgery.

BACKGROUND: The University of British Columbia (UBC) Division of General Surgery developed an initiative entitled "5-in-5s" to improve educational opportunities on the Acute Care Surgery (ACS) service. We examined whether 5-in-5s are felt to be a valuable teaching tool, and evaluated their ability to incorporate CanMEDS competencies within the General Surgery program. METHODS: A web-based survey was distributed to all general surgery trainees and staff on ACS that have participated in 5-in-5s. RESULTS: A total of 37 responses were collected (62% response rate). All respondents felt 5-in-5s were valuable overall. Four of the seven CanMEDS competencies were evaluated. About 100% felt their knowledge was positively impacted by presenting, and 80% by attending alone. About 71% of respondents agreed that 5-in5s provided opportunities for health advocacy, 50% for collaboration, and 36% for leadership. CONCLUSION: We identified 5-in-5s as a valuable teaching method and a novel approach to integrate CanMEDS competencies into ACS training.

Fitness-for-purpose of the CanMEDS competencies for workplace-based assessment in General Practitioner's Training: a Delphi study.

BACKGROUND: In view of the exponential use of the CanMEDS framework along with the lack of rigorous evidence about its applicability in workplace-based medical trainings, further exploring is necessary before accepting the framework as accurate and reliable competency outcomes for postgraduate medical trainings. Therefore, this study investigated whether the CanMEDS key competencies could be used, first, as outcome measures for assessing trainees' competence in the workplace, and second, as consistent outcome measures across different training settings and phases in a postgraduate General Practitioner's (GP) Training. METHODS: In a three-round web-based Delphi study, a panel of experts (n = 25-43) was asked to rate on a 5-point Likert scale whether the CanMEDS key competencies were feasible for workplace-based assessment, and whether they could be consistently assessed across different training settings and phases. Comments on each CanMEDS key competency were encouraged. Descriptive statistics of the ratings were calculated, while content analysis was used to analyse panellists' comments. RESULTS: Out of twenty-seven CanMEDS key competencies, consensus was not reached on six competencies for feasibility of assessment in the workplace, and on eleven for consistency of assessment across training settings and phases. Regarding feasibility, three out of four key competencies under the role "Leader", one out of two competencies under the role "Health Advocate", one out of four competencies under the role "Scholar", and one out of four competencies under the role "Professional" were deemed as not feasible for assessment in a workplace setting. Regarding consistency, consensus was not achieved for one out of five competencies under "Medical Expert", two out of five competencies under "Communicator",one out of three competencies under "Collaborator", one out of two under "Health Advocate", one out of four competencies under "Scholar", one out of four competencies under "Professional". No competency under the role "Leader" was deemed to be consistently assessed across training settings and phases. CONCLUSIONS: The findings indicate a mismatch between the initial intent of the CanMEDS framework and its applicability in the context of workplace-based assessment. Although the CanMEDS framework could offer starting points, further contextualization of the framework is required before implementing in workplace-based postgraduate medical trainings.

The CASPER preparation program innovation: increasing self-perceived competence and confidence of underrepresented applicants on the novel CASPER Snapshot and CanMEDS roles.

BACKGROUND: Underrepresented Minorities in Medicine (URMMs) may face financial and social limitations when matriculating into medical schools. Performance on situational judgment tests such as Computer-based Assessment for Sampling Personal Characteristics (CASPER) can be enhanced by coaching and mentorship. The CASPER Preparation Program (CPP) coaches URMMs to prepare for the CASPER test. During the coronavirus 2019 pandemic (COVID-19), CPP implemented novel curricula on the CASPER Snapshot and CanMEDS roles. METHODS: Pre and post-program questionnaires were completed by the students, which assessed their: 1) confidence in understanding the CanMEDS roles, and 2) perceived confidence in performing well and their familiarity and preparedness with the CASPER Snapshot. With a second post-program questionnaire, participants' scores on the CASPER test as well as medical school application outcome were also assessed. RESULTS: Participants reported a significant increase in the URMMs' knowledge, self-perceived competency to complete the CASPER Snapshot, and their anxiety significantly decreased. The level of confidence in understanding CanMEDS roles for a career in healthcare increased as well. The majority (91%) agreed that the feedback received from tutors was adequate and the virtual component of the program was beneficial during COVID-19. 51% of students scored in the highest quartile on the CASPER test and 35% received an offer of admission from CASPER-requiring medical schools. CONCLUSION: Pathway coaching programs have the potential to increase confidence and familiarity amongst URMMs for the CASPER tests and CanMEDS roles. Similar programs should be developed with the aim to increase the chances of URMMs matriculating into medical schools.

Commentary on alignment of medical student assessment and vocational training in psychiatry and addiction medicine.

OBJECTIVE: To comment upon the potential for alignment of medical student assessment and vocational specialist training through the RANZCP-CanMEDS model of Entrustable Professional Activities (EPAs) and Workplace-Based Assessments (WBAs). We discuss a specific post hoc example of such an alignment in an Australian graduate medical school in Psychiatry and Addiction Medicine. CONCLUSIONS: Vocational training models of assessment, such as the RANZCP specialist training program for psychiatrists, can potentially be mapped to medical student education in formative and summative assessment through CanMEDs-based EPAs and WBAs, to assist in transition to specialist training.

Adolescent medicine training in postgraduate family medicine education: a scoping review.

INTRODUCTION: Adolescents and young adults require age-appropriate healthcare services delivered by clinicians with expertise in adolescent medicine. However, resident family physicians report a low perceived self-efficacy and under-preparedness to deliver adolescent medical care. We conducted a scoping review to map the breadth and depth of the current evidence about adolescent medicine training for family medicine residents. CONTENT: We followed Arksey and O'Malley's framework and searched seven electronic databases and key organizations' webpages from inception to September 2020. Informed by the CanMEDS-FM, we analyzed the extracted data concerning basic document characteristics, competencies and medical topics using numerical and qualitative content analysis. SUMMARY: We included 41 peer-reviewed articles and six adolescent health competency frameworks (n=47). Most competencies taught in family medicine programs were organized under the roles of family medicine expert (75%), communicator (11.8%), and professional roles (7.9%). Health advocate and leader were rarely included (1.3%), and never scholar. OUTLOOK: The omission of multiple competency roles in family medicine resident education on adolescents is insufficient for family physicians to deliver optimal care to adolescents. The combined efforts of family medicine stakeholders to address adolescent medicine competency gaps may positively impact the perceived competence reported by family medicine residents.

MatricS-A novel tool for monitoring professional role development in surgical disciplines.

Introduction: Mentoring is an effective method for human resource development. Monitoring the process is important for individual mentee/mentor pairs as well as for program directors. Due to individual personality differences of both mentees and mentors and their respective interactions, it is challenging to monitor the individual development process of mentees in a structured manner. This study investigates to what extent a novel instrument, the mentee-based assessment tool for role development of interpersonal competencies in surgical professions (MatricS) can adequately monitor the professional role development process of residents during an established mentoring program. Material and methods: In a prospective longitudinal study, the competence development of 31 mentees in two subsequent cohorts was assessed by a modified role matrix based on Canadian Medical Education Directives for Specialists. The evaluation focused on three defined roles (D, developer; N, networker; M, multiplicator) at three levels (private, employer-related, national/international) with four stages of development. For validation of mentee self-assessments, the assessments of the respective mentors were recorded alongside. For correlation analyses, Pearson coefficients were calculated, pre-post-comparisons were done by paired t-tests; significance was assumed at p < 0.05, respectively. Results: Mentee self-assessments overall correlated well with the objective mentor assessments (Pearson's r 0.8, p < 0.001). Significant correlations of this magnitude were found for both individual cohorts as well as for all individual roles. The mentees acquired competencies in all roles indicated by significant increases of corresponding MatricS scores. The largest competency gains (mean ± SD) were found in the role D (start: 1.30 ± 0.77, end: 2.13 ± 0.83, p < 0.001). The majority of mentees achieved the prespecified target competency level in >75% of all roles and levels. Conclusion: The role development process during mentoring can be reliably monitored by using MatricS. MatricS scores highly correlate between mentees and mentors, indicating that mentee self-assessments are suitable and sufficient for monitoring. These findings help to lessen the work burden on senior surgeons and thus can help to increase the acceptance of mentoring programs in surgical disciplines.

Validity evidence for summative performance evaluations in postgraduate community pharmacy education.

INTRODUCTION: Workplace-based assessment of competencies is complex. In this study, the validity of summative performance evaluations (SPEs) made by supervisors in a two-year longitudinal supervisor-trainee relationship was investigated in a postgraduate community pharmacy specialization program in the Netherlands. The construct of competence was based on an adapted version of the 2005 Canadian Medical Education Directive for Specialists (CanMEDS) framework. METHODS: The study had a case study design. Both quantitative and qualitative data were collected. The year 1 and year 2 SPE scores of 342 trainees were analyzed using confirmatory factor analysis and generalizability theory. Semi-structured interviews were held with 15 supervisors and the program director to analyze the inferences they made and the impact of SPE scores on the decision-making process. RESULTS: A good model fit was found for the adapted CanMEDS based seven-factor construct. The reliability/precision of the SPE measurements could not be completely isolated, as every trainee was trained in one pharmacy and evaluated by one supervisor. Qualitative analysis revealed that supervisors varied in their standards for scoring competencies. Some supervisors were reluctant to fail trainees. The competency scores had little impact on the high-stakes decision made by the program director. CONCLUSIONS: The adapted CanMEDS competency framework provided a valid structure to measure competence. The reliability/precision of SPE measurements could not be established and the SPE measurements provided limited input for the decision-making process. Indications of a shadow assessment system in the pharmacies need further investigation.

Does peer teaching improve academic results and competencies during medical school? A mixed methods study.

BACKGROUND: This study investigates the impact of Peer-Assisted Learning (PAL) in clinical skills on peer teachers' academic scores and competencies; however, controversy remains on this topic, and concrete evidence on its impact lacking. METHODS: We performed a mixed methods study combining a retrospective cohort study with a modified Delphi survey. Peer teachers and Skills Lab faculty members participated in this study. A validated questionnaire, the CanMEDS Competency Based Inventory (CCBI), and group interviews were used to assess the outcomes of PAL. Our results were also triangulated with literature data. RESULTS: In 3 consecutive cohorts of medical students (n = 311), 78 participated in PAL. Peer teachers obtained higher scores from the start of the study, at different timepoints in medical school, and on their final scores compared to all other students. Interestingly their progress followed the same path and magnitude as other well-performing students. However, based on our findings from a modified Delphi survey (CCBI interviews) and a literature review, we found further supporting evidence for a positive impact of PAL on the competencies of physical skills (medical expert), teamwork and leadership (collaborator), lifelong learning (scholar), and for admitting uncertainty/limits (professional) within the CanMEDS roles. CONCLUSIONS: We conclude that higher achieving students are more likely to volunteer for a peer tutoring program; however this does not significantly augment their academic scores as compared to above well-performing non-teaching fellow students. Importantly, our modified Delphi survey indicated which CanMEDS roles were positively impacted by PAL: medical expert, collaborator, scholar and professional.

An online Delphi study to investigate the completeness of the CanMEDS Roles and the relevance, formulation, and measurability of their key competencies within eight healthcare disciplines in Flanders.

BACKGROUND: Several competency frameworks are being developed to support competency-based education (CBE). In medical education, extensive literature exists about validated competency frameworks for example, the CanMEDS competency framework. In contrast, comparable literature is limited in nursing, midwifery, and allied health disciplines. Therefore, this study aims to investigate (1) the completeness of the CanMEDS Roles, and (2) the relevance, formulation, and measurability of the CanMEDS key competencies in nursing, midwifery, and allied health disciplines. If the competency framework is validated in different educational programs, opportunities to support CBE and interprofessional education/collaboration can be created. METHODS: A three-round online Delphi study was conducted with respectively 42, 37, and 35 experts rating the Roles (n = 7) and key competencies (n = 27). These experts came from non-university healthcare disciplines in Flanders (Belgium): audiology, dental hygiene, midwifery, nursing, occupational therapy, podiatry, and speech therapy. Experts answered with yes/no (Roles) or on a Likert-type scale (key competencies). Agreement percentages were analyzed quantitatively whereby consensus was attained when 70% or more of the experts scored positively. In round one, experts could also add remarks which were qualitatively analyzed using inductive content analysis. RESULTS: After round one, there was consensus about the completeness of all the Roles, the relevance of 25, the formulation of 24, and the measurability of eight key competencies. Afterwards, key competencies were clarified or modified based on experts' remarks by adding context-specific information and acknowledging the developmental aspect of key competencies. After round two, no additional key competencies were validated for the relevance criterion, two additional key competencies were validated for the formulation criterion, and 16 additional key competencies were validated for the measurability criterion. After adding enabling competencies in round three, consensus was reached about the measurability of one additional key competency resulting in the validation of the complete CanMEDS competency framework except for the measurability of two key competencies. CONCLUSIONS: The CanMEDS competency framework can be seen as a grounding for competency-based healthcare education. Future research could build on the findings and focus on validating the enabling competencies in nursing, midwifery, and allied health disciplines possibly improving the measurability of key competencies.

The McMaster Advanced Communication Competencies Model for Psychiatry (MACC Model).

OBJECTIVE: Communication is a core competency for all physicians in training. In Canada, the importance of communication during residency is recognized through the CanMEDS framework. Although literature exists around teaching communication skills to residents, research in psychiatry residents is lacking. The purpose of this study was to explore how faculty members conceptualize the development of communication skills in psychiatry residents and develop a model reflecting this. METHODS: The authors used a constructivist grounded theory approach. Purposive sampling was used to select 14 faculty educators who regularly supervise psychiatry residents in a single university-based residency training program. Semi-structured interviews were conducted to explore educators' perceptions of how communication skills develop during residency. Constant comparative analysis occurred concurrently with data collection until thematic theoretical sufficiency was reached and relationships between themes determined. RESULTS: Five themes underlie the McMaster Advanced Communication Competencies model, describing the progressive development of communication abilities in residents. Three themes identify foundational sets of abilities including: refining common foundational relational abilities, developing foundational specific psychiatric communication abilities, and learning to reflect upon and manage internal reactions. These foundational pillars then allow residents to develop a personalized art of flexible psychiatric interviewing, and skillfully partner with patients in co-creating care plans. CONCLUSIONS: This research describes a preliminary communication competency model for teaching and assessing psychiatry residents. It defines the core communication abilities required for residents to progress to independent practice. Future research could explore and test the model's validity and transferability.

"When in Doubt, Ask the Patient": A Quantitative, Patient-Oriented Approach to Formative Assessment of CanMEDS Roles.

Introduction: Since the introduction of competency-based frameworks into postgraduate medical curricula, educators have struggled to implement robust assessment tools that document the progression of necessary skills. The global movement towards competency-based medical education demands validated assessment tools. Our objective was to provide validity evidence for the Ottawa CanMEDS Competency Assessment Tool (OCCAT), designed to assess clinical performance in the communicator, professional, and health advocate CanMEDS roles. Methods: We developed the OCCAT, a 29-item questionnaire informed by specialty-specific Entrustable Professional Activities and consultation with stakeholders, including patients. Our sample included nine neonatal-perinatal medicine and maternal fetal medicine fellows rotating through antenatal high-risk clinics at the Ottawa Hospital. Following 70 unique encounters, the OCCAT was completed by patients and learners. Generalizability theory was used to determine overall reliability of scores. Differences in self and patient ratings were assessed using analyses of variance. Results: Generalizability analysis demonstrated that both questionnaires produced reliable scores (G-coefficient > 0.9). Self-scores were significantly lower than patient scores across all competencies, F(1, 6) = 13.9, p = .007. Variability analysis demonstrated that trainee scores varied across all competencies, suggesting both groups were able to recognize competencies as distinct and discriminate favorable behaviors belonging to each. Discussion: Our findings lend support to the movement to integrate self-assessment and patient feedback in formal evaluations for the purpose of enriched learner experiences and improved patient outcomes. We anticipate that the OCCAT will facilitate bridging to competency-based medical education.

Are interpersonal communication skills adequately taught at postgraduate specialist level in South Africa? The neurology experience.

BACKGROUND: Interpersonal communication skills by clinicians with patients, carers, fellow health professionals and legal professionals carry many unique challenges in practice. Whilst undergraduate training in communication helps with generic information receiving and information giving, uncomfortable and demanding speciality-specific issues in the various medical specialities are not covered during under- and postgraduate training. METHODS: The aim of this study was to determine the self-perceived competence of neurology registrars and neurologists in interpersonal communication and the need for such assessment in college exit exams. We undertook a quantitative, descriptive, cross-sectional survey by using self-administered printed questionnaires and the EvaSYS online system. Neurology registrars in training from the seven training centres in South Africa and neurologists based at the training centres and in the private sector were recruited. RESULTS: We received a 62.9% response rate. One hundred and twenty-nine participants were recruited comprising 42 neurology registrars and 87 neurologists. Registrars were more commonly female, more likely to be multilingual and less likely to use translators. Undergraduate training in communication was considered insufficient, 42.9% and 39.1% for registrars and specialists respectively, and was also considered not relevant to address speciality-specific issues encountered in practice. Most training received has been by observation of others and on-the-job training. Both groups felt strongly that postgraduate training in interpersonal communication was important (registrars 95.2%, specialists 91.9%), especially when dealing with issues of death and dying, disclosing medical errors and dealing with the legal profession. CONCLUSION: Postgraduate training of interpersonal communication as required of neurology registrars and neurologists was considered insufficient. Most training has been by observation of others or experiential by trial and error. Assessment of interpersonal communication at board exit exams will drive postgraduate training and importantly will embrace the AfriMEDS framework developed to produce the holistic doctor in South Africa.

Creating a Competency-Based Medical Education Curriculum for Canadian Diagnostic Radiology Residency (Queen's Fundamental Innovations in Residency Education)-Part 2: Core of Discipline Stage.

PURPOSE: All postgraduate residency programs in Canada are transitioning to a competency-based medical education (CBME) model divided into 4 stages of training. Queen's University has been the first Canadian institution to mandate transitioning to CBME across all residency programs, including Diagnostic Radiology. This study describes the implementation of CBME with a focus on the third developmental stage, Core of Discipline, in the Diagnostic Radiology residency program at Queen's University. We describe strategies applied and challenges encountered during the adoption and implementation process in order to inform the development of other CBME residency programs in Diagnostic Radiology. METHODS: At Queen's University, the Core of Discipline stage was developed using the Royal College of Physicians and Surgeons of Canada's (RCPSC) competence continuum guidelines and the CanMEDS framework to create radiology-specific entrustable professional activities (EPAs) and milestones for assessment. New committees, administrative positions, and assessment strategies were created to develop these assessment guidelines. Currently, 2 cohorts of residents (n = 6) are enrolled in the Core of Discipline stage. RESULTS: EPAs, milestones, and methods of evaluation for the Core of Discipline stage are described. Opportunities during implementation included tracking progress toward educational objectives and increased mentorship. Challenges included difficulty meeting procedural volume requirements, inconsistent procedural tracking, improving feedback mechanisms, and administrative burden. CONCLUSION: The transition to a competency-based curriculum in an academic Diagnostic Radiology residency program is significantly resource and time intensive. This report describes challenges faced in developing the Core of Discipline stage and potential solutions to facilitate this process.

Visiting and observing: reflections on clinical observer visits to Neuropsychiatry, Royal Melbourne Hospital.

OBJECTIVES: To describe and provide experiential reflections on a model of continuing professional development in psychiatry for development and maintenance of specialised skills. CONCLUSIONS: For clinical psychiatrists working in smaller population centres, clinical observer visits with peers may be a useful method to develop, improve and calibrate knowledge and skills. Such potential benefits may be even more marked for specialised fields of psychiatry, such as neuropsychiatry.