Educational renewal of physician training in Australia and New Zealand: Multiple educational innovations in a complex environment.

AIM: The Royal Australasian College of Physicians is renewing its specialty training programs and shifting towards competency-based medical education. Our aim is to improve the quality and rigor of training and graduate outcomes, and promote high standards of physician practice to serve the health of patients, families, and communities in a changing healthcare environment. METHODS: We are progressing holistic change and multiple educational innovations in a complex environment. Numerous stakeholders, a disparate training landscape and a largely volunteer supervisor workforce pose challenges in supporting effective implementation. This paper describes our progress and experience with three key components of our education renewal program: curricular renewal, a new selection process and faculty development. It offers reflections on the practical challenges, lessons learned and factors critical for success. CONCLUSIONS: Our experience highlights opportunities for training organizations to maximize their influence over workplace training experiences and outcomes by taking a systems approach to the design, delivery and evaluation of the components of education renewal. We found that design, development and delivery of our multiple educational innovations have benefited from co-design approaches, progressive and concurrent development, continual exploration of new strategies, and implementation as soon as viable with a commitment to iterative improvements over time.

Utility of selection methods for specialist medical training: A BEME (best evidence medical education) systematic review: BEME guide no. 45.

BACKGROUND: Selection into specialty training is a high-stakes and resource-intensive process. While substantial literature exists on selection into medical schools, and there are individual studies in postgraduate settings, there seems to be paucity of evidence concerning selection systems and the utility of selection tools in postgraduate training environments. AIM: To explore, analyze and synthesize the evidence related to selection into postgraduate medical specialty training. METHOD: Core bibliographic databases including PubMed; Ovid Medline; Embase, CINAHL; ERIC and PsycINFO were searched, and a total of 2640 abstracts were retrieved. After removing duplicates and screening against the inclusion criteria, 202 full papers were coded, of which 116 were included. RESULTS: Gaps in underlying selection frameworks were illuminated. Frameworks defined by locally derived selection criteria, and heavily weighed on academic parameters seem to be giving way to the evidencing of competency-based selection approaches in some settings. Regarding selection tools, we found favorable psychometric evidence for multiple mini-interviews, situational judgment tests and clinical problem-solving tests, although the bulk of evidence was mostly limited to the United Kingdom. The evidence around the robustness of curriculum vitae, letters of recommendation and personal statements was equivocal. The findings on the predictors of past performance were limited to academic criteria with paucity of long-term evaluations. The evidence around nonacademic criteria was inadequate to make an informed judgment. CONCLUSIONS: While much has been gained in understanding the utility of individual selection methods, though the evidence around many of them is equivocal, the underlying theoretical and conceptual frameworks for designing holistic and equitable selection systems are yet to be developed.