From theory to actual practice: creation and application of milestones in an internal medicine residency program, 2004-2010.

BACKGROUND: In the USA, the Accreditation Council of Graduate Medical Education, Educational Innovations Project is a partner in reshaping residency training to meet increasingly complex systems of health care delivery. AIM: We describe the creation and implementation of milestones as a vehicle for translating educational theory into practice in preparing residents to provide safe, autonomous patient care. METHOD: Six program faculty leaders, all with advanced medical education training, met in an iterative process of developing, implementing, and modifying milestones until a final set were vetted. RESULTS: We first formed the profile of a Master Internist. We then translated it into milestone language and implemented its integration across the program. Thirty-seven milestones were applied in all settings and rotations to reach explicit educational outcomes. We created three types of milestones: Progressive, build one on top of the other to mastery; additive, adding multiple behaviors together to culminate in mastery; and descriptive, using a proscribe set of complex, predetermined steps toward mastery. CONCLUSIONS: Using milestones, our program has enhanced an educational model into explicit, end of training goals. Milestone implementation has yielded positive results toward competency-based training and others may adapt our strategies in a similar effort.

"I can do patient care on my own": autonomy and the manager role.

PURPOSE: An internal medicine (IM) residency program redesigned its second year, the Manager Year, to restore balance among autonomy, supervision, and clinical competence. This study examined the response of residents and some supervising attendings to this innovation. METHOD: In this qualitative study-part of a total program evaluation-two authors gathered data from 36 second-year resident-managers, 3 third-year residents, and 8 attendings through semistructured interviews between spring 2005 and spring 2007. All resident-managers in 2005-2006 and all but one in 2006-2007 were interviewed. From verbatim transcripts, two of the authors coded the responses into themes; then all four reviewed and revised these themes. RESULTS: Coding revealed that second-year residents associated four qualities with their experience as managers: ownership of patients, accountability to others, competence in patient management skills, and personal satisfaction. They described the manager role as being as being "on your own." They were accountable to fellow managers, attendings, and nursing staff at a different level from that of an intern. Without an intern to teach, they learned critical management skills to complete their work. They became adult learners around their own patient cases. CONCLUSIONS: Successful preparation of physicians for independent practice requires a careful balance between autonomy and supervision, increasing the former during the training program sequence. For resident-managers, the assignment as principle caregiver occurs at the interface between the two. Managers identify themselves as a great deal more autonomous while still valuing attending supervision and input from co-managers to meet responsibilities.

Managing change in postgraduate medical education: still unfreezing?

BACKGROUND: Modernizing Medical Careers (MMC) is an ambitious project to change the training of UK doctors. A key to its successful implementation is the ways that MMC is perceived and operationalized by senior doctors who act as local educational leaders and supervisors. AIMS: To analyse hospital consultants' perceptions of the modernization process and its impact on their role as the primary educators of Senior House Officers (SHOs), using Schein's extended model to explain their stage in the process of change. METHODS: We interviewed medical directors, College and clinical tutors and education supervisors at 6 Trusts. The transcripts were analysed using Schein's change model to explore the perceptions and assumptions of senior medical staff and to determine their stage in the process of change. RESULTS: 12 tutors, 12 supervisors, and 4/6 medical directors approached agreed to participate (28/30). Nine themes emerged from transcript analysis. These were related to the three-stage model of change. Most participants were at the stage of 'unfreezing', expressing views around disconfirmation of expectations, guilt and anxiety and feelings of some psychological safety. A smaller number were at the stage of 'moving to a new position'. There were limited examples of 'refreezing'. CONCLUSIONS: At the local delivery level, most senior doctors were aware of the need to review their current position and alter their approaches and assumptions about postgraduate medical education. Yet only a minority were moving forward. Considerable work remains for successful implementation of MMC.

Learning the house officer role: reflections on the value of shadowing a PRHO.

In the new integrated undergraduate medical programme at the University of Manchester, fifth-year students spend several weeks shadowing the pre-registration house officer (PRHO) whose post they will take over. The concept of 'shadowing' emerged from a set of interviews conducted with graduates during their first PRHO job. Graduates felt that shadowing helped them to gain familiarity with the work environment; with orientation to the role of a PRHO; and with specific learning, such as disease management, on which they could then get feedback. We hypothesize that shadowing provides an opportunity for focused apprenticeship learning of the future PRHO role. Further research may clarify the specific values of shadowing and how it might lessen the stresses faced by new graduates during the transition from student to doctor.

Views, behaviours and perceived staff development needs of doctors and surgeons regarding learners in outpatient clinics.

INTRODUCTION: The need to use outpatient clinics as a major learning environment in hospitals for students and doctors-in-training is clear. However, consultant supervisors perceive major barriers to this and continue to rely heavily on traditional inpatient learning. This quantitative study examines what approaches consultant supervisors employ in outpatient learning, together with what they perceive themselves to use and what they would value in further training. METHODS: We observed learning episodes for students and doctors-in-training in medical and surgical clinics. A questionnaire on outpatient teaching was also sent to consultant doctors and surgeons. This was based on these observations and focus groups with students and doctors-in-training. RESULTS: There was an overall survey response rate of 62% (194/311). The dominant forms of learning we observed were 'arms-length' supervision for doctors-in-training and 'modelling' for students. Only 7% of learning episodes involved a doctor-in-training doing something under direct supervision. In contrast to the observation results, consultants considered that students and doctors-in-training received a lot of direct supervision and interaction. For example, 45% considered that doctors-in-training 'may see patients with me in a joint consultation'. Only 30% of respondents would be interested in staff development in learning in outpatient clinics. CONCLUSIONS: Although consultants reported that they frequently used an active approach to learning in outpatient clinics, modelling was used predominantly for students and arms-length supervision was used for doctors-in-training.

A qualitative study of the attitudes to teamwork of graduates from a traditional and an integrated undergraduate medical course.

INTRODUCTION: In 1994 the University of Manchester medical school introduced an integrated undergraduate course using problem-based learning throughout. This study explores differences between the new and old (traditional) course graduates' attitudes to, and conceptualization of, teamwork. METHODS: Semi-structured interviews were conducted with 24 graduates of the traditional course (graduating in 1998) and 23 from the new course (1999 graduates), representing approximately 14% of graduates from each cohort. Theories were then developed from concepts emerging from the data. RESULTS: The new course graduates (NCGs) had a broader view of members of a health professional team. The NCGs believed that the medical team should provide support and were more comfortable consulting them when faced with problems. CONCLUSIONS: The new curriculum has had some impact on conceptualization and attitude to teamwork. However, further development is required if graduates are to see themselves as part of a multi-professional team.

Does a new undergraduate curriculum based on Tomorrow's Doctors prepare house officers better for their first post? A qualitative study of the views of pre-registration house officers using critical incidents.

INTRODUCTION: In 1994 Manchester University introduced an integrated undergraduate medical course using problem-based learning (PBL) throughout. The study reported here explored whether there were any differences between the new course graduates (NCGs) and the traditional course graduates (TCGs) in the types of scenarios they recalled as 'critical incidents', or challenging cases, while working as pre-registration house officers (PRHOs). The focus is on differences rather than causal links. METHOD: We used semistructured interviews to generate our data. Twenty-four traditional course graduates and 23 new course graduates were interviewed approximately 3 months after starting their first PRHO placement. RESULTS: We identified 4 types of critical incidents relating to: clinical practice; limitations of competence; emotional involvement; and communication. Traditional course graduates reported difficulties in making patient management decisions, whereas the NCGs were better at dealing with uncertainty, knowing their limits and asserting their rights for support. Communication difficulties and coping with emotional involvement were common across both groups of graduates and hence remain problems in relation to being prepared for the role of a PRHO. CONCLUSIONS: Graduates of the new, integrated curriculum seemed to be much better at dealing with uncertainty, knowing their personal limits and asserting their rights for support when they felt these limits had been reached. Communication difficulties and emotional involvement remain major factors in the transition from student to PRHO.

Should medical school faculty see assessments of students made by previous teachers?

Whether medical school faculty should be provided with assessments of students made by previous teachers remains controversial. To document which schools have implemented policies that address this issue and to characterize the specific features of these policies, in 1998 the authors conducted a direct mail survey of deans of student affairs and medical education at 144 medical schools in the United States, Canada, and Puerto Rico. Replies were received from 129 (90%) of the 144 medical schools. Of those schools, 72 (56%) reported having policies that address this issue. The policies permit the sharing of information in 38 (53%) of the 72 schools that had policies; therefore, at the time of this study, 29% of the 129 medical schools that responded to the survey had a policy that permits the sharing of assessment information. The policies permit the sharing of information related to problems with academic performance (35%), professional conduct (35%), physical health (25%), and miscellaneous circumstances, such as learning disability (5%). Information may be shared with clerkship coordinators (44%), course directors (35%), faculty mentors (11%), clinical faculty supervisors (8%), and resident supervisors (3%). The findings show that there is considerable diversity in the format and content of policies that address the issue of whether medical school faculty should be provided with information about students' assessments made by previous teachers. The authors explain why policies that require the provision of such information are helpful to medical school faculty, and offer recommendations based on the survey findings.

Translational medicine in the first year: integrative cores.

OBJECTIVE: The intensity of the first year leaves many students pondering the wisdom of their career choice. In creating its new curriculum, Mount Sinai School of Medicine faced this issue of burnout by devoting the last three weeks of the first year to a course that links basic science concepts introduced at the bench to the clinical care of patients. The goal of "Bench to Bedside Selectives" is to reenergize students' career choice by allowing them to experience a multidisciplinary approach to translational medicine. Students participate in an in-depth study of a selected disease entity under the direction of a faculty core leader. DESCRIPTION: In 2001, students selected either a research core (n = 57), which allowed them to expand their summer research time, or a disease-focused core (n = 48). Six diseasefocused cores were offered, each consisting of didactic sessions, exposure to basic research, diagnostic laboratory techniques, ethics, health policy, pharmacology, and clinical experiences. The cores were as follows: (1) Atherosclerotic Heart Disease: Integration of Basic Science and Clinical Medicine; (2) Translational Medicine in HIV: A Road to a Cure; (3) Gene Therapy: A Journey from Scientific Principles to Clinical Applications; (4) Solid Organ Transplantation: Defying Mother Nature; (5) The ABC's of Liver Disease; (6) The New Frontiers in Aging. Core leaders were responsible for developing and implementing their programs and recruiting faculty from many departments. All students completed an independent project tailored to their core. For example, the HIV core included modules on AIDS in Africa and needle-exchange programs, and the students' final project was a debate on whether "there will or will not be an effective HIV vaccine in the next 5 years." Students ranked their top three choices among the cores. Most (96%) were enrolled in their first or second choices, forming groups of six to eight. On the last day of core, students attended a focus group and filled out questionnaires about the strengths and weaknesses of their experience. DISCUSSION: There was overwhelming support for the core experience at the focus session. Most students commented that the program successfully overcame their end-of-first-year blues. All students felt that cores should be continued and recommended additional core selections. Weaknesses cited were inequality in the time and amount of work required for individual cores and an imbalance between excessive didactic material and insufficient clinical exposure in one core. Seventy-one percent of participants also completed the feedback questionnaires; 97% of them strongly agreed that the core successfully integrated material from previous courses; 88% strongly agreed that the clinical presentations demonstrated the relevance of content to medical practice; and 69% strongly agreed that the proportionate mix of lab, clinical, and small-group sessions was appropriate. Faculty were also enthusiastic about their experience. This program will be continued and expanded in 2002. We recommend this teaching format as an antidote to first-year burnout and a novel way to promote the development of physicians with an appreciation of the scientific basis of disease and the role ethics and health policy play in medicine.

Tutor versus computer: a prospective comparison of interactive tutorial and computer-assisted instruction in radiology education.

RATIONALE AND OBJECTIVES: This study compared the educational effectiveness of an interactive tutorial with that of interactive computer-assisted instruction (CAI) and determined the effects of personal preference, learning style, and level of training. MATERIALS AND METHODS: Fifty-four medical students and four radiology residents were prospectively, randomly assigned to receive instruction from different sections of an interactive tutorial and an interactive CAI module. Participants took tests of factual knowledge at the beginning and end of the instruction and a test of visual diagnosis at the end. They completed questionnaires to evaluate their preferred learning styles objectively and to elicit their subjective attitudes toward the two formats. Mean test scores of the tutorial and CAI groups were compared by means of analysis of covariance and two-tailed repeated-measures F test. RESULTS: Both the tutorial and CAI groups demonstrated significant improvement in posttest scores (P < .01 and P < .01, respectively) with the tutorial group's mean posttest score marginally but significantly higher (32.84 vs 28.13, P < .001). There were no significant interaction effects with participants' year of training (P = .845), objectively evaluated preferred learning style (P = .312), subjectively elicited attitude toward learning with CAI (P = .703), or visual diagnosis score (tutorial, 7.61; CD-ROM, 7.75; P = .79). CONCLUSION: Interactive tutorial and optimal CAI are both effective instructional formats. The tutorial was marginally but significantly more effective at teaching factual knowledge, an effect unrelated to students' year of training, learning style, or stated enjoyment of CAI. The superiority of the tutorial is expected to increase when it is compared with commercially expedient CAI modules.

Perceptions of how well graduates are prepared for the role of pre-registration house officer: a comparison of outcomes from a traditional and an integrated PBL curriculum.

INTRODUCTION: Most medical schools in the UK have been engaged in major curriculum reform based on their premises of what might improve undergraduate medical education. In 1994 the course at the medical school of the University of Manchester changed to an integrated course using problem-based learning throughout and with increased emphasis on community-based medical education. This study explores whether the new curriculum has produced any differences in perceptions of how well graduates are prepared for the role of pre-registration house officer. METHODS: A postal questionnaire was used to survey 1998 Manchester graduates (traditional course) and 1999 Manchester graduates (new course), three months into their first pre-registration house officer placement. A similar questionnaire was sent to the educational supervisors who were supervising the graduates. The questionnaire was designed to measure perceptions of levels of preparedness for the role of pre-registration house officer, using a list of broad areas of competence and specific skills listed in the General Medical Council's 'The New Doctor'. RESULTS: Graduates rated the new course significantly more effective for 12 of the 19 broad competences and eight of the 13 specific skills that were listed. The 'new' graduates rated their understanding of disease processes lower than the 'traditional' graduates, but there was no difference in the ratings given by the educational supervisors for this. Overall the educational supervisors rated the new course as better preparing graduates in five of the competences. CONCLUSIONS: Overall, the evaluation shows that a major change in curriculum approach has changed the profile of the perceived preparedness of graduates for entering professional practice.