Implementing medical teaching policy in university hospitals.

Within the unique and complex settings of university hospitals, it is difficult to implement policy initiatives aimed at developing careers in and improving the quality of academic medical teaching because of the competing domains of medical research and patient care. Factors that influence faculty in making use of teaching policy incentives have remained underexplored. Knowledge of these factors is needed to develop theory on the successful implementation of medical teaching policy in university hospitals. To explore factors that influence faculty in making use of teaching policy incentives and to develop a conceptual model for implementation of medical teaching policy in university hospitals. We used the grounded theory methodology. We applied constant comparative analysis to qualitative data obtained from 12 semi-structured interviews conducted at the Radboud University Medical Center. We used a constructivist approach, in which data and theories are co-created through interaction between the researcher and the field and its participants. We constructed a model for the implementation of medical teaching policy in university hospitals, including five factors that were perceived to promote or inhibit faculty in a university hospital to make use of teaching policy incentives: Executive Board Strategy, Departmental Strategy, Departmental Structure, Departmental Culture, and Individual Strategy. Most factors we found to affect individual teachers' strategies and their use of medical teaching policy lie at the departmental level. If an individual teacher's strategy is focused on medical teaching and a medical teaching career, and the departmental context offers support and opportunity for his/her development, this promotes faculty's use of teaching policy incentives.

An investigation of anatomical competence in junior medical doctors.

Because of a decrease of the time available for anatomy education, decisions need to be made to reduce the relevant content of the anatomy curriculum. Several expert consensus initiatives resulted in lists of structures, lacking analysis of anatomical competence. This study aims to explore the use of anatomical knowledge by medical doctors in an attempt to delineate the nature of anatomical competence. The research question is: what kind of anatomical knowledge do junior medical doctors use during a consultation with a patient presenting with a shoulder complaint? Ten junior medical doctors participated in this stimulated recall study. Each of them was videotaped while performing a consultation with a standardized patient with a complex shoulder complaint. The recording was viewed immediately after. Participants were videotaped again while verbalizing the thoughts they remembered having during the consultation. Verbatim transcriptions were coded by two coders using the qualitative data analysis ATLAS.ti software. Results were that these junior medical doctors used anatomical knowledge in all phases of the consultation, especially during physical examination. The use of anatomical terms was strongly associated with clinical reasoning and it was apparent that every subject visualized relevant anatomical information. Conclusion is that young medical doctors actively use their anatomical knowledge and it seems that the relevant anatomy consists largely of adequate visual representations in memory. Anatomy teachers should focus the students' learning activity on building an adequate visual representation of anatomical structures. This should be supported by assessments that test the quality of the students' visual representations.

Understanding resident ratings of teaching in the workplace: a multi-centre study.

Providing clinical teachers with feedback about their teaching skills is a powerful tool to improve teaching. Evaluations are mostly based on questionnaires completed by residents. We investigated to what extent characteristics of residents, clinical teachers, and the clinical environment influenced these evaluations, and the relation between residents' scores and their teachers' self-scores. The evaluation and feedback for effective clinical teaching questionnaire (EFFECT) was used to (self)assess clinical teachers from 12 disciplines (15 departments, four hospitals). Items were scored on a five-point Likert scale. Main outcome measures were residents' mean overall scores (MOSs), specific scale scores (MSSs), and clinical teachers' self-evaluation scores. Multilevel regression analysis was used to identify predictors. Residents' scores and self-evaluations were compared. Residents filled in 1,013 questionnaires, evaluating 230 clinical teachers. We received 160 self-evaluations. 'Planning Teaching' and 'Personal Support' (4.52, SD .61 and 4.53, SD .59) were rated highest, 'Feedback Content' (CanMEDS related) (4.12, SD .71) was rated lowest. Teachers in affiliated hospitals showed highest MOS and MSS. Medical specialty did not influence MOS. Female clinical teachers were rated higher for most MSS, achieving statistical significance. Residents in year 1-2 were most positive about their teachers. Residents' gender did not affect the mean scores, except for role modeling. At group level, self-evaluations and residents' ratings correlated highly (Kendall's τ 0.859). Resident evaluations of clinical teachers are influenced by teacher's gender, year of residency training, type of hospital, and to a lesser extent teachers' gender. Clinical teachers and residents agree on strong and weak points of clinical teaching.

Relations between policy for medical teaching and basic need satisfaction in teaching.

Policy initiatives that aim to elevate the position of medical teaching to that of medical research could influence the satisfaction of three basic psychological needs related to motivation for medical teaching. To explore relations between the satisfaction of three basic psychological needs towards medical teaching and two policy initiatives for medical teaching: (Junior) Principal Lecturer positions [(J)PL positions] and Subsidized Innovation and Research Projects in Medical Education (SIRPMEs). An online questionnaire was used to collect data about medical teaching in the setting of a university hospital. We adapted the Work-related Basic Need Satisfaction scale (Van den Broeck et al. in J Occup Organ Psychol, 83(4):981-1002, 2010), in order to measure feelings of autonomy, competence, and relatedness in teaching. We examined the relations between (J)PL positions and SIRPMEs and the satisfaction of three basic psychological needs. A total of 767 medical teachers participated. The initiatives appear to be related to different beneficial outcomes in terms of feelings of autonomy, competence, and relatedness in medical teaching. Either a (J)PL position is obtained by teachers who feel competent and related towards medical teaching, or obtaining a (J)PL position makes teachers feel more competent and related towards teaching, or these relations could be interacting. Also, either a SIRPME is obtained by teachers who feel competent and autonomous towards medical teaching, or obtaining a SIRPME makes teachers feel more competent and autonomous towards teaching, or these relations could be interacting. Additional research needs to scrutinize the causal or interacting relations further and to determine optimal conditions for these policy initiatives more specifically. Implications for future research are discussed.

Exploring the validity of assessment in anatomy: do images influence cognitive processes used in answering extended matching questions?

Assessment is an important aspect of medical education because it tests students' competence and motivates them to study. Various assessment methods, with and without images, are used in the study of anatomy. In this study, we investigated the use of extended matching questions (EMQs). To gain insight into the influence of images on the validity of test items, we focused on students' cognitive processes while they answered questions with and without images. Seventeen first-year medical students answered EMQs about gross anatomy, combined with either labeled images or answer lists, while thinking aloud. The participants' verbal reports were transcribed verbatim and then coded. Initial codes were based on a task analysis and were adapted into final codes during the coding process. Results showed that students used more cues from EMQs with images and visualized more often in EMQs with answer lists. Ready knowledge and verbal reasoning were used equally often in both conditions. In conclusion, EMQs with and without images elicit different results in this think aloud experiment, indicating different cognitive processes. They seem to measure different skills, making them valid for different testing purposes. The take-home message for anatomy teachers is that questions without images seem to test the quality of students' mental images while questions with images test their ability to interpret visual information. It makes sense to use both response formats in tests. Using images from clinical practice instead of anatomical drawings will help to improve test validity.

Medical students' emotional development in early clinical experience: a model.

Dealing with emotions is a critical feature of professional behaviour. There are no comprehensive theoretical models, however, explaining how medical students learn about emotions. We aimed to explore factors affecting their emotions and how they learn to deal with emotions in themselves and others. During a first-year nursing attachment in hospitals and nursing homes, students wrote daily about their most impressive experiences, explicitly reporting what they felt, thought, and did. In a subsequent interview, they discussed those experiences in greater detail. Following a grounded theory approach, we conducted a constant comparative analysis, collecting and then interpreting data, and allowing the interpretation to inform subsequent data collection. Impressive experiences set up tensions, which gave rise to strong emotions. We identified four 'axes' along which tensions were experienced: 'idealism versus reality', 'critical distance versus adaptation', 'involvement versus detachment' and 'feeling versus displaying'. We found many factors, which influenced how respondents relieved those tensions. Their personal attributes and social relationships both inside and outside the medical community were important ones. Respondents' positions along the different dimensions, as determined by the balance between attributes and tensions, shaped their learning outcomes. Medical students' emotional development occurs through active participation in medical practice and having impressive experiences within relationships with patients and others on wards. Tensions along four dimensions give rise to strong emotions. Gaining insight into the many conditions that influence students' learning about emotions might support educators and supervisors in fostering medical students' emotional and professional development.

The effect of a daily quiz (TOPday) on self-confidence, enthusiasm, and test results for biomechanics.

Many students in Biomedical Sciences have difficulty understanding biomechanics. In a second-year course, biomechanics is taught in the first week and examined at the end of the fourth week. Knowledge is retained longer if the subject material is repeated. However, how does one encourage students to repeat the subject matter? For this study, we developed 'two opportunities to practice per day (TOPday)', consisting of multiple-choice questions on biomechanics with immediate feedback, which were sent via e-mail. We investigated the effect of TOPday on self-confidence, enthusiasm, and test results for biomechanics. All second-year students (n = 95) received a TOPday of biomechanics on every regular course day with increasing difficulty during the course. At the end of the course, a non-anonymous questionnaire was conducted. The students were asked how many TOPday questions they completed (0-6 questions [group A]; 7-18 questions [group B]; 19-24 questions [group C]). Other questions included the appreciation for TOPday, and increase (no/yes) in self-confidence and enthusiasm for biomechanics. Seventy-eight students participated in the examination and completed the questionnaire. The appreciation for TOPday in group A (n = 14), B (n = 23) and C (n = 41) was 7.0 (95 % CI 6.5-7.5), 7.4 (95 % CI 7.0-7.8), and 7.9 (95 % CI 7.6-8.1), respectively (p < 0.01 between A and C). Of the students who actively participated (B and C), 91 and 80 % reported an increase in their self-confidence and enthusiasm, respectively, for biomechanics due to TOPday. In addition, they had a higher test result for biomechanics (p < 0.01) compared with those who did not actively participate (A). In conclusion, the teaching method 'TOPday' seems an effective way to encourage students to repeat the subject material, with the extra advantage that students are stimulated to keep on practising for the examination. The appreciation was high and there was a positive association between active participation, on the one hand, and self-confidence, enthusiasm, and test results for biomechanics on the other.

Residents provide feedback to their clinical teachers: reflection through dialogue.

BACKGROUND: Physicians play a crucial role in teaching residents in clinical practice. Feedback on their teaching performance to support this role needs to be provided in a carefully designed and constructive way. AIMS: We investigated an evaluation system for evaluating supervisors and providing formative feedback. METHOD: In a design based research approach, the 'Evaluation and Feedback For Effective Clinical Teaching System' (EFFECT-S) was examined by conducting semi-structured interviews with residents and supervisors of five departments in five different hospitals about feedback conditions, acceptance and its effects. Interviews were analysed by three researchers, using qualitative research software (ATLAS-Ti). RESULTS: Principles and characteristics of the design are supported by evaluating EFFECT-S. All steps of EFFECT-S appear necessary. A new step, team evaluation, was added. Supervisors perceived the feedback as instructive; residents felt capable of providing feedback. Creating safety and honesty require different actions for residents and supervisors. Outcomes include awareness of clinical teaching, residents learning feedback skills, reduced hierarchy and an improved learning climate. CONCLUSIONS: EFFECT-S appeared useful for evaluating supervisors. Key mechanism was creating a safe environment for residents to provide honest and constructive feedback. Residents learned providing feedback, being part of the CanMEDS and ACGME competencies of medical education programmes.

Towards organizational development for sustainable high-quality medical teaching.

Literature shows that faculty development programmes are not organizationally embedded in academic hospitals. This leaves medical teaching a low and informal status. The purpose of this article is to explore how organizational literature can strengthen our understanding of embedding faculty development in organizational development, and to provide a useful example of organizational development with regards to medical teaching and faculty development. Constructing a framework for organizational development from the literature, based on expert brainstorming. This framework is applied to a case study. A framework for organizational development is described. Applied in a context of medical teaching, these organizational insights show the process (and progress) of embedding faculty development in organizational development. Organizational development is a necessary condition for assuring sustainable faculty development for high-quality medical teaching. Organizational policies can only work in an organization that is developing. Recommendations for further development and future research are discussed.

Repeated evaluations of the quality of clinical teaching by residents.

Many studies report on the validation of instruments for facilitating feedback to clinical supervisors. There is mixed evidence whether evaluations lead to more effective teaching and higher ratings. We assessed changes in resident ratings after an evaluation and feedback session with their supervisors. Supervisors of three medical specialities were evaluated, using a validated instrument (EFFECT). Mean overall scores (MOS) and mean scale scores were calculated and compared using paired T-tests. 24 Supervisors from three departments were evaluated at two subsequent years. MOS increased from 4.36 to 4.49. The MOS of two scales showed an increase >0.2: 'teaching methodology' (4.34-4.55), and 'assessment' (4.11-4.39). Supervisors with an MOS <4.0 at year 1 (n = 5) all demonstrated a strong increase in the MOS (mean overall increase 0.50, range 0.34-0.64). Four supervisors with an MOS between 4.0 and 4.5 (n = 6) demonstrated an increase >0.2 in their MOS (mean overall increase 0.21, range -0.15 to 53). One supervisor with an MOS >4.5 (n = 13) demonstrated an increase >0.02 in the MOS, two demonstrated a decrease >0.2 (mean overall increase -0.06, range -0.42 to 0.42). EFFECT-S was associated with a positive change in residents' ratings of their supervisors, predominantly in supervisors with relatively low initial scores.

Bridging the gap: How is integrating communication skills with medical content throughout the curriculum valued by students?

OBJECTIVE: To describe a program with integrated learning of communication and consultation skills developed with the intention of preventing deterioration of communication skills, and to present student evaluation data. METHODS: Description and evaluation of the program through: (1) monthly student evaluations; (2) questionnaire on student perceptions about the integrated curriculum; (3) a questionnaire about the value of one specific integrated training preceding the pediatric clerkship. RESULTS: Key components of training throughout years 3-6 are reinforcement throughout the clinical years, adapting communication training to the clinical context of clerkships using a sandwich model with cycles of preparation, clerkship, and reflection. EVALUATION: response rates were 69%, 93% and 93%, respectively. Students value practicing integration of communication and medical content with SPs who represent the population of their next clerkships. They appreciate the multisource feedback during the training, feedback by clerkship specific specialists and SPs is valued most. CONCLUSIONS: This description shows an example of an integrated curriculum that helps students to feel well prepared for their communication tasks in subsequent clerkships. PRACTICE IMPLICATIONS: Designing and implementing communication curricula to address the issue of integration is feasible. The effects of such integrated programs should be subject to future studies.

Learning anatomy enhances spatial ability.

Spatial ability is an important factor in learning anatomy. Students with high scores on a mental rotation test (MRT) systematically score higher on anatomy examinations. This study aims to investigate if learning anatomy also oppositely improves the MRT-score. Five hundred first year students of medicine (n = 242, intervention) and educational sciences (n = 258, control) participated in a pretest and posttest MRT, 1 month apart. During this month, the intervention group studied anatomy and the control group studied research methods for the social sciences. In the pretest, the intervention group scored 14.40 (SD: ± 3.37) and the control group 13.17 (SD: ± 3.36) on a scale of 20, which is a significant difference (t-test, t = 4.07, df = 498, P < 0.001). Both groups show an improvement on the posttest compared to the pretest (paired samples t-test, t = 12.21/14.71, df = 257/241, P < 0.001). The improvement in the intervention group is significantly higher (ANCOVA, F = 16.59, df = 1;497, P < 0.001). It is concluded that (1) medical students studying anatomy show greater improvement between two consecutive MRTs than educational science students; (2) medical students have a higher spatial ability than educational sciences students; and (3) if a MRT is repeated there seems to be a test effect. It is concluded that spatial ability may be trained by studying anatomy. The overarching message for anatomy teachers is that a good spatial ability is beneficial for learning anatomy and learning anatomy may be beneficial for students' spatial ability. This reciprocal advantage implies that challenging students on spatial aspects of anatomical knowledge could have a twofold effect on their learning.

Construction and validation of the Nijmegen Evaluation of the Simulated Patient (NESP): assessing simulated patients' ability to role-play and provide feedback to students.

PURPOSE: To develop an instrument that could be used at different medical schools to assess the performance of individual simulated patients (SPs) on their ability to role-play and provide feedback, including feedback on medical students' communication skills and medical knowledge. METHOD: In 2011, the authors sought to develop and validate a new instrument to achieve these goals. During Phase 1, one of the authors conducted semistructured interviews with medical students, medical psychologists, physicians, and experts to explore what was required of SPs. During Phase 2, the authors assessed the reliability and feasibility of the instrument that they had developed during Phase 1, using a principal components analysis with varimax rotation. During Phase 3, they performed a confirmatory factor analysis on the items in the final instrument. RESULTS: During Phase 1, the authors constructed the Nijmegen Evaluation of the Simulated Patient (NESP), which included three components-role-play, process of feedback, and application of feedback rules. They then determined that approximately 8 to 20 completed instruments per SP led to satisfactory to excellent reliability estimates. In Phase 3, their confirmatory analysis confirmed the three components that they had determined in Phase 2. Reliability estimates for each component (role-play, process of feedback, application of feedback rules) and the final NESP as a whole were 0.86, 0.83, 0.79, and 0.92, respectively. CONCLUSIONS: The authors concluded that the NESP is a feasible, valid, and reliable instrument that could be used at different medical schools to assess the performance of individual SPs.

Do images influence assessment in anatomy? Exploring the effect of images on item difficulty and item discrimination.

Anatomists often use images in assessments and examinations. This study aims to investigate the influence of different types of images on item difficulty and item discrimination in written assessments. A total of 210 of 460 students volunteered for an extra assessment in a gross anatomy course. This assessment contained 39 test items grouped in seven themes. The answer format alternated per theme and was either a labeled image or an answer list, resulting in two versions containing both images and answer lists. Subjects were randomly assigned to one version. Answer formats were compared through item scores. Both examinations had similar overall difficulty and reliability. Two cross-sectional images resulted in greater item difficulty and item discrimination, compared to an answer list. A schematic image of fetal circulation led to decreased item difficulty and item discrimination. Three images showed variable effects. These results show that effects on assessment scores are dependent on the type of image used. Results from the two cross-sectional images suggest an extra ability is being tested. Data from a scheme of fetal circulation suggest a cueing effect. Variable effects from other images indicate that a context-dependent interaction takes place with the content of questions. The conclusion is that item difficulty and item discrimination can be affected when images are used instead of answer lists; thus, the use of images as a response format has potential implications for the validity of test items.

Entering medical practice for the very first time: emotional talk, meaning and identity development.

CONTEXT: During early clinical exposure, medical students have many emotive experiences. Through participation in social practice, they learn to give personal meaning to their emotional states. This meaningful social act of participation may lead to a sense of belonging and identity construction. OBJECTIVES: The aim of this study was to broaden and deepen our understanding of the interplay between those experiences and students' identity development. Our research questions asked how medical students give meaning to early clinical experiences and how that affects their professional identity development. METHODS: Our method was phenomenology. Within that framework we used a narrative interviewing technique. Interviews with 17 medical students on Year 1 attachments to nurses in hospitals and nursing homes were analysed by listening to audio-recordings and reading transcripts. Nine transcripts, which best exemplified the students' range of experiences, were purposively sampled for deeper analysis. Two researchers carried out a systematic analysis using qualitative research software. Finally, cases representing four paradigms were chosen to exemplify the study findings. RESULTS: Students experienced their relationships with the people they met during early clinical experiences in very different ways, particularly in terms of feeling and displaying emotions, adjusting, role finding and participation. The interplay among emotions, meaning and identity was complex and four different 'paradigms' of lived experience were apparent: feeling insecure; complying; developing, and participating. CONCLUSIONS: We found large differences in the way students related to other people and gave meaning to their first experiences as doctors-to-be. They differed in their ability to engage in ward practices, the way they experienced their roles as medical students and future doctors, and how they experienced and expressed their emotions. Medical educators should help students to be sensitive to their emotions, offer space to explore different meanings, and be ready to suggest alternative interpretations that foster the development of desired professional identities.

Evaluation and feedback for effective clinical teaching in postgraduate medical education: validation of an assessment instrument incorporating the CanMEDS roles.

BACKGROUND: Providing clinical teachers in postgraduate medical education with feedback about their teaching skills is a powerful tool to improve clinical teaching. A systematic review showed that available instruments do not comprehensively cover all domains of clinical teaching. We developed and empirically test a comprehensive instrument for assessing clinical teachers in the setting of workplace learning and linked to the CanMEDS roles. METHODS: In a Delphi study, the content validity of a preliminary instrument with 88 items was studied, leading to the construction of the EFFECT (evaluation and feedback for effective clinical teaching) instrument. The response process was explored in a pilot test and focus group research with 18 residents of 6 different disciplines. A confirmatory factor analyses (CFA) and reliability analyses were performed on 407 evaluations of 117 supervisors, collected in 3 medical disciplines (paediatrics, pulmonary diseases and surgery) of 6 departments in 4 different hospitals. RESULTS: CFA yielded an 11 factor model with a good to excellent fit and internal consistencies ranged from 0.740 to 0.940 per domain; 7 items could be deleted. CONCLUSION: The model of workplace learning showed to be a useful framework for developing EFFECT, which incorporates the CanMEDS competencies and proved to be valid and reliable.

Mixed messages in learning communication skills? Students comparing role model behaviour in clerkships with formal training.

BACKGROUND: Medical students learn professional communication through formal training and in clinical practice. Physicians working in clinical practice have a powerful influence on student learning. However, they may demonstrate communication behaviours not aligning with recommendations in training programs. AIMS: This study aims to identify more precisely what differences students perceive between role model communication behaviour during clerkships and formal training. METHOD: In a cross-sectional study, data were collected about physicians' communication performance as perceived by students. Students filled out a questionnaire in four different clerkships in their fourth and fifth year. RESULTS: Just over half of the students reported communication similar to formal training. This was especially true for students in the later clerkships (paediatrics and primary care). Good examples were seen in providing information corresponding to patients' needs and in shared decision making, although students often noted that in fact the doctor made the decision. Bad examples were observed in exploring cognitions and emotions, and in providing information meeting patient's pace. CONCLUSIONS: Further study is needed on actual physician behaviour in clinical practice. From our results, we conclude that students need help in reflecting on and learning from the gap in communication patterns they observe in training versus clinical practice.

Emotional learning of undergraduate medical students in an early nursing attachment in a hospital or nursing home.

BACKGROUND: Entering medicine for the first time is highly impressive for students, but we know little about the actual emotional learning processes taking place. AIMS: We aimed to get more insight into expectations, experiences and emotions of students during their first clinical experiences in a hospital compared to a nursing home. METHODS: We carried out a qualitative and a quantitative survey by administering questionnaires about expectations, impressive experiences and learning activities within two cohorts of first-year medical students before and after a 4-week nursing attachment. RESULTS: Despite different expectations, students reported similar experiences and learning activities for the nursing home and the hospital. Most impressive events were related to patient care, being a trainee, or professional identities being challenged. Students in nursing homes most often referred to their own relationships with patients. Students expressed different emotions, and frequently experienced positive and negative emotions at the same time. CONCLUSIONS: Rewarding experiences (not only difficult or stressful events) do matter for medical professional development. Students need to learn how to deal with and feel strengthened by the emotions evoked during clinical experiences, which should be supported by educators. The nursing home and the hospital seem to be equally suited as learning environments.