Medical Faculty and Medical Student Opinions on the Utility of Questions to Teach and Evaluate in the Clinical Environment.

Objectives: We sought to report medical student and faculty perceptions of the purpose and utility of questions on clinical rounds. Methods: We developed and administered a survey to third and fourth-year medical students and teaching physicians. The survey elicited attitudes about using questions to teach on rounds in both benign and malignant learning environments. Results: Ninety-seven percent of faculty and 85% of students predicted they will use questions to teach. Nine percent of students described learning-impairing stress during benign bedside teaching. Fifty-nine percent of faculty felt questions were mostly for teaching; 74% of students felt questions were mostly for evaluation. Forty-six percent of students felt questions underestimated their knowledge. Students felt questions were more effective for classroom teaching than bedside teaching. Faculty and students agreed that a malignant environment detrimentally affected learning and performance. Conclusions: Students and faculty supported the use of questions to teach and evaluate, especially in benign teaching environments. Many students described stress severe enough to affect their learning and performance, even when questioned in benign teaching environments. Faculty underestimated the degree to which students experience stress-related learning impairment and the degree to which students see questions as evaluation rather than teaching. Nearly half of students felt that questions underestimated their own knowledge. Students feel more stress and less learning when questioned with a patient present. Faculty must realize that even in the best learning environment some students experience stress-impaired learning and performance, perhaps because of the conflict between learning and evaluation.

Using focus groups to understand causes for morale decline after introducing change in an IM residency program.

BACKGROUND: Although program evaluation is a core requirement of Internal Medicine residencies, little is reported in the literature regarding resident satisfaction with training. Most program evaluation consists of numerical rating scales from which it is often difficult to pinpoint exact sources of dissatisfaction. METHODS: Our goal in this work is to evaluate the utility of focus group methodology to uncover in detail the reasons for residents' deteriorating morale in an IM residency program, as well as to solicit suggestions for correction. This study employed focus groups (FG) in a qualitative research design, in which descriptive statistics from a resident program evaluation survey served to guide an intensive focus group process. Participants were 40 of 45 2nd and 3rd year internal medicine residents enrolled in the IM residency training program. Five chief residents were trained to conduct 5 focus groups with 8 residents in each group. The focus groups examined possible issues contributing to the deterioration of morale noted in the quantitative survey. RESULTS: Many unexpected themes were uncovered by the FGs. Residents identified the following factors as the major contributors to deteriorating morale: 1) Pace of change 2) Process of change 3) The role of chief residents in change 4) Fear of intimidation and retaliation. Groups also suggested practical recommendations for improving the culture of the residency. CONCLUSION: Introducing change in residency training is a challenging process. Respectful attention to resident frustrations and solution-focused discussions are necessary to understand and improve morale. Focus groups proved to be a useful tool in revealing the precise source of pervasive resident concerns as well as providing potential solutions. In addition, FGs methodology can be adapted in a practical manner to residency evaluation.

Education first: reforming the first-year curriculum of the internal medicine residency.

Many opinion leaders of the academic internal medicine community have expressed concern about the adequacy of internal medicine (IM) residency training to prepare residents for their careers and to attract medical students to IM residency programs. In response to those concerns, several core organizations have prepared reports and issued significant recommendations suggesting comprehensive reform and restructuring of IM training programs.The authors discuss their approach, strategy, and efforts to restructure the first year in the IM residency training program at the University of California, Irvine. They point out that educators have often viewed the internship as a rite of passage, heavy with inpatient service commitment. However, in the authors' view, the current trend to residents' early subspecialty commitment has made it imperative that the first year of IM residency be more focused, standardized, meaningful, and effective in order to achieve core educational goals before each resident's career focus has become too narrowed and while the big picture is more apparent. The authors describe in detail their review of their first-year curriculum based on consensus goals and objectives. This process led to a restructuring of the first year that places emphasis on a defined educational model and a central core curriculum. The authors conclude that residency program leaders can restructure the first year to provide a model of education that includes appropriate educational experiences as well as meaningful time for reflection and professional growth.

Teaching the art of doctoring: an innovative medical student elective.

The authors describe a longitudinal third- and fourth-year elective, 'The Art of Doctoring', introduced in an attempt to counteract perceived frustration and cynicism in medical students at their home institution during the clinical years. The course goals aimed at helping students to develop self-reflective skills; improve awareness of and ability to modify personal attitudes and behaviors that compromise patient care; increase altruism, empathy and compassion toward patients; and sustain commitment to patient care, service and personal well-being. These goals were accomplished through introduction and development of five skill sets: learning from role models and peers; on-site readings of works by medical student- and physician-authors; self- and other-observation; self-reflective techniques; and case-based problem-solving. The course involved regular in-class exercises and homework assignments, as well as a personal project related to improving personal compassion, caring and empathy toward patients. Students also learned to use a coping algorithm to approach problematic clinical and interpersonal situations. Class discussions revealed three issues of recurring importance to students: loss of idealism, non-compliant patients, and indifferent, harsh or otherwise unpleasant attendings and residents. Quantitative and qualitative student evaluations overall indicated a generally favorable response to the course. Problems and barriers included attendance difficulties and variable levels of student engagement. Future directions for this type of educational intervention are considered, as well as its implications for medical education.

Point-of-view writing: A method for increasing medical students' empathy, identification and expression of emotion, and insight.

CONTEXT: Although interest exists among medical educators in using writing that reflects on clinical experience to enhance medical students' communication skills, empathy, and overall professionalism, little empirical research documents the value of this approach. This study explored whether students trained in one type of writing would first demonstrate increased awareness of emotional aspects of a clinical encounter in their writing; and second, be evaluated more positively in an OSCE situation by standardized patients. METHOD: Ninety-two students were assigned to either a point-of-view writing or a clinical reasoning condition as part of a second year doctoring course. At the end of the year, students were evaluated in an OSCE format on 3 cases, and completed a writing assignment about an ER death from cardiac arrest. Student essays were scored according to presence or absence of various themes. A linguistic analysis of the essays was also performed. Point-of-view and clinical reasoning group scores were compared on both measures, as well as on the standardized patient OSCE ratings. RESULTS: Students trained in point-of-view writing demonstrated significantly more awareness of emotional and spiritual aspects of a paper case in a writing assignment than did students trained in clinical reasoning. By contrast, students in the clinical reasoning group were more likely to distance from the scenario. The two groups did not differ on SP OSCE ratings. CONCLUSION: Training in point-of-view writing can improve medical students' written skills on certain affective dimensions. It is not clear that these skills can translate into clinical behavior.

Training the clinical eye and mind: using the arts to develop medical students' observational and pattern recognition skills.

INTRODUCTION: Observation, including identification of key pieces of data, pattern recognition, and interpretation of significance and meaning, is a key element in medical decision making. Clinical observation is taught primarily through preceptor modelling during the all-important clinical years. No single method exists for communicating these skills, and medical educators have periodically experimented with using arts-based training to hone observational acuity. The purpose of this qualitative study was to better understand the similarities and differences between arts-based and clinical teaching approaches to convey observation and pattern recognition skills. METHOD: A total of 38 Year 3 students participated in either small group training with clinical photographs and paper cases (group 1), or small group training using art plus dance (group 2), both consisting of 3 2-hour sessions over a 6-month period. FINDINGS: Students in both conditions found value in the training they received and, by both self- and instructor-report, appeared to hone observation skills and improve pattern recognition. The clinically based condition appeared to have been particularly successful in conveying pattern recognition concepts to students, probably because patterns presented in this condition had specific correspondence with actual clinical situations, whereas patterns in art could not be generalised so easily to patients. In the arts-based conditions, students also developed skills in emotional recognition, cultivation of empathy, identification of story and narrative, and awareness of multiple perspectives. CONCLUSION: The interventions studied were naturally complementary and, taken together, can bring greater texture to the process of teaching clinical medicine by helping us see a more complete 'picture' of the patient.

The effect of a 13-hour curriculum to improve residents' teaching skills: a randomized trial.

BACKGROUND: Although resident physicians often teach, few trials have tested interventions to improve residents' teaching skills. A pilot trial in 2001-2002 found that 13 trained resident teachers taught better than did untrained control residents. OBJECTIVE: To determine whether a longitudinal residents-as-teachers curriculum improves residents' teaching skills. DESIGN: Randomized, controlled trial from May 2001 to February 2002 (pilot trial) and March 2002 to April 2003. SETTING: 4 generalist residencies affiliated with an urban academic medical center. PARTICIPANTS: 62 second-year residents: 23 in the 2001-2002 pilot trial and 39 more in 2002-2003; 27 of the 39 participants were medicine residents required to learn teaching skills. INTERVENTION: A 13-hour curriculum in which residents practiced teaching and received feedback during 1-hour small-group sessions taught twice monthly for 6 months. MEASUREMENTS: A 3.5-hour, 8-station, objective structured teaching examination that was enacted and rated by 50 medical students before and after the intervention. Two trained, blinded raters independently assessed each station (inter-rater reliability, 0.75). RESULTS: In the combined results for 2001-2003, the intervention group (n = 33) and control group (n = 29) were similar in sex, specialty, and academic performance. On a 1 to 5 Likert scale, intervention residents outscored controls on overall improvement score (post-test-pretest difference, 0.74 vs. 0.07; difference between intervention and control groups, 0.68 [95% CI, 0.55 to 0.81]; P < 0.001) by a magnitude of 2.8 standard deviations and on all 8 individual stations. The intervention residents improved 28.5% overall, whereas the scores of control residents did not increase significantly (2.7%). In 2002-2003, 19 intervention residents similarly outscored 19 controls (post-test-pretest difference, 0.83 vs. 0.14; difference between intervention and control groups, 0.69 [CI, 0.53 to 0.84]; P < 0.001). Twenty-seven medicine residents required to learn teaching skills achieved scores similar to those of volunteers. LIMITATIONS: The study was conducted at a single institution. No "real life" assessment with which to compare the results of the objective structured teaching examination was available. CONCLUSIONS: Generalist residents randomly assigned to receive a 13-hour longitudinal residents-as-teachers curriculum consistently showed improved teaching skills, as judged by medical student raters. Residents required to participate improved as much as volunteers did.

An innovative, longitudinal program to teach residents about end-of-life care.

At the University of California, Irvine Medical Center, an end-of-life curriculum was implemented in 2000 for an internal medicine residency utilizing a longitudinal approach that allowed residents to follow patients through their entire hospice experience. An elective home hospice rotation was developed for which third-year residents served as primary care physicians for patients at the end of life over a one-year period. Residents were supervised by faculty who were hospice medical directors. They also learned through case vignettes, quarterly meetings, textbook reading, and personal projects. From July 2000 to June 2002, residents demonstrated positive attitudes towards hospice care and recommended the rotation highly (mean 8.86 on a scale of 1-10). The rotation grew in popularity from six initial residents to ten residents the next year, and has since become a mandatory rotation for all senior residents. A 360-degree evaluation uniformly indicated positive resident performance from the hospice team (mean scores 7.56-8.69 on a 1-9 scale), family (mean scores 9.3-9.7 on a 1-10 scale) and faculty (mean scores 7.29-7.72 on a 1-9 scale). Residents were also pleased with the level of teaching (mean 8.86 on a scale of 1-10) and felt that the patient care load was "just right." Their knowledge improved by 8% (p =.0175). In conclusion, a longitudinal hospice rotation was implemented that fulfilled curricular goals without undue burden on the residents or residency program.

Can poetry make better doctors? Teaching the humanities and arts to medical students and residents at the University of California, Irvine, College of Medicine.

The Program in Medical Humanities & Arts at the University of California, Irvine, College of Medicine has been in existence for five years. The program was implemented to enhance aspects of professionalism including empathy, altruism, compassion, and caring toward patients, as well as to hone clinical communication and observational skills. It contains elective or required curriculum across all four years of medical school and required curriculum in two residency programs, organized according to structural principles of horizontal coherence, vertical complexity, and patient care applications. The program emphasizes small-group, interdisciplinary teaching and faculty development, and is notable for learners' use of creative projects to reflect on patients and themselves. Evaluation of the program indicates a positive response among learners. More systematic studies point to increases in empathy and positive attitudes toward the humanities as tools for professional development as a result of exposure to the program curriculum. Future directions include closer collaboration with the University of California, Irvine, Schools of the Arts and Humanities, involvement of local artists and writers, and development of a graduation with distinction in humanities for medical students.

A pilot randomized, controlled trial of a longitudinal residents-as-teachers curriculum.

PURPOSE: To determine whether a longitudinal residents-as-teachers curriculum improves generalist residents' teaching skills. METHOD: From May 2001 to February 2002, 23 second-year generalist residents in four residencies affiliated with the University of California, Irvine, College of Medicine, completed a randomized, controlled trial of a longitudinal residents-as-teachers program. Thirteen intervention residents underwent a 13-hour curriculum during one-hour noon conferences twice monthly for six months, practicing teaching skills and receiving checklist-guided feedback. In a 3.5-hour, eight-station objective structured teaching examination (OSTE) enacted and rated by 15 senior medical students before and after the curriculum, two trained, blinded raters independently assessed each station with detailed, case-specific rating scales (rating scale reliability = 0.96, inter-rater reliability = 0.78). RESULTS: The intervention and control groups were similar in academic performance, specialty distribution, and gender (chi(2) = 0.434, p =.81). On a five-point Likert scale (5 = best teaching skills), intervention and control residents showed similar mean pretest OSTE scores (2.83 vs. 2.88, p =.736). The intervention group improved their mean overall OSTE scores 22.3% (more than two standard deviations) from 2.83 (pretest) to 3.46 (post-test; p <.0005; 95% CI 0.53 to 0.72). Intervention residents also improved significantly on six of eight OSTE stations. Within the control group, no pretest-to-post-test change achieved statistical significance. Mann-Whitney and Wilcoxon signed-rank tests confirmed these results. CONCLUSIONS: Generalist residents randomly assigned to receive a 13-hour longitudinal residents-as-teachers curriculum consistently showed improved OSTE scores. Future research should clarify which aspects of residents-as-teachers curricula most effectively improve educational outcomes.

Becoming a physician: students' creative projects in a third-year IM clerkship.

PURPOSE: Medical educators have only limited understanding of how integrating humanities-based components into standard curricula contributes to the medical students' professionalism. This study qualitatively analyzed how students used a creative-project assignment during their third-year internal medicine clerkships to explore various aspects of their professional development. METHOD: A total of 277 students from three consecutive classes (1999-2002) at the University of California, Irvine, College of Medicine each completed a creative project reflecting on a particularly problematic or meaningful illness-related incident. Process and content analyses of the 221 projects submitted for analysis were performed. RESULTS: Students' projects employed a wide range of formats, tones, and styles to examine the process of socialization into medicine. Within this framework, their work tended to explore issues such as the proper relationship of medical students to patients, coming to terms with death and dying, understanding the patient's experience of illness, and coping with professional and personal stress. CONCLUSION: A creative-projects course component can be a valuable adjunct to traditional clerkship activities in helping students to reflect on the process of becoming a physician.

Using literature as the framework for a new course.

OBJECTIVE: The award-winning book The Spirit Catches You and You Fall Down,(1) a true story of the collision between two cultures (American and Hmong) with heartrending consequences for the patient, the patient's family, and the medical professionals who care for them, has been favorably reviewed(2) and used to stimulate teaching of cultural diversity, ethics, and professionalism to students and residents. We used it as a required text for a new Patient Doctor Society (PDS) course for 184 first- and second-year medical students. This report describes the scope and contexts in which the book was used to meet specific course goals. DESCRIPTION: PDS is a required 90-hour introduction to medical interviewing, which integrates ethics, communication, clinical reasoning, cultural diversity, humanities, spirituality, integrative medicine, nutrition, and behavioral science. To provide a common experience among these diverse topics, faculty members were asked to use examples from the book to achieve their learning objectives. A required faculty development session illustrated strategies for effectively using the text. Focusing on chapter 13 ("Code X"), dramatic portrayals of differences in beliefs about end-of-life care and clinician-family communication, facilitated the introduction of methods including point-of-view writing, role-plays, and faculty-facilitated discussions as techniques for meeting course objectives. At PDS orientation, we used the same chapter, and had faculty members lead small groups of students using the teaching techniques they acquired. About 90% of students read the book prior to orientation. Students favorably reviewed this three-hour session. For the ethics session, unfacilitated small groups of students were asked to identify and discuss the ethical issues in chapter 11 ("The Big One"), which describes a major turning point in the health care provided to the text's central character, Lia. Each group presented its "moral diagnosis" and ethical arguments for resolution. Class discussion then focused on the diverse views presented, to emphasize the importance of justifying decisions and to practice using tools of ethical analysis. In the communication skills workshop, we excerpted dramatic readings from the book. Faculty members played the roles of the author, the patient's mother, and one of Lia's physicians. The interaction became a dialogue to illustrate the points of view of the participants. The dialogue was used to stimulate discussion about potential pitfalls in physician-patient communication and understanding. In a medical humanities session, excerpts from the book were compared with poetry explicating themes of physician arrogance and humility. DISCUSSION: The Spirit Catches You and You Fall Down provides a context appropriate to teaching students how to listen to, and learn from patient stories. The story will be reintroduced in the pediatrics clerkship. Caution will be exercised to (1) avoid overexposure to the text, (2) counteract the potential to interpret the story too narrowly, and (3) assure that faculty become familiar with the text and its uses. We intend to track outcomes in knowledge, skills and attitudes for each content area, and observe the degree that the book facilitates achievement of objectives. We will follow several cohorts of students to verify longitudinally the learning effects observed.

Reach out and teach someone: generalist residents' needs for teaching skills development.

BACKGROUND AND OBJECTIVES: Family practice residents and students receive substantial teaching from senior residents. Yet, we lack data about residents' needs for teaching skills development, particularly in generalist training. This multicenter, interdisciplinary study describes the learning needs of generalist residents for becoming more effective teachers. METHODS: One hundred medical students, residents, and faculty infamily medicine, internal medicine, and pediatrics participated in 11 focus groups and 4 semi-structured key informant interviews at the University of California, Irvine and the University of California, Los Angeles in 2000-2001. RESULTS: Participants agreed that resident teachers fulfill critical roles in medical education, providing powerful, skills-based teaching that can tangibly benefit both residents themselves and their junior learners. House staff often facilitate students' best learning experiences despite inherent risks in serving as teachers and professional role models. Residents need teaching skills training that prepares them to lead clinical teams and teach students essential skills that include history taking and physical examination, critical reasoning, charting, and procedures. CONCLUSIONS: Generalist residents fulfill important roles as practical clinical teachers and role models for junior learners. Future research should address how resident teachers affect learners' clinical skills, academic performance, and professionalism.

Medical students' note-taking in a medical biochemistry course: an initial exploration.

Beginning medical students spend numerous hours every week attending basic science lectures and taking notes. Medical faculty often wonder whether they should give students pre-printed instructors' notes before lectures. Proponents of this strategy argue that provided notes enhance learning by facilitating the accurate transmission of information, while opponents counter that provided notes inhibit students' cognitive processing or even discourage students from attending lectures. Little if any research has directly addressed medical students' note-taking or the value of providing instructors' notes. The educational literature does suggest that taking lecture notes enhances university students' learning. University students perform best on post-lecture testing if they review a combination of provided notes and their own personal notes, particularly if the provided notes follow a 'skeletal' format that encourages active note-taking.