Responding to a changing nation: are faculty prepared for cross-cultural conversations and care?

BACKGROUND AND OBJECTIVES: The United States is becoming increasingly diverse. Health disparities continue with little improvement despite national policies and standards. Medical institutions are modifying their curricula; however, little is known about faculty attitudes and comfort in addressing cultural issues. The purpose of this study was to determine faculty attitudes, self-perceived levels of comfort and skill, and future knowledge needs pertaining to cultural competence. METHODS: A survey was administered to all clinical faculty at the University of Virginia School of Medicine. Survey questions addressed faculty attitudes and self-perceived levels of comfort and skill in dealing with cultural issues, as well as perceived need and interest in future cultural competence training. RESULTS: When considering each phase of education (medical school, residency, continuing medical education [CME]), fewer than 25% of the respondents reported receiving formal instruction in cultural competency in any given phase, although 93% felt that cultural competency training was important. Fifty-eight percent felt "very comfortable" caring for diverse patients, although this dropped to 30% when specifying limited English proficiency. The situation in which the highest percentage of respondents felt "not particularly comfortable" or "not at all comfortable" was breaking bad news to a patient's family first if this was more culturally appropriate (47%). Respondents felt most skilled in working with medical interpreters, apologizing for cross-cultural misunderstandings, and eliciting the patients' perspectives about their health and illness. Respondents felt the least skilled providing culturally sensitive end-of-life care and dealing with cross-cultural conflicts. CONCLUSIONS: Clinical faculty have received limited instruction on cultural competency, and the reported levels of comfort and skill in many challenging areas of multicultural health leave much room for improvement. Until faculty become more comfortable and are able to model and teach these behaviors to learners, positive responses to national policies in culturally competent care are likely to be limited.

Bayes' theorem and the physical examination: probability assessment and diagnostic decision making.

PURPOSE: To determine how examination findings influence the probability assessment and diagnostic decision making of third- and fourth-year medical students, internal medicine residents, and academic general internists. METHOD: In a 2008 cross-sectional, Web-based survey, participants from three medical schools were asked questions about their training and eight examination scenarios representing four conditions. Participants were given literature-derived preexamination probabilities for each condition and were asked to (1) estimate postexamination probabilities (post-EPs) and (2) select a diagnostic choice (report that condition is present, order more tests, or report that condition is absent). Participants' inverse transformed logit (ITL) mean post-EPs were compared with corresponding literature-derived post-EPs. RESULTS: Of 906 individuals invited to participate, 684 (75%) submitted a completed survey. In two of four scenarios with positive findings, the participants' ITL mean post-EPs were significantly less than corresponding literature-derived post-EP point estimates (P<.001 for each). In three of four scenarios with negative findings, ITL mean post-EPs were significantly greater than corresponding literature-derived post-EP point estimates (P<.001 for each). In the four scenarios with positive findings, 17% to 38% of participants ordered more diagnostic tests when the literature indicated a >85% probability that the condition was present. In the four scenarios with largely negative findings, 70% to 85% chose to order diagnostic tests to further reduce diagnostic uncertainty. CONCLUSIONS: All three groups tended to similarly underestimate the impact of examination findings on condition probability assessment, especially negative findings, and often ordered more tests when probabilities indicated that additional testing was unnecessary.

Online "spaced education progress-testing" of students to confront two upcoming challenges to medical schools.

PURPOSE: U.S. medical students will soon complete only one licensure examination sequence, given near the end of medical school. Thus, schools are challenged to identify poorly performing students before this high-stakes test and help them retain knowledge across the duration of medical school. The authors investigated whether online spaced education progress-testing (SEPT) could achieve both aims. METHOD: Participants were 2,648 students from four U.S. medical schools; 120 multiple-choice questions and explanations in preclinical and clinical domains were developed and validated. For 34 weeks, students randomized to longitudinal progress-testing alone (LPTA) received four new questions (with answers/ explanations) each week. Students randomized to SEPT received the identical four questions each week, plus two-week and six-week cycled reviews of the questions/explanations. During weeks 31-34, the initial 40 questions were re-sent to students to assess longer-term retention. RESULTS: Of the 1,067 students enrolled, the 120-question progress-test was completed by 446 (84%) and 392 (74%) of the LPTA and SEPT students, respectively. Cronbach alpha reliability was 0.87. Scores were 39.9%, 51.9%, 58.7%, and 58.8% for students in years 1-4, respectively. Performance correlated with Step 1 and Step 2 Clinical Knowledge scores (r = 0.52 and 0.57, respectively; P < .001) and prospectively identified students scoring below the mean on Step 1 with 75% sensitivity, 77% specificity, and 41% positive predictive value. Cycled reviews generated a 170% increase in learning retention relative to baseline (P < .001, effect size 0.95). CONCLUSIONS: SEPT can identify poorly performing students and improve their longer-term knowledge retention.

Procedural and interpretive skills of medical students: experiences and attitudes of fourth-year students.

BACKGROUND: Recent data do not exist regarding fourth-year medical students' performance of and attitudes toward procedural and interpretive skills, and how these differ from third-year students'. METHOD: Cross-sectional survey conducted in February 2006 of 122 fourth-year students from seven U.S. medical schools, compared with their responses in summer 2005. Students estimated their cumulative performance of 22 skills and reported self-confidence and perceived importance using a five-point Likert-type scale. RESULTS: The response rate was 79% (96/122). A majority reported never having performed cardioversion, thoracentesis, cardiopulmonary resuscitation, blood culture, purified protein derivative placement, or paracentesis. One fifth of students had never performed peripheral intravenous catheter insertion, phlebotomy, or arterial blood sampling. Students reported increased cumulative performance of 17 skills, increased self-confidence in five skills, and decreased perceived importance in three skills (two-sided P < .05). CONCLUSIONS: A majority of fourth-year medical students still have never performed important procedures, and a substantial minority have not performed basic procedures.

Sharpening the eye of the OSCE with critical action analysis.

PURPOSE: When interpreting performance scores on an objective structured clinical examination (OSCE), are all checklist items created equal? Although assigning priority through checklist item weighting is often used to emphasize the clinical importance of selected checklist items, the authors propose the use of critical action analysis as an additional method for analyzing and discriminating clinical performance in clinical skill assessment exercises. A critical action is defined as an OSCE checklist item whose performance is critical to ensure an optimal patient outcome and avoid medical error. In this study, the authors analyzed a set of clerkship OSCE performance outcome data and compared the results of critical action analysis versus traditional checklist item performance scores. METHOD: OSCE performance scores of 398 third-year clerkship students from 2003 to 2006 at the University of Virginia School of Medicine were analyzed using descriptive statistics and a logistic regression model. Through a consensus process, 10 of 25 OSCE cases were identified as containing critical actions. RESULTS: Students who scored above the median correctly performed the critical actions more often than those scoring lower. However, for 9 of 10 cases, 6% to 46% of higher-scoring students failed to perform the critical action correctly. CONCLUSIONS: Failure to address this skill assessment outcome is a missed opportunity to more fully understand and apply the results of such examinations to the clinical performance development of medical students. Including critical action analysis in OSCE data interpretation sharpens the eye of the OSCE and enhances its value in clinical skill assessment.

When should students learn essential physical examination skills? Views of internal medicine clerkship directors in North America.

PURPOSE: To determine whether any consensus exists among internal medicine clerkship directors regarding when students should acquire proficiency in selected physical examination (PE) skills. METHOD: In 2004, the annual survey of Clerkship Directors in Internal Medicine (CDIM) included a question about the timing of PE-skills proficiency. (CDIM members are from 123 U.S. and Canadian medical schools.) A total of 259 members (123 institutional and 136 individual members) were asked the following question about 39 common physical examination skills, selected using a consensus process among the authors and members of the CDIM Council: "When in the medical school curriculum should medical students acquire proficiency for the following skills?" RESULTS: There were 157 respondents, an overall response rate of 60%. There were 89 (72%) responding institutional members and 68 (50%) responding individual members. Respondents agreed that 31 (80%) of the skills should be learned by the end of the clerkship year. However, considerable variability existed regarding when in the curriculum those skills should be learned: for only 18 of 39 skills was there 80% agreement on skills-learning timing. CDIM members were divided on whether normal examination findings should be learned before or during the clerkships. CONCLUSIONS: Variability existed among CDIM members regarding their expectations for the timing of student physical examination learning in the undergraduate medical curriculum. Creating a common vision among clerkship directors and faculty regarding what neophyte clinicians must learn to do and when they are expected to be able to do it will help to address the issue of physical examination proficiency standards of medical students.

Enhancing clinical skills education: University of Virginia School of Medicine's Clerkship Clinical Skills Workshop Program.

In 1993, the University of Virginia School of Medicine began a clinical skills workshop program in an effort to improve the preparation of all clerkship students to participate in clinical care. This program involved the teaching of selected basic clinical skills by interested faculty to small groups of third-year medical students. Over the past 14 years, the number of workshops has increased from 11 to 31, and they now involve clerkship faculty from family medicine, internal medicine, and pediatrics. Workshops include a variety of common skills from the communication, physical examination, and clinical test and procedure domains such as pediatric phone triage, shoulder examination, ECG interpretation, and suturing. Workshop sessions allow students to practice skills on each other, with standardized patients, or with models, with the goal of improving competence and confidence in the performance of basic clinical skills. Students receive direct feedback from faculty on their skill performance. The style and content of these workshops are guided by an explicit set of educational criteria.A formal evaluation process ensures that faculty receive regular feedback from student evaluation comments so that adherence to workshop criteria is continuously reinforced. Student evaluations confirm that these workshops meet their skill-learning needs. Preliminary outcome measures suggest that workshop teaching can be linked to student assessment data and may improve students' skill performance. This program represents a work-in-progress toward the goal of providing a more comprehensive and developmental clinical skills curriculum in the school of medicine.

Procedural and interpretive skills of medical students: experiences and attitudes of third-year students.

BACKGROUND: Recent data do not exist on medical students' performance of and attitudes toward procedural and interpretive skills deemed important by medical educators. METHOD: A total of 171 medical students at seven medical schools were surveyed regarding frequency of performance, self-confidence, and perceived importance of 21 procedural and interpretive skills. RESULTS: Of the 122 responding students (71% response rate), a majority had never performed lumbar puncture, thoracentesis, paracentesis, or blood culture, and students reported lowest self-confidence in these skills. At least one-quarter of students had never performed phlebotomy, peripheral intravenous catheter insertion, or arterial blood sampling. Students perceived all 21 skills as important to learn and perform during medical school. CONCLUSION: Through the third year of medical school, a majority of students had never performed important procedures, and a substantial minority had not performed basic procedures. Students had low self-confidence in skills they rarely performed, but perceived all skills surveyed as important.

Effect of a second-year primary care preceptorship on medical students' career plans.

BACKGROUND: Preceptorships with community physicians have been incorporated into medical curricula to foster interest in generalist careers. An evaluation of our preceptorship program was undertaken to determine this influence. METHODS: Students were asked about career interests before and after a second-year community preceptorship. When graduating, those students entering primary-care residencies were surveyed to validate whether they planned to become generalist or specialist. Associations between career choice at graduation and career interest before and after the preceptorship were examined. RESULTS: Of 73 students who maintained a generalist career plan after the community preceptorship, 57 (78%) continued with the same at graduation. After the preceptorship, 70 students reported a change in career interest toward generalism, compared with 9 who reported an interest in specialism. A significant relationship was found between career interest change and career choice at graduation. CONCLUSION: Our community preceptorship had a modest impact in stimulating students to consider generalist careers.