Using a computer simulation for teaching communication skills: A blinded multisite mixed methods randomized controlled trial.

OBJECTIVES: To assess advanced communication skills among second-year medical students exposed either to a computer simulation (MPathic-VR) featuring virtual humans, or to a multimedia computer-based learning module, and to understand each group's experiences and learning preferences. METHODS: A single-blinded, mixed methods, randomized, multisite trial compared MPathic-VR (N=210) to computer-based learning (N=211). Primary outcomes: communication scores during repeat interactions with MPathic-VR's intercultural and interprofessional communication scenarios and scores on a subsequent advanced communication skills objective structured clinical examination (OSCE). Multivariate analysis of variance was used to compare outcomes. SECONDARY OUTCOMES: student attitude surveys and qualitative assessments of their experiences with MPathic-VR or computer-based learning. RESULTS: MPathic-VR-trained students improved their intercultural and interprofessional communication performance between their first and second interactions with each scenario. They also achieved significantly higher composite scores on the OSCE than computer-based learning-trained students. Attitudes and experiences were more positive among students trained with MPathic-VR, who valued its providing immediate feedback, teaching nonverbal communication skills, and preparing them for emotion-charged patient encounters. CONCLUSIONS: MPathic-VR was effective in training advanced communication skills and in enabling knowledge transfer into a more realistic clinical situation. PRACTICE IMPLICATIONS: MPathic-VR's virtual human simulation offers an effective and engaging means of advanced communication training.

Relationships between preclinical course grades and standardized exam performance.

Success in residency matching is largely contingent upon standardized exam scores. Identifying predictors of standardized exam performance could promote primary intervention and lead to design insights for preclinical courses. We hypothesized that clinically relevant courses with an emphasis on higher-order cognitive understanding are most strongly associated with performance on United States Medical Licensing Examination Step exams and National Board of Medical Examiners clinical subject exams. Academic data from students between 2007 and 2012 were collected. Preclinical course scores and standardized exam scores were used for statistical modeling with multiple linear regression. Preclinical courses were categorized as having either a basic science or a clinical knowledge focus. Medical College Admissions Test scores were included as an additional predictive variable. The study sample comprised 795 graduating medical students. Median score on Step 1 was 234 (interquartile range 219-245.5), and 10.2 % (81/795) scored lower than one standard deviation below the national average (205). Pathology course score was the strongest predictor of performance on all clinical subject exams and Step exams, outperforming the Medical College Admissions Test in strength of association. Using Pathology score <75 as a screening metric for Step 1 score <205 results in sensitivity and specificity of 37 and 97 %, respectively, and a likelihood ratio of 11.9. Performance in Pathology, a clinically relevant course with case-based learning, is significantly related to subsequent performance on standardized exams. Multiple linear regression is useful for identifying courses that have potential as risk stratifiers.

Developing a fully online course for senior medical students.

In 2002 the University of Michigan Medical School created a one-month course in advanced medical therapeutics (AMT). All senior medical students were required to complete the course. To provide some flexibility for students who were interviewing for residency positions the AMT course was created using a distance-learning model, and in the 2008-2009 academic year it was offered in a fully online format. The components of the course are weekly case-based modules, a weekly online seminar, quizzes based on modules and seminars, and a research project based on a therapeutic question. The paper discusses the development and components of the AMT course, a survey of fourth-year medical students who participated in the course between 2007 and 2010, and how the course evolved over three years.

Pass-fail grading: laying the foundation for self-regulated learning.

Traditionally, medical schools have tended to make assumptions that students will "automatically" engage in self-education effectively after graduation and subsequent training in residency and fellowships. In reality, the majority of medical graduates out in practice feel unprepared for learning on their own. Many medical schools are now adopting strategies and pedagogies to help students become self-regulating learners. Along with these changes in practices and pedagogy, many schools are eliminating a cornerstone of extrinsic motivation: discriminating grades. To study the effects of the switch from discriminating to pass-fail grading in the second year of medical school, we compared internal and external assessments and evaluations for a second-year class with a discriminating grading scale (Honors, High Pass, Pass, Fail) and for a second-year class with a pass-fail grading scale. Of the measures we compared (MCATs, GPAs, means on second-year examinations, USMLE Step 1 scores, residency placement, in which there were no statistically significant changes), the only statistically significant decreases (lower performance with pass fail) were found in two of the second-year courses. Performance in one other course also improved significantly. Pass-fail grading can meet several important intended outcomes, including "leveling the playing field" for incoming students with different academic backgrounds, reducing competition and fostering collaboration among members of a class, more time for extracurricular interests and personal activities. Pass-fail grading also reduces competition and supports collaboration, and fosters intrinsic motivation, which is key to self-regulated, lifelong learning.

A qualitative exploration of how the conflict between the formal and informal curriculum influences student values and behaviors.

PURPOSE: The third-year students at one medical school told the authors that values core to patient-centered care were impossible to practice in clerkships, in a culture where supervisors role modeled behaviors in direct conflict with patient-centered care. As they developed a new medical student curriculum, the authors designed the Family Centered Experience (FCE) to help students achieve developmental goals and understand the importance of and provide a foundation for patient-centered care. METHOD: The authors solicited members of the first cohort to complete the FCE (the class of 2007) to participate in this focus-group-based study halfway through the third year. They explored the influence of the FCE on students' experiences in the third-year clerkships, and how conflicts between the two learning experiences shaped these students' values and behaviors. RESULTS: Students reported that during clerkships they experienced strong feelings of powerlessness and conflict between what they had learned about patient-centered care in the first two years and what they saw role modeled in the third year. Based on students' comments, the authors categorized students into one of three groups: those whose patient-centered values were maintained, compromised, or transformed. CONCLUSIONS: Students revealed that their conflict was connected to feelings of powerlessness, along with exacerbating factors including limited time, concerns about expectations for their behavior, and pessimism about change. Role modeling had a significant influence on consequences related to students' patient-centered values.

Remediating students' failed OSCE performances at one school: the effects of self-assessment, reflection, and feedback.

PURPOSE: To investigate whether and how use of an online remediation system requiring reflective review of performance and self-assessment influenced students' performance on objective structured clinical examination (OSCE) station repeats (subsequent to failure on the first attempt) and their self-assessments of their performance (between the first and second attempts). METHOD: Fourth-year medical students' performances on seven OSCE stations were videotaped at University of Michigan Medical School in 2006. Failing students took the exam again; remediation included self-assessment and review, plus faculty guidance for failures that were greater than one standard error of measurement of the distribution. A total of 1,171 possible observations of students' actual performance and performance self-assessments were analyzed using independent and dependent t tests and within-subjects ANOVA. RESULTS: Results indicate statistically significant changes in students' performance between first and second attempts and statistically significant improvements in self-assessment between first and second attempts. No significant changes were found between self-assessed and faculty-guided remediation. CONCLUSIONS: This study provides evidence that OSCE remediation combining review, reflection, and self-assessment has a salutary effect on (subsequent) performance and self-assessment of performance.

Analysis of factors that predict clinical performance in medical school.

Academic achievement indices including GPAs and MCAT scores are used to predict the spectrum of medical student academic performance types. However, use of these measures ignores two changes influencing medical school admissions: student diversity and affirmative action, and an increased focus on communication skills. To determine if GPA and MCAT predict performance in medical school consistently across students, and whether either predicts clinical performance in clerkships. A path model was developed to examine relationships among indices of medical student performance during the first three years of medical school for five cohorts of medical students. A structural equation approach was used to calculate the coefficients hypothesized in the model for majority and minority students. Significant differences between majority and minority students were observed. MCAT scores, for example, did not predict performance of minority students in the first year of medical school but did predict performance of majority students. This information may be of use to medical school admissions and resident selection committees.

The impact of facilitation of small-group discussions of psychosocial topics in medicine on faculty growth and development.

PURPOSE: To use qualitative analysis of interview transcripts with clinician-educators who facilitate small-group discussions on psychosocial themes--including doctoring--to answer the question, "What impact does facilitating small-group discussions of the patient's experience with chronic illness, the doctor-patient relationship, and doctoring have on faculty instructors' attitudes regarding their roles as clinicians and teachers?" METHOD: In 2006, in-depth, face-to-face interviews using an open-ended question format were conducted with individual faculty small-group instructors teaching in the Family Centered Experience and Longitudinal Case Studies courses at the University of Michigan Medical School. Interview transcripts were analyzed using grounded theory methodology to identify emerging themes. Accuracy of interpretations and saturation of themes was confirmed by repeated contextual reading of the transcripts. RESULTS: Several major thematic codes emerged from the data. Facilitation of small-group discussions of psychosocial topics and doctoring fostered reflective approaches to patient care and teaching; enhanced interpersonal relationships between facilitators and their students, colleagues, and patients; and acted as a source of fulfillment and renewal among faculty facilitators. CONCLUSIONS: Small-group teaching of the art of doctoring may stimulate personal and professional growth among faculty facilitators and renewed interest in teaching and patient care.

Assessing the assessment: are senior summative OSCEs measuring advanced knowledge, skills, and attitudes?

PURPOSE: The authors investigated adaptation of Bloom's and Simpson's taxonomies for the medical (student) setting, and using the adapted taxonomies to determine whether a summative objective structured clinical examination (OSCE) used at their medical school was assessing higher-order knowledge, skills, and attitudes. METHOD: Two faculty members (including H.M.H.) adapted the taxonomies and used them to categorize (knowledge, skills, or attitudes) and rank (by level within the taxonomies) every item on every OSCE station checklist. Interrater reliability was moderate to high. RESULTS: Although there was a range of domains and levels within and across stations, on average every OSCE station was assessing learning behaviors at a lower level than expectations articulated in the school's goals for medical students' education. CONCLUSIONS: The adapted taxonomies were useful for assessing the domains and levels of behaviors measured on the summative OSCE, and they can also be used to modify existing checklists or to create new assessment instruments that meet the expectations articulated in a school's goals for medical students' education.

Use of interactive theater for faculty development in multicultural medical education.

BACKGROUND: The development of critical consciousness, anchored in principles of social justice, is an essential component of medical education. AIM: In order to assist faculty instructors in facilitating small-group discussions on potentially contentious issues involving race, gender, sexual orientation, and socioeconomic class, a faculty development workshop was created. METHODS: The workshop used 'Forum Theater' techniques in which the audience was directly involved in determining the course of a simulated classroom discussion and conflict. We assessed the workshop's impact on the instructors' attitudes regarding facilitation of small-group discussions through two surveys: one to gauge immediate impressions, and another, 9-15 months later, to assess impact over time. RESULTS: Immediately after the workshop, participants reported that the topics covered in the sketch and in the discussion were highly relevant. In the follow-up survey, the instructors agreed that the workshop had raised their awareness of the classroom experiences of minorities and women and had offered strategies for addressing destructive classroom dynamics. 72% reported that the workshop led to changes in their behavior as facilitators. Differences in responses according to gender were observed. CONCLUSIONS: A workshop using interactive theater was effective in training faculty to facilitate small-group discussions about multicultural issues. This approach emphasizes and models the need to foster critical consciousness in medical education.

Smoothing out transitions: how pedagogy influences medical students' achievement of self-regulated learning goals.

Medical school is an academic and developmental path toward a professional life demanding self-regulation and self-education. Thus, many medical schools include in their goals for medical student education their graduates' ability to self-assess and self-regulate their education upon graduation and throughout their professional lives. This study explores links between medical students' use of self-regulated learning as it relates to motivation, autonomy, and control, and how these influenced their experiences in medical school. Subjects were medical students in two distinct medical school environments, "Problem-based learning" and "Traditional." PBL students described a rough transition into medical school, but once they felt comfortable with the autonomy and control PBL gave them, they embraced the independence and responsibility. They found themselves motivated to learning for learning's sake, and able to channel their motivation into effective transitions from the classrooms into the clerkships. Traditional students had a rougher transition from the classrooms to the clerkships. In the first two years they relied on faculty to direct and control learning, and they channeled their motivation toward achieving the highest grade. In the clerkships, they found faculty expected them to be more independent and self-directed than they felt prepared to be, and they struggled to assume responsibility for their learning. Self-regulated learning can help smooth out the transitions through medical school by preparing first and second year students for expectations in the third and fourth years, which can then maximize learning in the clinical milieu, and prepare medical students for a lifetime of learning.

The effect of the obstetrics and gynecology clerkship on students' interest in a career in obstetrics and gynecology.

OBJECTIVE: The goal of this study was to determine the influence of the third-year obstetrics and gynecology (OB/GYN) clerkship on male and female medical students' interest in a career in OB/GYN. STUDY DESIGN: Third-year medical students were surveyed about anticipated career field before and at the completion of the OB/GYN clerkship. The percentage of students considering OB/GYN as a career was computed before and after the clerkship. A multiple regression analysis was performed to examine the influence of various demographic factors on interest in OB/GYN. A Chi-square test was performed to establish different effects on males and females. RESULTS: A total of 268 students (55%) completed both surveys. Eight percent (mostly females) considered an OB/GYN career pre-clerkship and 15% post-clerkship. Interest in OB/GYN pre-clerkship was the strongest predictor of interest post-clerkship. CONCLUSION: The OB/GYN clerkship increases students' interest in a career in OB/GYN. Most males are not considering OB/GYN as a career choice before the start of the clerkship.

Multidimensional effects of the 80-hour work week at the University of Michigan Medical School.

PURPOSE: To examine the effects of the new resident work-hour restrictions on medical students, as measured by their perceptions of the quality of their experiences during the required clerkships. METHOD: Evaluations of four clerkships were compared for two student cohorts at the University of Michigan Medical School. The first cohort, from the class of 2002-03, completed their clinical clerkships the year before the work-hour restrictions were implemented, and the second cohort, from the class of 2003-04, completed their clerkships the same year the restrictions were implemented. RESULTS: There were significant and notable differences in the experiences of the two cohorts. Students' perceptions of the quality of their experiences in the surgery-oriented clerkships (obstetrics-gynecology and surgery) in particular were significantly lower (i.e., more negative) in the 2003-04 cohort than in the previous cohort for the same clerkships. The nonsurgery-oriented clerkships (internal medicine and pediatrics) hired hospitalists, who offset the residents' workload (internal medicine) and assumed teaching responsibilities (pediatrics). Between 2002-03 and 2003-04, students' perceptions of the quality of their experience in the internal medicine clerkship remained mostly stable, and increased in several areas for the students in the pediatrics clerkship. CONCLUSIONS: Implementation of resident work-hour restrictions had significant effects on the education of the medical students studied. These effects need to be carefully analyzed and considered to ensure quality education for medical students. The findings also highlight that the nature of students' perceptions was related to preparations made (or not) by specific clerkships as restricted work-hour regulations were adopted.

Medical students self-reported work hours: perception versus reality.

OBJECTIVE: The objective of this study was to compare the students' actual work hours with their self-reported work hours during the obstetrics and gynecology clerkship, and to determine whether the number of hours worked correlate with the amount of "scut" reported or students' rating of the quality of the clerkship. STUDY DESIGN: Students self-reported work hours were compared against their actual scheduled hours over 2 different academic years. Pearson's correlation was performed to correlate the actual hours with the amount of reported "scut" work and the overall rating of the quality of the clerkship. RESULTS: The actual hours per week worked by students averaged 59 hours in 2003 and 48 hours in 2004. Students overestimated their work hours both years. Students who worked more hours rated the clerkship lower and the quality of the clerkship significantly improved from 2003 to 2004 (4.2 vs 3.8 P < .03). CONCLUSION: The majority of third-year students overestimate their work hours in obstetrics and gynecology. The rating of the overall quality of the clerkship increase significantly with fewer hours worked, and it is not affected by the amount of "scut" work.

Opening cultural doors: providing culturally sensitive healthcare to Arab American and American Muslim patients.

Differences in the social and religious cultures of Arab Americans and American Muslims raise challenges to healthcare access and delivery. These challenges go far beyond language to encompass entire world views, concepts of health, illness, and recovery and even death. Medical professionals need a more informed understanding and consideration of the rich and diverse array of beliefs, expectations, preferences, and behavioral make up of the social cultures of these patients to ensure that they are providing the best and most comprehensive care possible. Improved understanding will enhance a provider's ability to offer quality healthcare and to build trusting relationships with patients. Here, we provide a broad overview of Arab culture and Islamic religious beliefs that will assist providers in delivering culturally sensitive healthcare to these groups. We offer insight into the behaviors, requirements, and preferences of Arab American and American Muslim patients, especially as they apply to women's health.

A content analysis of e-mail communication between patients and their providers: patients get the message.

OBJECTIVE: E-mail use in the clinical setting has been slow to diffuse for several reasons, including providers' concerns about patients' inappropriate and inefficient use of the technology. This study examined the content of a random sample of patient-physician e-mail messages to determine the validity of those concerns. DESIGN: A qualitative analysis of patient-physician e-mail messages was performed. MEASUREMENTS: A total of 3,007 patient-physician e-mail messages were collected over 11 months as part of a randomized, controlled trial of a triage-based e-mail system in two primary care centers (including 98 physicians); 10% of messages were randomly selected for review. Messages were coded across such domains as message type, number of requests per e-mail, inclusion of sensitive content, necessity of a physician response, and message tone. RESULTS: The majority (82.8%) of messages addressed a single issue. The most common message types included information updates to the physicians (41.4%), prescription renewals (24.2%), health questions (13.2%), questions about test results (10.9%), referrals (8.8%), "other" (including thank yous, apologies) (8.8%), appointments (5.4%), requests for non-health-related information (4.8%), and billing questions (0.3%). Overall, messages were concise, formal, and medically relevant. Very few (5.1%) included sensitive content, and none included urgent messages. Less than half (43.2%) required a physician response. CONCLUSION: A triage-based e-mail system promoted e-mail exchanges appropriate for primary care. Most patients adhered to guidelines aimed at focusing content, limiting the number of requests per message, and avoiding urgent requests or highly sensitive content. Thus, physicians' concerns about the content of patients' e-mails may be unwarranted.