Description and Early Outcomes of a Comprehensive Curriculum Redesign at the Northwestern University Feinberg School of Medicine.

In 2012, the Northwestern University Feinberg School of Medicine launched a redesigned curriculum addressing the four primary recommendations in the 2010 Carnegie Foundation for the Advancement of Teaching report on reforming medical education. This new curriculum provides a more standardized evaluation of students' competency achievement through a robust portfolio review process coupled with standard evaluations of medical knowledge and clinical skills. It individualizes learning processes through curriculum flexibility, enabling students to take electives earlier and complete clerkships in their preferred order. The new curriculum is integrated both horizontally and vertically, combining disciplines within organ-based modules and deliberately linking elements (science in medicine, clinical medicine, health and society, professional development) and threads (medical decision making, quality and safety, teamwork and leadership, lifestyle medicine, advocacy and equity) across the three phases that replaced the traditional four-year timeline. It encourages students to conduct research in an area of interest and commit to lifelong learning and self-improvement. The curriculum formalizes the process of professional identity formation and requires students to reflect on their experiences with the informal and hidden curricula, which strongly shape their identities.The authors describe the new curriculum structure, explain their approach to each Carnegie report recommendation, describe early outcomes and challenges, and propose areas for further work. Early data from the first cohort to progress through the curriculum show unchanged United States Medical Licensing Examination Step 1 and 2 scores, enhanced student research engagement and career exploration, and improved student confidence in the patient care and professional development domains.

What Is the Relationship Between a Preclerkship Portfolio Review and Later Performance in Clerkships?

PURPOSE: Medical educators struggle to find effective ways to assess essential competencies such as communication, professionalism, and teamwork. Portfolio-based assessment provides one method of addressing this problem by allowing faculty reviewers to judge performance, as based on a longitudinal record of student behavior. At the Feinberg School of Medicine, the portfolio system measures behavioral competence using multiple assessments collected over time. This study examines whether a preclerkship portfolio review is a valid method of identifying problematic student behavior affecting later performance in clerkships. METHOD: The authors divided students into two groups based on a summative preclerkship portfolio review in 2014: students who had concerning behavior in one or more competencies and students progressing satisfactorily. They compared how students in these groups later performed on two clerkship outcomes as of October 2015: final grades in required clerkships, and performance on a clerkship clinical composite score. They used Mann-Whitney tests and multiple linear regression to examine the relationship between portfolio review results and clerkship outcomes. They used USMLE Step 1 to control for knowledge acquisition. RESULTS: Students with concerning behavior preclerkship received significantly lower clerkship grades than students progressing satisfactorily (P = .002). They also scored significantly lower on the clinical composite score (P < .001). Regression analysis indicated concerning behavior was associated with lower clinical composite scores, even after controlling for knowledge acquisition. CONCLUSIONS: The results show a preclerkship portfolio review can identify behaviors that impact clerkship performance. A comprehensive portfolio system is a valid way to measure behavioral competencies.

Feasibility and Outcomes of Implementing a Portfolio Assessment System Alongside a Traditional Grading System.

PURPOSE: Portfolios are a powerful tool to collect and evaluate evidence of medical students' competence across time. However, comprehensive portfolio assessment systems that are implemented alongside traditional graded curricula at medical schools in the United States have not been described in the literature. This study describes the development and implementation of a longitudinal competency-based electronic portfolio system alongside a graded curriculum at a relatively large U.S. medical school. METHOD: In 2009, the authors developed a portfolio system that served as a repository for all student assessments organized by competency domain. Five competencies were selected for a preclerkship summative portfolio review. Students submitted reflections on their performance. In 2014, four clinical faculty members participated in standard-setting activities and used expert judgment and holistic review to rate students' competency achievement as "progressing toward competence," "progressing toward competence with some concern," or "progressing toward competence pending remediation." Follow-up surveys measured students' and faculty members' perceptions of the process. RESULTS: Faculty evaluated 156 portfolios and showed high levels of agreement in their ratings. The majority of students achieved the "progressing toward competence" benchmark in all competency areas. However, 31 students received at least one concerning rating, which was not reflected in their course grades. Students' perceptions of the system's ability to foster self-assessment were mixed. CONCLUSIONS: The portfolio review process allowed faculty to identify students with a concerning rating in a behavioral competency who would not have been identified in a traditional grading system. Identification of these students allows for intervention and early remediation.

Academic Performance of Students in an Accelerated Baccalaureate/MD Program: Implications for Alternative Physician Education Pathways.

PURPOSE: Over one-third of U.S. medical schools offer combined baccalaureate/MD (BA/MD) degree programs. A subset of these truncate the premedical phase, reducing total time to the MD degree. Data comparing educational outcomes of these programs with those of conventional pathways are limited. METHOD: The authors reviewed demographic characteristics and medical school performance of all 2,583 students entering Northwestern University Feinberg School of Medicine from 1999 to 2013, comparing students in the Honors Program in Medical Education (HPME), an accelerated seven-year program, versus non-HPME medical students. They evaluated Alpha Omega Alpha (AOA) selection, quintile performance distribution from the Medical Student Performance Evaluation, United States Medical Licensing Examination (USMLE) scores, and Match outcomes. RESULTS: A total of 560 students (21.7%) entered through the HPME. HPME students were on average 2.2 years younger and less likely (15/537 [2.8%] versus 285/1,833 [15.5%]) to belong to a racial/ethnic group underrepresented in medicine. There were no significant differences in AOA selection, quintile performance distribution, or USMLE scores. More HPME students entered internal medicine (161/450 [35.8%] versus 261/1,265 [20.6%]), and fewer chose emergency medicine (25/450 [5.6%] versus 110/1,265 [8.7%]) and obstetrics-gynecology (9/450 [2.0%] versus 67/1,265 [5.3%]). CONCLUSIONS: The academic performances of medical students in the two programs studied were equivalent. Accelerated BA/MD programs might play a role in ameliorating the length and cost of a medical education. The academic success of these students absent the usual emphasis on undergraduate GPA and Medical College Admission Test scores supports efforts to redefine medical student selection criteria.

Four-Year Educational and Patient Care Outcomes of a Team-Based Primary Care Longitudinal Clerkship.

BACKGROUND: Longitudinal clerkships show promise in improving undergraduate primary care education. This study examines the Education-Centered Medical Home (ECMH), a longitudinal clerkship embedding teams of students across all four years into primary care clinics to provide patient care and serve as health coaches for high-risk patients. METHOD: All students graduating in 2015 were surveyed to assess attitudes, experiences, and preferences regarding primary care education. ECMH students were compared with students receiving their primary care training in a traditional curriculum (TC) using paired measures of comparison. To assess the impact of the ECMH on patient care quality, authors performed a detailed chart review at one site. RESULTS: Seventy-six percent of eligible students participated in the study. ECMH students (n = 69) and TC students (n = 68) had similar baseline academic performance and career interests. ECMH students reported more continuity-of-care experiences, higher satisfaction with their primary care learning climate (86% versus 61% in the EMCH and TC cohorts, respectively), more confidence in their quality improvement skills, and scored higher on measures of perceived patient centeredness. Students from both groups recommended the ECMH (91% and 57%, respectively). Student involvement at one ECMH site was correlated with increased patient contacts and improved delivery of recommended preventive care. CONCLUSIONS: Incorporating students longitudinally into primary care clinics is highly rated by students. The ECMH model led to improved continuity, improved perceptions of the learning climate, and higher patient centeredness. Preliminary data suggest that students add value and improve patient outcomes during longitudinal clinical experiences.

Commentary: Accurate medical student performance evaluations and professionalism assessment: "Yes, we can!".

In this issue, Brenner and colleagues report a correlation between the frequency of negative comments in the "dean's letter" and future problems during a psychiatry residency program. Their study makes an important contribution to the body of literature on factors that predict professionalism-related performance issues during residency and suggests the importance of dependable data that can be used to predict and hopefully intervene early in the training of future physicians across all specialties. As we think about the implications of this study, important issues involving the standardization of medical student performance evaluations (MSPEs) and the assessment of professionalism are raised. Despite the Association of American Medical Colleges' 2002 guidelines for MSPEs, subsequent studies have revealed that considerable inconsistencies among the evaluations still remain. To enhance the accuracy and usefulness of the MSPEs in predicting "problem residents," improved standardization is necessary. Moreover, Brenner's findings call for the development of more vigorous assessment of professionalism in undergraduate medical education, as well as more accurate reporting of these assessments to residency programs. Longitudinal assessment of professionalism with robust tools allows for the identification and possible remediation of students early in their undergraduate training. Insofar as unprofessional behavior in medical school is predictive not only of problems during residency but also of later disciplinary action against the practicing physician by state medical boards, it is the obligation of the medical school to the residency program and to society to identify and report these behaviors.

Selection criteria for residency: results of a national program directors survey.

PURPOSE: To assess the relative importance of criteria used for residency selection in 21 medical specialties given current available data and competitiveness of specialties. METHOD: In 2006, questionnaires were distributed to 2,528 program directors in university hospital or university-affiliated community hospital residency programs across 21 medical specialties. Responses were recorded using a five-point Likert scale of importance. Mean values for each item were calculated within and across all specialties. Mean scores for item responses were used to create rank orders of selection criteria within the specialties. To facilitate comparisons, specialties were grouped according to the percentages of positions filled with U.S. medical school graduates. RESULTS: The overall response rate was 49%. With the data from all specialties pooled, the top five selection criteria were (1) grades in required clerkships, (2) United States Medical Licensing Examination (USMLE) Step 1 score, (3) grades in senior electives in specialty, (4) number of honors grades, and (5) USMLE Step 2 Clinical Knowledge (CK) score. CONCLUSIONS: The top academic selection criteria are based on clinical performance, with the exception of USMLE Step 1 score. Indicators that reflect excellence in clinical performance are valued across the specialties by residency program directors regardless of competitiveness within the specialty. USMLE Step 2 CK ranks higher in the less competitive specialties, whereas research experience is more prominent in the most competitive specialties. The Medical Student Performance Evaluation was ranked lowest of all criteria by the program directors.

Teaching pediatrics residents how to obtain informed consent.

BACKGROUND: Few physicians view informed consent as a critical component of the physician-patient relationship or as a way to improve individual and population health. We hypothesized that formal education about informed consent would affect first-year pediatrics residents' knowledge and attitudes. METHOD: Twenty-seven first-year pediatrics residents participated in a randomized controlled trial with a wait-list control group. The one-hour interactive intervention consisted of a lecture, video, and small-group discussion. Outcomes were measured after randomization at baseline and after the intervention group received the intervention. Data were analyzed using multivariate analysis and between and within group t tests. Qualitative data were obtained after the wait-list control group's exposure to the intervention. RESULTS: The quantitative analyses demonstrated that the intervention yielded statistically significant improvements in the measured outcomes. The qualitative analyses confirm the quantitative findings. CONCLUSION: A formal session on informed consent in the pediatrics residency educational program positively affects residents' knowledge and attitudes about informed consent.