Applying the Lean Startup Method to Structure Project-Based, Student-Driven Curricular Enhancements.

PROBLEM: Formal medical student engagement in curricular evaluation provides significant value through identification of opportunities for curricular change. Students provide diverse perspectives and have a unique vantage point, which allows them to see aspects of the curriculum that educators and administrators might not recognize. Current descriptions of student engagement are focused largely on collection, analysis, and presentation of summative feedback in the pre-clerkship curriculum. However, medical students could potentially contribute to curricular improvement in ways extending beyond post hoc curricular evaluation. Student teams focused on identification of specific needs and project-based implementation of solutions represent one means of doing so but require a structured, organizing method in order to succeed. INTERVENTION: We describe a novel, project-based, student-driven medical education initiative, the Special Projects Team, which is focused on identifying opportunities for forward-looking curricular enhancements beyond single courses or rotations. We adapted and implemented the lean startup method, a model for project management, in order to address the need for organization and accountability in the Special Projects Team. Members of the Special Projects Team were recruited from the first- and second-year medical school classes in the 2018-2020 academic years and provided with training on the lean startup method. Team members selected and pursued projects according to the principles of lean startup method, reporting their progress to the chair of the Special Projects Team and other team members at monthly meetings with pre-defined structure. CONTEXT: The Special Projects Team is part of the local Student Curricular Board at the Chicago campus of the University of Illinois College of Medicine. The Student Curricular Board is responsible for conducting curricular evaluation and improvement, operating under the local medical student council with financial support from the Office of Curricular Affairs. Direct supervision of the Special Projects Team is provided by a student chair, the executive board of the Student Curricular Board, and the curricular dean. IMPACT: The projects initiated as part of the Special Projects Team covered a broad range of themes, including curricular evaluation, technology, and student experiences. Lean startup method contributed to sustained project success and frequent reassessment across the two years of our experience, with aggregate project success or continuation rate of 68.4% (13/19 projects). We further demonstrate how lean startup method increased productivity while providing structure and accountability for a student-led medical education team. LESSONS LEARNED: Lean startup method can be used to structure student-driven, project-based curricular enhancements. This approach is broadly applicable to other medical schools with implementation requiring only a motivated student team, faculty advisor, and basic knowledge of the lean startup method.

Evaluating Core Clerkships: Lessons Learned From Implementing a Student-Driven Feedback System for Clinical Curricula.

PROBLEM: Medical schools have implemented various ways to engage students in improving medical curricula. These systems, however, usually focus on the preclerkship curriculum, perhaps because medical students move through this phase of medical education synchronously, making it easier to collect student input. In contrast, clerkship and postclerkship curricula often lack similar levels of student engagement in program evaluation. APPROACH: To increase communication among students, faculty, and administration during the clinical years of medical education, the Student Curricular Board (SCB) at the University of Illinois College of Medicine's Chicago campus (UICOM-Chicago) developed a student-driven feedback model in 2016 that aimed to parallel the system previously implemented in the preclerkship years. Interested fourth-year students were selected by their peers to represent individual core clerkships, and they communicated regularly with clerkship directors about concerns from current clerkship students. Third-year students applied and were selected to represent their cohort of peers moving through clerkship tracks. Proposed changes and improvements were tracked via novel, student-driven SOAP-Education (SOAP-Ed) progress notes written throughout the academic year. OUTCOMES: In response to a program evaluation survey conducted after implementation of this pilot, third-year students said they felt that their feedback was taken seriously by faculty and administration. Furthermore, student feedback led to meaningful changes in core clerkship curricula and in the system used to gather clerkship feedback. Clerkship directors expressed appreciation for this partnership, and students said they gained valuable leadership experience and knowledge of curricular development. NEXT STEPS: Current SCB members and curricular leadership plan to assess student and faculty perceptions of this system and its efficacy and work toward expansion to all UICOM campuses. Lessons learned from this student-driven model of feedback in third-year core clerkships will likely add to the conversation on how to better engage medical students as active stakeholders in their own education.

Beyond Technical Standards: A Competency-Based Framework for Access and Inclusion in Medical Education.

Efforts to include people with disability as students and practitioners in the health professions have gained momentum in recent years. However, prevailing technical standards at U.S. medical schools have biases that can prevent or impede their admission, promotion, and graduation. These standards derive from an approach first promulgated in 1979 and have since remained largely unaltered. Current technical standards at most medical schools are now at odds with changes occurring since the 1990 enactment of broad civil rights protections for people with disability and current aspirations for diversity, equity, and inclusion in the medical profession. It is time to replace the technical standards construct with an approach more consistent with current medical practices, and with societal imperatives of equity and social justice. Such an approach should assess candidates' demonstrable skills and merits, rather than relying on a preconceived construct identifying the presence or absence of defined levels of ability. The maturation of competency-based approaches to curricular design and assessment provides an opportunity to reconceptualize the abilities required to practice medicine, foster the appropriate inclusion of physicians with disability, and better align medical education and training with broader societal needs and goals.

Translation, Adaptation, and Assessment of the Communication Assessment Tool in Tigray, Northern Ethiopia.

BACKGROUND: Ethiopia has experienced tremendous growth in medical education beginning in the early 2000s. Research shows a need for emphasis on empathy and compassionate care in this setting. In the United States, the Communication Assessment Tool (CAT) is a widely used, validated survey measuring provider-patient interactions. OBJECTIVE: The goal of this study was to translate, culturally adapt, and pilot the CAT to allow it to be used with trainees and patients in Ethiopia. METHODS: Bilingual experts translated the CAT into Tigrigna, the primary language of the Tigray region in northern Ethiopia, followed by focus group discussions, back translation, and review by the original author of the CAT. The translated tool was administered to the patients of resident physicians in 6 specialties at Ayder Referral Hospital between December 2016 and February 2017. RESULTS: Our translation of the CAT into Tigrigna had semantic, idiomatic, and experiential equivalence. Of 1024 patients recruited, 1002 (98%) completed interviews using the CAT. Mean score was 3.09; 3% of all scores were excellent and 54% were good. Cronbach's alpha score for the full survey was 0.942, demonstrating high reliability. CONCLUSIONS: The translated CAT in Tigrigna can be used to assess communication skills in Ethiopian residents. Both mean score and percentage of excellent scores were considerably lower than scores in other countries, suggesting that there may be opportunities for improvement in residents' communication skills.

Leading Practices and Future Directions for Technical Standards in Medical Education.

The medical profession first addressed the need for technical standards (TS), defining the nonacademic requirements deemed essential for participation in an educational program, in guidelines published by the Association of American Medical Colleges in 1979. Despite many changes in the practice of medicine and legal, cultural, and technological advances that afford greater opportunities for people with disabilities, the profession's approach to TS largely has not changed over the ensuing four decades. Although physicians with disabilities bring unique perspectives to medicine and contribute to a diverse physician workforce of culturally competent practitioners, they remain underrepresented in the profession.As part of an initiative sponsored by the Association of Academic Physiatrists, the authors describe the need for an updated TS framework, outlining interval changes in the legal and regulatory climate, medical practice, and medical education since the initial TS guidelines were put forth. They conclude by offering eight recommendations and two functional approaches to TS that are consistent with now-prevalent competency-based medical education constructs.The profession's commitment to diversity and inclusion should extend explicitly to people with disabilities, and this stance should be clearly communicated through medical schools' TS and procedures for requesting accommodations. To this end, schools should consider the principles of universal design to create policies and assessments that work for all learners, to the greatest extent possible, without the need for after-the-fact accommodations. A thoughtful and concerted effort along these lines is long overdue in medical education.

Description and Early Outcomes of a Comprehensive Curriculum Redesign at the Northwestern University Feinberg School of Medicine.

In 2012, the Northwestern University Feinberg School of Medicine launched a redesigned curriculum addressing the four primary recommendations in the 2010 Carnegie Foundation for the Advancement of Teaching report on reforming medical education. This new curriculum provides a more standardized evaluation of students' competency achievement through a robust portfolio review process coupled with standard evaluations of medical knowledge and clinical skills. It individualizes learning processes through curriculum flexibility, enabling students to take electives earlier and complete clerkships in their preferred order. The new curriculum is integrated both horizontally and vertically, combining disciplines within organ-based modules and deliberately linking elements (science in medicine, clinical medicine, health and society, professional development) and threads (medical decision making, quality and safety, teamwork and leadership, lifestyle medicine, advocacy and equity) across the three phases that replaced the traditional four-year timeline. It encourages students to conduct research in an area of interest and commit to lifelong learning and self-improvement. The curriculum formalizes the process of professional identity formation and requires students to reflect on their experiences with the informal and hidden curricula, which strongly shape their identities.The authors describe the new curriculum structure, explain their approach to each Carnegie report recommendation, describe early outcomes and challenges, and propose areas for further work. Early data from the first cohort to progress through the curriculum show unchanged United States Medical Licensing Examination Step 1 and 2 scores, enhanced student research engagement and career exploration, and improved student confidence in the patient care and professional development domains.

Beyond cognitive measures: Empirical evidence supporting holistic medical school admissions practices and professional identity formation.

This article was migrated. The article was marked as recommended. Background: Medical schools seek admissions methods that identify applicants who hold promise to become physicians who will navigate and shape the future medical landscape. The focus on traditional cognitive measures for admission has prompted calls for holistic admissions review during the past five years. Yet, empirical evidence linking selection measures to holistic admissions practices has not been fully established, including their relationship with professional identity formation over time. A non-cognitive admissions situational judgment screening test (CASPer) measuring personal and professional characteristics was added to the University of Illinois College of Medicine admissions process two years ago, as we implemented a new curriculum that emphasizes professional identity development. Purpose: This study examined associations among admissions measures (Medical College Admission Test [MCAT], grade point average [GPA], interview, and CASPer), and their predictive relationships with curricular measures of professional identity formation (Professional Identity Essay [PIE]) and moral reasoning (Defining Issues Test [DIT2]). Methods: Data were taken from two entering cohorts ( n = 596; entering class of 2017 and 2018 across 3 regional sites). Correlations and regression analyses were used to examine associations between admissions and professional identity measures. Results: CASPer and in-person admissions interview ratings had significant positive correlations, suggesting that CASPer can contribute to effective screening processes. In addition, CASPer demonstrated statistically significant positive relationships with professional identity (CASPer and PIE, r=.10, p<.05) and a measure of moral reasoning (CASPer and DIT2 type indicator, r=.09, p<.05). Association between CASPer and PIE remained consistent, even after controlling for MCAT, interview, and GPA. Conclusion: Our institutional focus on professional identity formation has provided new ways to conceptualize students' readiness for medical school - demonstrated academic rigor as well as signs of professionalism, ethics, and motivation. Non-academic factors measured in situational judgment tests may promote better alignment of admissions practices and desired educational outcomes.

Medical students as health coaches, and more: adding value to both education and patient care.

New ways of thinking about medicine and health care demand new methods in medical education. Over the past two decades, as both the practice and the study of medicine have become increasingly concerned with demonstrable outcomes, medical schools have developed new curricula in health systems science and are increasingly emphasizing students' development and demonstration of skills essential to a systems-based, outcomes-oriented practice environment.Polak and colleagues recently reported the development in Israel of one such curriculum, in lifestyle medicine, that includes opportunities for students to adopt the role of health coach. This commentary describes additional recent curricular developments elsewhere with similar goals, but utilizing more ambitious approaches that embed students in medical practices and provide meaningful, ongoing responsibility for assisting in the care of patients. These emerging new models for ambulatory care education, through a construct known as "value added education," can simultaneously benefit both educational and patient care outcomes.

Academic Performance of Students in an Accelerated Baccalaureate/MD Program: Implications for Alternative Physician Education Pathways.

PURPOSE: Over one-third of U.S. medical schools offer combined baccalaureate/MD (BA/MD) degree programs. A subset of these truncate the premedical phase, reducing total time to the MD degree. Data comparing educational outcomes of these programs with those of conventional pathways are limited. METHOD: The authors reviewed demographic characteristics and medical school performance of all 2,583 students entering Northwestern University Feinberg School of Medicine from 1999 to 2013, comparing students in the Honors Program in Medical Education (HPME), an accelerated seven-year program, versus non-HPME medical students. They evaluated Alpha Omega Alpha (AOA) selection, quintile performance distribution from the Medical Student Performance Evaluation, United States Medical Licensing Examination (USMLE) scores, and Match outcomes. RESULTS: A total of 560 students (21.7%) entered through the HPME. HPME students were on average 2.2 years younger and less likely (15/537 [2.8%] versus 285/1,833 [15.5%]) to belong to a racial/ethnic group underrepresented in medicine. There were no significant differences in AOA selection, quintile performance distribution, or USMLE scores. More HPME students entered internal medicine (161/450 [35.8%] versus 261/1,265 [20.6%]), and fewer chose emergency medicine (25/450 [5.6%] versus 110/1,265 [8.7%]) and obstetrics-gynecology (9/450 [2.0%] versus 67/1,265 [5.3%]). CONCLUSIONS: The academic performances of medical students in the two programs studied were equivalent. Accelerated BA/MD programs might play a role in ameliorating the length and cost of a medical education. The academic success of these students absent the usual emphasis on undergraduate GPA and Medical College Admission Test scores supports efforts to redefine medical student selection criteria.

Policy issues related to educating the future Israeli medical workforce: an international perspective.

A 2014 external review of medical schools in Israel identified several issues of importance to the nation's health. This paper focuses on three inter-related policy-relevant topics: planning the physician and healthcare workforce to meet the needs of Israel's population in the 21(st) century; enhancing the coordination and efficiency of medical education across the continuum of education and training; and the financing of medical education. All three involve both education and health care delivery. The physician workforce is aging and will need to be replenished. Several physician specialties have been in short supply, and some are being addressed through incentive programs. Israel's needs for primary care clinicians are increasing due to growth and aging of the population and to the increasing prevalence of chronic conditions at all ages. Attention to the structure and content of both undergraduate and graduate medical education and to aligning incentives will be required to address current and projected workforce shortage areas. Effective workforce planning depends upon data that can inform the development of appropriate policies and on recognition of the time lag between developing such policies and seeing the results of their implementation. The preclinical and clinical phases of Israeli undergraduate medical education (medical school), the mandatory rotating internship (stáge), and graduate medical education (residency) are conducted as separate "silos" and not well coordinated. The content of basic science education should be relevant to clinical medicine and research. It should stimulate inquiry, scholarship, and lifelong learning. Clinical exposures should begin early and be as hands-on as possible. Medical students and residents should acquire specific competencies. With an increasing shift of medical care from hospitals to ambulatory settings, development of ambulatory teachers and learning environments is increasingly important. Objectives such as these will require development of new policies. Undergraduate medical education (UME) in Israel is financed primarily through universities, and they receive funds through VATAT, an education-related entity. The integration of basic science and clinical education, development of earlier, more hands-on clinical experiences, and increased ambulatory and community-based medical education will demand new funding and operating partnerships between the universities and the health care delivery system. Additional financing policies will be needed to ensure the appropriate infrastructure and support for both educators and learners. If Israel develops collaborations between various government agencies such as the Ministries of Education, Health, and Finance, the universities, hospitals, and the sick funds (HMOs), it should be able to address successfully the challenges of the 21st century for the health professions and meet its population's needs.

Four-Year Educational and Patient Care Outcomes of a Team-Based Primary Care Longitudinal Clerkship.

BACKGROUND: Longitudinal clerkships show promise in improving undergraduate primary care education. This study examines the Education-Centered Medical Home (ECMH), a longitudinal clerkship embedding teams of students across all four years into primary care clinics to provide patient care and serve as health coaches for high-risk patients. METHOD: All students graduating in 2015 were surveyed to assess attitudes, experiences, and preferences regarding primary care education. ECMH students were compared with students receiving their primary care training in a traditional curriculum (TC) using paired measures of comparison. To assess the impact of the ECMH on patient care quality, authors performed a detailed chart review at one site. RESULTS: Seventy-six percent of eligible students participated in the study. ECMH students (n = 69) and TC students (n = 68) had similar baseline academic performance and career interests. ECMH students reported more continuity-of-care experiences, higher satisfaction with their primary care learning climate (86% versus 61% in the EMCH and TC cohorts, respectively), more confidence in their quality improvement skills, and scored higher on measures of perceived patient centeredness. Students from both groups recommended the ECMH (91% and 57%, respectively). Student involvement at one ECMH site was correlated with increased patient contacts and improved delivery of recommended preventive care. CONCLUSIONS: Incorporating students longitudinally into primary care clinics is highly rated by students. The ECMH model led to improved continuity, improved perceptions of the learning climate, and higher patient centeredness. Preliminary data suggest that students add value and improve patient outcomes during longitudinal clinical experiences.

North American medical schools' experience with and approaches to the needs of students with physical and sensory disabilities.

PURPOSE: To determine the nature and frequency of impairments and related underlying conditions of medical students with physical and sensory disabilities (PSDs), and to assess medical schools' use of relevant publications in setting admission criteria and developing appropriate accommodations. METHOD: A 25-item survey addressed schools' experiences with students known to have PSDs and their related policies and practices. The survey instrument was directed to student affairs deans at all 163 accredited American and Canadian medical schools. The authors limited the survey to consideration of PSDs, excluding psychiatric, cognitive, and learning disabilities. RESULTS: Eighty-six schools (52.8%) responded, representing an estimated 83,327 students enrolled between 2001 and 2010. Of these students, 0.56% had PSDs at matriculation and 0.42% at graduation. Although 81% of respondents were familiar with published guidelines for technical standards, 71% used locally derived institutional guidelines for the admission of disabled applicants. The most commonly reported accommodations for students with PSDs included extra time to complete tasks/exams (n = 62), ramps, lifts, or accessible entrances (n = 43), and dictated/audio-recorded lectures (n = 40). All responding schools required students' demonstration of physical examination skills; requirements for other technical skills, with or without accommodations, varied considerably. CONCLUSIONS: The matriculation and graduation rates of medical students with PSDs remain low. The most frequent accommodations reported were among those required of any academic or clinical setting by the Americans with Disabilities Act. There is a lack of consensus regarding technical standards for admission, suggesting a need to reexamine this critical issue.

Toward a liberal education in medicine.

The central thesis of Abraham Flexner's analyses of North American and European medical education was that the university is essential to the provision of a medical education. The authors invoke the spirit of Flexner to envision further contributions of the university at large to undergraduate medical education. Medical curricula now include elements of a variety of other disciplines that are better represented in other parts of the university. Most schools, however, even those closely affiliated with a comprehensive university, do not take full advantage of these resources, nor do they offer sufficient opportunities for students to pursue individualized interests and learning goals. Medical school now plays a different role in the education of physicians than it did a century ago-it remains the definitive, but is no longer the ultimate, stage in a continuum involving college, professional, postgraduate, and continuing education. The authors explore the medical school years as an opportunity for a liberal education in medicine. Beyond the assurance of competence in core knowledge, skills, and perspectives, this model places more emphasis on nurturing students' intellectual curiosity about phenomena of illness and disease, their understanding of the human condition, and their exploration of the many other disciplines related to medicine and the life sciences. A richer, broader education can be achieved through more flexible and individualized paths to the MD and facilitated by realizing medical schools' full academic citizenship in the university.

Collaborative governance of multiinstitutional graduate medical education: lessons from the McGaw Medical Center of Northwestern University.

The governance of graduate medical education (GME) and management of its interface with clinical care is a shared responsibility of teaching hospitals and medical educators. Significant changes in the structure and financing of medical care over the last few decades, along with a recent shift in the educational paradigm for GME, have made this collaboration all the more challenging. Calls for increased institutional accountability for GME from the Association of American Medical Colleges and the Accreditation Council on Graduate Medical Education have highlighted the need for more effective models of GME governance. With these challenges in mind, this article examines the recent experiences of The McGaw Medical Center of Northwestern University, a multiinstitutional, not-for-profitcorporation that serves as the vehicle for educational collaboration between Northwestern University Feinberg School of Medicine and the teaching hospitals/health systems that provide the clinical homes for McGaw-sponsored GME programs. The authors explore the rationale for pursuing a new model of GME governance at McGaw, and various factors important to its success. These "critical success factors" may be of use in other, similarly complex GME settings.