Evaluation of an Individualized Learning Plan Template for the Transition to Residency.

Background Specialty-specific individualized learning plans (ILPs) have been promoted to improve the undergraduate to graduate medical education transition, yet few pilots have been described. Objective To create and report on the feasibility and acceptability of a pilot internal medicine (IM) ILP template. Methods The ILP was created by a group of diverse IM expert stakeholders and contained questions to stimulate self-reflection and collect self-reported readiness data from incoming interns. US IM residency programs were invited to pilot the ILP with interns in spring 2022. Data was used at the programs' discretion. The pilot was evaluated by a post-pilot survey of programs to elicit perceptions of the impact and value of the ILP and analyze anonymous ILP data from 3 institutions. Results Fifty-two IM residency programs agreed to participate with a survey response rate of 87% (45 of 52). Of responding programs, 89% (40 of 45) collected ILPs, thus we report on data from these 40 programs. A total of 995 interns enrolled with 782 completing ILPs (79%). One hundred eleven ILPs were analyzed (14%). Most programs found the ILP valuable to understand incoming interns' competencies (26 of 40, 65%) and areas for improvement (24 of 40, 60%) and thought it should continue (29 of 40, 73%). Programs estimated the ILP took interns 29.2±14.9 minutes and 21.6±10.3 minutes for faculty mentors to complete. The most common barrier was faculty mentor participation. Conclusions An ILP based on interns' self-reported data was feasible and valuable to IM residency programs in understanding interns' competencies and areas for improvement.

Strategies for Advancing Equity in Frontline Clinical Assessment.

Educational equity in medicine cannot be achieved without addressing assessment bias. Assessment bias in health professions education is prevalent and has extensive implications for learners and, ultimately, the health care system. Medical schools and educators desire to minimize assessment bias, but there is no current consensus on effective approaches. Frontline teaching faculty have the opportunity to mitigate bias in clinical assessment in real time. Based on their experiences as educators, the authors created a case study about a student to illustrate ways bias affects learner assessment. In this paper, the authors use their case study to provide faculty with evidence-based approaches to mitigate bias and promote equity in clinical assessment. They focus on 3 components of equity in assessment: contextual equity, intrinsic equity, and instrumental equity. To address contextual equity, or the environment in which learners are assessed, the authors recommend building a learning environment that promotes equity and psychological safety, understanding the learners' contexts, and undertaking implicit bias training. Intrinsic equity, centered on the tools and practices used during assessment, can be promoted by using competency-based, structured assessment methods and employing frequent, direct observation to assess multiple domains. Instrumental equity, focused on communication and how assessments are used, includes specific, actionable feedback to support growth and use of competency-based narrative descriptors in assessments. Using these strategies, frontline clinical faculty members can actively promote equity in assessment and support the growth of a diverse health care workforce.

Reviewing Internal Medicine Clerkship Grading Through a Proequity Lens: Results of a National Survey.

PURPOSE: Equity in assessment and grading has become imperative across medical education. Although strategies to promote equity exist, there may be variable penetrance across institutions. The objectives of this study were to identify strategies internal medicine (IM) clerkship directors (CDs) use to reduce inequities in assessment and grading and explore IM CDs' perceptions of factors that impede or facilitate the implementation of these strategies. METHOD: From October to December 2021, the Clerkship Directors in Internal Medicine of the Alliance for Academic Internal Medicine conducted its annual survey of IM core CDs at 137 U.S. and U.S. territory-based medical schools. This study is based on 23 questions from the survey about equity in IM clerkship assessment and grading. RESULTS: The survey response rate was 73.0% (100 of 137 medical school CDs). Use of recommended evidence-based strategies to promote equity in clerkship assessment and grading varied among IM clerkships. Only 30 respondents (30.0%) reported that their clerkships had incorporated faculty development on implicit bias for clinical supervisors of students; 31 (31.0%) provided education to faculty on how to write narrative assessments that minimize bias. Forty respondents (40.0%) provided guidance to clerkship graders on how to minimize bias when writing final IM clerkship summaries, and 41 (41.0%) used grading committees to determine IM clerkship grades. Twenty-three CDs (23.0%) received formal education by their institution on how to generate clerkship grades and summaries in a way that minimized bias. CONCLUSIONS: This national survey found variability among medical schools in the application of evidence-based strategies to promote equity in assessment and grading within their IM clerkships. Opportunities exist to adopt and optimize proequity grading strategies, including development of programs that address bias in clerkship assessment and grading, reevaluation of the weight of standardized knowledge exam scores on grades, and implementation of grading committees.

Medical student advising during virtual residency recruitment: results of a national survey of internal medicine clerkship and sub-internship directors.

INTRODUCTION: The residency application process is a critical time for medical students. The COVID-19 pandemic prompted changes to the residency recruitment procedures with the conversion of interviews to a virtual format. For medical school advisors guiding students on an all-virtual residency application process brought uncertainty to their advising practices. Thus, this study aimed to identify advising practices during the 2021 virtual application cycle. METHODS: We administered an IRB-exempt national survey through the Clerkship Directors in Internal Medicine to 186 internal medicine core/co-/associate/assistant clerkship directors and sub-internship directors representing 140 Liaison Committee on Medical Education-accredited U.S./U.S.-territory-based medical schools in spring 2021. The 23-question survey was designed and pilot-tested by faculty-educators and leaders with expertise in undergraduate medical education. Data analysis included paired t- and z-tests and thematic analysis of open-ended questions. RESULTS: The institutional response rate was 67% (93/140) and individual rate 55% (103/186). Half of the respondents felt prepared/very prepared (40% and 13% respectively) for their advising roles. Compared to pre-pandemic cycles, respondents advised a typical student in the middle-third of their class at their institution to apply to more residency programs (mean 24 programs vs 20, p < 0.001) and accept more interviews (mean 14 interviews vs 12, p < 0.001). Sixty-three percent (64/101) of respondents spent more time on student advising; 51% (51/101) reported more students asked them for informal advice. Fifty-nine percent (60/101) of respondents reported their advisees were able to assess a residency program 'somewhat well;' 31% (31/101) expressed that residency recruitment should remain entirely virtual in the future. CONCLUSION: The transition to virtual residency recruitment due to COVID-19 prompted advising practices that may have contributed to application inflation and increased advising workload. Future studies should explore longitudinal outcomes of virtual interviews on student success to guide best practices in how to advise students during residency recruitment.

Innovation and Missed Opportunities in Internal Medicine Undergraduate Education During COVID-19: Results from a National Survey.

BACKGROUND: COVID-19 disrupted undergraduate clinical education when medical schools removed students from clinical rotations following AAMC recommendations. Clerkship directors (CDs) had to adapt rapidly and modify clerkship curricula. However, the scope and effects of these modifications are unknown. OBJECTIVE: To examine the effects of the initial phase of COVID-19 on the internal medicine (IM) undergraduate clinical education. DESIGN: A nationally representative web survey. PARTICIPANTS: IM CDs from 137 LCME-accredited US medical schools in 2020. MAIN MEASURES: Items (80) assessed clerkship structure and curriculum, assessment in clerkships, post-clerkship IM clinical experiences, and CD roles and support. The framework of Understanding Crisis Response (Royal Society for Encouragement of Arts, Manufactures, and Commerce) was used to determine whether curricular modifications were "amplified," "restarted," "let go," or "ended." KEY RESULTS: Response rate was 74%. In response to COVID-19, 32% (32/101) of clerkships suspended all clinical activities and 66% (67/101) only in-person. Prior to clinical disruption, students spent a median of 8.0 weeks (IQR: 2) on inpatient and 2.0 weeks (IQR: 4) on ambulatory rotations; during clinical re-entry, students were spending 5.0 (IQR: 3) and 1.0 (IQR: 2) weeks, respectively. Bedside teaching and physical exam instruction were "let go" during the early phase. Students were removed from direct patient care for a median of 85.5 days. The sub-internship curriculum remained largely unaffected. Before the pandemic, 11% of schools were using a pass/fail grading system; at clinical re-entry 47% and during the survey period 23% were using it. Due to the pandemic, 78.2% of CDs assumed new roles or had expanded responsibilities; 51% reported decreased scholarly productivity. CONCLUSIONS: Curricular adaptations occurred in IM clerkships across US medical schools as a result of COVID-19. More research is needed to explore the long-term implications of these changes on medical student education and clinical learning environments.

Roles and Responsibilities of Medicine Subinternship Directors : Medicine Subinternship Director Roles.

BACKGROUND: The internal medicine (IM) subinternship (also referred to as acting internship) plays a crucial part in preparing medical students for residency. The roles, responsibilities, and support provided to subinternship directors have not been described. OBJECTIVE: We sought to describe the current role of IM subinternship directors with respect to their responsibilities, salary support, and reporting structure. DESIGN: Nationally representative, annually recurring thematic survey of IM core clerkship directors with membership in an academic professional association as of September 2017. PARTICIPANTS: A total of 129 core clinical medicine clerkship directors at Liaison Committee on Medical Education fully accredited U.S./U.S.-territory-based medical schools. MAIN MEASURES: Responsibilities, salary support, and reporting structure of subinternship directors. KEY RESULTS: The survey response rate was 83.0% (107/129 medical schools). Fifty-one percent (54/107) of respondents reported overseeing both core clerkship inpatient experiences and/or one or more subinternships. For oversight, 49.1% (28/53) of subinternship directors also reported that they were the clerkship director, 26.4% (14/53) that another faculty member directed all medicine subinternships, and 18.9% (10/53) that each subinternship had its own director. The most frequently reported responsibilities for the subinternship directors were administration, including scheduling, and logistics of student schedules (83.0%, 44/53), course evaluation (81.1%, 43/53), and setting grades 79.2% (42/53). The modal response for estimated FTE per course was 10-20% FTE, with 33.3% (16/48) reporting this level of support and 29.2% (14/54) reporting no FTE support. CONCLUSIONS: The role of the IM subinternship director has become increasingly complex. Since the IM subinternship is critical to preparing students for residency, IM subinternship directors require standard expectations and adequate support. Future studies are needed to determine the appropriate level of support for subinternship directors and to define essential roles and responsibilities.

Telehealth Attitudes, Training, and Preparedness Among First-Year Internal Medicine Residents in the COVID-19 Era.

Introduction: Telehealth, especially the use of real-time video and phone visits in ambulatory care, is increasingly important in the wake of the COVID-19 pandemic. The current state of internal medicine (IM) interns' telehealth training at the start of residency is unknown. Objective: To characterize the attitudes, training, and preparedness of IM interns regarding the use of telehealth video and phone visits in ambulatory care. Materials and Methods: We conducted a cross-sectional survey of IM interns at four IM residency programs in the United States in 2020. Results: One hundred fifty-six surveys were analyzed (response rate 82%). Seventy-five percent of interns rated training in the use of real-time video and phone visits for ambulatory care as important or very important. The vast majority received no training (74%) or clinical experience (90% no prior video visits, 81% no prior phone visits) during medical school. More interns believed that primary care may be effectively delivered via video visits compared with phone visits (77% vs. 35%). Most interns (69%) missed clinical time during medical school due to the COVID-19 pandemic; 41% felt that the pandemic negatively affected their ambulatory care preparation. Overall, the majority of interns (58%) felt prepared for primary care; only 12% felt prepared to deliver primary care using either video or phone visits. Conclusions: Although IM interns had favorable attitudes toward video and phone visits, few had training or clinical experience; most felt unprepared. Residency programs may need to close training gaps for current interns in conducting telehealth video and phone visits.

Teaching Telemedicine in the COVID-19 Era: a National Survey of Internal Medicine Clerkship Directors.

BACKGROUND: Prior to the COVID-19 pandemic, telemedicine (TM) experiences in undergraduate medical education were uncommon. When students' clinical experiences were interrupted due to the pandemic, TM education provided opportunities for students to participate in clinical care while adhering to social distancing guidelines. OBJECTIVE: To assess the prevalence of TM experiences in the internal medicine (IM) core clerkship experience prior to the COVID-19 pandemic, during interruption in clinical clerkships, and following the return to in-person activities at US medical schools. DESIGN: The Clerkship Directors in Internal Medicine (CDIM) survey is a national, annually recurring thematic survey of IM core clerkship directors. The 2020 survey focused on effects of the COVID-19 pandemic, including a section about TM. The survey was fielded online from August through October 2020. PARTICIPANTS: A total of 137 core clinical medicine clerkship directors at Liaison Committee on Medical Education fully accredited US/US territory-based medical schools. MAIN MEASURES: A 10-item thematic survey section assessing student participation in TM and assessment of TM-related competencies. KEY RESULTS: The response rate was 73.7% (101/137 medical schools). No respondents reported TM curricular experiences prior to the pandemic. During clinical interruption, 39.3% of respondents reported TM experiences in the IM clerkship, whereas 24.7% reported such experiences occurring at the time they completed the survey. A higher percentage of clerkships with an ambulatory component reported TM to be an important competency compared to those without an ambulatory component. CONCLUSIONS: The extent to which TM was used in the IM clinical clerkship, and across clinical clerkships, increased substantially when medical students were removed from in-person clinical duties as a response to COVID-19. When students returned to in-person clinical duties, experiences in TM continued, suggesting the continued value of TM as part of the formal education of students during the medicine clerkship. Curricula and faculty development will be needed to support TM education.

Use of a structured approach and virtual simulation practice to improve diagnostic reasoning.

OBJECTIVES: In 2015, the National Academy of Medicine IOM estimated that 12 million patients were misdiagnosed annually. This suggests that despite prolonged training in medical school and residency there remains a need to improve diagnostic reasoning education. This study evaluates a new approach. METHODS: A total of 285 medical students were enrolled in this 8 center, IRB approved trial. Students were randomized to receive training in either abdominal pain (AP) or loss of consciousness (LOC). Baseline diagnostic accuracy of the two different symptoms was assessed by completing a multiple-choice question (MCQ) examination and virtual patient encounters. Following a structured educational intervention, including a lecture on the diagnostic approach to that symptom and three virtual patient practice cases, each student was re-assessed. RESULTS: The change in diagnostic accuracy on virtual patient encounters was compared between (1) baseline and post intervention and (2) post intervention students trained in the prescribed symptom vs. the alternate symptom (controls). The completeness of the student's differential diagnosis was also compared. Comparison of proportions were conducted using χ2-tests. Mixed-effects regressions were used to examine differences accounting for case and repeated measures. Compared with baseline, both the AP and LOC groups had marked post-intervention improvements in obtaining a correct final diagnosis; a 27% absolute improvement in the AP group (p<0.001) and a 32% absolute improvement in the LOC group (p<0.001). Compared with controls (the groups trained in the alternate symptoms), the rate of correct diagnoses increased by 13% but was not statistically significant (p=0.132). The completeness and efficiency of the differential diagnoses increased by 16% (ß=0.37, p<0.001) and 17% respectively (ß=0.45, p<0.001). CONCLUSIONS: The study showed that a virtual patient platform combined with a diagnostic reasoning framework could be used for education and diagnostic assessment and improved correct diagnosis compared with baseline performance in a simulated platform.

Interprofessional Education Without Limits: A Video-Based Workshop.

Introduction: Interprofessional collaboration improves patient outcomes. Many institutions lack access to learners from other health care professions, limiting the feasibility of many published interprofessional curricula. We created a video-based workshop to fill the need for an introductory interactive interprofessional activity for third-year medical students (MS 3) in their internal medicine clerkship, in which other health care students and standardized patients were not readily accessible. Methods: This session introduced medical students to the interprofessional model of care through a video workshop. Learners engaged in reflective observation as a video presented a physician interviewing a patient. The training and roles of interprofessional providers were discussed with the aid of video demonstrations. Learners completed postworkshop and postmedicine clerkship surveys with responses indicated using a Likert scale (1 = strongly disagree, 5 = strongly agree). Results: Sixty-seven MS 3s participated in this workshop; postworkshop survey response rate was 82%. Of students who responded to the surveys, 87% agreed that the video increased their understanding of when it would be beneficial to consult interprofessional team members. Students' confidence in interacting with interprofessional team members improved from a mean of 3.0 before the workshop to 3.7 after the workshop. At the end of the medicine clerkship, 71% indicated that the video improved their ability to work with interprofessional team members at least moderately. Discussion: This video-based workshop improved students' self-rated understanding of interprofessional team members' roles and increased their confidence interacting with other members of the interprofessional health care team.