JUST-IN-TIME EDUCATION: IMPLEMENTING A SIMULATIONBASED TELEMEDICINE TRAINING AND ASSESSMENT PROGRAM ACROSS OUR EDUCATIONAL CONTINUUM AND HEALTH SYSTEM

ABSTRACT

SETTING AND PARTICIPANTS: Clinician trainees across our health system, including 1) 107 internal medicine faculty and residents who participated in workplace-based learning at public, private, and federal (Veterans Affairs) ambulatory practices, 2) 16 clinicians at our student health center, and 3) upwards of 250 medical students, residents, and newly-hired general internal medicine (GIM) faculty members from medicine, neurology, and pediatrics departments in our simulation center. DESCRIPTION While core communication skills have always been at the forefront of medical trainee assessment, information on transference of those skills and integration of the in-person clinical workflow to the virtual care environment was limited prior to COVID-19. NYU Grossman School of Medicine (NYUSOM) implemented a telehealth improvement program across medical students, residents and faculty. In order to assess and improve our systems' ongoing telehealth practices, we employed three distinct educational methodologies across our health systems since March 2020 objective structured clinical exams (OSCEs) and announced (ASPs) and unannounced standardized patient (USPs). Cases were designed to target common, site-specific issues (i.e., hearing loss, COVID-19 vaccine hesitancy, social determinants of health, and sexual and mental health concerns). In line with previous work, all SPs were trained to use a standard behaviorally-anchored checklist to assess communication and telemedicine-specific skills over video visit ( Zoom or WebEx). USPs, professional actors who conduct visits unbeknownst to the clinician, were also trained to collect data on clinic functioning. EVALUATION Summary reports on performance were provided to both clinical and education leadership and learners to identify future training needs. Data on telemedicine skills across all projects demonstrates room for improvement (mean % marked 'well done' across learners 46% in the OSCE, 68% at the SHC, and 48% in the public clinics, respectively). Common telemedicine challenges included prompting the SP to adjust their video frame or remove distracting background noise. Most health systems conducted fewer screenings virtually than they did inperson (e.g., at the SHC only 41% and 6% of SPs were screened for alcohol and vaping, respectively;at the public clinics, 25% and 20% were screened for depression and vaping, respectively). Participant feedback reports highlight performance across core domains and provide resources for improvement. DISCUSSION / REFLECTION / LESSONS LEARNED Our ongoing telemedicine training program demonstrates a highly scalable educational assessment methodology that can be leveraged to optimize common care practices. Data confirm that SPs, ASPs, and USPs can be used across the health care system in simulated and real-world scenarios to identify areas for intervention.