Shadowing emergency medicine residents by medical education specialists to provide feedback on non-medical knowledge-based ACGME sub-competencies.

OBJECTIVE: Non-medical knowledge-based sub-competencies (multitasking, professionalism, accountability, patient-centered communication, and team management) are challenging for a supervising emergency medicine (EM) physician to evaluate in real-time on shift while also managing a busy emergency department (ED). This study examines residents' perceptions of having a medical education specialist shadow and evaluate their nonmedical knowledge skills. METHODS: Medical education specialists shadowed postgraduate year 1 and postgraduate year 2 EM residents during an ED shift once per academic year. In an attempt to increase meaningful feedback to the residents, these specialists evaluated resident performance in selected non-medical knowledge-based Accreditation Council of Graduate Medical Education (ACGME) sub-competencies and provided residents with direct, real-time feedback, followed by a written evaluation sent via email. Evaluations provided specific references to examples of behaviors observed during the shift and connected these back to ACGME competencies and milestones. RESULTS: Twelve residents participated in this shadow experience (six post graduate year 1 and six postgraduate year 2). Two residents emailed the medical education specialists ahead of the scheduled shadow shift requesting specific feedback. When queried, five residents voluntarily requested their feedback to be included in their formal biannual review. Residents received milestone scores and narrative feedback on the non-medical knowledge-based ACGME sub-competencies and indicated the shadow experience and subsequent feedback were valuable. CONCLUSION: Medical education specialists who observe residents over the course of an entire shift and evaluate non-medical knowledge-based skills are perceived by EM residents to provide meaningful feedback and add valuable information for the biannual review process.

Role of an audience response system in didactic attendance and assessment.

BACKGROUND: The Residency Review Committee for Emergency Medicine mandates conference participation, but tracking attendance is difficult and fraught with errors. Feedback on didactic sessions, if not collected in real time, is challenging to obtain. OBJECTIVE: We assessed whether an audience response system (ARS) would (1) encourage residents to arrive on time for lectures, and (2) increase anonymous real-time audience feedback. METHODS: The ARS (Poll Everywhere) provided date/time-stamped responses to polls from residents, including a question to verify attendance and questions to gather immediate, anonymous postconference evaluations. Fisher exact test was used to calculate proportions. RESULTS: The proportion of residents who completed evaluations prior to the institution of the ARS was 8.75, and it was 59.42 after (P < .001). The proportion of faculty who completed evaluations prior to using the ARS was 6.12, and it was 85.71 after (P < .001). The proportion of residents who reported they had attended the conference session was 55 for the 3 weeks prior to initiating the ARS, decreasing to 46.67 for the 3 weeks during which the ARS was used to take attendance (P  =  .46). The proportion of faculty who reported attending the conference was 5.56 for the 3 weeks prior to ARS initiation, decreasing to 4.44 for the 3 weeks while using the ARS (P  =  .81). CONCLUSIONS: Audience response systems are an effective way to verify attendance and tardiness, eliminating the subjective effect of attendance takers' leniency and increasing completion of evaluations for didactic sessions.