ABSTRACT
BACKGROUND: Many medical schools offer a culminating internship readiness experience. Curricula focus on particular knowledge and skills critical to internship, such as answering urgent nursing pages. Studies have shown student performance improvement with mock paging education programs, but the role of feedback versus self-regulated practice has not been studied. DESIGN AND METHODS: The interprofessional mock paging program included 156 medical students enrolled in a 4th-year internship readiness course and 44 master's level direct entry nursing students. Medical students were randomized to receive verbal feedback immediately after each of the three phone calls (intervention group) or delayed written feedback (control group) after the third phone call only. Specialty-specific case scenarios were developed and a single checklist for all scenarios was developed using the communication tool ISBAR. Medical students and nursing students had separate training sessions before the pages commenced. The nursing students administered the phone calls and evaluated the medical students by ISBAR checklist. An interrater reliability measure was obtained with physician observation of a selection of phone calls. RESULTS: After adjusting for the case effects (different case scenarios for different specialties), students showed no statistically significant differences on checklist scores for case 1 (first case, F = 1.491, df = 1, p = .224), but did show statistically significant differences on checklist scores for case 3 (final case, F = 12.238, df = 1, p = .001). Strong interrater reliability was found between the faculty physician and observed nursing students (ICC = .89). CONCLUSIONS: Immediate feedback significantly improves student checklist scores with a mock paging program. This finding suggests that coaching with feedback may have advantages above self-regulated learning.
ABSTRACT
Introduction: New medical interns face a steep learning curve as they must manage complex medical scenarios, many of which they have only seen before in a classroom setting. To ameliorate these challenges, medical schools are increasingly including courses designed to address the transition from student to doctor. One of the biggest challenges for new interns is learning to triage and manage nursing pages, so we designed a mock paging program incorporated within our fourth-year transitions course. Methods: We developed a database of clinical scenarios to occur via telephone between a nurse and a medicine intern. Throughout the 2-week course, these cases were administered to 40 fourth-year medical students by Master's level nursing students and nurse evaluators. The nurses used checklists to evaluate medical student management and communication, and at the end of the phone encounter students received immediate feedback. We used an observational prospective design, using a within subjects method with repeated measures. Results: Data from a total of 216 phone calls were analyzed for 36 students. No statistically significant improvement of checklist scores was observed. Substantial interrater reliability was observed for the four observed cases with a Fleiss-Kappa of .76. Student comments indicated the activity was helpful for preparing them to answer pages. Discussion: Our paging program offered students the chance to simulate being on call, as well as the opportunity to receive immediate feedback. It did not show improvement in checklists across time. Limitations included a small sample size and few common variables across the cases.
