Improving the introduction of telemedicine in pre-hospital emergency medicine: understanding users and how acceptability, usability and effectiveness influence this process.

INTRODUCTION: Increasing numbers of ambulance calls, vacant positions and growing workloads in Emergency Medicine (EM) are increasing the pressure to find adequate solutions. With telemedicine providing health-care services by bridging large distances, connecting remote providers and even patients while using modern communication technologies, such a technology seems beneficial. As the process of developing an optimal solution is challenging, a need to quantify involved processes could improve implementation. Existing models are based on qualitative studies although standardised questionnaires for factors such as Usability, Acceptability and Effectiveness exist. METHODS: A survey was provided to participants within a German county. It was based on telemedical surveys, the System Usabilty Scale (SUS) and earlier works describing Usability, Acceptability and Effectiveness. Meanwhile a telemedical system was introduced in the investigated county. A comparison between user-groups aswell as an exploratory factor analysis (EFA) was performed. RESULTS: Of n = 91 included participants n = 73 (80,2%) were qualified as emergency medical staff (including paramedics n = 36 (39,56%), EMTs n = 28 (30,77%), call handlers n = 9 (9,89%)) and n = 18 (19,8%) as emergency physicians. Most participants approved that telemedicine positively impacts EM and improved treatment options with an overall Usabilty Score of 68,68. EFA provided a 3-factor solution involving Usability, Acceptability and Effectiveness. DISCUSSION: With our results being comparable to earlier studies but telemedicine only having being sparsely introduced, a positive attitude could still be attested. While our model describes 51,28% of the underlying factors, more research is needed to identify further influences. We showed that Usability is correlated with Acceptability (strong effect), Usability and Effectiveness with a medium effect, likewise Acceptability and Effectiveness. Therefore available systems need to improve. Our approach can be a guide for decision makers and developers, that a focus during implementation must be on improving usability and on a valid data driven implementation process.

A Teach-the-Teacher Module for Human Trafficking Bedside Instruction.

Introduction: Human trafficking (HT) is a public health issue that adversely affects patients' well-being. Despite the prevalence of trafficked persons in health care settings, a lack of educational modules exists for use in clinical contexts. We developed a 50-minute train-the-trainer module on HT. Methods: After piloting the workshop for faculty, fellows, and residents (n = 19) at the Society for Academic Emergency Medicine (SAEM) national conference, we implemented it in medical students' curricula during their emergency medicine clerkship at the University of Iowa (n = 162). We evaluated the worskhop by (a) a retrospective pre-post survey of self-reported ability to (1) define HT, (2) recognize high-risk signs, (3) manage situations with trafficked persons, and (4) teach others about HT, and (b) a 3-month follow-up survey to assess longitudinal behavior change. Results: In both contexts, results demonstrated improvement across all learning outcomes (pre-post differences of 1.5, 1.3, 1.9, and 1.7 on a 4-point Likert-type scale for each learning objective above, respectively, at the SAEM conference and 1.2, 1.0, 1.3, and 1.3 at the University of Iowa; p < .001 for all). In the 3-month follow-up, we observed statistically significant changes in self-reported consideration of and teaching about HT during clinical encounters among learners who had previously never done either (p < .001 and p = .006, respectively). Discussion: This train-the-trainer module is a brief and effective clinical tool for bedside teaching about HT, especially among people who have never previously considered HT in a clinical context.

What the Fika? Implementation of Swedish Coffee Breaks During Emergency Medicine Conference.

Introduction: In this study we aimed to investigate the effects of incorporating Swedish-style fika (coffee) breaks into the didactic schedule of emergency medicine residents on their sleepiness levels during didactic sessions. Fika is a Swedish tradition that involves a deliberate decision to take a break during the workday and usually involves pastries and coffee. We used the Karolinska Sleepiness Scale to assess changes in sleepiness levels before and after the implementation of fika breaks. Methods: The study design involved a randomized crossover trial approach, with data collected from emergency medicine residents over a specific period. This approach was done to minimize confounding and to be statistically efficient. Results: Results revealed the average sleepiness scale was 4.6 and 5.5 on fika and control days, respectively (P = 0.004). Conclusion: Integration of fika breaks positively influenced sleepiness levels, thus potentially enhancing the educational experience during residency didactics.

A Measure of the Impact on Real-Time Patient Care of Evidence-based Medicine Logs.

Introduction: Evidence-based medicine (EBM) is a critical skill for physicians, and EBM competency has been shown to increase implementation of best medical practices, reduce medical errors, and increase patient-centered care. Like any skill, EBM must be practiced, receiving iterative feedback to improve learners' comprehension. Having residents document patient interactions in logbooks to allow for residency program review, feedback, and documentation of competency has been previously described as a best practice within emergency medicine (EM) to document practice-based learning (PBL) competency. Quantifying how residents use the information they query, locate, evaluate, and apply while providing direct patient care can measure the efficacy of EBM education and provide insight into more efficient ways of providing medical care. Methods: Practice-based learning logs were surveys created to record resident EBM activity on-shift and were placed into our residency management software program. Residents were required to submit 3-5 surveys of EBM activity performed during a 28-day rotation during which additional information was sought. This study included all PBL logs completed by EM residents from June 1, 2013-May 11, 2020. Using qualitative methodology, a codebook was created to analyze residents' free-text responses to the prompt: "Based on your research, would you have done anything differently?" The codebook was designed to generate a three-digit code conveying the effect of the researched information on the patient about whom the log was written, as well as whether the information would affect future patient care and whether these decisions were based on scientific evidence. Results: A total of 10,574 logs were included for primary analysis. In total, 1,977 (18.7%) logs indicated that the evidence acquired through research would affect future patient care. Of these, 392 (3.7%) explicitly stated that the EBM activity conducted as part of our project led to real-time changes in patient care in the ED and would change future management of patients as well. Conclusion: We present a proof of concept that PBL log activity can lead to integration of evidence-based medicine into real-time patient care. While a convenience sample, our cohort recorded evidence of both lifelong learning and application to patient care.

Sued, Subpoenaed or Sworn in: Use of a Flipped-Classroom Style Medicolegal Workshop for Emergency Medicine Residents.

Background: It is an unfortunate truth that Emergency Medicine (EM) physicians will, at some point, have contact with the medicolegal system. However, most EM residency training programs lack education on the legal system in their curriculum, leaving EM physicians unprepared for litigation. To fill this gap, we designed a high-yield and succinct medical legal workshop highlighting legal issues commonly encountered by EM physicians. We aimed to determine the effectiveness of this curriculum by measuring pre and post knowledge questions. Methods: A two-hour session included a case-based discussion of common misconceptions held by physicians about the legal system, proper steps when interacting with the legal system and review of legal documents. This session was developed with the involvement of our hospital legal counsel and discussed real encounters. The effectiveness of the session was determined using pre- and post-session surveys assessing participant knowledge and comfort approaching the scenarios. Results: A total of 34 EM residents had the opportunity to complete this workshop as a part of their conference curriculum. A total of 26 participants completed the pre-survey and 19 participants completed the post-survey. No participants had previous training in the legal aspects of medicine, including handling a subpoena, serving as a witness, or giving a deposition. The pre-survey demonstrated that there was significant uncertainty surrounding the processes, definitions, and the legal system interaction. Many participants stated they would not know what to do if they received a subpoena (85.71%), were called as a witness in a trial (96.43%) or receive correspondence from a lawyer (96.43%). The post survey revealed an increased knowledge base and confidence following the session. 100% of residents reported knowing what to do after receiving a subpoena, being called as a witness and understanding the process involved in giving a deposition. All residents reported that the session was beneficial and provided crucial information. Conclusion: EM residents have limited baseline understanding of how to approach common legal scenarios. Educational materials available for this curriculum topic are limited. Based on the rapid knowledge increase observed in our residents, we believe our workshop could be adapted for use at other residency programs.

Assessing Team Performance: A Mixed-Methods Analysis Using Interprofessional in situ Simulation.

Introduction: Optimizing the performance of emergency department (ED) teams impacts patient care, but the utility of current, team-based performance assessment tools to comprehensively measure this impact is underexplored. In this study we aimed to 1) evaluate ED team performance using current team-based assessment tools during an interprofessional in situ simulation and 2) identify characteristics of effective ED teams. Methods: This mixed-methods study employed case study methodology based on a constructivist paradigm. Sixty-three eligible nurses, technicians, pharmacists, and postgraduate year 2-4 emergency medicine residents at a tertiary academic ED participated in a 10-minute in situ simulation of a critically ill patient. Participants self-rated performance using the Team Performance Observation Tool (TPOT) 2.0 and completed a brief demographic form. Two raters independently reviewed simulation videos and rated performance using the TPOT 2.0, Team Emergency Assessment Measure (TEAM), and Ottawa Crisis Resource Management Global Rating Scale (Ottawa GRS). Following simulations, we conducted semi-structured interviews and focus groups with in situ participants. Transcripts were analyzed using thematic analysis. Results: Eighteen team-based simulations took place between January-April 2021. Raters' scores were on the upper end of the tools for the TPOT 2.0 (R1 4.90, SD 0.17; R2 4.53, SD 0.27, IRR [inter-rater reliability] 0.47), TEAM (R1 3.89, SD 0.19; R2 3.58, SD 0.39, IRR 0.73), and Ottawa GRS (R1 6.6, SD 0.56; R2 6.2, SD 0.54, IRR 0.68). We identified six themes from our interview data: team member entrustment; interdependent energy; leadership tone; optimal communication; strategic staffing; and simulation empowering team performance. Conclusion: Current team performance assessment tools insufficiently discriminate among high performing teams in the ED. Emergency department-specific assessments that capture features of entrustability, interdependent energy, and leadership tone may offer a more comprehensive way to assess an individual's contribution to a team's performance.

The Evolution of Board-Certified Emergency Physicians and Staffing of Emergency Departments in Israel.

Introduction: Emergency medicine (EM) was recognized as a specialty in Israel in 1999. Fifty-nine of the 234 (25%) attending physicians working in emergency departments (ED) nationwide in 2002 were board-certified emergency physicians (EP). A 2012 study revealed that 123/270 (45%) of ED attendings were EPs, and that there were 71 EM residents. The EPs primarily worked midweek morning shifts, leaving the EDs mostly staffed by other specialties. Our objective in this study was to re-evaluate the EP workforce in Israeli EDs and their employment status and satisfaction 10 years after the last study, which was conducted in 2012. Methods: We performed a three-part, prospective cross-sectional study: 1) a survey, sent to all EDs in Israel, to assess the numbers, level of training, and specialties of physicians working in EDs; 2) an anonymous questionnaire, sent to EPs in Israel, to assess their demographics, training, employment, and work satisfaction; and 3) interviews of a convenience sample of EPs analyzed by a thematic approach. Results: There were 266 board-certified EPs, 141 (53%) of whom were employed in EDs full-time or part-time. Sixty-two non-EPs also worked in EDs. The EPs were present in the EDs primarily during weekday morning shifts. There were 273 EM residents nationwide. A total of 101 questionnaires were completed and revealed that EPs working part-time in the ED worked fewer hours, received higher salaries, and had more years of experience compared to EPs working full time or not working in the ED. Satisfaction correlated only with working part time. Meaningful work, diversity, and rewarding relationships with patients and colleagues were major positive reasons for working in the ED. Feeling undervalued, carrying a heavy caseload, and having complicated relationships with other hospital departments were reasons against working in the ED. Conclusion: Our study findings showed an increase in the number of trained and in-training EPs, and a decrease in the percentage of board-certified EPs who persevere in the EDs. Emergency medicine in Israel is at a crossroads: more physicians are choosing EM than a decade ago, but retention of board-certified EPs is a major concern, as it is worldwide. We recommend taking measures to maintain trained and experienced EPs working in the ED by allowing part-time ED positions, introducing dedicated academic time, and diversifying EP roles, functioning, and work routine.

RISE-EM: Resident Instruction in Social Emergency Medicine, a Cohort Study of a Novel Curriculum.

There is recognition in the field of emergency medicine (EM) that social determinants of health (SDoH) are key drivers of patient care outcomes. Leaders in EM are calling for curricula integrating SDoH assessment and intervention, public health, and multidisciplinary approaches to EM care throughout medical school and residency. This intersection of SDoH and the emergency care system is known as social emergency medicine (SEM). Currently, there are few resources available for EM training programs to integrate this content; as a result, few EM trainees receive adequate education in SEM. To address this gap, we developed a four-part training in SEM tailored to EM residency programs and medical schools. This curriculum, known as RISE-EM (Resident Instruction in Social Emergency Medicine), uses video lectures, case examples, and group discussions to engage trainees and develop competency in providing sound care that is grounded in evidence-based principles of SEM. In the current study, we tested RISE-EM by delivering the video lectures to residents and medical students in two training programs. We administered pre- and post-course knowledge tests and a post-course participant attitudes survey to assess the acceptability and potential efficacy of the program for improving SEM knowledge and attitudes among EM learners. We found it to be both feasible and acceptable to introduce SEM content in residency conferences, with preliminary data showing statistically significant improvement in knowledge of the content and self-efficacy to apply it to their clinical practice. In summary, RISE-EM has been highly valued by EM learners and viewed as a strong supplement to their existing training, and it has been shown to successfully improve SEM knowledge and attitudes.

A Multidisciplinary Curriculum to Standardize Chest Procedures Training for Trainees in General Surgery, Emergency Medicine, and Critical Care.

Introduction: Critical care, emergency medicine, and surgical trainees frequently perform surgical and Seldinger-technique tube thoracostomy, thoracentesis, and thoracic ultrasound. However, approaches to teaching these skills are highly heterogeneous. Over 10 years, we have developed a standardized, multidisciplinary curriculum to teach these procedures. Methods: Emergency medicine residents, surgical residents, and critical care fellows, all in the first year of their respective programs, underwent training in surgical and Seldinger chest tube placement and securement, thoracentesis, and thoracic ultrasound. The curriculum included preworkshop instructional videos and 45-minute in-person practice stations (3.5 hours total). Sessions were co-led by faculty from emergency medicine, thoracic surgery, and pulmonary/critical care who performed real-time formative assessment with standardized procedural steps. Postcourse surveys assessed learners' confidence before versus after the workshop in each procedure, learners' evaluations of faculty by station and specialty, and the workshop overall. Results: One hundred twenty-three trainees completed course evaluations, demonstrating stable and positive responses from learners of different backgrounds taught by a multidisciplinary group of instructors, as well as statistically significant improvement in learner confidence in each procedure. Over time, we have made incremental changes to our curriculum based on feedback from instructors and learners. Discussion: We have developed a unique curriculum designed, revised, and taught by a multidisciplinary faculty over many years to teach a unified approach to the performance of common chest procedures to surgical, emergency medicine, and critical care trainees. Our curriculum can be readily adapted to the needs of institutions that desire a standardized, multidisciplinary approach to thoracic procedural education.

[Sonography in Pre-clinical Care]. / Sonografie in der Präklinik.

Sonography is an established noninvasive diagnostic tool in the clinical context of an emergency department. Its use in the prehospital setting is still rare despite its importance to use someone's resources purposeful and its importance in emergency medicine guidelines. In this article we show the advantages and disadvantages of prehospital point-of-care ultrasound (pPOCUS). We reflect organizational hurdles implementing pPOCUS as well as describing the technical preconditions for an easy and meaningful use. Furthermore, we explain teaching issues for pPOCUS and with a standard operating procedure (SOP) we show how pPOCUS could be implemented in the prehospital setting using some cardinal symptoms as examples.

Exploring the Use of Natural Language Processing to Understand Emotions of Trainees and Faculty Regarding Entrustable Professional Activity Assessments.

Background In medical education, artificial intelligence techniques such as natural language processing (NLP) are starting to be used to capture and analyze emotions through written text. Objective To explore the application of NLP techniques to understand resident and faculty emotions related to entrustable professional activity (EPA) assessments. Methods Open-ended text data from a survey on emotions toward EPA assessments were analyzed. Respondents were residents and faculty from pediatrics (Peds), general surgery (GS), and emergency medicine (EM), recruited for a larger emotions study in 2023. Participants wrote about their emotions related to receiving/completing EPA assessments. We analyzed the frequency of words rated as positive via a validated sentiment lexicon used in NLP studies. Specifically, we were interested if the count of positive words varied as a function of group membership (faculty, resident), specialty (Peds, GS, EM), gender (man, woman, nonbinary), or visible minority status (yes, no, omit). Results A total of 66 text responses (30 faculty, 36 residents) contained text data useful for sentiment analysis. We analyzed the difference in the count of words categorized as positive across group, specialty, gender, and being a visible minority. Specialty was the only category revealing significant differences via a bootstrapped Poisson regression model with GS responses containing fewer positive words than EM responses. Conclusions By analyzing text data to understand emotions of residents and faculty through an NLP approach, we identified differences in EPA assessment-related emotions of residents versus faculty, and differences across specialties.

Hawks and Doves in Standardized Letters of Evaluation: 6 Years of Rating Distributions and Trends in Emergency Medicine.

Background Standardized Letters of Evaluation (SLOEs) are an important part of resident selection in many specialties. Often written by a group, such letters may ask writers to rate applicants in different domains. Prior studies have noted inflated ratings; however, the degree to which individual institutions are "doves" (higher rating) or "hawks" (lower rating) is unclear. Objective To characterize institutional SLOE rating distributions to inform readers and developers regarding potential threats to validity from disparate rating practices. Methods Data from emergency medicine (EM) SLOEs between 2016 and 2021 were obtained from a national database. SLOEs from institutions with at least 10 letters per year in all years were included. Ratings on one element of the SLOE-the "global assessment of performance" item (Top 10%, Top Third, Middle Third, and Lower Third)-were analyzed numerically and stratified by predefined criteria for grading patterns (Extreme Dove, Dove, Neutral, Hawk, Extreme Hawk) and adherence to established guidelines (Very High, High, Neutral, Low, Very Low). Results Of 40 286 SLOEs, 20 407 met inclusion criteria. Thirty-five to 50% of institutions displayed Neutral grading patterns across study years, with most other institutional patterns rated as Dove or Extreme Dove. Adherence to guidelines was mixed and fewer than half of institutions had Very High or High adherence each year. Most institutions underutilize the Lower Third rating. Conclusions Despite explicit guidelines for the distribution of global assessment ratings in the EM SLOE, there is high variability in institutional rating practices.

Triage Performance Across Large Language Models, ChatGPT, and Untrained Doctors in Emergency Medicine: Comparative Study.

BACKGROUND: Large language models (LLMs) have demonstrated impressive performances in various medical domains, prompting an exploration of their potential utility within the high-demand setting of emergency department (ED) triage. This study evaluated the triage proficiency of different LLMs and ChatGPT, an LLM-based chatbot, compared to professionally trained ED staff and untrained personnel. We further explored whether LLM responses could guide untrained staff in effective triage. OBJECTIVE: This study aimed to assess the efficacy of LLMs and the associated product ChatGPT in ED triage compared to personnel of varying training status and to investigate if the models' responses can enhance the triage proficiency of untrained personnel. METHODS: A total of 124 anonymized case vignettes were triaged by untrained doctors; different versions of currently available LLMs; ChatGPT; and professionally trained raters, who subsequently agreed on a consensus set according to the Manchester Triage System (MTS). The prototypical vignettes were adapted from cases at a tertiary ED in Germany. The main outcome was the level of agreement between raters' MTS level assignments, measured via quadratic-weighted Cohen κ. The extent of over- and undertriage was also determined. Notably, instances of ChatGPT were prompted using zero-shot approaches without extensive background information on the MTS. The tested LLMs included raw GPT-4, Llama 3 70B, Gemini 1.5, and Mixtral 8x7b. RESULTS: GPT-4-based ChatGPT and untrained doctors showed substantial agreement with the consensus triage of professional raters (κ=mean 0.67, SD 0.037 and κ=mean 0.68, SD 0.056, respectively), significantly exceeding the performance of GPT-3.5-based ChatGPT (κ=mean 0.54, SD 0.024; P<.001). When untrained doctors used this LLM for second-opinion triage, there was a slight but statistically insignificant performance increase (κ=mean 0.70, SD 0.047; P=.97). Other tested LLMs performed similar to or worse than GPT-4-based ChatGPT or showed odd triaging behavior with the used parameters. LLMs and ChatGPT models tended toward overtriage, whereas untrained doctors undertriaged. CONCLUSIONS: While LLMs and the LLM-based product ChatGPT do not yet match professionally trained raters, their best models' triage proficiency equals that of untrained ED doctors. In its current form, LLMs or ChatGPT thus did not demonstrate gold-standard performance in ED triage and, in the setting of this study, failed to significantly improve untrained doctors' triage when used as decision support. Notable performance enhancements in newer LLM versions over older ones hint at future improvements with further technological development and specific training.

Improving emergency medicine resident pediatric lumbar puncture procedural performance through a brief just-in-time video intervention.

BACKGROUND: Emergency medicine (EM) trainee comfort level with lumbar puncture (LP) has decreased over time due to changing practice guidelines, particularly amongst pediatric patients. We implemented a "just in time" (JIT) brief educational video based on a previously published LP Performance Scoring Checklist to improve trainee efficiency and competence in LP performance. METHODS: Our pilot quasi-experimental study took place January-June 2022 within a large, academic Midwestern emergency department (ED) with an established 3-year EM residency program. All 9 interns performed a timed diagnostic LP on an infant LP model in January, scored according to the LP Performance Scoring Checklist. In June, interns repeated the timed LP procedure directly after watching a brief educational video based on major checklist steps. The study was deemed exempt by the Institutional Review Board. RESULTS: All interns completed both assessments. At baseline, interns had logged performance of median 2 (IQR 0-5) LPs and spent 12.9 (10.3-14.4) minutes performing the procedure. Post-intervention, interns had logged an additional median 2 (0-5) LPs and completed the procedure faster with an average time of 10.3 (9.7-11.3) minutes (p = 0.004). A median of 5 (4-7) major steps were missed at baseline, compared to 1 (1-2) at time of post-intervention assessment (p = 0.015). CONCLUSION: Development of a brief educational video improved efficiency and competency amongst our intern class in performing an infant LP when viewed Just-In-Time. Similar efforts may improve education and performance of other rare (or decreasing in frequency) procedures within EM training.

American Board of Emergency Medicine Report on Residency and Fellowship Training Information (2023-2024).

The American Board of Emergency Medicine gathers extensive background information on Accreditation Council of Graduate Medical Education-accredited emergency medicine residency and fellowship programs as well as the residents and fellows training in those programs. We present the 2024 annual report on the status of physicians training in ACGME-accredited emergency medicine training programs in the United States.