Development of entrustable professional activities for emergency medicine medical education fellowships: A modified Delphi study.

Background: It is essential that medical education (MedEd) fellows achieve desired outcomes prior to graduation. Despite the increase in postgraduate MedEd fellowships in emergency medicine (EM), there is no consistently applied competency framework. We sought to develop entrustable professional activities (EPAs) for EM MedEd fellows. Methods: From 2021 to 2022, we used a modified Delphi method to achieve consensus for EPAs. EM education experts generated an initial list of 173 EPAs after literature review. In each Delphi round, panelists were asked to make a binary choice of whether to include the EPA. We determined an inclusion threshold of 70% agreement a priori. After the first round, given the large number of EPAs meeting inclusion threshold, panelists were instructed to vote whether each EPA should be included in the "20 most important" EPAs for a MedEd fellowship. Modifications were made between rounds based on expert feedback. We calculated descriptive statistics. Results: Seventeen experts completed four Delphi rounds each with 100% response. After Round 1, 87 EPAs were eliminated and two were combined. Following Round 2, 46 EPAs were eliminated, seven were combined, and three were included in the final list. After the third round, one EPA was eliminated and 13 were included. After the fourth round, 11 EPAs were eliminated. The final list consisted of 16 EPAs in domains of career development, education theory and methods, research and scholarship, and educational program administration. Conclusions: We developed a list of 16 EPAs for EM MedEd fellowships, the first step in implementing competency-based MedEd.

Oh, the places you'll go! A qualitative study of resident career decisions in emergency medicine.

Objectives: Postresidency career choices are complex decisions that involve personal, professional, and financial preferences and may be influenced by training programs. It is unknown how residents navigate these decisions during emergency medicine (EM) residency. We explored EM residents' perspectives on career decision making and how residency programs can support career planning. Methods: We conducted semistructured interviews at seven accredited EM residency programs from diverse locations and training formats. We used purposive sampling to reflect the diversity of trainees with regard to gender, level of training, and career plans. Two researchers independently coded the transcripts. We used a constructivist-interpretivist paradigm to guide our thematic analysis. Results: We interviewed 11 residents and identified major themes in three categories. Residents described being exposed to career options through formalized curricula such as required rotations, career fairs, and subspeciality tracks, highlighting the importance of access to faculty with diverse areas of clinical and academic expertise. Many noted that exposure was often self-driven. We identified three major themes regarding career decisions: instrumental factors, people involved, and processes of decision making. Instrumental factors included personal interests, goals, and values as well as practice characteristics, financial considerations, timing, and opportunity costs. Mentors and family were highly involved in resident career decisions. Residents often utilized reflection and conversations with mentors and peers in their decision-making process. Participants recommended that programs provide exposure to diverse career options early in training, protect time for career education, and ensure adequate mentorship and a supportive community. Participants suggested specific curricular content and strategies to support career decisions. Conclusions: This study illuminates important factors involved in resident career decision making and how programs can support their trainees. Essential components include diverse experiences and building a reflective mentorship environment.

Fostering Adaptive Expertise Through Simulation.

Technology-enhanced simulation has been used to tackle myriad challenges within health professions education. Recently, work has typically adopted a mastery learning orientation that emphasizes trainees' sequential mastery of increasingly complex material. Doing so has privileged a focus on performance and task completion, as captured by trainees' observable behaviors and actions. Designing simulation in these ways has provided important advances to education, clinical care, and patient safety, yet also placed constraints around how simulation-based activities were enacted and learning outcomes were measured. In tracing the contemporary manifestations of simulation in health professions education, this article highlights several unintended consequences of this performance orientation and draws from principles of adaptive expertise to suggest new directions. Instructional approaches grounded in adaptive expertise in other contexts suggest that uncertainty, struggle, invention, and even failure help learners to develop deeper conceptual understanding and learn innovative approaches to novel problems. Adaptive expertise provides a new lens for simulation designers to think intentionally around how idiosyncrasy, individuality, and inventiveness could be enacted as central design principles, providing learners with opportunities to practice and receive feedback around the kinds of complex problems they are likely to encounter in practice. Fostering the growth of adaptive expertise through simulation will require a fundamental reimagining of the design of simulation scenarios, embracing the power of uncertainty and ill-defined problem spaces, and focusing on the structure and pedagogical stance of debriefing. Such an approach may reveal untapped potential within health care simulation.

"Not just a checkbox": A qualitative study of the resident scholarly experience.

Objectives: Scholarship is a requirement of residency training; however, the scholarly productivity of trainees is highly variable. The purpose of this study was to explore the perspectives of residents who have been highly productive in scholarship. Methods: We performed a qualitative study using a constructivist-interpretivist paradigm and conducted semistructured interviews at seven Accreditation Council for Graduate Medical Education-accredited emergency medicine residency programs in the United States. We included sites of diverse locations and training formats (PGY-1 to -4 vs. PGY-1 to -3). Program leadership identified residents with high levels of scholarly productivity at their institutions. We used purposive sampling to seek out residents with diversity in gender and PGY level. Two researchers independently performed a thematic analysis of interview transcripts. Discrepancies were resolved through in-depth discussion and negotiated consensus. Results: We invited 14 residents and all consented to be interviewed. Residents felt scholarship enhanced their knowledge and skills, grew collaborative networks, and provided personal fulfillment and external rewards. Scholarship positively impacted their careers by focusing their professional interests and informing career decisions. Participants identified individual and institutional facilitators of success including personal prior knowledge and skills, project management skills, mindset, protected time, mentorship, and leadership support. Challenges to conducting scholarship included lack of time, expertise, and resources. Participants acknowledged that participating in scholarly activities was hard work and recommended that residents seek out quality mentorship, work on projects that they are passionate, start early, and be persistent in their efforts. Participants' advice to faculty supporting resident scholarship included recommendations to allow resident autonomy of projects, provide scholarly opportunities, and be responsive to trainee needs. Conclusions: Participants in this study highlighted benefits of participating in scholarly activity as well as challenges and strategies for success. These results can inform residencies seeking to enhance the scholarly experience of trainees.

Beyond the CLAIM: A comprehensive needs assessment strategy for creating an Advanced Medical Education Research Training Program (ARMED-MedEd).

BACKGROUND: The health professions education (HPE) landscape has shifted substantively with increasing professionalization of research and scholarship. Clinician educators seeking to become competitive in this domain often pursue fellowships and master's degrees in HPE, but there are few resources for the continuing professional development (CPD) of those who seek to continue developing their scholarly practice within HPE. Acknowledging the multiple players in this landscape, the authors sought to design a new "beyond beginners" HPE research program using a novel needs assessment planning process. METHODS: The authors developed and conducted a new three-phase, five-step process that sets forth a programmatic approach to conducting a needs assessment for a CPD course in HPE research. The five steps of the CLAIM method are: Competitive analysis, Literature review with thematic analysis, Ask stakeholders, Internal review by experts, and Mapping of a curriculum. These steps are organized into three phases (Discovery, Convergence, and Synthesis). RESULTS: Over a 12-month period, the authors completed a comprehensive needs assessment. The CLAIM process revealed that longitudinal digital connection, diverse and in depth exposure to HPE research methods, skills around scholarly publishing, and leadership and management of research would be beneficial to our design. CONCLUSIONS: The CLAIM method provided scaffolding to help the authors create a robust curriculum that adopts a scholarly approach for developing a HPE research course. This needs assessment methodology may be useful in other CPD contexts.

A practical guide for conducting qualitative research in medical education: Part 3-Using software for qualitative analysis.

The process of performing qualitative analysis can be a daunting task. Technology can be employed to ease the burden of the work; however, the researcher may not fully appreciate how and when computer software can assist in conducting qualitative analysis. In this, the third installment of our "how-to" series on qualitative research methods, we describe basic concepts and approaches to using both simple word processing programs and specific qualitative research software programs to assist in coding and analysis. We hope that the concepts put forth in this paper will help qualitative researchers become more familiar with available technological approaches and that they will, in turn, enhance the efficiency of the research process as well as the depth, clarity and richness of research findings.

A practical guide for conducting qualitative research in medical education: Part 2-Coding and thematic analysis.

An organized and rigorous approach to analyzing qualitative data can yield important insights into the intricacies of human behavior and can answer "how" and "why" questions. One process of coding interview responses from study subjects using grounded theory with a constructivist approach is outlined and applied to an example study. The emergent themes can provide insight to medical educators to create interventions that optimize the learning environment. For researchers, they may generate hypotheses to study by quantitative analysis.

Academic springboard: The chief resident position correlates with career path in emergency medicine.

BACKGROUND: The chief resident role often includes additional administrative and educational experiences beyond those of nonchief senior residents. It is unclear to what extent these experiences influence the postresidency career path of those selected as chief residents. The objective of this study was to evaluate the association of chief resident status on immediate postresidency career characteristics relative to nonchief residents in emergency medicine (EM). METHODS: We retrospectively analyzed graduate data from 2016 to 2020 at six accredited EM residency programs. Participating sites were geographically diverse and included 3- and 4-year training formats. Each site abstracted data using a standardized form including program, year of graduation, chief resident status, publications during residency, and immediate postresidency position (academic vs. nonacademic). We calculated descriptive statistics and performed logistic regression to explore differences between the chief resident cohort and other graduates. RESULTS: We gathered information on 365 total graduates (45.8% from 3-year programs and 54.2% from 4-year programs) including 93 (25.5%) chief residents. A total of 129 (35%) graduates assumed an academic position immediately following residency. Fifty-six (60%) of 93 chief residents assumed an academic position immediately following residency, compared to 74 (27%) of 272 other graduates. After program, year of graduation, and number of publications completed during residency were controlled for, chief resident status was a significant predictor of immediate postresidency academic career (odds ratio for a chief resident assuming an academic job = 5.36, 95% confidence interval = 3.10 to 9.27). CONCLUSION: The chief resident role within EM is significantly associated with pursuit of an academic position immediately following residency compared to nonchiefs.

A nationwide survey of emergency medicine resident workflow efficiency: Are training programs teaching residents to be efficient?

BACKGROUND: Workflow efficiency (WFE) is essential to the practice of emergency medicine (EM), but a standardized approach to measuring and teaching it during residency is lacking. In this study we sought to describe how EM residency programs in the United States currently measure and teach WFE and to assess the relative importance of WFE teaching to EM residency program leaders. METHODS: We conducted a cross-sectional survey of all accredited EM residency training programs in the United States in Fall 2019. We invited all allopathic EM residency programs to participate in the study by directly emailing program directors and assistant/associate program directors. We conducted the study and performed descriptive statistics using SurveyMonkey software. RESULTS: We received a total of 133 responses out of 190 total programs (70%) with proportionate representation from 3- and 4-year programs and all regions of the United States. When asked to what extent teaching efficiency should be a priority compared to other educational goals, 65% of program leaders responded with "significant" or "moderate" priority. Most EM programs collect WFE data on their residents, either by tracking patients per hour (78%) or by written evaluations (59%). Common methods for providing WFE data to residents were: "individual data provided along with deidentified rank" (35%), "data provided only during private feedback meetings" (26%), and "no data or rank provided to residents" (16%). Regarding targeted WFE teaching to residents, 88% reported utilizing general on-shift teaching, 48% reported teaching WFE during formal didactics, and 45% during dedicated private feedback sessions. CONCLUSION: This national study of allopathic U.S. EM programs suggests that most EM program leaders do value WFE teaching. However, we found no consistent approach among programs for tracking or distributing resident WFE data, and many programs lack a formalized way to teach efficiency to their residents.

Emergency Medicine Education Research Since the 2012 Consensus Conference: How Far Have We Come and What's Next?

In 2012, the Society for Academic Emergency Medicine convened a consensus conference on the state of medical education research with goals of defining and advancing a future research agenda. Since that time, emergency medicine (EM) education research has grown significantly. A task force of EM education experts was assembled and sought to understand the current state of EM education research and future directions. Among the advances are increases in medical education fellowships, advanced degree and certification programs, faculty development programs, publication venues, and funding. These findings are discussed in light of the prior objectives from the 2012 consensus conference, and recommendations for future directions are provided.

Heart Rate Variability and Acute Stress Among Novice Airway Managers.

BACKGROUND: The nature of medical emergencies places emergency physicians at risk for high levels of acute psychological stress (APS). Stress-modifying techniques like visualization, breath control, and mental practice may help mitigate APS, but objective markers of stress are difficult to measure in the clinical setting. We explored the relationship between heart rate variability (HRV), a real-time measure of autonomic arousal, and self-reported APS among emergency medicine (EM) residents learning to intubate on actual patients. METHODS: This was a prospective study of postgraduate year 1 (PGY-1) EM residents at a single academic medical center during their 1-month anesthesia rotation. We obtained repeated measures of HRV immediately before and during the first intubation attempt each day. Participants completed the modified Spielberger State-Trait Anxiety Inventory (STAI-6) before intubation attempts and scored intubation difficulty using the Intubation Difficulty Scale. We analyzed HRV using root mean square of successive differences and analyzed data using clustered data methods and Pearson correlation coefficients. RESULTS: We enrolled eight PGY-1 residents and recorded 64 intubations. Mean HRV in the 2 minutes before intubation (17.88 ± 9.22) and during intubation (21.17 ± 13.46) was significantly lower than resting baseline (32.09 ± 15.23; adjusted mean difference [95% CI] = -13.90 [-20.35 to -7.45], p < 0.001; and -10.77 [-17.65 to -3.88], p = 0.02). Preintubation anxiety was negatively correlated with HRV (r = -0.39 [-0.58 to -0.16], p = 0.001). Intubation difficulty was not significantly correlated with HRV (r = -0.12 [-0.36 to 0.13], p = 0.35). CONCLUSIONS: HRV shows promise as a real-time index of autonomic arousal and may serve as an outcome measure in the evaluation of stress-modifying interventions.

How do novices learn physical examination skills? A systematic review of the literature.

BACKGROUND: Physical Examination (PE) skills are vital for patient care, and many medical students receive their first introduction to them in their pre-clinical years. A substantial amount of curriculum time is devoted to teaching these skills in most schools. Little is known about the best way to introduce PE skills to novice learners. OBJECTIVE: Our objective was to conduct a systematic review of how medical students are first taught PE skills and the evidence supporting these strategies. DESIGN: We searched ERIC, SCOPUS, MEDLINE, PubMed and EMBASE for descriptions of complete PE curricula for novice learners. Inclusion criteria were: (1) English language; (2) subjects were enrolled in medical school and were in the preclinical portion of their training; (3) description of a method to teach physical examination skills for the first time; (4) description of the study population; (5) Description of a complete PE curriculum. We used the Medical Education Research Study Quality Instrument (MERSQI) score to evaluate the quality of evidence provided. RESULTS: Our search returned 5,418 articles; 32 articles met our inclusion criteria. Two main types of curricula were reported: comprehensive 'head-to-toe' PE curricula (18%) and organ system-based curricula (41%). No studies compared these directly, and only two evaluated trainees' clinical performance. The rest of the articles described interventions used across curricula (41%). Median MERSQI score was 10.1 Interquartile range 8.1-12.4. We found evidence for the use of non-faculty teaching associates, technology-enhanced PE education, and the addition of clinical exposure to formal PE teaching. CONCLUSIONS: The current literature on teaching PE is focused on describing innovations to head-to-toe and organ system-based curricula rather than their relative effectiveness, and is further limited by its reliance on short-term outcomes. The optimal strategy for novice PE instruction remains unknown.

Research Pioneers in Emergency Medicine-Reflections on Their Paths to Success and Advice to Aspiring Researchers: A Qualitative Study.

STUDY OBJECTIVE: Research in basic, translational, and clinical emergency medicine has made great strides since the formalization of emergency medicine as a specialty. Our objective is to identify and analyze strategies used by emergency medicine research pioneers to inform further advancement of research in emergency medicine, particularly for aspiring researchers and those in emerging areas, using emergency medicine medical education as one example. METHODS: This was a prospective, grounded-theory, qualitative study, using a constructivist/interpretivist paradigm. Leading basic science, translational, and clinical emergency medicine researchers who completed residency before 1995 were eligible for structured interviews. Thematic coding followed an iterative process until saturation was reached. A theoretic model was developed and analyzed. RESULTS: Research pioneers valued advanced methodological training and mentorship. Barriers to funding were lack of recognition of emergency medicine as a specialty, absence of a research history, and lack of training and funding resources. Deliberate interventions to improve emergency medicine research included educational sessions at national meetings, external (to emergency medicine) mentor pairings, targeted funding by emergency medicine organizations, and involvement with funding agencies. Pioneers facilitate research excellence by serving as mentors and allocating funds or protected time to develop researchers. To advance emerging subfields of research in emergency medicine, pioneers recommend advanced methodological training that is specific to the area, deliberate mentorship, and the formation of research consortia to conduct generalizable outcomes-based studies. CONCLUSION: Research pioneers in emergency medicine cite mentorship, advanced skills obtained through fellowship or graduate degrees, deliberate collaboration with experienced researchers, support from emergency medicine organizations, and forming networks as the cornerstones of success.

Longitudinal exploration of in situ mock code events and the performance of cardiac arrest skills.

INTRODUCTION: In hospital cardiac arrest (IHCA) affects 200,000 adults in the United States each year, and resuscitative efforts are often suboptimal. The objective of this study was to determine whether a program of "mock codes" improves group-level performance of IHCA skills. Our primary outcome of interest was change in CPR fraction, and the secondary outcomes of interest were time to first dose of epinephrine and time to first defibrillation. We hypothesized that a sustained program of mock codes would translate to greater than 10% improvement in each of these core metrics over the first three years of the program. METHODS: We conducted mock codes in an urban teaching hospital between August, 2012 and October, 2015. Mock codes occurred on telemetry and medical/surgical units on day and night shifts. Codes were managed by unit staff and members of the hospital's "Code Blue" team, and data were recorded by trained observers. Data were summarized using descriptive statistics, and repeated measures outcomes were calculated using a mixed effects model. RESULTS: Fifty-seven mock codes were included in the analysis: 42 on Medical/Surgical units and 15 on Telemetry units. CPR fraction increased by 2.9% per six-month time interval on Telemetry units, and 1.3% per time interval on Medical/Surgical units. Neither time to first epinephrine dosing nor time to defibrillation changed significantly. CONCLUSIONS: While we observed a significant improvement in CPR fraction over the course of this program of mock codes, similar improvements were not observed for other key measures of cardiac arrest performance.

The View From the Top: Academic Emergency Department Chairs' Perspectives on Education Scholarship.

Education scholarship continues to grow within emergency medicine (EM) and in academic medicine in general. Despite a growing interest, would-be education scholars often struggle to find adequate mentorship, research training, funding, and protected time to produce rigorous scholarship. The ways in which individual academic EM departments can support this mission remains an area in need of description. OBJECTIVES: We sought to describe academic EM department chairs' perceptions of education scholarship and facilitators and barriers to producing high-quality education scholarship. METHODS: We conducted a qualitative study using a grounded theory-derived approach. Participants were solicited directly, and semistructured interviews were conducted via telephone. Interviews were transcribed verbatim and were analyzed by three study investigators using a coding matrix. Discrepancies in coding were resolved via in depth discussion. RESULTS: We interviewed seven EM chairs from academic departments throughout North America (six in geographically diverse regions of the United States and one in western Canada). Chairs described education scholarship as lacking clearly defined and measurable outcomes, as well as methodologic rigor. They identified that education faculty within their departments need training and incentives to pursue scholarly work in a system that primarily expects teaching from educators. Chairs acknowledged a lack of access to education research expertise and mentorship within their own departments, but identified potential resources within their local medical schools and universities. They also voiced willingness to support career development opportunities and scholarly work among faculty seeking to perform education research. CONCLUSIONS: Academic EM chairs endorse a need for methodologic training, mentorship, and access to expertise specific to education scholarship. While such resources are often rare within academic EM departments, they may exist within local universities and schools of medicine. Academic EM chairs described themselves as willing and able to support faculty who wish to pursue this type of work.

The Changing Use of Intravenous Opioids in an Emergency Department.

INTRODUCTION: Government agencies are increasingly emphasizing opioid safety in hospitals. In 2012, the Joint Commission on Accreditation of Healthcare Organizations (JCAHO) started a sentinel event program, the "Safe Use of Opioids in Hospitals." We sought to determine if opioid use patterns in our emergency department (ED) changed from 2011, before the program began, to 2013, after start of the program. METHODS: This was a retrospective study of all adult ED patients who received an intravenous opioid and had a serum creatinine measured. We recorded opioids used, dose prescribed, and serum creatinine. As an index of the safety of opioids, uses of naloxone after administration of an opioid was recorded. RESULTS: Morphine is still the most commonly used opioid by doses given, but its percentage of opioids used decreased from 68.9% in 2011 to 52.8% in 2013. During the same period, use of hydromorphone increased from 27.5% to 42.9%, while the use of fentanyl changed little (3.6% to 4.3%). Naloxone administration was rare after an opioid had been given. Opioids were not dosed in an equipotent manner. CONCLUSION: The use of hydromorphone in our ED increased by 56% (absolute increase of 15.4%), while the use of morphine decreased by 30.5% (absolute decrease 16.1%) of total opioid use from 2011 to 2013. The JCAHO program likely was at least indirectly responsible for this change in relative dosing of the opioids. Based on frequency of naloxone administered after administration of an opioid, the use of opioids was safe.

Socioeconomic status and survival from out-of-hospital cardiac arrest.

BACKGROUND: Socioeconomic status (SES) has been linked to heart disease, but its influence on outcome from out-of-hospital cardiac arrest (OHCA) is not well understood. OBJECTIVES: The authors hypothesized that higher levels of SES would be associated with better survival, potentially through demographic, circumstance, or care factors. METHODS: A cohort investigation of OHCA due to heart disease treated by emergency medical services between January 1, 1999, and December 31, 2003, was conducted in the study county. Socioeconomic status was assessed using two different measures: an individual-level measure, tax-assessed property value per unit, and a geography-based measure, median household income from the 2000 Census. The authors used logistic regression to evaluate the association between survival to hospital discharge and quartile of SES. Models systematically adjusted for demographic, circumstance, and care factors that could potentially confound the association. RESULTS: Socioeconomic status as measured by value per unit was associated with survival in unadjusted models (odds ratio [OR] = 1.21; 95% confidence interval [95% CI] = 1.05 to 1.36, for each successive increase in value-per-unit quartile). Adjustment for demographic, circumstance, and care factors altered the association only slightly (fully adjusted OR = 1.23; 95% CI = 1.08 to 1.39). In contrast, SES as measured by median household income was not associated with survival. The study could not investigate all potentially explanatory factors. The findings may not be generalizable to persons or communities that differ from the current investigation. CONCLUSIONS: An individual-level, but not an area-level, measure of SES predicted survival following OHCA independent of demographic, circumstance, or care factors. Future research should continue to investigate mechanisms through which SES is associated with OHCA survival.