FOAM authorship: Who's teaching our learners?

Background: Free open-access medical education (FOAM) is extremely popular among learners and educators despite lacking the traditional peer review process. Despite the potential for inaccurate, low-quality, or biased content, little has been published describing FOAM authors. Methods: We performed a cross-sectional analysis of 12 months of content from the top 25 blogs in the 2020 Social Media Index from August 2020-2021. We recorded the number of posts per site and descriptive characteristics of authors, including gender affiliation, conflicts of interest (COI) statements, and type of practice (academic, community, or hybrid). Results: We identified 2141 posts by 1001 authors. More than half were produced by six websites: EM Docs (266), Life in the Fast Lane (232), EMCrit (188), ALiEM (185), Don't Forget the Bubbles (181), and Rebel EM (174). Most content (1680 posts, 78.5%) lacked a COI statement. Authors were mostly academic (89%), mostly held MD degrees (67.4%), and were mostly men (59.7%). Geographically, most FOAM authors reside in the United States (59.5%), Canada (22.42%), or the United Kingdom (9.4%). Conclusions: Of all the posts in the top 25 sites in 2020, more than half came from six sites, and authors were largely North American men in academics with MD degrees. Learners, content creators, and educators should consider the ways in which a more diverse authorship pool might bring value to the FOAM educational experience.

Systematic online academic resource (SOAR) review: Pediatric respiratory infectious disease.

Background: Free open access medical education (FOAM) resources have become increasingly popular in graduate medical education. Despite their accessibility, the assessment of FOAM resources' quality is challenging due to their decentralized nature and the diverse qualifications of their authors and distribution platforms. In this first pediatric systematic online academic resource (SOAR) review, we utilized a systematic methodology to aggregate and assess the quality of FOAM resources on pediatric respiratory infectious disease topics. Methods: We searched 177 keywords using FOAMSearch, the top 50 FOAM websites on the Social Media Index, and seven additional pediatric emergency medicine-focused blogs. Following a basic initial screen, resources then underwent full-text quality assessment utilizing the revised Medical Education Translational Resources: Impact and Quality (rMETRIQ) tool. Results: The search yielded 44,897 resources. After 44,456 were excluded, 441 underwent quality assessment. A total of 36/441 posts (8% of posts) reached the high-quality threshold score (rMETRIQ ≥ 16). The most frequent topics overall were pneumonia and bronchiolitis. A total of 67/441 posts (15% of posts) were found to have a rMETRIQ score of less than or equal to 7, which may indicate poor quality. Conclusions: We systematically identified, described, and performed quality assessment on FOAM resources pertaining to the topic of pediatric respiratory infectious disease. We found that there is a paucity of high-quality posts on this topic. Despite this, the curated list of high-quality resources can help guide trainees and educators toward relevant educational information and suggest unmet needs for future FOAM resources.

Emergency Medicine Procedures: A Review of Approved Instructional Resources from the World of Free Open Access Medical Education.

The Academic Life in Emergency Medicine (ALiEM) Approved Instructional Resources (AIR) Series was created in 2014 to address the Free Open Access Medical Education (FOAM) movement's decentralized nature and lack of inherent peer review. The AIR series provides a topic-based, curated list of online educational content vetted by academic emergency medicine (EM) faculty that meets individualized interactive instruction criteria for EM trainees. Relevant FOAM resources were identified from the top 50 FOAM websites using the Social Media Index and then scored by EM faculty using a validated instrument to identify the highest quality posts related to a topic. This article reviews FOAM resources pertaining to EM procedures that were labeled as an "Approved Instructional Resource" or "Honorable Mention" using the AIR series methodology.

Simulating a Vertical Evacuation of a NICU and PICU to Examine the Relationship Between Training and Preparedness.

OBJECTIVE: The aim of this study was to implement pediatric vertical evacuation disaster training and evaluate its effectiveness by using a full-scale exercise to compare outcomes in trained and untrained participants. METHODS: Various clinical and nonclinical staff in a tertiary care university hospital received pediatric vertical evacuation training sessions over a 6-wk period. The training consisted of disaster and evacuation didactics, hands-on training in use of evacuation equipment, and implementation of an evacuation toolkit. An unannounced full-scale simulated vertical evacuation of neonatal intensive care unit (NICU) and pediatric intensive care unit (PICU) patients was used to evaluate the effectiveness of the training. Drill participants completed a validated evaluation tool. Pearson chi-squared testing was used to analyze the data. RESULTS: Eighty-four evaluations were received from drill participants. Forty-three (51%) of the drill participants received training and 41 (49%) did not. Staff who received pediatric evacuation training were more likely to feel prepared compared with staff who did not (odds ratio, 4.05; confidence interval: 1.05-15.62). CONCLUSIONS: There was a statistically significant increase in perceived preparedness among those who received training. Recently trained pediatric practitioners were able to achieve exercise objectives on par with the regularly trained emergency department staff. Pediatric disaster preparedness training may mitigate the risks associated with caring for children during disasters.

Systematic online academic resource (SOAR) review: Endocrine, metabolic, and nutritional disorders.

BACKGROUND: Free open-access medical education (FOAM) has become an integral resource for medical school and residency education. However, questions of quality and inconsistent coverage of core topics remain. In this second entry of the SAEM Systematic Online Academic Resource (SOAR) series, we describe the application of a systematic methodology to identify, curate, and describe FOAM topics specific to endocrine, metabolic, and nutritional disorders as defined by the 2016 Model of the Clinical Practice of Emergency Medicine (MCPEM). METHODS: We developed an automated algorithm to search 264 keywords derived from nine subtopics within the MCPEM category in the FOAM Search (a customized FOAM search tool) and the Social Media index. The top 100 results were extracted for each keyword. Resources underwent a manual iterative screening process, and those relevant to endocrine, metabolic, or nutritional disorders and EM were evaluated with the revised Medical Education Translational Resources: Impact and Quality (rMETRIQ) tool. RESULTS: The search yielded 36,346 resources, of which 756 met the criteria for quality assessment. After rMETRIQ tool training, four raters demonstrated an average measured intraclass correlation coefficient of 0.94 (95% confidence interval = 0.88 to 0.97, p < 0.001). A total of 121 posts (16% of posts) covering 25 subtopics were identified as high quality (rMETRIQ ≥16). The most covered subtopic was potassium disorders, representing 15% of all posts. Subtopics that did not have a high-quality resource identified include metabolic alkalosis, respiratory alkalosis, fluid overload, phosphorus metabolism, hyperglycemia, malabsorption, malnutrition, and thyroiditis. From most to least common, the overall target audience was junior resident (91%), PGY-1 resident (88%), senior resident (81%), clerk (64%), attending (50%), and preclerkship (9%). CONCLUSIONS: We systematically identified, described, and curated FOAM resources for EM learners on the topic of endocrine, metabolic, and nutritional disorders. A final list of high-quality resources can guide trainees, educator recommendations, and FOAM authors.

Holes in the FOAM: An Analysis of Curricular Comprehensiveness in Online Educational Resources.

OBJECTIVES: We sought to evaluate Free Open Access Medical Education (FOAM), defined as online educational content available free to anyone, anywhere, at any time, by classifying the most impactful FOAM content per the Social Media Index into the topics and subtopics of the American Board of Emergency Medicine's Model of the Clinical Practice of Emergency Medicine. We then analyzed FOAM's comprehensiveness by describing over- and underrepresentation among these topics and subtopics. METHODS: First, we searched for FOAM resources based on the most recent 12 months of relevant content for each organ system from the top 50 Social Media Index sites. Next, we classified all 898 posts into its related topics or subtopics per the American Board of Emergency Medicine's Model of the Clinical Practice of Emergency Medicine. Finally, we analyzed how comprehensively FOAM covered each organ system and the frequency of posts that covered each organ system subtopic as well as identified the subtopics with the most frequent coverage. RESULTS: The search yielded 898 FOAM posts, of which cardiology and neurology were significantly overrepresented and psychobehavioral; obstetrics and gynecology; and head, ears, eyes, nose, and throat were significantly underrepresented. Among subtopics, acute coronary syndrome had the highest subtopic coverage consisting of 55.5% of all cardiology content. Other highly represented subtopics include renal colic; diabetic ketoacidosis; sepsis; and stroke with 39, 40, 40, and 71% of each of their topic's content, respectively. CONCLUSIONS: Although residents and programs are frequently incorporating FOAM into the educational curriculum, these materials seem to lack comprehensiveness. Educators and learners must be aware of these deficits in creating comprehensive emergency medicine curricula.

The revised Approved Instructional Resources score: An improved quality evaluation tool for online educational resources.

BACKGROUND: Free Open-Access Medical education (FOAM) use among residents continues to rise. However, it often lacks quality assurance processes and residents receive little guidance on quality assessment. The Academic Life in Emergency Medicine Approved Instructional Resources tool (AAT) was created for FOAM appraisal by and for expert educators and has demonstrated validity in this context. It has yet to be evaluated in other populations. OBJECTIVES: We assessed the AAT's usability in a diverse population of practicing emergency medicine (EM) physicians, residents, and medical students; solicited feedback; and developed a revised tool. METHODS: As part of the Medical Education Translational Resources: Impact and Quality (METRIQ) study, we recruited medical students, EM residents, and EM attendings to evaluate five FOAM posts with the AAT and provide quantitative and qualitative feedback via an online survey. Two independent analysts performed a qualitative thematic analysis with discrepancies resolved through discussion and negotiated consensus. This analysis informed development of an initial revised AAT, which was then further refined after pilot testing among the author group. The final tool was reassessed for reliability. RESULTS: Of 330 recruited international participants, 309 completed all ratings. The Best Evidence in Emergency Medicine (BEEM) score was the component most frequently reported as difficult to use. Several themes emerged from the qualitative analysis: for ease of use-understandable, logically structured, concise, and aligned with educational value. Limitations include deviation from questionnaire best practices, validity concerns, and challenges assessing evidence-based medicine. Themes supporting its use include evaluative utility and usability. The author group pilot tested the initial revised AAT, revealing a total score average measure intraclass correlation coefficient (ICC) of moderate reliability (ICC = 0.68, 95% confidence interval [CI] = 0 to 0.962). The final AAT's average measure ICC was 0.88 (95% CI = 0.77 to 0.95). CONCLUSIONS: We developed the final revised AAT from usability feedback. The new score has significantly increased usability, but will need to be reassessed for reliability in a broad population.

An Emergency Medicine Virtual Clerkship: Made for COVID, Here to Stay.

INTRODUCTION: Safety concerns surrounding the coronavirus 2019 pandemic led to the prohibition of student rotations outside their home institutions. This resulted in emergency medicine (EM)-bound students having less specialty experience and exposure to outside programs and practice environments, and fewer opportunities to gain additional Standardized Letters of Evaluation, a cornerstone of the EM residency application. We filled this void by implementing a virtual clerkship. METHODS: We created a two-week virtual, fourth-year visiting clerkship focused on advanced medical knowledge topics, social determinants of health, professional development, and professional identity formation. Students completed asynchronous assignments and participated in small group-facilitated didactic sessions. We evaluated the virtual clerkship with pre- and post-medical knowledge tests and evaluative surveys. RESULTS: We hosted 26 senior medical students over two administrations of the same two-week virtual clerkship. Students had a statistically significant improvement on the medical knowledge post-tests compared to pre-tests (71.7% [21.5/30] to 76.3% [22.9/30]). Students reported being exposed to social determinants of health concepts they had not previously been exposed to. Students appreciated the interactive nature of the sessions; networking with other students, residents, and faculty; introduction to novel content regarding social determinants of health; and exposure to future career opportunities. Screen time, technological issues, and mismatch between volume of content and time allotted were identified as potential challenges and areas for improvement. CONCLUSION: We demonstrate that a virtual EM visiting clerkship is feasible to implement, supports knowledge acquisition, and is perceived as valuable by participants. The benefits seen and challenges faced in the development and implementation of our clerkship can serve to inform future virtual clerkships, which we feel is a complement to traditional visiting clerkships even though in-person clerkships have been re-established.

Retained gallstones: an elusive complication of laparoscopic cholecystectomy.

A young, healthy woman presented to the emergency department multiple times with right upper quadrant pain and subjective fevers for over a year after her laparoscopic cholecystectomy. The patient required multiple hospital visits and extensive work-ups before finally being diagnosed with retained gallstones in her abdomen. After surgical removal of the stones, her symptoms resolved completely. The case highlights the challenges in diagnosing retained gallstones, the substantial burdens they can impose on patients, and the importance of prevention and thorough documentation.

Effect of Interpolated Questions on Podcast Knowledge Acquisition and Retention: A Double-Blind, Multicenter, Randomized Controlled Trial.

STUDY OBJECTIVE: We determine whether interpolated questions in a podcast improve knowledge acquisition and retention. METHODS: This double-blinded controlled trial randomized trainees from 6 emergency medicine programs to listen to 1 of 2 versions of a podcast, produced de novo on the history of hypertension. The versions were identical except that 1 included 5 interpolated questions to highlight educational points (intervention). There were 2 postpodcast assessments, 1 within 48 hours of listening (immediate posttest) and a second 2 to 3 weeks later (retention test), consisting of the same 15 multiple-choice questions, 5 directly related to the interpolated questions and 10 unrelated. The primary outcome was the difference in intergroup mean assessment scores at each point. A sample size was calculated a priori to identify a significant interarm difference. RESULTS: One hundred thirty-seven emergency medicine trainees were randomized to listen to a podcast, 69 without interpolated questions (control) and 68 with them (intervention). Although no significant difference was detected at the immediate posttest, trainees randomized to the interpolated arm had a significantly higher mean score on the retention test, with a 5.6% absolute difference (95% confidence interval 0.2% to 10.9%). For the material covered by the interpolated questions, the intervention arm had significantly higher mean scores on both the immediate posttest and retention tests, with absolute differences of 8.7% (95% confidence interval 1.6% to 15.8%) and 10.1% (95% confidence interval 2.8% to 17.4%), respectively. There was no significant intergroup difference for noninterpolated questions. CONCLUSION: Podcasts containing interpolated questions improved knowledge retention at 2 to 3 weeks, driven by the retention of material covered by the interpolated questions. Although the gains may be modest, educational podcasters may improve knowledge retention by using interpolating questions.

Academic Life in Emergency Medicine (ALiEM) Blog and Podcast Watch: Gastrointestinal Emergencies.

The Academic Life in Emergency Medicine (ALiEM) Approved Instructional Resources (AIR) Series and Approved Instructional Resources - Professional (AIR-Pro) Series were created in 2014 and 2015, respectively, in response to the growing need to curate online educational content as well as create a nationally available curriculum that meets individualized interactive instruction criteria for emergency medicine (EM) trainees. These two online series identify high-quality educational blog and podcast content using an expert-based approach. We summarize the accredited posts on gastrointestinal emergencies that met our a priori determined quality criteria per evaluation by eight experienced faculty educators in EM.

Systematic Online Academic Resource (SOAR) Review: Renal and Genitourinary.

BACKGROUND: Online resources for emergency medicine (EM) trainees and physicians have variable quality and inconsistent coverage of core topics. In this first entry of the Society for Academic Emergency Medicine Systematic Online Academic Resource (SOAR) series, we describe the application of a systematic methodology to comprehensively identify, collate, and curate online content for topic-specific modules. METHODS: A list of module topics and related terms was generated from the American Board of Emergency Medicine's Model of the Clinical Practice of Emergency Medicine. The authors selected "renal and genitourinary" for the first module, which contained 35 terms; all MeSH headers and colloquial synonyms related to the topic and related terms were searched both within the 100 most impactful online educational websites per the Social Media Index and the FOAMsearch.net search engine. Duplicate entries, journal articles, images, and archives were excluded. The quality of each article was rated using the revised METRIQ (rMETRIQ) score. RESULTS: The search yielded 13,058 online resources. After 12,717 items were excluded, 341 underwent quality assessment. All renal/genitourinary topics were covered by at least one resource. The median rMETRIQ score was 11 of 21 (interquartile range = 8-14). Calculus of urinary tract was most prominently featured with 60 posts. Thirty-four posts (10% of full-text screened FOAM articles) covering 12 core topics were identified as high quality (rMETRIQ ≥ 16). CONCLUSIONS: We demonstrated the feasibility of systematically identifying and curating FOAM resources for a specific EM topic and identified an overrepresentation of some subtopics. This curated list of resources may guide trainees, teacher recommendations, and resource producers. Further entries in the series will address other topics relevant to EM.

The Revised METRIQ Score: A Quality Evaluation Tool for Online Educational Resources.

BACKGROUND: With the rapid proliferation of online medical education resources, quality evaluation is increasingly critical. The Medical Education Translational Resources: Impact and Quality (METRIQ) study evaluated the METRIQ-8 quality assessment instrument for blogs and collected feedback to improve it. METHODS: As part of the larger METRIQ study, participants rated the quality of five blog posts on clinical emergency medicine topics using the eight-item METRIQ-8 score. Next, participants used a 7-point Likert scale and free-text comments to evaluate the METRIQ-8 score on ease of use, clarity of items, and likelihood of recommending it to others. Descriptive statistics were calculated and comments were thematically analyzed to guide the development of a revised METRIQ (rMETRIQ) score. RESULTS: A total of 309 emergency medicine attendings, residents, and medical students completed the survey. The majority of participants felt the METRIQ-8 score was easy to use (mean ± SD = 2.7 ± 1.1 out of 7, with 1 indicating strong agreement) and would recommend it to others (2.7 ± 1.3 out of 7, with 1 indicating strong agreement). The thematic analysis suggested clarifying ambiguous questions, shortening the 7-point scale, specifying scoring anchors for the questions, eliminating the "unsure" option, and grouping-related questions. This analysis guided changes that resulted in the rMETRIQ score. CONCLUSION: Feedback on the METRIQ-8 score contributed to the development of the rMETRIQ score, which has improved clarity and usability. Further validity evidence on the rMETRIQ score is required.

Academic Life in Emergency Medicine Blog and Podcast Watch: Respiratory Emergencies.

The Academic Life in Emergency Medicine (ALiEM) Approved Instructional Resources (AIR) Series and Approved Instruction Resources Professional (AIR-Pro) Series were created in 2014 and 2015, respectively, to address the need for curation of online educational content as well as a nationally available curriculum that meets individualized interactive instruction criteria. These two programs identify high-quality educational blog and podcast content using an expert-based approach. We summarize the accredited posts on respiratory emergencies that met our a priori determined quality criteria per evaluation by eight experienced faculty educators in emergency medicine.