Quality Appraisal and Assurance Techniques for Free Open Access Medical Education (FOAM) Resources: A Rapid Review.

Free open access medical education (FOAM) has disrupted traditional modes of knowledge translation and dissemination. These are popular resources with a wide educational reach. Nephrology has been a leader in FOAM, but many skeptics still question the accuracy and reliability of this content. Recently, quality-assurance techniques have been developed to address these concerns. These techniques may be helpful for readers to appraise the online literature and for institutions to reward the production of high-quality open educational resources. We performed a rapid review of the literature. A medical librarian conducted a systematic search of the Medline and Cumulative Index of Nursing and Allied Health Literature databases. Two independent assessors screened and selected articles, performed a hand-search of reference lists, and scored articles on their quality using the Medical Education Research Study Quality Instrument. Thirteen reports were included for the final descriptive analysis. We identified 10 quality-assessment techniques, and 4 of them having been validated. The quality of the reports was fairly high, with an average Medical Education Research Study Quality Instrument score of 11.5 of 18 (SD, 2.3; range, 7.25-14.25). The calculated Cronbach α was 0.85. There is burgeoning literature on the topic of critical appraisal of open educational resources, and, more specifically, FOAM resources. Many of the techniques used are of varying quality and developed with different intended uses and audiences. By continuing to refine these tools, we can continue not only to support and legitimize the FOAM movement, but also foster individual critical appraisal skills that increasingly are necessary in this age of information.

CanadiEM: Accessing a Virtual Community of Practice to Create a Canadian National Medical Education Institution.

BACKGROUND: The rise of free open-access medical education (FOAM) has led to a wide range of online resources in emergency medicine. Canadian physicians have been active contributors to FOAM. OBJECTIVES: We aimed to create a virtual community of practice that would serve as a national platform for collaboration, learning, and knowledge dissemination. METHODS: CanadiEM was formed in 2016 from the merger of two Canadian websites and a podcast. Using a community-of-practice model, we introduced two training programs to support junior community members in becoming core editorial team members and employed asynchronous Web technologies to facilitate collaboration. We also introduced a coached peer review process and formed strategic alliances that aim to ensure a high quality of publication. RESULTS: CanadiEM has become a portal for readers to access a broad range of FOAM content. The website has published 782 articles. Of these, 71 have undergone a coached peer review process. The website has received over 2.5 million page views from 217 countries, and the associated CRACKCast podcast has been downloaded over 750,000 times. CONCLUSIONS: CanadiEM has succeeded in building a national multi-interface dissemination network that fosters collaboration and knowledge sharing in emergency medicine while fostering junior digital scholars. The construction of a community of practice has been facilitated by quality assurance, training programs, and the use of asynchronous Web technologies. Ongoing challenges in sustainability include a volunteer workforce with high turnover.

Coached Peer Review: Developing the Next Generation of Authors.

PROBLEM: Publishing in academic journals is challenging for learners. Those who pass the initial stages of internal review by an editor often find the anonymous peer review process harsh. Academic blogs offer alternate avenues for publishing medical education material. Many blogs, however, lack a peer review process, which some consumers argue compromises the quality of materials published. APPROACH: CanadiEM (formerly BoringEM) is an academic educational emergency medicine blog dedicated to publishing high-quality materials produced by learners (i.e., residents and medical students). The editorial team has designed and implemented a collaborative "coached peer review" process that comprises an open exchange among the learner-author, editors, and reviewers. The goal of this process is to facilitate the publication of high-quality academic materials by learner-authors while providing focused feedback to help them develop academic writing skills. OUTCOMES: The authors of this Innovation Report surveyed (February-June 2015) their blog's learner-authors and external expert "staff" reviewers who had participated in coached peer review for their reactions to the process. The survey results revealed that participants viewed the process positively compared with both traditional journal peer review and academic blog publication processes. Participants found the process friendly, easy, efficient, and transparent. Learner-authors also reported increased confidence in their published material. These outcomes met the goals of coached peer review. NEXT STEPS: CanadiEM aims to inspire continued participation in, exposure to, and high-quality production of academic writing by promoting the adoption of coached peer review for online educational resources produced by learners.