Goal-Oriented and Habit-Oriented Reflective Models to Support Professional Identity Formation and Metacognitive Thinking.

Professional identity formation (PIF) is a multi-year, complex, social, and intellectual process that culminates in trainees "thinking, acting, and feeling like a doctor." Some of the processes of PIF, particularly the Hidden Curriculum, may result in suboptimal outcomes in student's cognition, including implicit bias and poor clinical decision-making. Many have recognized the importance of reflective writing, particularly metacognition, in undergraduate medical education. However, there are few concrete examples and explanations for fully integrating reflective writing exercises across multiple situations, experiences, and levels of growth. The authors provide conceptual frameworks, concrete curricular structures, and reflective tools used at two medical schools. Supplementary Information: The online version contains supplementary material available at 10.1007/s40670-023-01752-9.

Mobile technologies to support workplace-based assessment for entrustment decisions: Guidelines for programs and educators: AMEE Guide No. 154.

With the rise of competency-based medical education and workplace-based assessment (WBA) since the turn of the century, much has been written about methods of assessment. Direct observation and other sources of information have become standard in many clinical programs. Entrustable professional activities (EPAs) have also become a central focus of assessment in the clinical workplace. Paper and pencil (one of the earliest mobile technologies!) to document observations have become almost obsolete with the advent of digital technology. Typically, clinical supervisors are asked to document assessment ratings using forms on computers. However, accessing these forms can be cumbersome and is not easily integrated into existing clinical workflows. With a call for more frequent documentation, this practice is hardly sustainable, and mobile technology is quickly becoming indispensable. Documentation of learner performance at the point of care merges WBA with patient care and WBA increasingly uses smartphone applications for this purpose.This AMEE Guide was developed to support institutions and programs who wish to use mobile technology to implement EPA-based assessment and, more generally, any type of workplace-based assessment. It covers backgrounds of WBA, EPAs and entrustment decision-making, provides guidance for choosing or developing mobile technology, discusses challenges and describes best practices.

Status of Entrustable Professional Activities (EPA) Implementation at Colleges of Osteopathic Medicine in the United States and Future Considerations.

CONTEXT: Competency-based medical education, developmental milestones for residency training, and the single graduate medical education (GME) accreditation system have emerged over the last decade, necessitating new ways to adequately prepare graduates to meet new standards in proficiency, including the 13 Core Entrustable Professional Activities (EPA) for Entering Residency. The American Association of Colleges of Osteopathic Medicine (AACOM) Entrustable Professional Activities (EPA) steering committee has implemented an information-gathering process to provide suggestions for supporting a variety of EPA-related implementation efforts at colleges of osteopathic medicine (COMs) across the country. OBJECTIVE: To review the status of EPA implementation at COMs nationally. METHODS: An explanatory mixed-methods design was used to guide information gathering and synthesis of a 41-question survey and interview feedback; the overarching premise of this design was to use qualitative data to build upon initial quantitative findings. This survey was delivered electronically through a link emailed to liaisons at each main, branch, and satellite campus of the 47 schools within the AACOM institutional database. After survey administration, follow-up structured interviews were conducted according to an 18-question script with a purposive sample of 16 institutions with EPA implementation levels ranging from "moderate implementation with reporting" to "full implementation with reporting." Post-interview, the interview notes were analyzed and results were aggregated for comparison with the original survey findings. RESULTS: Of the 47 schools surveyed, 42 responded (89.4%). To maintain uniformity in data coding and analysis, 36 of 47 (76.6%) of COMs with independently submitted survey responses were retained in the review. The majority of those respondents (23 of 36; 64%) indicated that their institution was above "somewhat knowledgeable" toward "expert" regarding knowledge of EPAs, but 23 (64%) also indicated "no confidence" or "somewhat confident" regarding EPA implementation. Postinterview results showed that the majority of schools were equally distributed across the "foundational implementation" (10; 28%), "slight implementation" (11; 31%), and "moderate implementation" (11, 31%) categories, with a few schools indicating "no implementation" (2; 5%) or "progressive implementation" (2; 5%). CONCLUSION: The results of this review indicate that most osteopathic medical schools are at the early stages of EPA implementation, with emphasis varying by program year in terms of the specific EPAs addressed. Many schools appear engaged in curricular change efforts that will support the advancement of EPA use within their institutions. Faculty development was identified as a continued critical need for a majority of institutions.

Nelson-Denny Reading Test Scores as a Predictor of Student Success in Osteopathic Medical Education.

BACKGROUND: Reading skills are crucial in medical school, where students are expected to absorb an onslaught of new and complex material. Studies on reading assessment in osteopathic medical education are lacking. OBJECTIVE: To address gaps in the literature related to reading assessment and to investigate the correlation of the Nelson-Denny Reading Test with various performance indicators in osteopathic medical education. METHODS: The West Virginia School of Osteopathic Medicine administered the Nelson-Denny Reading Test to first- and second-year students between 2015 and 2017. Raw scores were translated into the percentile rank, scale score, grade equivalent score, and stanine score based on guidelines supplied with the Nelson-Denny Reading Test. These translated scores were compared with Medical College Admission Test (MCAT) scores, first- and second-year performance on course examinations, Comprehensive Osteopathic Medical Licensing Examination-USA (COMLEX-USA) Level 1 scores, and scores provided in a 2002 study by Haught and Walls. RESULTS: A total of 623 students took the first-year Nelson-Denny Reading Test, and 408 took both the first- and second-year Nelson-Denny Reading Test. Findings showed a large correlation between the Nelson-Denny Reading Test and the verbal reasoning section (r=0.56 for the class of 2020 and 0.46 for the class of 2021) of the old MCAT (before 2015) and the reasoning skills section (r=0.42 for the class of 2020 and 0.49 for the class of 2021) of the new MCAT (released in 2015). There were no correlations with first- and second-year course examination scores or COMLEX-USA Level 1 scores. The Nelson-Denny Reading Test scores reported by Haught and Walls for medical students and health professional students were slightly higher than those found for osteopathic medical students in this study. CONCLUSION: The reasoning skills section of the new MCAT could serve as a good proxy for a reading test. There were no correlations between the Nelson-Denny Reading Test and performance in the first 2 years of medical school or COMLEX-USA Level 1 performance. Further research can strengthen the findings and determine whether correlations exist with clinical performance.

Assessment Considerations for Core Entrustable Professional Activities for Entering Residency.

CONTEXT: In the process of analyzing entrustable professional activities (EPAs) for use in medical education, ten Cate and others identified challenges, including the need for valid and reliable EPA assessment strategies. OBJECTIVE: To provide osteopathic medical schools with a database of assessment tools compiled from the literature to assist them with the development and implementation of robust, evidence-based assessment methods. METHODS: MEDLINE, ERIC, PubMed, and other relevant databases were searched using MeSH keywords for articles outlining robust, evidence-based assessment tools that could be used in designing assessments for EPAs 1 through 6. RESULTS: A total of 55 publications were included in content analysis and reporting. All but 2 of the assessment articles were conducted in an undergraduate or graduate medical education setting. The majority of the 55 articles related to assessment of competencies affiliated with EPA 2 (16 articles) and EPA 4 (15 articles). Four articles focused on EPA 3. CONCLUSION: Osteopathic medical schools can use this database of assessment tools to support the development of EPA-specific assessment plans that match the unique context and needs of their institution.

Entrustable Professional Activities for Entering Residency: Establishing Common Osteopathic Performance Standards in the Transition From Medical School to Residency.

Entrustable professional activities (EPAs) are measurable units of observable professional practice that can be entrusted to an unsupervised trainee. They were first introduced as a method of operationalizing competency-based medical education in graduate medical education. The American Association of Medical Colleges subsequently used EPAs to establish the core skills that medical students must be able to perform before they enter residency training. A recently published guide provides descriptions, guidelines, and rationale for implementing and assessing the core EPAs from an osteopathic approach. These osteopathically informed EPAs can allow schools to more appropriately assess a learner's whole-person approach to a patient, in alignment with the philosophy of the profession. As the single accreditation system for graduate medical education moves forward, it will be critical to integrate EPAs into osteopathic medical education to demonstrate entrustment of medical school graduates. The authors describe the collaborative process used to establish the osteopathic considerations added to EPAs and explores the challenges and opportunities for undergraduate osteopathic medical education.

Osteopathic Medical Students Entering Family Medicine and Attitudes Regarding Osteopathic Manipulative Treatment: Preliminary Findings of Differences by Sex.

CONTEXT: Factors distinguishing osteopathic physicians from their allopathic counterparts include the use of osteopathic manipulative treatment (OMT), application of osteopathic principles and practice (OPP), and a greater likelihood of entering primary care, specifically family medicine (FM). In the United States, the percentage of entering osteopathic medical students who were female rose from 14.3% in fall 1977 to 44.3% in fall 2015. OBJECTIVES: To investigate the perspectives of female osteopathic medical students as they relate to osteopathic distinctiveness. METHODS: Students at the West Virginia School of Osteopathic Medicine who were eligible to participate in graduation exercises in 2014 or 2015 were asked to complete the school's standard Exit Survey. The research team chose 5 items from the survey to include in the current analysis. Sex had been self-identified at admission, and residency in first postgraduate year was categorized as FM or other specialty. Graduates entering a transitional year or traditional internship were removed from analysis. RESULTS: Analysis was conducted for 308 of the 375 students (82%) expected to graduate in 2014 or 2015. χ2 analysis found no difference by sex in the number of graduates entering FM residencies vs other specialties (P=.727). Statistically significant differences were found in 2 survey items: "Use of OMT will enhance my practice" (P=.005) and "What emphasis do you believe OMT will have in your practice?" (P<.001). Graduating female students responded more favorably to OMT on both items. For the latter item, 91.4% of female and 80.3% of male students indicated OMT would have at least some role in their practices. Sex differences remained after statistically controlling for entry into FM. CONCLUSION: Female graduating osteopathic medical students were more likely to report that OMT will have at least some role in their practices. Future studies of the attitudes and practice patterns of osteopathic physicians should analyze for differences by sex.

Status of portfolios in undergraduate medical education in the LCME accredited US medical school.

AIM: We sought to investigate the number of US medical schools utilizing portfolios, the format of portfolios, information technology (IT) innovations, purpose of portfolios and their ability to engage faculty and students. METHODS: A 21-question survey regarding portfolios was sent to the 141 LCME-accredited, US medical schools. The response rate was 50% (71/141); 47% of respondents (33/71) reported that their medical school used portfolios in some form. Of those, 7% reported the use of paper-based portfolios and 76% use electronic portfolios. Forty-five percent reported portfolio use for formative evaluation only; 48% for both formative and summative evaluation, and 3% for summative evaluation alone. RESULTS: Seventy-two percent developed a longitudinal, competency-based portfolio. The most common feature of portfolios was reflective writing (79%). Seventy-three percent allow access to the portfolio off-campus, 58% allow usage of tablets and mobile devices, and 9% involve social media within the portfolio. Eighty percent and 69% agreed that the portfolio engaged students and faculty, respectively. Ninety-seven percent reported that the portfolios used at their institution have room for improvement. CONCLUSION: While there is significant variation in the purpose and structure of portfolios in the medical schools surveyed, most schools using portfolios reported a high level of engagement with students and faculty.