Ready or Not: A Crossover Study of (Un)graded Individual Readiness Assurance Tests in Team-Based Learning.

OBJECTIVE: This study aimed to measure the effects of graded vs ungraded individual readiness assurance tests (iRATs) on the students' test scores and achievement goals in a team-based learning classroom. METHODS: A 2 × 2 crossover study was conducted in a required second-year pharmacotherapy course. Teams 1 to 8 were assigned to a UG iRAT during the first half of the course, followed by a G iRAT the second half of the course (G/UG group). Teams 9 to 16 were assigned to the opposite grading sequence (ie, UG/G). A multivariate analysis of variance was used to analyze the differences in test scores, as measured using iRAT and examination scores. A separate multivariate analysis of variance was used to examine the differences in achievement goals. RESULTS: There was a significant difference in test scores based on the iRAT grading condition. Individual readiness assurance tests were higher in the G condition (72.51% vs 67.99%); however, the examination scores were similar in the G and UG conditions (81.07% vs 80.32%). There was no statistically significant difference in the achievement goals based on the iRAT grading condition. CONCLUSION: In a required second-year pharmacotherapy course that uses team-based learning, student performance on the iRAT was modestly lower in the UG iRAT condition; however, the students' examination scores were unchanged. Achievement goals were unchanged based on the iRAT grading condition.

Predicting Medical Student Performance With a Situational Judgment Test in Admissions.

PURPOSE: To explore correlations between AAMC situational judgment test (SJT) scores, other admissions data, and learners' medical school performance. METHOD: First- and second-year medical students from 8 U.S. MD-granting medical schools completed a prototype version of the AAMC SJT in 2017. Outcomes included research-only faculty ratings of student performance, final course grades, and faculty evaluations of student performance, 2017-2018 and 2018-2019 academic years. Bivariate correlations were used to investigate the relationship between SJT scores and student performance outcomes and hierarchical regressions to investigate whether SJT scores provided incremental validity over MCAT total scores and cumulative undergraduate grade point averages (UGPAs) for predicting student performance outcomes. RESULTS: In general, there were small positive correlations with research-only faculty ratings from the first year of medical school, with the highest for social skills/service orientation ( rcorrected = .33, P < .05). Correlations were higher, with the highest for social skills/service orientation and cultural competence ( rcorrected = .33 and .36, respectively, P < .05) in the second year in medical school. SJT scores improved prediction of research-only faculty ratings over MCAT total scores and UGPAs for reliability and dependability/capacity for improvement, cultural competence, social skills/service orientation, and the overall composite score in the first year and for resilience and adaptability, social skills/service orientation, cultural competence, and the overall composite score in the second year. SJT scores demonstrated small correlations with course grades ( rsample-weighted = .10, P = ns) and faculty evaluations related to professionalism skills ( rsample-weighted = .14, P < .05); however, MCAT total scores explained most of the variance associated with course outcomes. CONCLUSIONS: These studies provide initial evidence that SJT scores may add value to the medical school admissions process because scores were related to faculty ratings of professional behaviors and provided unique information relative to MCAT scores and UGPAs.

Exploring the impacts of learning modality changes: Validation of the learning modality change community of inquiry and self-efficacy scales.

The rapid learning environment transition initiated by the COVID-19 pandemic impacted students' perception of, comfort with, and self-efficacy in the online learning environment. Garrison's Community of Inquiry framework provides a lens for examining students' online learning experiences through three interdependent elements: social presence, cognitive presence, and teaching presence. Researchers in this study developed and validated the Learning Modality Change Community of Inquiry and Self-Efficacy scales to measure health professions students' self-efficacy with online learning, while exploring how cognitive, social, and teaching presence is experienced by students who transition from one learning environment to another. The two scales demonstrate strong validity and reliability evidence and can be used by educators to explore the impacts of learning modality changes on student learning experiences. As learning environments continue to evolve, understanding the impact of these transitions can inform how educators consider curriculum design and learning environment changes.

A Bibliometric Analysis of the 100 Most Cited Articles on Problem-Based Learning in Medical Education.

Problem-based learning (PBL) is an instructional approach used in medical education that is characterized by solving problems in small groups with tutor guidance. More than 50 years since PBL's inception, many questions remain to be addressed about its processes and learning outcomes. The purpose of the study was to examine the bibliometric characteristics of the 100 most cited articles on PBL in medical education and to identify landmark papers that have made significant contributions to PBL research. Results were systematically reviewed for citation frequency, publication year, journal, article type, article focus, authors, author collaboration, and country collaboration. The number of citations ranged from 81 to 3531 times cited with 31,041 total citations. The articles were contributed by 211 authors in 23 journals and most articles (68%) were published in Medical Education, Academic Medicine, and Medical Teacher. The majority of the articles (71%) originated from Netherlands, Canada, and the United States and six prolific authors were identified. Almost half of the articles are classified as empirical research. Article foci included theoretical foundations of PBL, curriculum design, learning outcomes and processes, tutors, assessment, guides to PBL implementation, commentaries, and student well-being. The strong author and country collaborations indicate continued global interest in the PBL instructional method, which is likely to remain an active topic of research as the evidence of its effectiveness over traditional instructional methods as well as its most impactful components is inconclusive.

A continuing professional development imperative? Examining trends and characteristics of health professions education doctoral programs.

BACKGROUND: Despite the long-standing faculty development initiatives for improving teaching skills in the health professions, there is still a growing need for educators who are formally trained in educational theory and practice as health professions schools experience dramatic demand and growth. Graduate programs in health professions education (HPE) provide an avenue for health professions' faculty continuing professional development to enhance their knowledge and skills for teaching and curriculum leadership roles. There has been a proliferation of certificate, master's, and doctoral programs in HPE over the last two decades to respond to the growing need for well-prepared faculty educators and program leadership. The purpose of this study was to identify and describe current HPE doctoral programs in United States (U.S.) and Canada. METHODS: The study first examined doctoral programs in HPE identified in earlier studies. Next, we searched the literature and the web to identify new doctoral programs in the U.S. and Canada that had been established between 2014, when the prior study was conducted, and 2022. We then collated and described the characteristics of these programs, highlighting their similarities and differences. RESULTS: We identified a total of 20 doctoral programs, 17 in the U.S. and 3 in Canada. Of these, 12 programs in the U.S. and 1 program in Canada were established in the last 8 years. There are many similarities and some notable differences across programs with respect to degree title, admission requirements, duration, delivery format, curriculum, and graduation requirements. Most programs are delivered in a hybrid format and the average time for completion is 4 years. CONCLUSIONS: The workforce shortage facing health professional schools presents an opportunity, or perhaps imperative, for continuing professional development in HPE through certificate, master's, or doctoral programs. With the current exponential growth of new doctoral programs, there is a need to standardize the title, degree requirements, and further develop core competencies that guide the knowledge and skills HPE graduates are expected to have upon graduation.

How an Online Teaching Community Supports and Equips Interprofessional Graduate Faculty.

INTRODUCTION: Learning communities have been shown to help strengthen teaching skills, innovation, and scholarship. We sought to understand the impact of an online teaching community among interprofessional graduate faculty at a health professions university, notably in the context of COVID-19. METHODS: The University of Maryland, Baltimore's Online Teaching Community (OTC) was created in 2019 to provide peer-to-peer faculty support and resources for effective online teaching. The OTC meets monthly, online, for a 1-hour informal discussion including a 30-minute topical presentation related to online teaching. A brief impact survey was completed in May 2020, as well as a live poll in January 2021. RESULTS: Membership doubled after the first year; the OTC becoming particularly relevant after COVID-19, including individuals across seven professional schools on campus. Faculty reported enjoying the sense of community, feeling supported as an online instructor, and learning strategies and sharing resources for online instruction. DISCUSSION: An OTC can support, unite, and equip interprofessional graduate faculty members to teach online. The OTC described may be a helpful model for developing and implementing OTCs on other campuses.

Predictors of medical students' ethical decision-making: A pilot study using the Theory of Interpersonal Behavior.

OBJECTIVE: To understand medical students' (MS) ethical decision-making using the Theory of Interpersonal Behavior (TIB). METHODS: We conducted two rounds of focus groups to develop a TIB-based questionnaire by eliciting students' perspectives on an ethical dilemma they will encounter in a standardized patient (SP) station, in which an SP "surgeon" asked them to intubate a sedated patient whom the student knew had requested no student involvement. We administrated questionnaires to 241 third-year MS following this SP station, asking for their decisions in the SP station and if a surgeon made the same request in their clerkship. Confirmatory factor analysis (CFA) was used to test whether observed data fit the proposed TIB-based model. RESULTS: The CFA provided an acceptable fit to the a priori proposed model. Fifty-five percent of students indicated they would intubate in an actual situation versus 18% in the SP station (p < 0.05). Using logistic regression, TIB domains affect and facilitating factors reported significant association with students' decisions in both the SP and hypothesized actual situations. CONCLUSIONS: The TIB appears to be an effective theoretical framework for explaining students' ethical decision-making. PRACTICE IMPLICATIONS: The TIB may guide design and assessment of educational programs for professional formation.

The Multidisciplinary Translational Team (MTT) Model for Training and Development of Translational Research Investigators.

Multiinstitutional research collaborations now form the most rapid and productive project execution structures in the health sciences. Effective adoption of a multidisciplinary team research approach is widely accepted as one mechanism enabling rapid translation of new discoveries into interventions in human health. Although the impact of successful team-based approaches facilitating innovation has been well-documented, its utility for training a new generation of scientists has not been thoroughly investigated. We describe the characteristics of how multidisciplinary translational teams (MTTs) promote career development of translational research scholars through competency building, interprofessional integration, and team-based mentoring approaches. Exploratory longitudinal and outcome assessments from our experience show that MTT membership had a positive effect on the development of translational research competencies, as determined by a self-report survey of 32 scholars. We also observed that all trainees produced a large number of collaborative publications that appeared to be associated with their CTSA association and participation with MTTs. We conclude that the MTT model provides a unique training environment for translational and team-based learning activities, for investigators at early stages of career development.