What have we learned about constructed response short-answer questions from students and faculty? A multi-institutional study.

PURPOSE: The purpose of this study was to enrich understanding about the perceived benefits and drawbacks of constructed response short-answer questions (CR-SAQs) in preclerkship assessment using Norcini's criteria for good assessment as a framework. METHODS: This multi-institutional study surveyed students and faculty at three institutions. A survey using Likert scale and open-ended questions was developed to evaluate faculty and student perceptions of CR-SAQs using the criteria of good assessment to determine the benefits and drawbacks. Descriptive statistics and Chi-square analyses are presented, and open responses were analyzed using directed content analysis to describe benefits and drawbacks of CR-SAQs. RESULTS: A total of 260 students (19%) and 57 faculty (48%) completed the survey. Students and faculty report that the benefits of CR-SAQs are authenticity, deeper learning (educational effect), and receiving feedback (catalytic effect). Drawbacks included feasibility, construct validity, and scoring reproducibility. Students and faculty found CR-SAQs to be both acceptable (can show your reasoning, partial credit) and unacceptable (stressful, not USMLE format). CONCLUSIONS: CR-SAQs are a method of aligning innovative curricula with assessment and could enrich the assessment toolkit for medical educators.

Professional Identity Formation of Basic Science Medical Educators: A Qualitative Study of Identity Supports and Threats.

PURPOSE: Basic science medical educators (BSME) play a vital role in the training of medical students, yet little is known about the factors that shape their professional identities. This multi-institutional qualitative study investigated factors that support and threaten the professional identity formation (PIF) of these medical educators. METHOD: A qualitative descriptive study was conducted with a purposive sample of 58 BSME from 7 allopathic medical schools in the U.S. In-depth semi-structured interviews of individual BSME were conducted between December 2020 and February 2021 to explore the facilitators and barriers shaping the PIF of BSME. Thematic analysis was conducted. RESULTS: Factors shaping PIF were grouped into 3 broad domains: personal, social, and structural. Interrelated themes described a combination of factors that pushed BSME into teaching (early or positive teaching experiences) and kept them there (satisfaction and rewards of teaching, communities of like-minded people), as well as factors that challenged their PIF (misunderstanding from medical students, clinical, and research faculty, lack of formal training programs, and lack of tenure-track educator positions). The structural environment was reported to be crucial for PIF and determined whether BSME felt that they belonged and were valued. CONCLUSIONS: This study shows that although most BSME derive a sense of fulfillment and meaning from their role as medical educators, they face considerable obstacles during their PIF. Structural change and support are needed to increase recognition, value, promotion, and belonging for BSME to improve the satisfaction and retention of this important group of faculty.

A Multi-institutional Study of the Feasibility and Reliability of the Implementation of Constructed Response Exam Questions.

PROBLEM: Some medical schools have incorporated constructed response short answer questions (CR-SAQs) into their assessment toolkits. Although CR-SAQs carry benefits for medical students and educators, the faculty perception that the amount of time required to create and score CR-SAQs is not feasible and concerns about reliable scoring may impede the use of this assessment type in medical education. INTERVENTION: Three US medical schools collaborated to write and score CR-SAQs based on a single vignette. Study participants included faculty question writers (N = 5) and three groups of scorers: faculty content experts (N = 7), faculty non-content experts (N = 6), and fourth-year medical students (N = 7). Structured interviews were performed with question writers and an online survey was administered to scorers to gather information about their process for creating and scoring CR-SAQs. A content analysis was performed on the qualitative data using Bowen's model of feasibility as a framework. To examine inter-rater reliability between the content expert and other scorers, a random selection of fifty student responses from each site were scored by each site's faculty content experts, faculty non-content experts, and student scorers. A holistic rubric (6-point Likert scale) was used by two schools and an analytic rubric (3-4 point checklist) was used by one school. Cohen's weighted kappa (κw) was used to evaluate inter-rater reliability. CONTEXT: This research study was implemented at three US medical schools that are nationally dispersed and have been administering CR-SAQ summative exams as part of their programs of assessment for at least five years. The study exam question was included in an end-of-course summative exam during the first year of medical school. IMPACT: Five question writers (100%) participated in the interviews and twelve scorers (60% response rate) completed the survey. Qualitative comments revealed three aspects of feasibility: practicality (time, institutional culture, teamwork), implementation (steps in the question writing and scoring process), and adaptation (feedback, rubric adjustment, continuous quality improvement). The scorers' described their experience in terms of the need for outside resources, concern about lack of expertise, and value gained through scoring. Inter-rater reliability between the faculty content expert and student scorers was fair/moderate (κw=.34-.53, holistic rubrics) or substantial (κw=.67-.76, analytic rubric), but much lower between faculty content and non-content experts (κw=.18-.29, holistic rubrics; κw=.59-.66, analytic rubric). LESSONS LEARNED: Our findings show that from the faculty perspective it is feasible to include CR-SAQs in summative exams and we provide practical information for medical educators creating and scoring CR-SAQs. We also learned that CR-SAQs can be reliably scored by faculty without content expertise or senior medical students using an analytic rubric, or by senior medical students using a holistic rubric, which provides options to alleviate the faculty burden associated with grading CR-SAQs.

American Society for Pharmacology and Experimental Therapeutics Division for Pharmacology Education at EB2022-Meeting report.

The American Society for Pharmacology and Experimental Therapeutics (ASPET) held its annual meeting at the Experimental Biology 2022 conference in Philadelphia, PA on April 2-5, 2022. The authors provide a synopsis and discussion of each of the four sessions presented at the meeting under the ASPET Division for Pharmacology Education (DPE).

Design of a foundational sciences curriculum: Applying the ICAP framework to pharmacology education in integrated medical curricula.

Expectations for physicians are rapidly changing, as is the environment in which they will practice. In response, preclerkship medical education curricula are adapting to meet these demands, often by reducing the time for foundational sciences. This descriptive study compares preclerkship pharmacology education curricular practices from seven allopathic medical schools across the United States. We compare factors and practices that affect how pharmacology is integrated into the undergraduate medical education curriculum, including teaching techniques, resources, time allocated to pharmacology teaching, and assessment strategies. We use data from seven medical schools in the United States, along with results from a literature survey, to inform the strengths and weaknesses of various approaches and to raise important questions that can guide future research regarding integration of foundational sciences in medical school and health professions' curricula. In this comparative study, we found that there is significant heterogeneity in the number of hours dedicated to pharmacology in the preclerkship curriculum, whereas there was concordance in the use of active learning pedagogies for content delivery. Applying the ICAP (Interactive, Constructive, Active, Passive) Framework for cognitive engagement, our data showed that pharmacology was presented using more highly engaging pedagogies during sessions that are integrated with other foundational sciences. These findings can serve as a model that can be applied beyond pharmacology to other foundational sciences such as genetics, pathology, microbiology, biochemistry, etc.

The importance of collaboratively designing pharmacology education programs.

A grounded knowledge of pharmacology is essential for healthcare providers to improve the quality of patients' lives, avoid medical errors, and circumvent potentially dangerous drug-drug interactions. One of the greatest tools to achieve this foundational knowledge of pharmacology is the dedicated pharmacology educators who teach in health sciences programs. Too often, the pharmacology educators responsible for teaching this material are left siloed at their own institutions with little room for dialog and collaboration. As scientists, we know that it is through dialog and collaboration that ideas grow, are refined, and improve. More collaborative work is needed to identify and describe best practices for pharmacology education in health sciences programs. While evidence-based, outcomes-focused studies are the optimum standard for this work, there is also a place for descriptive studies and innovative reports.

Effects of longitudinal small-group learning on delivery and receipt of communication skills feedback.

OBJECTIVES: Although feedback is a critical component of learning, recent data suggest that learners may discount feedback they receive. The emotional threat inherent in feedback can contribute to its ineffectiveness, particularly for sensitive topics like communication skills. Longitudinal relationships among peers may increase their sense of safety and soften the perceived threat of feedback to allow students to give, receive and potentially more effectively incorporate feedback. We studied the effects of prior shared learning experiences among medical students in the delivery and receipt of feedback on clinical (communication) skills. METHODS: During a formative clinical skills examination, we divided Year 3 students at a US medical school into two subgroups comprising, respectively, small-group classmates from a 2-year longitudinal pre-clerkship clinical skills course (with prior peer-learning relationships), and peers with no prior shared small-group coursework. Students in both subgroups observed peers in a simulated clinical case and then provided feedback, which was videotaped, transcribed and coded. Feedback recipients also completed a survey on their perceptions of the feedback. RESULTS: Students valued the feedback they received and intended to enact it, regardless of whether they had prior peer-learning relationships. Coding of feedback revealed high specificity. Feedback providers who had prior peer-learning relationships with recipients provided more specific corrective feedback on communication skills than those with no such relationships (p = 0.014); there was no significant difference between subgroups in the provision of reinforcing feedback on communication skills. CONCLUSIONS: Year 3 medical student peers can deliver specific feedback on clinical skills; prior peer-learning relationships in pre-clerkship clinical skills courses enrich the provision of specific corrective feedback about communication skills. Feedback between peers with pre-existing peer-learning relationships represents an additional and potentially underutilised method of helping students improve clinical skills in sensitive realms such as interpersonal communication.

A potential role for calcium / calmodulin-dependent protein kinase-related peptide in neuronal apoptosis: in vivo and in vitro evidence.

Previously, we have established that a product of the doublecortin-like kinase (DCLK) gene, DCLK-short, is cleaved by caspases during serum deprivation. Subsequently, the N-terminal cleavage product of DCLK-short facilitates apoptosis in the neuroblastoma cell line NG108. As this N-terminal cleavage product is highly homologous to calcium/calmodulin-dependent protein kinase-related peptide (CARP), another DCLK gene splice variant, we aimed to determine the possible apoptotic properties of CARP in vivo and in vitro. We report highly specific CARP expression in apoptotic granule cells in the rat dentate gyrus after adrenalectomy relative to healthy granule cells. CARP is significantly upregulated in the suprapyramidal blade of the dentate gyrus, with varying levels of upregulation, depending on the extent of adrenalectomy-induced apoptosis. Similar to the caspase-cleaved N-terminus of DCLK-short, CARP overexpression itself facilitated apoptosis in serum-deprived NG108 cells. Furthermore, CARP facilitated polymerization of tubulin in vitro and was capable of interacting with growth factor receptor-bound protein 2, an intracellular protein involved in vesicle trafficking. Together, our data demonstrate a facilitating role for CARP in the apoptotic process in granule cell populations sensitive to adrenalectomy, and suggest that this proapoptotic effect is mediated by increasing the stability of the microtubule cytoskeleton.