Development and Evaluation of a Multi-Institutional Virtual Urology Course for Medical Students.

OBJECTIVE: Urological education has been declining in medical schools, leaving many students without adequate exposure to the fundamentals of the field. We aimed to create a virtual urology course for medical students preparing for subinternships. DESIGN: We created a 4-week curriculum of case-based urology modules with sections on hematuria, bladder cancer, kidney stones, vesicoureteral reflux, prostate cancer, urinary incontinence, and erectile dysfunction. Students completed precourse and postcourse surveys assessing confidence in content knowledge and 4 educational competencies. Faculty completed postcourse surveys. Confidence was scored on a 5-point Likert scale (0-4). SETTING: We offered the course in May 2022 and May 2023. The course was fully virtual and was offered at medical schools across the United States. PARTICIPANTS: The course included 157 medical students from 60 institutions and 44 faculty instructors from 30 institutions. All instructors were urologists representing a range of urological subspecialties. RESULTS: Surveys were completed by 61/157 students (39%) and 33/44 faculty (75%). Median student confidence in content knowledge increased across all disease processes: hematuria (3 vs. 2), bladder cancer (3 vs. 1), kidney stones (3 vs. 2), vesicoureteral reflux (3 vs. 1), prostate cancer (3 vs. 1), urinary incontinence (3 vs. 2), and erectile dysfunction (3 vs. 2) (all p < 0.001). Median confidence scores also increased across all 4 educational competencies: patient evaluation (3 vs. 2), pathophysiology (3 vs. 2), literature appraisal (3 vs. 2), and patient counseling (3 vs. 1) (all p < 0.001). Confidence increases in all areas were maintained at 7-month follow-up. Most students (85%) and faculty (91%) rated the course "excellent" or "very good." CONCLUSIONS: A multi-institutional virtual urology course for medical students led to a durable increase in confidence pertaining to content knowledge and various educational competencies.

Knowledge sharing among academics from Egyptian medical schools during the COVID-19 pandemic.

BACKGROUND: Sharing knowledge among scientists during global health emergencies is a critical issue. So, this study investigates knowledge-sharing behavior and attitude among staff members of 19 Medical schools in Egyptian universities during the COVID-19 pandemic. METHODS: Across-sectional study was conducted using a web-based questionnaire. A total of 386 replies from the 10,318 distributed questionnaires were analyzed. Descriptive statistics were computed using SPSS (version 22) to summarize the demographic data. Inferential statistics such as the independent and chi-square test were used to achieve the study aims. RESULTS: More than half of the respondents (54.4%) indicated that their levels of knowledge of COVID-19 were good. Most participants (72.5%) reported that scientific publications and international websites were the most reliable source of their knowledge concerning COVID-19. More than 46% stated they sometimes share their knowledge. The lack of time to share and organizational culture were the most important factors that could affect their knowledge sharing. Additionally, about 75% of participants shared knowledge about treatment.

Developing and validating a knowledge-based AI assessment system for learning clinical core medical knowledge in otolaryngology.

BACKGROUND: Clinical core medical knowledge (CCMK) learning is essential for medical trainees. Adaptive assessment systems can facilitate self-learning, but extracting experts' CCMK is challenging, especially using modern data-driven artificial intelligence (AI) approaches (e.g., deep learning). OBJECTIVES: This study aims to develop a multi-expert knowledge-aggregated adaptive assessment scheme (MEKAS) using knowledge-based AI approaches to facilitate the learning of CCMK in otolaryngology (CCMK-OTO) and validate its effectiveness through a one-month training program for CCMK-OTO education at a tertiary referral hospital. METHODS: The MEKAS utilized the repertory grid technique and case-based reasoning to aggregate experts' knowledge to construct a representative CCMK base, thereby enabling adaptive assessment for CCMK-OTO training. The effects of longitudinal training were compared between the experimental group (EG) and the control group (CG). Both groups received a normal training program (routine meeting, outpatient/operation room teaching, and classroom teaching), while EG received MEKAS for self-learning. The EG comprised 22 UPGY trainees (6 postgraduate [PGY] and 16 undergraduate [UGY] trainees) and 8 otolaryngology residents (ENT-R); the CG comprised 24 UPGY trainees (8 PGY and 16 UGY trainees). The training effectiveness was compared through pre- and post-test CCMK-OTO scores, and user experiences were evaluated using a technology acceptance model-based questionnaire. RESULTS: Both UPGY (z = -3.976, P < 0.001) and ENT-R (z = -2.038, P = 0.042) groups in EG exhibited significant improvements in their CCMK-OTO scores, while UPGY in CG did not (z = -1.204, P = 0.228). The UPGY group in EG also demonstrated a substantial improvement compared to the UPGY group in CG (z = -4.943, P < 0.001). The EG participants were highly satisfied with the MEKAS system concerning self-learning assistance, adaptive testing, perceived satisfaction, intention to use, perceived usefulness, perceived ease of use, and perceived enjoyment, rating it between an overall average of 3.8 and 4.1 out of 5.0 on all scales. CONCLUSIONS: The MEKAS system facilitates CCMK-OTO learning and provides an efficient knowledge aggregation scheme that can be applied to other medical subjects to efficiently build adaptive assessment systems for CCMK learning. Larger-scale validation across diverse institutions and settings is warranted further to assess MEKAS's scalability, generalizability, and long-term impact.

Online Visibility and Scientific Relevance of Strabismus Research: Bibliometric Analysis.

BACKGROUND: Quality and accuracy of online scientific data are crucial, given that the internet and social media serve nowadays as primary sources of medical knowledge. OBJECTIVE: This study aims to analyze the relationship between scientific relevance and online visibility of strabismus research to answer the following questions: (1) Are the most popular strabismus papers scientifically relevant? (2) Are the most high-impact strabismus studies shared enough online? METHODS: The Altmetric Attention Score (AAS) was used as a proxy for online visibility, whereas citations and the journal's impact factor (IF) served as a metric for scientific relevance. Using "strabismus" as a keyword, 100 papers with the highest AAS and 100 papers with the highest number of citations were identified. Statistical analyses, including the Spearman rank test, linear regression, and factor analysis, were performed to assess the relationship between AAS, citations, a journal's IF, and mentions across 18 individual Web 2.0 platforms. RESULTS: A weak, positive, statistically significant correlation was observed between normalized AAS and normalized citations (P<.001; r=0.27) for papers with high visibility. Only Twitter mentions and Mendeley readers correlated significantly with normalized citations (P=.02 and P<.001, respectively) and IF (P=.04 and P=.009, respectively), with Twitter being the strongest significant predictor of citation numbers (r=0.53). For high-impact papers, no correlation was found between normalized citations and normalized AAS (P=.12) or the IF of the journal (P=.55). CONCLUSIONS: While clinical relevance influences online attention, most high-impact research related to strabismus is not sufficiently shared on the web. Therefore, researchers should make a greater effort to share high-impact papers related to strabismus on online media platforms to improve accessibility and quality of evidence-based knowledge for patients.

Ten misconceptions regarding decision-making in critical care.

Diagnostic errors are prevalent in critical care practice and are associated with patient harm and costs for providers and the healthcare system. Patient complexity, illness severity, and the urgency in initiating proper treatment all contribute to decision-making errors. Clinician-related factors such as fatigue, cognitive overload, and inexperience further interfere with effective decision-making. Cognitive science has provided insight into the clinical decision-making process that can be used to reduce error. This evidence-based review discusses ten common misconceptions regarding critical care decision-making. By understanding how practitioners make clinical decisions and examining how errors occur, strategies may be developed and implemented to decrease errors in Decision-making and improve patient outcomes.

A Systematic Review of ChatGPT and Other Conversational Large Language Models in Healthcare.

Background: The launch of the Chat Generative Pre-trained Transformer (ChatGPT) in November 2022 has attracted public attention and academic interest to large language models (LLMs), facilitating the emergence of many other innovative LLMs. These LLMs have been applied in various fields, including healthcare. Numerous studies have since been conducted regarding how to employ state-of-the-art LLMs in health-related scenarios to assist patients, doctors, and public health administrators. Objective: This review aims to summarize the applications and concerns of applying conversational LLMs in healthcare and provide an agenda for future research on LLMs in healthcare. Methods: We utilized PubMed, ACM, and IEEE digital libraries as primary sources for this review. We followed the guidance of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRIMSA) to screen and select peer-reviewed research articles that (1) were related to both healthcare applications and conversational LLMs and (2) were published before September 1st, 2023, the date when we started paper collection and screening. We investigated these papers and classified them according to their applications and concerns. Results: Our search initially identified 820 papers according to targeted keywords, out of which 65 papers met our criteria and were included in the review. The most popular conversational LLM was ChatGPT from OpenAI (60), followed by Bard from Google (1), Large Language Model Meta AI (LLaMA) from Meta (1), and other LLMs (5). These papers were classified into four categories in terms of their applications: 1) summarization, 2) medical knowledge inquiry, 3) prediction, and 4) administration, and four categories of concerns: 1) reliability, 2) bias, 3) privacy, and 4) public acceptability. There are 49 (75%) research papers using LLMs for summarization and/or medical knowledge inquiry, and 58 (89%) research papers expressing concerns about reliability and/or bias. We found that conversational LLMs exhibit promising results in summarization and providing medical knowledge to patients with a relatively high accuracy. However, conversational LLMs like ChatGPT are not able to provide reliable answers to complex health-related tasks that require specialized domain expertise. Additionally, no experiments in our reviewed papers have been conducted to thoughtfully examine how conversational LLMs lead to bias or privacy issues in healthcare research. Conclusions: Future studies should focus on improving the reliability of LLM applications in complex health-related tasks, as well as investigating the mechanisms of how LLM applications brought bias and privacy issues. Considering the vast accessibility of LLMs, legal, social, and technical efforts are all needed to address concerns about LLMs to promote, improve, and regularize the application of LLMs in healthcare.

ChatGPT's adherence to otolaryngology clinical practice guidelines.

OBJECTIVES: Large language models, including ChatGPT, has the potential to transform the way we approach medical knowledge, yet accuracy in clinical topics is critical. Here we assessed ChatGPT's performance in adhering to the American Academy of Otolaryngology-Head and Neck Surgery guidelines. METHODS: We presented ChatGPT with 24 clinical otolaryngology questions based on the guidelines of the American Academy of Otolaryngology. This was done three times (N = 72) to test the model's consistency. Two otolaryngologists evaluated the responses for accuracy and relevance to the guidelines. Cohen's Kappa was used to measure evaluator agreement, and Cronbach's alpha assessed the consistency of ChatGPT's responses. RESULTS: The study revealed mixed results; 59.7% (43/72) of ChatGPT's responses were highly accurate, while only 2.8% (2/72) directly contradicted the guidelines. The model showed 100% accuracy in Head and Neck, but lower accuracy in Rhinology and Otology/Neurotology (66%), Laryngology (50%), and Pediatrics (8%). The model's responses were consistent in 17/24 (70.8%), with a Cronbach's alpha value of 0.87, indicating a reasonable consistency across tests. CONCLUSIONS: Using a guideline-based set of structured questions, ChatGPT demonstrates consistency but variable accuracy in otolaryngology. Its lower performance in some areas, especially Pediatrics, suggests that further rigorous evaluation is needed before considering real-world clinical use.

Flipping the Classroom in Residency Didactics Leads to Higher American Board of Surgery in-Training Examination Scores.

OBJECTIVE: Didactic education in General Surgery (GS) residency typically follows a nationally standardized curriculum; however, instructional format varies by institution. In recent years, GS residents at our institution expressed discontentment with weekly didactics and were not meeting their goals on the American Board of Surgery In-Training Examination (ABSITE). We sought to develop improvements in our didactic curriculum to increase resident satisfaction and ABSITE scores of GS junior residents (Jrs). DESIGN: In a quality improvement project, we changed the weekly didactic curriculum format from hour-long lectures in the 2018 to 2019 academic year (AY) to a partially-flipped classroom in the 2019 to 2020 AY, involving a 30-minute faculty-led presentation followed by 30 minutes of resident-led practice questions. The outcomes measured were ABSITE scores taken in 2019 and 2020 and resident opinions via an anonymous survey. SETTING: This study was conducted at the University of Minnesota (Minneapolis, MN). PARTICIPANTS: The cohort for this study included all GS Jrs in our GS residency program, including postgraduate year (PGY) 1 nondesignated preliminary, PGY1 to 3 categorical GS residents, and residents in their lab time. Senior residents attended a separate didactics session. RESULTS: After curriculum changes, the ABSITE percentile scores for GS Jrs rose from 52% ± 5% to 66% ± 4% (p = 0.03). No categorical GS Jr scored <30% in 2020, compared to 20% (6/30) of categorical General Surgery residents in 2019. All residents preferred the new format overall and reported greater engagement in and preparation for didactics. CONCLUSIONS: After changing didactic education from hour-long lectures in the 2018 to 2019 AY to a flipped classroom model in the 2019 to 2020 AY including 30 minutes of faculty-led lecture followed by 30 minutes of resident-led practice questions, ABSITE scores and resident satisfaction at the University of Minnesota General Surgery Program improved.

A Scoping Review of the Literature on Entrustable Professional Activities in Surgery Residency Programs.

OBJECTIVE: Entrustable professional activities (EPAs) are a crucial component of contemporary postgraduate medical education with many surgery residency programs having implemented EPAs as a competency assessment framework to assess and provide feedback on the performance of their residents. Despite broad implementation of EPAs, there is a paucity of evidence regarding the impact of EPAs on the learners and learning environments. A first step in improving understanding of the use and impact of EPAs is by mapping the rising number of EPA-related publications from the field of surgery. The primary objective of this scoping review is to examine the nature, extent, and range of articles on the development, implementation, and assessment of EPAs. The second objective is to identify the experiences and factors that influence EPA implementation and use in practice in surgical specialties. DESIGN: Scoping review. Four electronic databases (Medline, Embase, Education Source, and ERIC) were searched on January 20, 2022, and then again on July 19, 2023. A quasi-statistical content analysis was employed to quantify and draw meaning from the information related to the development, implementation, assessment, validity, reliability, and experiences with EPAs in the workplace. PARTICIPANTS: A total of 42 empirical and nonempirical articles were included. RESULTS: Four thematic categories describe the topic areas in included articles related to: 1) the development and refinement of EPAs, including the multiple steps taken to develop and refine unique EPAs for surgery residency programs; 2) the methods for implementing EPAs; 3) outcomes of EPA use in practice; 4) barriers, facilitators, and areas for improvement for the implementation and use of EPAs in surgical education. CONCLUSIONS: This scoping review highlights the key trends and gaps from the rapidly increasing number of publications on EPAs in surgery residency, from development to their use in the workplace. Existing EPA studies lack a theoretical and/or conceptual basis; future development and implementation studies should adopt implementation science frameworks to better structure and operationalize EPAs within surgery residency programs.

"Arming half-baked people with weapons!" Information enclaving among professionals and the need for a care-centred model for antibiotic use information in Uganda, Tanzania and Malawi.

BACKGROUND: The overuse of antimicrobial medicines is a global health concern, including as a major driver of antimicrobial resistance. In many low- and middle-income countries, a substantial proportion of antibiotics are purchased over-the-counter without a prescription. But while antibiotics are widely available, information on when and how to use them is not. OBJECTIVE: We aimed to understand the acceptability among experts and professionals of sharing information on antibiotic use with end users - patients, carers and farmers - in Uganda, Tanzania and Malawi. METHODS: Building on extended periods of fieldwork amongst end-users and antibiotic providers in the three countries, we conducted two workshops in each, with a total of 44 medical and veterinary professionals, policy makers and drug regulators, in December 2021. We carried out extensive documentary and literature reviews to characterise antibiotic information systems in each setting. RESULTS: Participants reported that the general public had been provided information on medicine use in all three countries by national drug authorities, health care providers and in package inserts. Participants expressed concern over the danger of sharing detailed information on antibiotic use, particularly that end-users are not equipped to determine appropriate use of medicines. Sharing of general instructions to encourage professionally-prescribed practices was preferred. CONCLUSIONS: Without good access to prescribers, the tension between enclaving and sharing of knowledge presents an equity issue. Transitioning to a client care-centred model that begins with the needs of the patient, carer or farmer will require sharing unbiased antibiotic information at the point of care.

Enhancing Error Detection on Medical Knowledge Graphs via Intrinsic Label.

The construction of medical knowledge graphs (MKGs) is steadily progressing from manual to automatic methods, which inevitably introduce noise, which could impair the performance of downstream healthcare applications. Existing error detection approaches depend on the topological structure and external labels of entities in MKGs to improve their quality. Nevertheless, due to the cost of manual annotation and imperfect automatic algorithms, precise entity labels in MKGs cannot be readily obtained. To address these issues, we propose an approach named Enhancing error detection on Medical knowledge graphs via intrinsic labEL (EMKGEL). Considering the absence of hyper-view KG, we establish a hyper-view KG and a triplet-level KG for implicit label information and neighborhood information, respectively. Inspired by the success of graph attention networks (GATs), we introduce the hyper-view GAT to incorporate label messages and neighborhood information into representation learning. We leverage a confidence score that combines local and global trustworthiness to estimate the triplets. To validate the effectiveness of our approach, we conducted experiments on three publicly available MKGs, namely PharmKG-8k, DiseaseKG, and DiaKG. Compared with the baseline models, the Precision@K value improved by 0.7%, 6.1%, and 3.6%, respectively, on these datasets. Furthermore, our method empirically showed that it significantly outperformed the baseline on a general knowledge graph, Nell-995.

Proposing a new history of grief's medicalisation: A critical discourse analysis.

Conceptualisations of grief have transformed significantly in recent decades, from an experience accepted and expressed in community spaces to a diagnosable clinical phenomenon. Narratives of this transformation tend to focus on grief's relationship to major depression, or on recent nosological changes. This paper examines the possibility of a new narrative for medicalisation by grounding in the networks of language and power created around 'grief' through a critical discourse analysis of psy-discipline articles (n = 70) published between 1975 and 1995. Focusing on shifts in definitions of, methods used to approach, and rationales motivating study of the experience, it posits that the psy-disciplines exerted exclusive expertise over grief decades before its creation as a diagnosis. By reconceptualising grief in the terms of psy-specific symptoms and functional performance and by approaching it with the decontextualising and interventionist methods of an increasingly scientific psy-discipline, the psy-community medicalised grief between 1975 and 1995. Identifying neoliberal and other cultural influences shaping this process of medical construction and reconsidering narratives of grief's history mindful of the powers exerted in medicalisation, this paper establishes that these moments played a critical role in the development of the present's grief.

Cost awareness among intensivists in their daily clinical practice: a prospective multicentre study.

BACKGROUND: Better cost-awareness is a prerogative in achieving the best benefit/risk/cost ratio in the care. We aimed to assess the cost-awareness of intensivists in their daily clinical practice and to identify factors associated with accurate estimate of cost (50-150% of the real cost). METHODS: We performed a prospective observational study in seven French ICUs. We compared the estimate of intensivists of the daily costs of caring with the real costs on a given day. The estimates covered five categories (drugs, laboratory tests, imaging modalities, medical devices, and waste) whose sum represented the overall cost. RESULTS: Of the 234 estimates made by 65 intensivists, 70 (29.9%) were accurate. The median overall cost estimate (€330 [170; 620]) was significantly higher than the real cost (€178 [124; 239], p < 0.001). This overestimation was found in four categories, in particular for waste (€40 [15; 100] vs. €1.1 [0.6; 2.3], p < 0.001). Only the laboratory tests were underestimated (€65 [30; 120] vs. €106 [79; 138], p < 0.001). Being aware of the financial impact of prescriptions was factor associated with accurate estimate (OR: 5.05, 95%CI:1.47-17.4, p = 0.01). However, feeling able to accurately perform estimation was factor negatively associated with accurate estimate (OR: 0.11, 95%CI: 0.02-0.71, p = 0.02). CONCLUSION: French intensivists have a poor awareness of costs in their daily clinical practice. Raising awareness of the financial impact of prescriptions, and of the cost of laboratory tests and waste are the main areas for improvement that could help achieve the objective of the best care at the best cost.

Mdpg: a novel multi-disease diagnosis prediction method based on patient knowledge graphs.

Diagnosis prediction, a key factor in enhancing healthcare efficiency, remains a focal point in clinical decision support research. However, the time-series, sparse and multi-noise characteristics of electronic health record (EHR) data make it a great challenge. Existing methods commonly address these issues using RNNs and incorporating medical prior knowledge from medical knowledge bases, but they neglect the local spatial characteristics and spatial-temporal correlation of the data. Consequently, we propose MDPG, a diagnosis prediction model based on patient knowledge graphs. Initially, we represent the electronic visit records of patients as a patient-centered temporal knowledge graph, capturing the local spatial structure and temporal characteristics of the visit information. Subsequently, we design the spatial graph convolution block, temporal self-attention block, and spatial-temporal synchronous graph convolution block to capture the spatial, temporal, and spatial-temporal correlations embedded in them, respectively. Ultimately, we accomplish the prediction of patients' future states through multi-label classification. We conduct comprehensive experiments on two real-world datasets independently and evaluate the results using visit-level precision@k and code-level accuracy@k metrics. The experimental results demonstrate that MDPG outperforms all baseline models, yielding the best performance.

Enhancing Human Papillomavirus Vaccination Rates through Better Knowledge? Insights from a Survey among German Medical Students.

INTRODUCTION: Vaccination against human papillomavirus (HPV) significantly reduces the risk for malignant diseases like cervix, anal, or penile cancer. However, although vaccination rates are rising, they are still too low mirroring a lack of disease awareness in the community. This study aims to evaluate knowledge about HPV vaccination as well as the vaccination rate among German medical students. MATERIAL AND METHODS: Medical students were surveyed during a German medical students' sports event. The self-designed survey on HPV vaccination consisted of 24 items. The data collection was anonymous. RESULTS: Among 974 participating medical students 64.9% (632) were women, 335 (34.4%) were male and 7 (0.7%) were nonbinary. Mean age was 23.1 ± 2.7 (± standard deviation; range 18-35) years. Respondents had studied mean 6.6 ± 3.3 (1-16) semesters and 39.4% (383) had completed medical education in urology. 613 (64%) respondents reported that HPV had been discussed during their studies. 7.6% (74) had never heard of HPV. In a multivariate model female gender, the knowledge about HPV, and having worked on the topic were significantly associated with being HPV-vaccinated. Older students were vaccinated less likely. CONCLUSIONS: Better knowledge and having worked on the topic of HPV were associated with a higher vaccination rate. However, even in this highly selected group the knowledge about HPV vaccination was low. Consequently, more information and awareness campaigns on HPV vaccination are needed in Germany to increase vaccination rates.

Diagnosing social ills: Theorising social determinants of health as a diagnostic category.

Medicine, as an institution and discipline, has embraced social determinants of health as a key influence on clinical practice and care. Beyond simply acknowledging their importance, most recent versions of the International Classification of Diseases explicitly codify social determinants as a viable diagnostic category. This diagnostic shift is noteworthy in the United States, where 'Z-codes' were introduced to facilitate the documentation of illiteracy, unemployment, poverty and other social factors impacting health. Z-codes hold promise in addressing patients' social needs, but there are likely consequences to medicalising social determinants. In turn, this article provides a critical appraisal of Z-codes, focussing on the role of diagnoses as both constructive and counterproductive sources of legitimacy, knowledge and responsibility in our collective understanding of health. Diagnosis codes for social determinants are powerful bureaucratic tools for framing and responding to psychosocial risks commensurate with biophysiological symptoms; however, they potentially reinforce beliefs about the centrality of individuals for addressing poor health at the population level. I contend that Z-codes demonstrate the limited capacity of diagnoses to capture the complex individual and social aetiology of health, and that sociology benefits from looking further 'upstream' to identify the structural forces constraining the scope and utility of diagnoses.

How Does ChatGPT Perform on the Italian Residency Admission National Exam Compared to 15,869 Medical Graduates?

PURPOSE: The study aims to assess ChatGPT performance on the Residency Admission National Exam to evaluate ChatGPT's level of medical knowledge compared to graduate medical doctors in Italy. METHODS: ChatGPT3 was used in June 2023 to undertake the 2022 Italian Residency Admission National Exam-a 140 multiple choice questions computer-based exam taken by all Italian medical graduates yearly, used to assess basic science and applied medical knowledge. The exam was scored using the same criteria defined by the national educational governing body. The performance of ChatGPT was compared to the performance of the 15,869 medical graduates who took the exam in July 2022. Lastly, the integrity and quality of ChatGPT's responses were evaluated. RESULTS: ChatGPT answered correctly 122 out of 140 questions. The score ranked in the top 98.8th percentile among 15,869 medical graduates. Among the 18 incorrect answers, 10 were evaluating direct questions on basic science medical knowledge, while 8 were evaluating candidates' applied clinical knowledge and reasoning under the form of case presentation. Errors were logical (2 incorrect answers) and informational in nature (16 incorrect answers). Explanations to the correct answers were all evaluated as "appropriate." Comparison to national statistics related to the minimal score needed to match into each specialty, demonstrated that the performance of ChatGPT would have granted the candidate a match into any specialty. CONCLUSION: ChatGPT proved to be proficient in basic science medical knowledge and applied clinical knowledge. Future research should assess the impact and reliability of ChatGPT in clinical practice.

What have we learned about constructed response short-answer questions from students and faculty? A multi-institutional study.

PURPOSE: The purpose of this study was to enrich understanding about the perceived benefits and drawbacks of constructed response short-answer questions (CR-SAQs) in preclerkship assessment using Norcini's criteria for good assessment as a framework. METHODS: This multi-institutional study surveyed students and faculty at three institutions. A survey using Likert scale and open-ended questions was developed to evaluate faculty and student perceptions of CR-SAQs using the criteria of good assessment to determine the benefits and drawbacks. Descriptive statistics and Chi-square analyses are presented, and open responses were analyzed using directed content analysis to describe benefits and drawbacks of CR-SAQs. RESULTS: A total of 260 students (19%) and 57 faculty (48%) completed the survey. Students and faculty report that the benefits of CR-SAQs are authenticity, deeper learning (educational effect), and receiving feedback (catalytic effect). Drawbacks included feasibility, construct validity, and scoring reproducibility. Students and faculty found CR-SAQs to be both acceptable (can show your reasoning, partial credit) and unacceptable (stressful, not USMLE format). CONCLUSIONS: CR-SAQs are a method of aligning innovative curricula with assessment and could enrich the assessment toolkit for medical educators.

Perceived Gaps in Knowledge for the Advanced Heart Failure and Transplant Cardiology Fellow: the Results of a National Needs-Assessment Survey.

BACKGROUND: The field of Advanced Heart Failure and Transplant Cardiology has evolved greatly since it was first established. We sought to elicit program directors' and fellows' viewpoints on potential curricular deficits so we can better meet the educational goals of current and future fellows. METHODS AND RESULTS: We surveyed advanced heart failure and transplant cardiology program directors and fellows concerning their perceptions of the current adequacy of training and their desire for additional training needed to achieve medical competency in advanced heart failure and transplant cardiology at their institutions, as defined by the 2017 ACC Advanced Training Statement. Survey results identified key competencies deemed to be inadequately addressed during training and those in which a moderate or significant additional amount of training was desired. These competencies were identified within the 4 main domains of the fellowship: heart failure, pulmonary hypertension, mechanical circulatory support, and heart transplantation. CONCLUSIONS: This study highlights key medical-knowledge competencies that are inadequately addressed by current fellowship training in advanced heart failure and transplant cardiology. Fellowship programs should develop curricula that focus on the integration of these competencies into training to ensure that fellows are well equipped to care for patients.