RESUMEN
BACKGROUND: ChatGPT is a large language model (LLM) trained on over 400 billion words from books, articles, and websites. Its extensive training draws from a large database of information, making it valuable as a diagnostic aid. Moreover, its capacity to comprehend and generate human language allows medical trainees to interact with it, enhancing its appeal as an educational resource. This study aims to investigate ChatGPT's diagnostic accuracy and utility in medical education. METHODS: 150 Medscape case challenges (September 2021 to January 2023) were inputted into ChatGPT. The primary outcome was the number (%) of cases for which the answer given was correct. Secondary outcomes included diagnostic accuracy, cognitive load, and quality of medical information. A qualitative content analysis was also conducted to assess its responses. RESULTS: ChatGPT answered 49% (74/150) cases correctly. It had an overall accuracy of 74%, a precision of 48.67%, sensitivity of 48.67%, specificity of 82.89%, and an AUC of 0.66. Most answers were considered low cognitive load 51% (77/150) and most answers were complete and relevant 52% (78/150). DISCUSSION: ChatGPT in its current form is not accurate as a diagnostic tool. ChatGPT does not necessarily give factual correctness, despite the vast amount of information it was trained on. Based on our qualitative analysis, ChatGPT struggles with the interpretation of laboratory values, imaging results, and may overlook key information relevant to the diagnosis. However, it still offers utility as an educational tool. ChatGPT was generally correct in ruling out a specific differential diagnosis and providing reasonable next diagnostic steps. Additionally, answers were easy to understand, showcasing a potential benefit in simplifying complex concepts for medical learners. Our results should guide future research into harnessing ChatGPT's potential educational benefits, such as simplifying medical concepts and offering guidance on differential diagnoses and next steps.
Asunto(s)
Educación Médica , Humanos , Educación Médica/métodos , Estudiantes de MedicinaRESUMEN
PURPOSE: LGBTQ + medical trainees experience significant discrimination. These individuals are stigmatized within a hetero- and cis-normative system, resulting in poorer outcomes in mental health and increased stress regarding career trajectory compared with their hetero- and cis-identifying counterparts. However, literature on the barriers experienced during medical training in this marginalized group is limited to small heterogeneous studies. This scoping review collates and explores prominent themes in existing literature on the personal and professional outcomes of LGBTQ + medical trainees. METHODS: We searched five library databases (SCOPUS, Ovid-Medline, ERIC, PsycINFO and EMBASE) for studies that investigated LGBTQ + medical trainees' academic, personal, or professional outcomes. Screening and full text review were performed in duplicate, and all authors participated in thematic analysis to determine emerging themes, which were iteratively reviewed to consensus. RESULTS: From 1809 records, 45 met inclusion criteria (κ = 0.57). Major themes that emerged in the literature included the prevalence of discrimination and mistreatment faced by LGBTQ + medical trainees from colleagues and superiors, concerns regarding disclosure of sexual and/or gender minority identity, and overall negative impacts on mental health including higher rates of depression, substance use, and suicidal ideation. There was a noted lack of inclusivity in medical education and having an LGBTQ + identity had a large impact on career trajectory. Community with peers and mentors was an important determinant of success and belonging. There was a noteworthy lack of research on intersectionality or positive interventions that improved outcomes for this population. CONCLUSION: This scoping review highlighted important barriers facing LGBTQ + medical trainees, identifying substantial gaps in the existing literature. Research on supportive interventions and predictors of training success is lacking and will be important to foster an inclusive education system. These findings provide critical insights for education leaders and researchers to help create and evaluate inclusive and empowering environments for trainees.
Asunto(s)
Prejuicio , Minorías Sexuales y de Género , Humanos , Identidad de Género , Salud Mental , EmocionesRESUMEN
Phenomenon: Ostracism has negative effects on one's fundamental needs. North Americans of Asian ethnicities are at an increased risk of ostracism due to stereotypes labeling them as inherently different to Western cultural norms. We explored Asian Canadian medical trainees' experiences with ostracism during their clinical training. Approach: We conducted semi-structured interviews with 20 medical trainees of Asian ethnicities at 3 Canadian medical schools to explore experiences of ostracism and conducted a thematic analysis guided by the theoretical framework of the temporal need threat model of ostracism. Findings: Participants from East-, South-, and Southeast-Asian sub-ethnic groups completed the study. They voiced experiences of being excluded from clinical and social settings. Ostracism was mainly fueled by systemic racism, power dynamics in medical education, and non-diverse training environments. The model minority myth was a significant contributor to experiences of ostracism. Trainees felt their well-being threatened and many felt resigned to accept ostracism going forward. Insights: Ostracism poses a significant threat to the wellbeing and career progression of Asian Canadian medical trainees. Trainees facing covert ostracism were particularly at risk of entering the resignation stage of hopelessness. This underrecognized problem needs to be addressed by institutions to dismantle harmful stereotypes and prejudiced practices facing these minoritized communities.
RESUMEN
PURPOSE: Twitter has become a powerful tool for professional development in academia. However, studies from the general population suggest that racialized and gender biases disproportionately empower male and white users. We characterized the demographics of Twitter influencers in Canadian healthcare. METHODS: We used the Right Relevance Insight API algorithm to identify Twitter influencers in the healthcare, healthcare research, and health policy domains, and to generated normalized influencer scores based on user connections and engagement. We used facial recognition software to approximate the influencers' race and sex. RESULTS: The majority of influencers identified were white (84%) and/or male (60%). Males had significantly higher influencer scores than females (65.1 ± 8.0 vs. 61.2 ± 6.2, P < 0.05) in health policy. We did not identify any sex- or race-associated disparities among influencers in healthcare or healthcare research. CONCLUSION: Male users have significantly higher levels of influence in health policy on Twitter. Given the importance of Twitter as a tool for professional development, it is crucial that institutional leaders and policymakers are aware of potential inequities in user reach. Future studies should evaluate additional factors shaping user influence in healthcare on Twitter, with a focus on equity, diversity, and trustworthiness.
Asunto(s)
Medios de Comunicación Sociales , Femenino , Humanos , Masculino , Canadá , Programas InformáticosRESUMEN
In medicine, effective teaching is requisite for both successful patient care and trainee development. However, opportunities for medical students to gain exposure to pedagogical principles and hone teaching skills are currently limited. Our initiative provides avenues for medical students to intentionally develop their teaching skill set from an early stage.
RESUMEN
Importance: Medical schools promote admission pathways as well as diversity and inclusivity to prospective students who are underrepresented in medicine (UIM) primarily via their websites. Research from organizational structures supports the use of instrumental values (which focus on behavior and core beliefs), rather than terminal values (which focus on the end goal), to promote diversity. Objective: To characterize the use of instrumental and terminal values to promote institutional diversity and inclusivity on Canadian medical school websites. Design, Setting, and Participants: This qualitative study analyzed the contents and themes of Canadian medical school websites based on a theoretical value framework and an organizational diversity management framework. A literature review was conducted to explore the use of instrumental and terminal values in promoting diversity and inclusivity, and a codebook was created that outlined the characteristics of these values. The content of all application pathway websites for UIM applicants to all Canadian medical schools was coded between July and August 2022. Main Outcomes and Measures: Use of terminal vs instrumental values across the UIM-targeted admission websites of medical schools. Results: Twenty-two websites for 17 Canadian medical schools were included. Content on most of these websites promoted diversity in response to government policies or public accountability and often supported a dominant culture while treating diversity as an exception. The use of terminal rather than instrumental values was also more prominent on websites that targeted Indigenous prospective students compared with Black prospective students and applicants with lower socioeconomic status (11 [50%] websites vs 5 [23%] and 4 [18%] websites). Instrumental values, although seldom used, promoted diversity as a means to improve health care and training for all students in a program. Conclusions and Relevance: Results of this qualitative study suggested that medical schools in Canada promoted diversity and inclusivity to prospective students primarily as an end goal rather than as a core value. Medical schools should highlight the benefits of diverse lived experiences and reinforce their commitment to diversity and inclusion by aligning their website content with their ongoing work in this area.
Asunto(s)
Facultades de Medicina , Estudiantes , Humanos , Canadá , Clase SocialRESUMEN
Background: Open inquiry-based learning (IBL) that aims to foster higher-level thinking, is defined by students formulating their own questions and learning through exploration. The present study aimed to summarize the breadth of metrics used to evaluate health professions trainees in open IBL curricula. Methods: We conducted a scoping review to identify publications detailing trainee outcomes in open IBL initiatives in health professions education. We queried five databases and included studies which described interventions with five phases of IBL (orientation, conceptualization, investigation, conclusion, and discussion). We completed abstract and full text reviews in duplicate. Data were collated and summarized. Results: From 3030 record, 21 studies were included in the final extraction (k = 0.94), with nine involving physician trainees and twelve involving nursing trainees. Three studies used validated data collection tools to measure student inquiry behavior, and a single study used a validated data collection tool to measure critical thinking abilities. Most studies (n = 11) reported trainee self-reported satisfaction or perceived gain of skills as the primary outcome. All four studies using validated tools reported high scores in inquiry behaviors at the end of the curriculum and results on critical thinking skills were mixed. One study collected serial data, while remaining studies collected pre-post or post-only data. Conclusion: IBL has the potential to cultivate a climate of curiosity among health professions learners. However, studies have relied heavily on subjective outcomes. Limited studies reported standardized measures of inquiry behaviors suggest favorable results. Curriculum innovations using IBL could make use of existing tools to better understand their impact on students' inquiry-oriented skills.
Contexte: L'apprentissage libre par le questionnement, qui vise à favoriser une réflexion de haut niveau, se définit par le fait que les étudiants formulent leurs propres questions et apprennent par l'exploration. La présente étude visait à faire l'inventaire des méthodes utilisées pour évaluer les étudiants des professions de la santé dans les programmes qui ont recours à l'apprentissage libre par le questionnement. Méthodes: Nous avons effectué une étude une revue exploratoire pour recenser les publications traitant des résultats des étudiants inscrits dans des programmes de formation dans une professionde la santé qui appliquent la méthode de l'apprentissage libre par le questionnement. Nous avons interrogé cinq bases de données et inclus les études qui décrivaient des interventions portant sur cinq phases de l'apprentissage par le questionnement (orientation, conceptualisation, investigation, conclusion et discussion). Nous avons procédé à l'examen des résumés et du texte intégral par deux lecteurs indépendants. Les données ont été colligées et résumées. Résultats: Sur 3030 documents, 21 études ont été incluses dans l'extraction finale (k=0,94), dont neuf concernaient des étudiants en médecine et douze des étudiants en sciences infirmières. Les auteurs de trois études ont utilisé des outils de collecte de données validés pour mesurer le démarchede recherche des étudiants, et ceux d'une seule étude ont employé un outil de collecte de données validé pour mesurer les capacités de réflexion critique. La plupart des études (n = 11) ont avancé comme résultat principal la satisfaction des étudiants ou l'amélioration ressentie de leurs compétences. Les quatre études réalisées à l'aide d'outils validés ont fait état de scores élevés en matière de démarche de recherche à la fin du programme, tandis que les résultats concernant les capacités de réflexion critique étaient mitigés. Dans l'une des études, les données avaient été recueillies de façon longitudinale et dans les autres, avant et après ou seulement après. Conclusion: L'apprentissage par le questionnement a le potentiel de cultiver la curiosité chez les apprenants des professions de santé. Cependant, les études recensées se sont largement appuyés sur des critères subjectifs. Des études limitées qui présentaient des mesures standardisées de la démarche de recherche des étudiants et ont montré des résultats favorables. Pour leurs innovations pédagogiques faisant appel à l'apprentissage par le questionnement, les programmes peuvent recourir aux outils de mesure existants pour mieux comprendre l'impact de cette méthode sur l'aptitude des étudiants au questionnement.
Asunto(s)
Curriculum , Aprendizaje , Humanos , Pensamiento , Benchmarking , Empleos en SaludRESUMEN
Background: There is limited work exploring competency-based medical education (CBME) in undergraduate medical education. We aimed to assess medical students' and faculty's perception of CBME in the undergraduate medicine setting after its implementation at our institution through a Content, Input, Process, Product (CIPP) program evaluation model. Methods: We explored the rationale for the transition to a CBME curriculum (Content), the changes to the curriculum and the teams involved in the transition (Input), medical students' and faculty's perception of the current CBME curriculum (Process), and benefits and challenges of implementing undergraduate CBME (Product). A cross-sectional online survey was delivered over 8-weeks in October 2021 to medical students and faculty as part of the Process and Product evaluation. Results: Medical students displayed greater optimism towards CBME, compared to faculty, in terms of its role in medical education (p<0.05). Faculty were less certain about how CBME was currently implemented (p<0.05), as well as how feedback to students should be delivered (p<0.05). Students and faculty agreed on perceived benefits to CBME implementation. Faculty time commitment to teaching and logistical concerns were reported as perceived challenges. Conclusion: Education leaders must prioritize faculty engagement and continued professional development of faculty to facilitate the transition. This program evaluation identified strategies to aid the transition to CBME in the undergraduate setting.
RESUMEN
BACKGROUND: The diagnosis of hypertension and hypertension-induced target organ injury by the 2022 American Heart Association (AHA) ambulatory blood pressure threshold as compared with 2014 AHA and 2016 European Society of Hypertension (ESH) thresholds has not been evaluated. METHODS: In a cross-sectional study (n = 291, aged 5-18 years, at a tertiary care outpatient clinic), we compared 2022 AHA with 2014 AHA and ESH thresholds (revised with 2018 adult ESH thresholds where applicable) to diagnose ambulatory hypertension (AH), and detect ambulatory arterial stiffness index (AASI) and left ventricular target organ injury (LVTOI). RESULTS: The 2022 AHA threshold diagnosed significantly more AH (53%) than the 2014 AHA (42%, p < 0.01) and ESH (36%, p < 0.001) thresholds. The 2022 AHA threshold demonstrated only a moderate agreement with the 2014 AHA (kappa (k) = 0.77) and ESH (k = 0.66) thresholds to diagnose AH. Adjusted logistic regression analysis found that only the 2022 AHA threshold predicted elevated AASI significantly (odds ratio 2.40, 95% CI 1.09, 5.25, p = 0.02; AUC 0.61, p < 0.01). In those with elevated AASI, more participants had AH by the 2022 AHA threshold (72%) than the 2014 AHA (46%, p = 0.02) and ESH (48%, p = 0.03) thresholds. AH defined by the 2022 AHA threshold continued to maintain higher odds, larger AUC, and higher sensitivity to identify LVTOI than the 2014 AHA and ESH thresholds; however, the difference did not reach a statistically significant level. CONCLUSIONS: AH defined by the 2022 AHA threshold diagnoses more children with hypertension and identifies more children with hypertension-induced target organ injury than the 2014 AHA and ESH thresholds. A higher resolution version of the Graphical abstract is available as Supplementary information.
Asunto(s)
Monitoreo Ambulatorio de la Presión Arterial , Hipertensión , Adulto , Estados Unidos , Humanos , Niño , American Heart Association , Estudios Transversales , Hipertensión/diagnóstico , Presión SanguíneaRESUMEN
The goal of this study was to investigate what is known about the demographic characteristics of Twitter influencers in academic medicine. We conducted a literature search and scoping review exploring the demographic characteristics of Twitter influencers in academic medicine. Included studies evaluated Twitter influence by any metric and reported associated demographic characteristics. There were no date or language restrictions. Data points included metrics of influence, demographics, and study characteristics. From 1656 records, thirteen met inclusion criteria. Influence was variably defined based on followers, measures of centrality, measures of engagement, or through third-party software. Studies were conducted at single time points and relied heavily on facial recognition for classification of sex or gender, with no studies exploring race as a variable of interest. Twitter influencers in academic medicine were found to be disproportionately male: significantly fewer influencers were female at all levels of professional status. Two studies identified more female influencers among trainee populations. Female users were less likely to develop influence based on followers, retweets, likes, or other measures of engagement at academic meetings, despite equal or greater representation at these meetings. Results on associations between Twitter influence and number of publications or h-index varied considerably. No included studies explored race or ethnicity in relation to Twitter influence, which presents a significant gap in the literature. Our findings highlight the need for larger, user-engaged studies of inequities related to social media influence in academic medicine, especially as social media is increasingly incorporated into academic portfolios.
Asunto(s)
Medicina , Medios de Comunicación Sociales , Humanos , Masculino , Femenino , Etnicidad , Lenguaje , EmocionesRESUMEN
Phenomenon: To increase racial diversity in medical school classes, many institutions have created underrepresented minority (URM) application streams. However, many URM students experience overt and passive marginalization throughout their training and this may be related to how matriculants from URM streams are perceived by their peers. Approach: We conducted a discourse analysis of online discussion forums to explore how URM streams across Canada and the United States are perceived. We analyzed 850 posts from 13 discussion threads published between 2015 and 2020. We used inductive content analysis to develop a data-driven coding scheme from which we identified common themes. Findings: Despite an overall appreciation of the benefits of a diverse workforce, participants engaged in prominent discussions surrounding the merits of URM streams. We identified perceptions that students admitted from URM streams are less academically and clinically competent, with URM applicants reporting feeling unworthy for admission in the eyes of non-URM applicants. Users felt that the influence of socioeconomic status was under-appreciated, and that admissions officers inadequately addressed this barrier. There were some applicants who perceived the admissions process as "broken" with non-URMs displaying a fear of social change, and URMs fearing that the system defines them by their racialized status. Insights: Online discussion forums provide unique insight into perceptions surrounding URM streams. We identified potentially harmful misconceptions about URM students applying to these streams and highlight that actionable measures to reduce marginalization against URM matriculants must begin before medical school.
RESUMEN
BACKGROUND: The agreement between the commonly used ambulatory blood pressure (ABP) thresholds to diagnose ambulatory hypertension in children (patient's 24-h mean ABP classified by 24-h 95th ABP percentile threshold, American Heart Association [AHA] threshold, or patient's day and night mean ABP classified by day-night 95th ABP percentile thresholds) is not known. We evaluated the agreement among 24-h ABP threshold, AHA threshold, and day-night ABP thresholds to diagnose ambulatory hypertension, white coat hypertension (WCH) and masked hypertension (MH). METHODS: In a cross-sectional study design, we analyzed ABP recordings from 450 participants with suspected hypertension from a tertiary care outpatient hypertension clinic. The American Academy of Pediatrics thresholds were used to diagnose office hypertension. RESULTS: The 24-h ABP threshold and day-night ABP thresholds classified 19% ABP (95% confidence interval [CI], 0.15-0.23) differently into ambulatory normotension/hypertension (kappa [κ], 0.58; 95% CI, 0.51-0.66). Ambulatory hypertension diagnosed by 24-h ABP threshold in 27% participants (95% CI, 0.22-0.32) was significantly lower than that by day-night ABP thresholds in 44% participants (95% CI, 0.37-0.50; P < 0.001). The AHA threshold had a stronger agreement with 24-h ABP threshold than with day-night ABP thresholds for classifying ABP into ambulatory normotension/hypertension (k 0.94, 95% CI 0.91-0.98 vs. k 0.59, 95% CI 0.52-0.66). The diagnosis of ambulatory hypertension by the AHA threshold (26%; 95% CI, 0.21-0.31) was closer to that by 24-h ABP threshold (27%, P = 0.73) than by day-night ABP thresholds (44%, P < 0.001). Similar agreement pattern persisted among these ABP thresholds for diagnosing WCH and MH. CONCLUSIONS: The 24-h ABP threshold classifies a lower proportion of ABP as ambulatory hypertension than day-night ABP thresholds. The AHA threshold exhibits a stronger agreement with 24-h ABP than with day-night ABP thresholds for diagnosing ambulatory hypertension, WCH and MH. Our findings are relevant for a consistent interpretation of hypertension by these ABP thresholds in clinical practice.
RESUMEN
Objective: The objective of this study was to identify nephrology topics of lowest perceived competency and importance for general paediatricians. Methods: Surveys were distributed to general paediatricians, paediatric residents, paediatric residency program directors, and paediatric nephrologists. Perceived importance and competence were rated on a 5-point Likert scale. Means and 95% confidence intervals were calculated. Results: Mean perceived competency from general paediatricians across all nephrology domains was 3.0, 95%CI (2.9 to 3.1) and mean importance was 3.2, 95%CI (3.1 to 3.3). Domains scoring below the means for competence and importance, respectively were kidney stones (2.5, 95%CI [2.2 to 2.7]) and 2.6, 95%CI [2.3 to 2.8]), acute kidney injury (2.5, 95%CI [2.2 to 2.8] and 2.4, 95%CI [2.1 to 2.8]), chronic kidney disease (1.9, 95%CI [1.7 to 2.2] and 2.1, 95%CI [1.8 to 2.4]), tubular disorders (1.8, 95%CI [1.6 to 2.0] and 2.0, 95%CI [1.8 to 2.3]), and kidney transplant (1.6, 95%CI [1.4 to 1.8] and 1.7, 95%CI [1.4 to 1.9]). Residents, program directors, and paediatric nephrologists agreed that stones, chronic kidney disease, tubular disorders, and transplant were of lower importance. However, acute kidney injury was the domain with the largest discrepancy in perceived importance between residents (4.4, 95%CI [4.2 to 4.6]), nephrologists (4.2, 95%CI [3.8 to 4.6]), and program directors (4.2, 95%CI [3.7 to 4.7]) compared to general paediatricians ([2.4, 95%CI [2.1 to 2.8]; P<0.05). Conclusion: Paediatricians did not believe acute kidney injury was important to their practice, despite expert opinion and evidence of long-term consequences. Educational interventions must address deficits in crucial domains of renal health in paediatrics.
RESUMEN
BACKGROUND: There is global recognition that interest in nephrology among pediatric and adult trainees is waning, while the burden of kidney disease continues to wax. There is a growing need to engage trainees in nephrology education. The objective of this study was to systematically review the literature on nephrology education for medical students and residents published in the last six years, collate the findings, and extract major themes in order to better define the gaps in this field. METHODS: A systematic literature search was conducted on four major academic search engines including MEDLINE (OvidSP), ERIC, EMBASE and Web of Science until October 22, 2020, retrieving a total of 2,694 studies. Forty studies published after September 2014 met the inclusion and exclusion criteria. These studies were analyzed based on study focus, type of study design, and outcomes. RESULTS: The studies fell into three main areas of focus: (a) factors that influence interest in nephrology careers (b) current gaps in nephrology knowledge and (c) innovative educational strategies. Barriers to engaging learners in nephrology include a lack of exposure, lack of mentorship, and perceived complexity of nephrology. Baseline awareness is deficient in the management of chronic kidney disease and acute kidney injury. Applying active learning strategies may reduce the perceived barriers to understanding nephrology. CONCLUSION: The importance of engaging the future nephrology workforce is well-recognized. Nephrologist educators should focus their efforts in studying curriculum interventions and their impact not only on learner satisfaction, but also future behavior, career choices, and patient outcomes.
Asunto(s)
Nefrología , Estudiantes de Medicina , Adulto , Niño , Curriculum , Humanos , Nefrólogos , Nefrología/educaciónRESUMEN
BACKGROUND: Intra-dialytic hypotension (IDH) is the most common serious adverse event in paediatric haemodialysis (HD). Repeated IDH results in chronic multi-organ damage and increased mortality. At the Hospital for Sick Children, Toronto, retrospective data from all in-centre HD sessions revealed frequently occurring IDH events (16.5 ± 5.6% of HD sessions per week). Based on literature review and clinical expertise, fluid volume management was selected as a potential modifiable risk factor to decrease IDH. Root causes identified as contributing to IDH were incorporated into a Paediatric haemodialysis fluid volume management (PedHDfluid) program using the Model for Improvement methodology including rapid cycles of change. METHODS: Multiple measures were evaluated including (i) Outcome: IDH events per number of HD sessions per week; (ii) Process: number of changes to estimated dry weight per number of HD sessions per week; (iii) Balancing: time spent on dry weight meeting per week. Data was analysed using statistical process control charts. We aimed to decrease IDH in our dialysis unit to < 10% of HD sessions per week over a 6-month period by implementing a PedHDfluid program, including a multifaceted dry weight assessment protocol, multidisciplinary meetings and electronic health records "Dry Weight Evaluation flow sheet/synopsis". RESULTS: The project resulted in a decline in IDH events from 16.5 ± 5.6% to 8.8 ± 3.3% of HD sessions per week. More frequent dry weight changes and increased awareness of fluid removal goals were noted. CONCLUSIONS: A multidisciplinary approach including regular assessment, guidelines and systematic discussion, with an embedded electronic health record assessment and data gathering tool may sustainably reduce IDH events. A higher resolution version of the Graphical abstract is available as Supplementary information.