Investigating Canadian Radiology Residents' Personal Financial Literacy: A Nation-Wide Assessment.

Purpose: Canadian resident physicians carry large debt to finance their education, which impacts their wellness and their future decision making. The objective of this observational study is to assess the financial literacy of Canadian radiology residents through testing their financial knowledge and examining their current financial status. Methods: A survey was designed to assess the financial literacy and current financial status of radiology residents, which was distributed to Canadian radiology residents via Google Forms. Descriptive analyses on preliminary data and the association between level of training and financial quiz scores were obtained. Results: 104 valid responses from 16 universities were received. The majority (53%) of residents indicated that their debt was greater than $150 000. Residents on average scored 71% on the financial quiz and the scores were not associated with training level (P = .71). The majority (89%) of residents indicated a strong interest in a formal financial literacy curriculum, with 80% preferring a physician-led curriculum. Conclusion: Overall, residents face a high debt burden. Current resident physicians value a formal financial literacy curriculum as a part of their residency program despite existing financial knowledge. Most importantly, residents feel that a curriculum created with involvement of other physicians would be optimal.

Antinociceptive Analysis of Natural Monoterpenes Eugenol, Menthol, Carvacrol and Thymol in a Zebrafish Larval Model.

In the last decade, a considerable number of studies have broadened our knowledge of the nociceptive mechanisms of pain, a global health problem in both humans and animals. The use of herbal compounds such as eugenol, menthol, thymol, and carvacrol as analgesic agents has accompanied the growing interest in this area, offering a possible solution for this complex problem. Here, we aimed to explore how these natural substances-at three different concentrations (2, 5 and 10 mg/L)-affect the pain responses in zebrafish (Danio rerio) larvae exposed to 0.05% acetic acid (AA) for 1 min. By analysing the activity of acetylcholinesterase (AChE), 5'-ectonucleotidase and NTPDases, as well as aversion and exploratory behaviours, it was observed that that although all substances were effective in counteracting the pain stimulus, the concentration range within which they do so might be very limited. Eugenol, despite its acknowledged properties in fish anaesthesia, failed to alleviate the pain stimulus at low concentrations. Contrastingly, menthol exhibited the most promising results at the lowest concentrations tested. Overall, it is concluded that menthol might be a good analgesic for this species, qualifying it as a substance of interest for prospective studies.

The influence of viewing time on visual diagnostic accuracy: Less is more.

BACKGROUND: Understanding the factors that contribute to diagnostic errors is critical if we are to correct or prevent them. Some scholars influenced by the default interventionist dual-process theory of cognition (dual-process theory) emphasise a narrow focus on individual clinician's faulty reasoning as a significant contributor. In this paper, we examine the validity of claims that dual process theory is a key to error reduction. METHODS: We examined the relationship between a clinical experience (staff and resident physicians) and viewing time on accuracy for categorising chest X-rays (CXRs) and electrocardiograms (ECGs). In two studies, participants categorised images as normal or abnormal, presented at viewing times of 175, 250, 500 and 1000 ms, to encourage System 1 processing. Study 2 extended viewing times to 1, 5, 10 and 20 s to allow time for System 2 processing and a diagnosis. Descriptives and repeated measures analysis of variance were used to analyse the proportion of true and false positive rates (TP and FP) as well as correct diagnoses. RESULTS: In Study 1, physicians were able to detect abnormal CXRs (0.78) and ECGs (0.67) with relatively high accuracy. The effect of experience was found for ECGs only, as staff physicians (0.71, 95% CI = 0.66-0.75) had higher ECG TP than resident physicians (0.63, 95% CI = 0.58-0.68) in Study 1, and staff had lower ECG FP (0.10, 95% CI = 0.03-0.18) than resident physicians (0.27, 95% CI = 0.20-0.33) in Study 2. In other comparisons, experience was equivocal for ECG FPs and CXR TPs and FPs. In Study 2, overall diagnostic accuracy was similar for both ECGs and CXRs, (0.74). There were small interactions between experience and time for TP in ECGs and FP in CXRs, which are discussed further in the discussion and offer insights into the relationship between processing and experience. CONCLUSION: Overall, our findings raise concerns about the practical application of models that link processing type to diagnostic error, or to specific diagnostic error reduction strategies.

ReThinking clinical reasoning: A paradigm shift.

Numerous studies have demonstrated that our healthcare systems and medical education programs are fundamentally flawed. In North America and Europe, most systems were built upon values and structures that have historically benefitted middle and upper class males of European descent in the global north. As a result, there continue to be systemic biases that are pervasive throughout our healthcare systems and medical education programs. This has led to inequities in health outcomes and clinical reasoning practices which marginalize several communities. These biases are perpetuated as we continue to lead medical education research and practice with traditional values and views of evidence. To address these issues, we proposed a 'flipped' conference in which three interdisciplinary writing teams, comprised of both junior and senior academics, clinicians, and researchers, were invited to rethink the foundations of clinical reasoning. In the months leading up to the conference, each writing team explored a specific topic related to clinical reasoning and racial equity. The papers, presented during the virtual conference are now available in this issue of the Journal for the Evaluation of Clinical Practice. In addition, 6 more publications were added to this special topic to showcase new evidence and theory that builds on the recommendations in the three core papers.

Crowdsourcing a diagnosis? Exploring the accuracy of the size and type of group diagnosis: an experimental study.

BACKGROUND: The consultation process, where a clinician seeks an opinion from another clinician, is foundational in medicine. However, the effectiveness of group diagnosis has not been studied. OBJECTIVE: To compare individual diagnosis to group diagnosis on two dimensions: group size (n=3 or 6) and group process (interactive or artificial groups). METHODOLOGY: Thirty-six internal or emergency medicine residents participated in the study. Initially, each resident worked through four written cases on their own, providing a primary diagnosis and a differential diagnosis. Next, participants formed into groups of three. Using a videoconferencing platform, they worked through four additional cases, collectively providing a single primary diagnosis and differential diagnosis. The process was repeated using a group of six with four new cases. Cases were all counterbalanced. Retrospectively, nominal (ie, artificial) groups were formed by aggregating individual participant data into subgroups of three and six and analytically computing scores. Presence of the correct diagnosis as primary diagnosis or included in the differential diagnosis, as well as the number of diagnoses mentioned, was calculated for all conditions. Means were compared using analysis of variance. RESULTS: For both authentic and nominal groups, the diagnostic accuracy of group diagnosis was superior to individual for both the primary diagnosis and differential diagnosis. However, there was no improvement in diagnostic accuracy when comparing a group of three to a group of six. Interactive and nominal groups were equivalent; however, this may be an artefact of the method used to combine data. CONCLUSIONS: Group diagnosis improves diagnostic accuracy. However, a larger group is not necessarily superior to a smaller group. In this study, interactive group discussion does not result in improved diagnostic accuracy.

Soluble MICA in endometriosis pathophysiology: Impairs NK cell degranulation and effector functions.

PROBLEM: Endometriosis exhibits several immune dysfunctions, including deficient natural killer (NK) cell cytotoxicity. MICA (MHC class I chain-related molecule A) is induced by biological stress and soluble MICA (sMICA) negatively modulates the expression of the activating receptor, NKG2D, reducing NK cells activities. We investigated the involvement of soluble MICA in NK cell-deficient activity in endometriosis. METHODS OF STUDY: sMICA levels (serum and peritoneal fluid-PF) were evaluated by ELISA. Circulating NK cell subsets quantification and its NKG2D receptor expression, NK cell cytotoxicity and CD107a, IFN-γ and IL-10 expressions by NK cells stimulated with K562 cells were determined by flow cytometry. RESULTS: We found higher sMICA levels (serum and PF) in endometriosis, especially in advanced and deep endometriosis. Endometriosis presented lower percentages of CD56dim CD16+ cytotoxic cells and impaired NK cell responses upon stimulation, resulting in lower CD107a and IFN-γ expressions, and deficient NK cell cytotoxicity. NK cell stimulation in the MICA-blocked condition (mimicking the effect of sMICA) showed decreased cytotoxicity in initial endometriosis stages and the emergence of a negative correlation between CD107a expression and sMICA levels. CONCLUSIONS: We suggest that soluble MICA is a potential player in endometriosis pathophysiology with involvement in disease progression and severity, contributing to NK cell impaired IFN-γ response and degranulation. NK cell compartment exhibits multiple perturbations, including quantitative deficiency and impaired cytotoxicity, contributing to inadequate elimination of ectopic endometrial tissue.

The inseparability of context and clinical reasoning.

Early descriptions of clinical reasoning have described a dual process model that relies on analytical or nonanalytical approaches to develop a working diagnosis. In this classic research, clinical reasoning is portrayed as an individual-driven cognitive process based on gathering information from the patient encounter, forming mental representations that rely on previous experience and engaging developed patterns to drive working diagnoses and management plans. Indeed, approaches to patient safety, as well as teaching and assessing clinical reasoning focus on the individual clinician, often ignoring the complexity of the system surrounding the diagnostic process. More recent theories and evidence portray clinical reasoning as a dynamic collection of processes that takes place among and between persons across clinical settings. Yet, clinical reasoning, taken as both an individual and a system process, is insufficiently supported by theories of cognition based on individual clinicals and lacks the specificity needed to describe the phenomenology of clinical reasoning. In this review, we reinforce that the modern healthcare ecosystem - with its people, processes and technology - is the context in which health care encounters and clinical reasoning take place.

Using Natural Language Processing to Evaluate the Quality of Supervisor Narrative Comments in Competency-Based Medical Education.

PURPOSE: Learner development and promotion rely heavily on narrative assessment comments, but narrative assessment quality is rarely evaluated in medical education. Educators have developed tools such as the Quality of Assessment for Learning (QuAL) tool to evaluate the quality of narrative assessment comments; however, scoring the comments generated in medical education assessment programs is time intensive. The authors developed a natural language processing (NLP) model for applying the QuAL score to narrative supervisor comments. METHOD: Samples of 2,500 Entrustable Professional Activities assessments were randomly extracted and deidentified from the McMaster (1,250 comments) and Saskatchewan (1,250 comments) emergency medicine (EM) residency training programs during the 2019-2020 academic year. Comments were rated using the QuAL score by 25 EM faculty members and 25 EM residents. The results were used to develop and test an NLP model to predict the overall QuAL score and QuAL subscores. RESULTS: All 50 raters completed the rating exercise. Approximately 50% of the comments had perfect agreement on the QuAL score, with the remaining resolved by the study authors. Creating a meaningful suggestion for improvement was the key differentiator between high- and moderate-quality feedback. The overall QuAL model predicted the exact human-rated score or 1 point above or below it in 87% of instances. Overall model performance was excellent, especially regarding the subtasks on suggestions for improvement and the link between resident performance and improvement suggestions, which achieved 85% and 82% balanced accuracies, respectively. CONCLUSIONS: This model could save considerable time for programs that want to rate the quality of supervisor comments, with the potential to automatically score a large volume of comments. This model could be used to provide faculty with real-time feedback or as a tool to quantify and track the quality of assessment comments at faculty, rotation, program, or institution levels.

A Stereological Approach to Quantify Immunohistochemical Staining in Zebrafish Larvae.

Immunohistochemistry (IHC) is a powerful research tool to localize specific antigens in whole-mount or tissue sections of embryos with labeled antibodies based on antigen-antibody interactions. Stereological methods are nowadays an essential tool to quantify cells or other types of structures in an unbiased and reproducible manner. In this chapter, a general protocol for a stereological estimation of the relative volume density of each structural component (Vv), which can be applied to any organ/structural component, will be described.

Undergraduate Learners' Receptiveness to Feedback in Medical Schools: A Scoping Review.

Feedback from educators to learners is considered an important element of effective learning in medical school. While early studies were focused on the processes of providing feedback, recent work has showed that factors related to how learners receive feedback seems to be equally important. Considering that the literature on this topic is new in medical education, and studies are diverse and methodologically variable, we sought to conduct a scoping review to map the articles on receptiveness to feedback, to provide an overview of its related factors, to identify the types of research conducted in this area, and to document knowledge gaps in the existing literature. Using the Joanna Briggs Institute scoping review methodology, we searched four databases (CINAHL, Ovid, PubMed, and Web of Science) and screened 9120 abstracts, resulting in 98 articles for our final analysis. In this sample, 80% of studies on the feedback receiver were published in the last 10 years, and there is a vast variation in the studies' methodologies. The main factors that affect medical students' receptiveness to feedback are students' characteristics, feedback content, educators' credibility, and the learning environment. Feedback literacy is a very recent and rarely used term in medical education; therefore, an important area for further investigation. Lastly, we identified some gaps in the literature that might guide future research, such as studying receptiveness to feedback based on academic seniority and feedback literacy's long-term impacts on learning. Supplementary Information: The online version contains supplementary material available at 10.1007/s40670-023-01858-0.

Non-Invasive Biomarkers in Saliva and Eye Infrared Thermography to Assess the Stress Response of Calves during Transport.

Animal transport is currently a stressful procedure. Therefore, animal-based indicators are needed for reliable and non-invasive welfare assessment. Saliva is a biospecimen with potential validity for the determination of cortisol and oxidative stress, although its use to assess calf welfare during transport has never been tested. Similarly, the applicability and reliability of infrared thermography to assess temperature change during calves' transport have never been evaluated. These objectives were outlined following the known and growing need to identify non-invasive methodologies for stress assessment in bovines. This study was conducted on 20 calves of the Arouquesa autochthone breed, at about nine months of age, during their transport to slaughter. For each animal, saliva samples and thermographic images of the eye were collected at three time points: before transport, after transport, and at slaughter. The saliva was then processed to measure cortisol levels and oxidative stress parameters (reactive oxygen species, thiobarbituric acid reactive substance, carbonyls, and advanced oxidation protein products), and the images were analyzed using FLIR Tools+ software. There was an increase in cortisol concentration and oxidative stress parameters (reactive oxygen species, thiobarbituric acid reactive substance, carbonyls, and advanced oxidation protein products) in saliva after transport. An increase in eye temperature triggered by transport was also observed. The cortisol and eye temperature results at slaughter were returned to values similar to those before transport; however, the values of oxidative stress remained increased (mainly TBARS values). These non-invasive techniques seem to be reliable indicators of stress in bovine transport, and oxidative stress parameters in saliva may be a persistent marker for welfare assessment.

Evaluating the Construct Validity of Competencies: A Retrospective Analysis.

Background: A competency-based framework focuses on alignment between professional standards and assessment design. This alignment implies improved measurement validity, yet it has not been established that competence in one context predicts performance in another context. High-stakes competence assessments offer insights into the relationship between assessment design and competencies. Methods/Analyses: The internationally educated nurses competency assessment program (IENCAP) was developed at Touchstone Institute in collaboration with the College of Nurses of Ontario (CNO) and includes a 12-station OSCE. Each station evaluated the same 10 competencies. We submitted competency scores to a multi-trait multi-method matrix analysis to evaluate the convergent and discriminant validity of competencies. Results/Observations: All correlations were significant and positive; however, we did not find evidence of convergent or discriminant validity. Correlations were higher between different competencies evaluated within the same station (mean correlation = 0.60) compared to identical competencies evaluated across different stations (mean correlation = 0.19). Discussion: The results do not provide evidence of construct validity for competencies. While competency-based approaches emphasize various generalized knowledge, skills, and attitudes, these findings indicate that the clinical context is a major determinant of performance. Conclusion: The context-dependent nature of competencies requires multiple assessments in varied contexts. Performance on a single competency cannot be determined in a single occasion. Supplementary Information: The online version contains supplementary material available at 10.1007/s40670-023-01794-z.

His opportunity, her burden: A narrative critical review of why women decline academic opportunities.

OBJECTIVES: This paper stems from a desire to deepen our own understanding of why women might 'say no' when allies and sponsors offer or create opportunities for advancement, leadership or recognition. The resulting disparity between representation by men and women in leadership positions, invited keynote speakers and publication counts in academic medicine is a stubborn and wicked problem that requires a synthesis of knowledge across multidisciplinary literature. Acknowledging the complexity of this topic, we selected a narrative critical review methodology to explore reasons why one man's opportunity might be a woman's burden in academic medicine. METHODS: We engaged with an iterative process of identifying, reviewing and interpreting literature from Psychology (cognitive, industrial and educational), Sociology, Health Professions Education and Business, placing no restrictions on context or year of publication. Knowledge synthesis and interpretation were guided by our combined expertise, lived experience, consultations with experts outside the author team and these guiding questions: (1) Why might women have less time for career advancement opportunities? (2) Why do women have less time for research and leadership? (3) How are these disparities maintained? RESULTS: Turning down an opportunity may be a symptom of a much larger issue. The power of social expectations, culture and gender stereotypes remains a resistant force against calls for action. Consequently, women disproportionately take on other tasks that are not as well recognised. This disparity is maintained through social consequences for breaking with firmly entrenched stereotypes. CONCLUSIONS: Popular strategies like 'lean into opportunities', 'fake it till you make it' and 'overcome your imposter syndrome' suggest that women are standing in their own way. Critically, these axioms ignore powerful systemic barriers that shape these choices and opportunities. We offer strategies that allies, sponsors and peers can implement to offset the power of stereotypes.

Are we talking about practice? A randomized study comparing simulation-based deliberate practice and mastery learning to self-guided practice.

OBJECTIVES: Simulation-based technical skills training is now ubiquitous in medicine, particularly for high acuity, low occurrence (HALO) procedures. Mastery learning and deliberate practice (ML + DP) are potentially valuable educational methods, however, they are resource intensive. We sought to compare the effect of deliberate practice and mastery learning versus self-guided practice on skill performance of the rare, life-saving procedure, a bougie-assisted cricothyroidotomy (BAC). METHODS: We conducted a multi-center, randomized study at five North American emergency medicine (EM) residency programs. We randomly assigned 176 EM residents to either the ML + DP or self-guided practice groups. Three blinded airway experts independently evaluated BAC skill performance by video review before (pre-test), after (post-test) and 6-12 months (retention) after the training session. The primary outcome was post-test skill performance using a global rating score (GRS). Secondary outcomes included performance time and skill performance at the retention test. RESULTS: Immediately following training, GRS scores were significantly higher as mean performance improved from pre-test, (22, 95% CI = 21-23) to post-test (27, 95% CI = 26-28), (p < 0.001) for all participants. However, there was no difference between the groups on GRS scores (p = 0.2) at the post-test or at the retention test (p = 0.2). At the retention test, participants in the ML + DP group had faster performance times (66 s, 95% CI = 57-74) compared to the self-guided group (77 s, 95% CI = 67-86), (p < 0.01). CONCLUSIONS: There was no significant difference in skill performance between groups. Residents who received deliberate practice and mastery learning demonstrated an improvement in skill performance time.

ABSTRAIT: OBJECTIFS: La formation aux compétences techniques fondée sur la simulation est maintenant omniprésente en médecine, en particulier pour les procédures de grande acuité et de faible occurrence (HALO). L'apprentissage de la maîtrise et la pratique délibérée (ML+DP) sont des méthodes éducatives potentiellement précieuses, mais elles exigent beaucoup de ressources. Nous avons cherché à comparer l'effet de la pratique délibérée et de l'apprentissage de la maîtrise par rapport à la pratique autoguidée sur le rendement des compétences de la rare intervention de sauvetage, une cricothyroïdotomie à la bougie. MéTHODES: Nous avons mené une étude multicentrique randomisée dans le cadre de cinq programmes nord-américains de résidence en médecine d'urgence. Nous avons affecté au hasard 176 résidents en SE aux groupes de ML+DP ou de pratique autoguidée. Trois experts des voies respiratoires aveuglés ont évalué de façon indépendante la performance des compétences en BAC par examen vidéo avant (pré-test), après (post-test) et 6 à 12 mois (rétention) après la séance de formation. Le principal résultat a été le rendement des compétences après le test au moyen d'une cote globale (SRC). Les résultats secondaires comprenaient le temps consacré au rendement et le rendement des compétences au test de rétention. RéSULTATS: Immédiatement après la formation, les résultats des SRC étaient beaucoup plus élevés, car le rendement moyen s'est amélioré entre le prétest (22, IC à 95 % = 21 à 23) et le post-test (27, IC à 95 % = 26 à 28), (p < 0,001) pour tous les participants. Cependant, il n'y avait aucune différence entre les groupes sur les scores GRS (p = 0,2) au post-test ou au test de rétention (p = 0,2). Au test de rétention, les participants du groupe ML+DP avaient des temps de performance plus rapides (66 secondes, IC à 95 % = 57 à 74) que ceux du groupe autoguidé (77 secondes, IC à 95 % = 67 à 86) (p < 0,01). CONCLUSIONS: Il n'y avait pas de différence significative dans le rendement des compétences entre les groupes. Les résidents qui ont bénéficié d'une pratique délibérée et d'un apprentissage de la maîtrise ont démontré une amélioration du temps consacré aux compétences.

Anti-Inflammatory, Anti-Oxidative and Anti-Apoptotic Effects of Thymol and 24-Epibrassinolide in Zebrafish Larvae.

Thymol (THY) and 24-epibrassinolide (24-EPI) are two examples of plant-based products with promising therapeutic effects. In this study, we investigated the anti-inflammatory, antioxidant and anti-apoptotic effects of the THY and 24-EPI. We used zebrafish (Danio rerio) larvae transgenic line (Tg(mpxGFP)i114) to evaluate the recruitment of neutrophils as an inflammatory marker to the site of injury after tail fin amputation. In another experiment, wild-type AB larvae were exposed to a well known pro-inflammatory substance, copper (CuSO4), and then exposed for 4 h to THY, 24-EPI or diclofenac (DIC), a known anti-inflammatory drug. In this model, the antioxidant (levels of reactive oxygen species-ROS) and anti-apoptotic (cell death) effects were evaluated in vivo, as well as biochemical parameters such as the activity of antioxidant enzymes (superoxide dismutase, catalase and glutathione peroxidase), the biotransformation activity of glutathione-S-transferase, the levels of glutathione reduced and oxidated, lipid peroxidation, acetylcholinesterase activity, lactate dehydrogenase activity, and levels of nitric acid (NO). Both compounds decreased the recruitment of neutrophils in Tg(mpxGFP)i114, as well as showed in vivo antioxidant effects by reducing ROS production and anti-apoptotic effects in addition to a decrease in NO compared to CuSO4. The observed data substantiate the potential of the natural compounds THY and 24-EPI as anti-inflammatory and antioxidant agents in this species. These results support the need for further research to understand the molecular pathways involved, particularly their effect on NO.

Protective effects of 24-epibrassinolide against the 6-OHDA zebrafish model of Parkinson's disease.

The molecular processes behind Parkinson's disease (PD) remain under debate although mitochondrial oxidative stress generation has been proposed as a fundamental contributor. In this context, different brassinosteroids have shown neuroprotective action hampering oxidative stress. This study determined the effects of 24-Epibrassinolide (24-EPI) against 6-hydroxydopamine- (6-OHDA-) induced toxicity using the zebrafish embryonic model. Embryos were exposed to 250 µM 6-OHDA or co-exposed to 24-EPI (0.01, 0.1, and 1 µM) for 3 days, starting at 48 h post-fertilization (hpf). During the experimental period, developmental parameters were assessed. At 120 hpf, larvae were tested for behavioural phenotypes with different biochemical biomarkers and tyrosine hydroxylase- (TH-) reactive neurons being also assessed. Exposure to 6-OHDA induced a decrease in body length while no other morphological phenotypes were noticed. A significant decrease in TH-neurons immunofluorescence, a decreased locomotion (speed and distance moved), and an increased absolute angle were found in 6-OHDA-exposed embryos. These outcomes were rescuable by the co-exposure with 24-EPI. Surprisingly, the direct effects of 6-OHDA on reactive oxygen species (ROS) were not observed in the present study supporting the involvement of other molecular pathways in the 6-OHDA-induced effects during embryonic development. Overall, the results obtained confirm PD-like symptoms induced by 6-OHDA during embryonic development which were reverted by 24-EPI. Although antioxidative signalling pathways deserve further scrutiny, the findings support the further investigation of 24-EPI neuroprotective effects.

Does allowing access to electronic differential diagnosis support threaten the reliability of a licensing exam?

INTRODUCTION: Newer electronic differential diagnosis supports (EDSs) are efficient and effective at improving diagnostic skill. Although these supports are encouraged in practice, they are prohibited in medical licensing examinations. The purpose of this study is to determine how using an EDS impacts examinees' results when answering clinical diagnosis questions. METHOD: The authors recruited 100 medical students from McMaster University (Hamilton, Ontario) to answer 40 clinical diagnosis questions in a simulated examination in 2021. Of these, 50 were first-year students and 50 were final-year students. Participants from each year of study were randomised into one of two groups. During the survey, half of the students had access to Isabel (an EDS) and half did not. Differences were explored using analysis of variance (ANOVA), and reliability estimates were compared for each group. RESULTS: Test scores were higher for final-year versus first-year students (53 ± 13% versus 29 ± 10, p < 0.001) and higher with the use of EDS (44 ± 28% versus 36 ± 26%, p < 0.001). Students using the EDS took longer to complete the test (p < 0.001). Internal consistency reliability (Cronbach's alpha) increased with EDS use among final-year students but was reduced among first-year students, although the effect was not significant. A similar pattern was noted in item discrimination, which was significant. CONCLUSION: EDS use during diagnostic licensing style questions was associated with modest improvements in performance, increased discrimination in senior students and increased testing time. Given that clinicians have access to EDS in routine clinical practice, allowing EDS use for diagnostic questions would maintain ecological validity of testing while preserving important psychometric test characteristics.