Primer Part 1 - Preparing a laboratory quality improvement project.

Quality in laboratory medicine encompasses multiple components related to total quality management, including quality control (QC), quality assurance (QA), quality indicators, and quality improvement (QI). Together, they contribute to minimizing errors (pre-analytical, analytical, or post-analytical) in clinical service delivery and improving process appropriateness and efficiency. In contrast to static quality benchmarks (QC, QA, quality indicators), the QI paradigm is a continuous approach to systemic process improvement for optimizing patient safety, timeliness, effectiveness, and efficiency. Healthcare institutions have placed emphasis on applying the QI framework to identify and improve healthcare delivery. Despite QI's increasing importance, there is a lack of guidance on preparing, executing, and sustaining QI initiatives in the field of laboratory medicine. This has presented a significant barrier for clinical laboratorians to participate in and lead QI initiatives. This three-part primer series will bridge this knowledge gap by providing a guide for clinical laboratories to implement a QI project that issuccessful and sustainable. In the first article, we introduce the steps needed to prepare a QI project with focus on relevant methodology and tools related to problem identification, stakeholder engagement, root cause analysis (e.g., fishbone diagrams, Pareto charts and process mapping), and SMART aim establishment. Throughout, we describe a clinical vignette of a real QI project completed at our institution focused on serum protein electrophoresis (SPEP) utilization. This primer series is the first of its kind in laboratory medicine and will serve as a useful resource for future engagement of clinical laboratory leaders in QI initiatives.

COVID-19 vaccine reactogenicity among participants enrolled in the GENCOV study.

BACKGROUND: GENCOV is a prospective, observational cohort study of COVID-19-positive adults. Here, we characterize and compare side effects between COVID-19 vaccines and determine whether reactogenicity is exacerbated by prior SARS-CoV-2 infection. METHODS: Participants were recruited across Ontario, Canada. Participant-reported demographic and COVID-19 vaccination data were collected using a questionnaire. Multivariable logistic regression was performed to assess whether vaccine manufacturer, type, and previous SARS-CoV-2 infection are associated with reactogenicity. RESULTS: Responses were obtained from n = 554 participants. Tiredness and localized side effects were the most common reactions across vaccine doses. For most participants, side effects occurred and subsided within 1-2 days. Recipients of Moderna mRNA and AstraZeneca vector vaccines reported reactions more frequently compared to recipients of a Pfizer-BioNTech mRNA vaccine. Previous SARS-CoV-2 infection was independently associated with developing side effects. CONCLUSIONS: We provide evidence of relatively mild and short-lived reactions reported by participants who have received approved COVID-19 vaccines.

Characterizing Risk Factors for Hospitalization and Clinical Characteristics in a Cohort of COVID-19 Patients Enrolled in the GENCOV Study.

The GENCOV study aims to identify patient factors which affect COVID-19 severity and outcomes. Here, we aimed to evaluate patient characteristics, acute symptoms and their persistence, and associations with hospitalization. Participants were recruited at hospital sites across the Greater Toronto Area in Ontario, Canada. Patient-reported demographics, medical history, and COVID-19 symptoms and complications were collected through an intake survey. Regression analyses were performed to identify associations with outcomes including hospitalization and COVID-19 symptoms. In total, 966 responses were obtained from 1106 eligible participants (87% response rate) between November 2020 and May 2022. Increasing continuous age (aOR: 1.05 [95%CI: 1.01-1.08]) and BMI (aOR: 1.17 [95%CI: 1.10-1.24]), non-White/European ethnicity (aOR: 2.72 [95%CI: 1.22-6.05]), hypertension (aOR: 2.78 [95%CI: 1.22-6.34]), and infection by viral variants (aOR: 5.43 [95%CI: 1.45-20.34]) were identified as risk factors for hospitalization. Several symptoms including shortness of breath and fever were found to be more common among inpatients and tended to persist for longer durations following acute illness. Sex, age, ethnicity, BMI, vaccination status, viral strain, and underlying health conditions were associated with developing and having persistent symptoms. By improving our understanding of risk factors for severe COVID-19, our findings may guide COVID-19 patient management strategies by enabling more efficient clinical decision making.

The care of critically ill adults with COVID-19 in Ontario pediatric intensive care units.

PURPOSE: To describe and review the experience of two pediatric intensive care units (PICUs) in Ontario, Canada, adapting and providing care to critically ill adults during the COVID-19 pandemic. CLINICAL FEATURES: At a time of extreme pressure to adult intensive care unit (ICU) capacity, two PICUs provided care to critically ill adults with COVID-19 pneumonia. Substantial yet rapid planning was required to facilitate safe delivery of critical care to adult patients while maintaining PICU services, including thoughtful development of care pathways and patient selection. To prepare clinical staff, several communication strategies, knowledge translation, skill consolidation, and system-adaptation mechanisms were developed. There was iterative adaptation of operational processes, including staffing models, specialist consultation, and the pharmacy. Care provided by the interprofessional teams was reoriented as appropriate to the needs of critically ill adults in close collaboration with adult ICU teams. Forty-one adults were admitted to the two PICUs over a 12-week period. In total, 36 patients (88%) received invasive ventilation, eight patients (20%) were supported with venovenous extracorporeal membrane oxygenation, and six patients (15%) received continuous renal replacement therapy. Four died in the PICU during this period. Feedback from staff included anxiety around reorienting practice to the care of critically ill adults, physical exhaustion, and psychological distress. Importantly, staff also reported a renewed sense of purpose with participation in the program. CONCLUSION: Though challenging, the experience has provided opportunity to enhance collaboration with partner institutions and improve the care of older children and adolescents in the PICU.

RéSUMé: OBJECTIF: Nous avions pour objectif de décrire et examiner l'expérience de deux unités de soins intensifs pédiatriques (USIP) en Ontario, au Canada, qui se sont adaptées et ont fourni des soins aux adultes gravement malades pendant la pandémie de COVID-19. CARACTéRISTIQUES CLINIQUES: À l'époque où la capacité des unités de soins intensifs (USI) pour adultes était extrêmement sollicitée, deux USIP ont prodigué des soins à des adultes gravement malades souffrant de pneumonie liée à la COVID-19. Une planification substantielle mais rapide a été nécessaire pour faciliter la prestation sécuritaire de soins intensifs à une patientèle adulte tout en maintenant les services de l'USIP, y compris l'élaboration réfléchie des trajectoires de soins et la sélection de la patientèle. Pour préparer le personnel clinique, plusieurs stratégies de communication, d'application des connaissances, de consolidation des compétences et de mécanismes d'adaptation du système ont été élaborées. Il y a eu une adaptation progressive des processus opérationnels, y compris des modèles de dotation, des consultations de spécialistes et de la pharmacie. Les soins fournis par les équipes interprofessionnelles ont été réorientés en fonction des besoins des adultes gravement malades en étroite collaboration avec les équipes adultes de soins intensifs. Quarante et une personnes adultes ont été admises dans les deux unités de soins intensifs pédiatriques sur une période de 12 semaines. Au total, 36 adultes (88 %) ont bénéficié d'une ventilation invasive, huit personnes (20 %) ont reçu une oxygénation par membrane extracorporelle veino-veineuse, et six (15 %) ont reçu un traitement substitutif de l'insuffisance rénale en continu. Quatre personnes sont décédées à l'USIP au cours de cette période. Les commentaires du personnel comprenaient de l'anxiété liée à la réorientation de leur pratique vers des soins à des adultes gravement malades, l'épuisement physique et la détresse psychologique. Fait important, le personnel a également signalé un regain de motivation lié à la participation de leur USIP à ce programme. CONCLUSION: Bien que difficile, l'expérience a permis d'améliorer la collaboration avec les établissements partenaires et d'améliorer les soins aux enfants plus âgé·es et aux adolescent·es de l'USIP.

Public knowledge of SARS-CoV-2 serological and viral lineage laboratory testing and result interpretation: A GENCOV study cross-sectional survey.

OBJECTIVES: Concepts related to SARS-CoV-2 laboratory testing and result interpretation can be challenging to understand. A cross-sectional survey of COVID-19 positive adults residing in Ontario, Canada was conducted to explore how well people understand SARS-CoV-2 laboratory tests and their associated results. DESIGN AND METHODS: Participants were recruited through fliers or by prospective recruitment of outpatients and hospitalized inpatients with COVID-19. Enrolled participants included consenting adults with a positive SARS-CoV-2 polymerase chain reaction test result. An 11-item questionnaire was developed by researchers, nurses, and physicians in the study team and was administered online between April 2021 to May 2022 upon enrolment into the study. RESULTS: Responses were obtained from 940 of 1106 eligible participants (85% participation rate). Most respondents understood 1) that antibody results should not influence adherence to social distancing measures (n = 602/888, 68%), 2) asymptomatic SARS-CoV-2 infection following test positivity (n = 698/888, 79%), 3) serological test sensitivity in relation to post-infection timeline (n = 540/891, 61%), and 4) limitations of experts' knowledge related to SARS-CoV-2 serology (n = 693/887, 78%). Conversely, respondents demonstrated challenges understanding 1) conflicting molecular and serological test results and their relationship with immune protection (n = 162/893, 18%) and 2) the impact of SARS-CoV-2 variants on vaccine effectiveness (n = 235/891, 26%). Analysis of responses stratified by sociodemographic variables identified that respondents who were either: 1) female, 2) more educated, 3) aged 18-44, 4) from a high-income household, or 5) healthcare workers responded expectedly more often. CONCLUSIONS: We have highlighted concepts related to SARS-CoV-2 laboratory tests and associated results which may be challenging to understand. The findings of this study enable us to identify 1) misconceptions related to various SARS-CoV-2 test results, 2) groups of individuals at risk, and 3) strategies to improve people's understanding of their test results.

Genome screening, reporting, and genetic counseling for healthy populations.

Rapid advancements of genome sequencing (GS) technologies have enhanced our understanding of the relationship between genes and human disease. To incorporate genomic information into the practice of medicine, new processes for the analysis, reporting, and communication of GS data are needed. Blood samples were collected from adults with a PCR-confirmed SARS-CoV-2 (COVID-19) diagnosis (target N = 1500). GS was performed. Data were filtered and analyzed using custom pipelines and gene panels. We developed unique patient-facing materials, including an online intake survey, group counseling presentation, and consultation letters in addition to a comprehensive GS report. The final report includes results generated from GS data: (1) monogenic disease risks; (2) carrier status; (3) pharmacogenomic variants; (4) polygenic risk scores for common conditions; (5) HLA genotype; (6) genetic ancestry; (7) blood group; and, (8) COVID-19 viral lineage. Participants complete pre-test genetic counseling and confirm preferences for secondary findings before receiving results. Counseling and referrals are initiated for clinically significant findings. We developed a genetic counseling, reporting, and return of results framework that integrates GS information across multiple areas of human health, presenting possibilities for the clinical application of comprehensive GS data in healthy individuals.

Types of clinical reasoning in a summative clerkship oral examination.

INTRODUCTION: Dual-process theory characterizes clinical reasoning (CR) as Type 1 (intuitive) and Type 2 (analytical) thinking. This study examined CR on a summative clinical clerkship structured clinical oral examination (SCOE). METHODS AND SUBJECTS: 511 clinical clerks at the University of Toronto underwent SCOEs. Type 1, Type 2, and Global CR performance were compared to other internal medicine clerkship assessments using descriptive statistics and Spearman correlations. RESULTS: Clinical clerks achieved mean marks >75% on the three clinical reasoning stations, on Type 1 and 2 CR tasks, and the overall SCOE. Performance on the SCOE CR stations correlated with each of the other clerkship assessments: written examination, inpatient, and ambulatory clinic assessments. The correlation of performance between Type 1 and Type 2 clinical reasoning tasks was statistically significant but weak (rs = 0.28). This suggests that defined measures of Type 1 and Type 2 reasoning were indeed assessing distinct constructs. CONCLUSION: Clinical clerks used both Type 1 and Type 2 reasoning with success. This study's characterization of Type 1 and Type 2 CR as separate domains, distinct from existing measures on the SCOE as well as the other clerkship assessments, can suggest a further addition to multimodal clerkship assessment.

Implementation of serological and molecular tools to inform COVID-19 patient management: protocol for the GENCOV prospective cohort study.

INTRODUCTION: There is considerable variability in symptoms and severity of COVID-19 among patients infected by the SARS-CoV-2 virus. Linking host and virus genome sequence information to antibody response and biological information may identify patient or viral characteristics associated with poor and favourable outcomes. This study aims to (1) identify characteristics of the antibody response that result in maintained immune response and better outcomes, (2) determine the impact of genetic differences on infection severity and immune response, (3) determine the impact of viral lineage on antibody response and patient outcomes and (4) evaluate patient-reported outcomes of receiving host genome, antibody and viral lineage results. METHODS AND ANALYSIS: A prospective, observational cohort study is being conducted among adult patients with COVID-19 in the Greater Toronto Area. Blood samples are collected at baseline (during infection) and 1, 6 and 12 months after diagnosis. Serial antibody titres, isotype, antigen target and viral neutralisation will be assessed. Clinical data will be collected from chart reviews and patient surveys. Host genomes and T-cell and B-cell receptors will be sequenced. Viral genomes will be sequenced to identify viral lineage. Regression models will be used to test associations between antibody response, physiological response, genetic markers and patient outcomes. Pathogenic genomic variants related to disease severity, or negative outcomes will be identified and genome wide association will be conducted. Immune repertoire diversity during infection will be correlated with severity of COVID-19 symptoms and human leucocyte antigen-type associated with SARS-CoV-2 infection. Participants can learn their genome sequencing, antibody and viral sequencing results; patient-reported outcomes of receiving this information will be assessed through surveys and qualitative interviews. ETHICS AND DISSEMINATION: This study was approved by Clinical Trials Ontario Streamlined Ethics Review System (CTO Project ID: 3302) and the research ethics boards at participating hospitals. Study findings will be disseminated through peer-reviewed publications, conference presentations and end-users.

Observational study of agreement between attending and trainee physicians on the surprise question: "Would you be surprised if this patient died in the next 12 months?"

BACKGROUND: Optimal end-of-life care requires identifying patients that are near the end of life. The extent to which attending physicians and trainee physicians agree on the prognoses of their patients is unknown. We investigated agreement between attending and trainee physician on the surprise question: "Would you be surprised if this patient died in the next 12 months?", a question intended to assess mortality risk and unmet palliative care needs. METHODS: This was a multicentre prospective cohort study of general internal medicine patients at 7 tertiary academic hospitals in Ontario, Canada. General internal medicine attending and senior trainee physician dyads were asked the surprise question for each of the patients for whom they were responsible. Surprise question response agreement was quantified by Cohen's kappa using Bayesian multilevel modeling to account for clustering by physician dyad. Mortality was recorded at 12 months. RESULTS: Surprise question responses encompassed 546 patients from 30 attending-trainee physician dyads on academic general internal medicine teams at 7 tertiary academic hospitals in Ontario, Canada. Patients had median age 75 years (IQR 60-85), 260 (48%) were female, and 138 (25%) were dependent for some or all activities of daily living. Trainee and attending physician responses agreed in 406 (75%) patients with adjusted Cohen's kappa of 0.54 (95% credible interval 0.41 to 0.66). Vital status was confirmed for 417 (76%) patients of whom 160 (38% of 417) had died. Using a response of "No" to predict 12-month mortality had positive likelihood ratios of 1.84 (95% CrI 1.55 to 2.22, trainee physicians) and 1.51 (95% CrI 1.30 to 1.72, attending physicians), and negative likelihood ratios of 0.31 (95% CrI 0.17 to 0.48, trainee physicians) and 0.25 (95% CrI 0.10 to 0.46, attending physicians). CONCLUSION: Trainee and attending physician responses to the surprise question agreed in 54% of cases after correcting for chance agreement. Physicians had similar discriminative accuracy; both groups had better accuracy predicting which patients would survive as opposed to which patients would die. Different opinions of a patient's prognosis may contribute to confusion for patients and missed opportunities for engagement with palliative care services.

The Canadian Medical Student Ultrasound Curriculum: A Statement From the Canadian Ultrasound Consensus for Undergraduate Medical Education Group.

OBJECTIVES: This study sought to establish by expert review a consensus-based, focused ultrasound curriculum, consisting of a foundational set of focused ultrasound skills that all Canadian medical students would be expected to attain at the end of the medical school program. METHODS: An expert panel of 21 point-of-care ultrasound and educational leaders representing 15 of 17 (88%) Canadian medical schools was formed and participated in a modified Delphi consensus method. Experts anonymously rated 195 curricular elements on their appropriateness to include in a medical school curriculum using a 5-point Likert scale. The group defined consensus as 70% or more experts agreeing to include or exclude an element. We determined a priori that no more than 3 rounds of voting would be performed. RESULTS: Of the 195 curricular elements considered in the first round of voting, the group reached consensus to include 78 and exclude 24. In the second round, consensus was reached to include 4 and exclude 63 elements. In our final round, with 1 additional item added to the survey, the group reached consensus to include an additional 3 and exclude 8 elements. A total of 85 curricular elements reached consensus to be included, with 95 to be excluded. Sixteen elements did not reach consensus to be included or excluded. CONCLUSIONS: By expert opinion-based consensus, the Canadian Ultrasound Consensus for Undergraduate Medical Education Group recommends that 85 curricular elements be considered for inclusion for teaching in the Canadian medical school focused ultrasound curricula.

Cost-Efficient Medical Education: An Innovative Approach to Creating Educational Products.

BACKGROUND: Cost is a barrier to creating educational resources, and new educational initiatives are often limited in distribution. Medical training programs must develop strategies to create and implement cost-effective educational programming. OBJECTIVE: We developed high-quality medical programming in procedural instruction with efficient economics, reaching the most trainees at the lowest cost. METHODS: The Just-In-Time online procedural program was developed at the University of Toronto in Canada, aiming to teach thoracentesis, paracentesis, and lumbar puncture skills to internal medicine trainees. Commercial vendors quoted between CAD $50,000 and $100,000 to create 3 comprehensive e-learning procedural modules-a cost that was prohibitive. Modules were therefore developed internally, utilizing 4 principles aimed at decreasing costs while creating efficiencies: targeting talent, finding value abroad, open source expansion, and extrapolating efficiency. RESULTS: Procedural modules for thoracentesis, paracentesis, and lumbar puncture were created for a total cost of CAD $1,200, less than 3% of the anticipated cost in utilizing traditional commercial vendors. From November 2016 until October 2018, 1800 online instructional sessions have occurred, with over 3600 pageviews of content utilized. While half of the instructional sessions occurred within the city of Toronto, utilization was documented in 10 other cities across Canada. CONCLUSIONS: The Just-in-Time online instructional program successfully created 3 procedural modules at a fraction of the anticipated cost and appeared acceptable to residents based on website utilization.

Ethylene and hydrogen peroxide regulate formation of a sterol-enriched domain essential for wall labyrinth assembly in transfer cells.

Transfer cells (TCs) facilitate high rates of nutrient transport into, and within, the plant body. Their transport function is conferred by polarized wall ingrowth papillae, deposited upon a specialized uniform wall layer, that form a scaffold supporting an amplified area of plasma membrane enriched in nutrient transporters. We explored the question of whether lipid-enriched domains of the TC plasma membrane could serve as organizational platforms for proteins regulating the construction of the intricate TC wall labyrinth using developing Vicia faba cotyledons. When these cotyledons are placed in culture, their adaxial epidermal cells trans-differentiate to a TC phenotype regulated by auxin, ethylene, extracellular hydrogen peroxide (apoH2O2), and cytosolic Ca2+ ([Ca2+]cyt) arranged in series. Staining cultured cotyledons with the sterol-specific dye, Filipin III, detected a polarized sterol-enriched domain in the plasma membrane of their trans-differentiating epidermal transfer cells (ETCs). Ethylene activated sterol biosynthesis while extracellular apoH2O2 directed sterol-enriched vesicles to fuse with the outer periclinal region of the ETC plasma membrane. The sterol-enriched domain was essential for generating the [Ca2+]cyt signal and orchestrating construction of both the uniform wall layer and wall ingrowth papillae. A model is presented outlining how the sterol-enriched plasma membrane domain forms and functions to regulate wall labyrinth assembly.

Professional Responsibilities and Personal Impacts: Residents' Experiences as Participants in Education Research.

PURPOSE: Although the field of medical education research is growing and residents are increasingly recruited to participate as subjects in research studies, little is known about their experiences. The goal of this study was to explore the experiences and perceptions of residents who are study participants in medical education research. METHOD: A phenomenographic approach was chosen to examine the range of residents' experiences as research participants. A maximum variation sampling strategy was used to identify residents with diverse experiences. Semistructured interviews that explored experiences as research participants were conducted with 19 residents in internal medicine, general surgery, and pediatrics at the University of Toronto in 2015-2016. RESULTS: The perceptions and experiences of participants fell into two categories. First, participation was seen as a professional responsibility to advance the profession, including a desire to improve future educational practices and a sense of responsibility to contribute to the academic cause. Second, the experience was noted for its personal impact, including benefits (e.g., receiving monetary incentives or novel educational experiences) and risks (e.g., coercion and breaches of confidentiality). The time required to participate in a study was identified as one of the most important factors affecting willingness to participate and the impact of participation. CONCLUSIONS: Being a participant in medical education research can be perceived in different ways. Understanding the view of resident participants is important to optimize potential benefits and minimize risks and negative consequences for them, thus fostering ready participation and high-quality research.

Quality of Widely Available Video Instructional Materials for Point-of-Care Ultrasound-Guided Procedure Training in Internal Medicine.

OBJECTIVES: Many instructional materials for point-of-care ultrasound (US)-guided procedures exist; however, their quality is unknown. This study assessed widely available educational videos for point-of-care US-guided procedures relevant to internal medicine: central venous catheterization, thoracentesis, and paracentesis. METHODS: We searched Ovid MEDLINE, YouTube, and Google to identify videos for point-of-care US-guided paracentesis, thoracentesis, and central venous catheterization. Videos were evaluated with a 5-point scale assessing the global educational value and a checklist based on consensus guidelines for competencies in point-of-care US-guided procedures. RESULTS: For point-of-care US-guided central venous catheterization, 12 videos were found, with an average global educational value score ± SD of 4.5 ± 0.7. Indications to abort the procedure were discussed in only 3 videos. Five videos described the indications and contraindications for performing central venous catheterization. For point-of-care US-guided thoracentesis, 8 videos were identified, with an average global educational value score of 4.0 ± 0.9. Only one video discussed indications to abort the procedure, and 3 videos discussed sterile technique. For point-of-care US-guided paracentesis, 7 videos were included, with an average global educational value score of 4.1 ± 0.9. Only 1 video discussed indications to abort the procedure, and 2 described the location of the inferior epigastric artery. CONCLUSIONS: The 27 videos reviewed contained good-quality general instruction. However, we noted a lack of safety-related information in most of the available videos. Further development of resources is required to teach internal medicine trainees skills that focus on the safety of point-of-care US guidance.

Does Making the Numerical Values of Verbal Anchors on a Rating Scale Available to Examiners Inflate Scores on a Long Case Examination?

PURPOSE: Rating scales are frequently used for scoring assessments in medical education. The effect of changing the structural elements of a rating scale on students' examination scores has received little attention in the medical education literature. This study assessed the impact of making the numerical values of verbal anchors on a rating scale available to examiners in a long case examination (LCE). METHOD: During the 2011-2012 academic year, the numerical values of verbal anchors on a rating scale for an internal medicine clerkship LCE were made available to faculty examiners. Historically, and specifically in the control year of 2010-2011, examiners only saw the scale's verbal anchors and were blinded to the associated numerical values. To assess the impact of this change, the authors compared students' LCE scores between the two cohort years. To assess for differences between the two cohorts, they compared students' scores on other clerkship assessments, which remained the same between the two cohorts. RESULTS: From 2010-2011 (n = 226) to 2011-2012 (n = 218), the median LCE score increased significantly from 82.11% to 85.02% (P < .01). Students' performance on the other clerkship assessments was similar between cohorts. CONCLUSIONS: Providing examiners with the numerical values of verbal anchors on a rating scale, in addition to the verbal anchors themselves, led to a significant increase in students' scores on an internal medicine clerkship LCE. When constructing or changing rating scales, educators must consider the potential impact of the rating scale structure on students' scores.

Defining Competencies for Ultrasound-Guided Bedside Procedures: Consensus Opinions From Canadian Physicians.

OBJECTIVES: This study sought to define the competencies in ultrasound knowledge and skills that are essential for medical trainees to master to perform ultrasound-guided central venous catheterization, thoracentesis, and paracentesis. METHODS: Experts in the 3 procedures were identified by a snowball technique through 3 Canadian tertiary academic health centers. Experts completed 2 rounds of surveys, including an 88-item central venous catheterization survey, a 96-item thoracentesis survey, and an 89-item paracentesis survey. For each item, experts were asked to determine whether the knowledge/skill described was essential, important, or marginal. Consensus on an item was defined as agreement by at least 80% of the experts. For items on which consensus was not reached during the first round of surveys, a second survey was created in which the experts were asked to rate the item in a binary fashion (essential/important versus marginal/unimportant). RESULTS: Of the 27 experts invited to complete each survey, 25 (93%) completed the central venous catheterization survey; 22 (81%) completed the thoracentesis survey; and 23 (85%) completed the paracentesis survey. The experts represented 8 specialties from 8 cities within Canada. A total of 22, 32, and 28 items were determined to be essential competencies for central venous catheterization, thoracentesis, and paracentesis, respectively, whereas 47, 38, and 42 competencies were determined to be important, and 8, 13, and 10 were determined to be marginal. The ability to perform real-time direct ultrasound guidance was considered essential only for the performance of central venous catheterization insertion. CONCLUSIONS: Our study presents expert consensus-derived ultrasound competencies that should be considered during the design and implementation of procedural skills training for learners.

An Equivalence Trial Comparing Instructor-Regulated With Directed Self-Regulated Mastery Learning of Advanced Cardiac Life Support Skills.

INTRODUCTION: Instructor-led simulation-based mastery learning of advanced cardiac life support (ACLS) skills is an effective and focused approach to competency-based education. Directed self-regulated learning (DSRL) may be an effective and less resource-intensive way to teach ACLS skills. METHODS: Forty first-year internal medicine residents were randomized to either simulation-based DSRL or simulation-based instructor-regulated learning (IRL) of ACLS skills using a mastery learning model. Residents in each intervention completed pretest, posttest, and retention test of their performance in leading an ACLS response to a simulated scenario. Performance tests were assessed using a standardized checklist. Residents in the DSRL intervention were provided assessment instruments, a debriefing guide, and scenario-specific teaching points, and they were permitted to access relevant online resources. Residents in the IRL intervention had access to the same materials; however, the teaching and debriefing were instructor led. RESULTS: Skills of both the IRL and DSRL interventions showed significant improvement after the intervention, with an average improvement on the posttest of 21.7%. After controlling for pretest score, there was no difference between intervention arms on the posttest [F(1,37) = 0.02, P = 0.94] and retention tests [F(1,17) = 1.43, P = 0.25]. Cost savings were realized in the DSRL intervention after the fourth group (16 residents) had completed each intervention, with an ongoing savings of $80 per resident. CONCLUSIONS: Using a simulation-based mastery learning model, we observed equivalence in learning of ACLS skills for the DSRL and IRL conditions, whereas DSRL was more cost effective.

Workplace-Based Assessment of Internal Medicine Resident Diagnostic Accuracy.

BACKGROUND: Making an accurate diagnosis is a core skill residents must develop. Assessments of this skill and decisions to grant residents clinical independence often are based on global impressions. A workplace-based assessment of diagnostic accuracy could be a useful part of a competency-based assessment program and could inform decisions about granting residents independence. INNOVATION: We developed a method for measuring diagnostic accuracy that was integrated into the workflow of internal medicine residents and attending physicians. METHODS: Four senior medical residents and 6 attending physicians working in the internal medicine clinical teaching unit of a tertiary hospital participated in this study. To determine their diagnostic accuracy, residents documented a leading diagnosis for each patient they evaluated in the emergency department. After reviewing each case with the resident and after examining the patient, the resident's attending physician documented the diagnosis. Discharge diagnosis was determined by retrospective chart review to allow determination of resident and attending physician diagnostic accuracy. Data were collected for 240 consecutive patients referred for a medicine consultation. RESULTS: Resident diagnostic accuracy was 66% (95% CI 60-72), whereas attending physician accuracy was significantly higher at 79% (95% CI 74-84, P < .001). By logistic regression, the accuracy of the attending physician was found to be influenced by the accuracy of the resident. Participants felt this process motivated them to improve their clinical reasoning. CONCLUSIONS: Measuring resident diagnostic accuracy provides information that could be used in a competency-based assessment program to provide feedback and motivation to stimulate performance improvement.