Inter-school variations in the standard of examiners' graduation-level OSCE judgements.

INTRODUCTION: Ensuring equivalence in high-stakes performance exams is important for patient safety and candidate fairness. We compared inter-school examiner differences within a shared OSCE and resulting impact on students' pass/fail categorisation. METHODS: The same 6 station formative OSCE ran asynchronously in 4 medical schools, with 2 parallel circuits/school. We compared examiners' judgements using Video-based Examiner Score Comparison and Adjustment (VESCA): examiners scored station-specific comparator videos in addition to 'live' student performances, enabling 1/controlled score comparisons by a/examiner-cohorts and b/schools and 2/data linkage to adjust for the influence of examiner-cohorts. We calculated score impact and change in pass/fail categorisation by school. RESULTS: On controlled video-based comparisons, inter-school variations in examiners' scoring (16.3%) were nearly double within-school variations (8.8%). Students' scores received a median adjustment of 5.26% (IQR 2.87-7.17%). The impact of adjusting for examiner differences on students' pass/fail categorisation varied by school, with adjustment reducing failure rate from 39.13% to 8.70% (school 2) whilst increasing failure from 0.00% to 21.74% (school 4). DISCUSSION: Whilst the formative context may partly account for differences, these findings query whether variations may exist between medical schools in examiners' judgements. This may benefit from systematic appraisal to safeguard equivalence. VESCA provided a viable method for comparisons.

A realist evaluation of how, why and when objective structured clinical exams (OSCEs) are experienced as an authentic assessment of clinical preparedness.

INTRODUCTION: Whilst rarely researched, the authenticity with which Objective Structured Clinical Exams (OSCEs) simulate practice is arguably critical to making valid judgements about candidates' preparedness to progress in their training. We studied how and why an OSCE gave rise to different experiences of authenticity for different participants under different circumstances. METHODS: We used Realist evaluation, collecting data through interviews/focus groups from participants across four UK medical schools who participated in an OSCE which aimed to enhance authenticity. RESULTS: Several features of OSCE stations (realistic, complex, complete cases, sufficient time, autonomy, props, guidelines, limited examiner interaction etc) combined to enable students to project into their future roles, judge and integrate information, consider their actions and act naturally. When this occurred, their performances felt like an authentic representation of their clinical practice. This didn't work all the time: focusing on unavoidable differences with practice, incongruous features, anxiety and preoccupation with examiners' expectations sometimes disrupted immersion, producing inauthenticity. CONCLUSIONS: The perception of authenticity in OSCEs appears to originate from an interaction of station design with individual preferences and contextual expectations. Whilst tentatively suggesting ways to promote authenticity, more understanding is needed of candidates' interaction with simulation and scenario immersion in summative assessment.

The association of denture wearing with reduced lung function and increased airflow limitation in 58-72 year old men.

OBJECTIVE: To investigate the association between denture wearing and airflow limitation in men in Northern Ireland enrolled in the Prospective Epidemiological Study of Myocardial Infarction (PRIME) study. METHODS: A case-control design was used to study partially dentate men. Cases were men aged 58-72 years who were confirmed as denture wearers. Controls were never denture wearers who were matched by age (± 1 month) and smoking habit to the cases. The men had a periodontal assessment and completed a questionnaire detailing their medical history, dental history and behaviours, social circumstances, demographic background and tobacco use. Physical examination and spirometry measurements of forced expiratory volume in one second (FEV1) and forced vital capacity (FVC) were also undertaken. Spirometry data for edentulous men who wore complete dentures were compared with that recorded for the partially dentate men studied. RESULTS: There were 353 cases who were partially dentate and were confirmed denture wearers. They were matched for age and smoking habit to never denture wearer controls. The cases had an FEV1 that was on average 140 ml lower than the controls, p = 0.0013 and a 4% reduction in percent predicted FEV1, p = 0.0022. Application of the GOLD criteria indicated that 61 (17.3%) of the cases had moderate to severe airflow limitation compared with 33 (9.3%) of controls, p = 0.0051. Fully adjusted multivariable analysis showed that partially dentate men who were denture wearers were significantly more likely (p = 0.01) to have moderate to severe airflow reduction with an adjusted odds ratio (OR) of 2.37 (95% confidence intervals 1.23-4.55). In the 153 edentulous men studied moderate to severe airflow limitation was recorded in 44 (28.4%), which was significantly higher than in the partially dentate denture wearers (p = 0.017), and the men who had never worn a denture (p<0.0001). CONCLUSION: Denture wearing was associated with an increased risk of moderate to severe airflow limitation in the cohort of middle-aged Western European men studied.

Subgingival microbial diversity and respiratory decline: A cross-sectional study.

AIM: To investigate whether there is an association between subgingival microbial diversity and reduced respiratory function. MATERIALS AND METHODS: A group of dentate 58-72-year-old men in Northern Ireland had a comprehensive periodontal examination including subgingival plaque sampling. DNA was extracted from plaque samples and the V1-V3 regions of the 16S rRNA gene were analysed by high-throughput sequencing and a microbial diversity index (MDI) was derived. Spirometry measurements were made using a wedge bellows spirometer. The primary outcome variable of interest was the percentage of predicted forced expiratory volume in 1 s (% predicted FEV1 ). Analysis included multiple linear regression with adjustment for various confounders. RESULTS: Five-hundred and seven men were included in the analysis. The mean age was 63.6 years (SD = 3.1). Of these, 304 (60.0%) men had no or mild periodontitis, 105 (20.7%) had moderate periodontitis and 98 (19.3%) had severe periodontitis. Multiple linear regression analysis showed that a one unit increase in MDI was associated with a 0.71% loss (95% confidence interval: 0.06%-1.35%; p = .03) in % predicted FEV1 after adjustment for all confounders. CONCLUSIONS: In this group of dentate men from Northern Ireland, subgingival microbial diversity was associated with reduced respiratory function.

Revised paper ASIM-D-21-00055R1: "Consulting properly rather than acting": advocating for real patient involvement in summative OSCEs.

BACKGROUND: In this "Advancing simulation practice" article, we offer an expose of the involvement of real patients in Objective Structured Clinical Examinations (OSCEs), inviting educators who traditionally involve solely SPs in their summative OSCEs to consider the practice. The need for standardisation in summative assessments can make educators understandably wary to try this, even if the rhetoric to involve real patients is accepted. We offer this as an instance of the tussle between standardisation and validity experienced throughout health professions education. MAIN TEXT: We offer our experience and empirical evidence of this simulation practice, based on an institutional ethnographic examination of the involvement of real patients in summative OSCEs from an undergraduate medical school in the UK. Our critique demonstrates the merits of this approach as an assessment environment closer to the real clinical environments where these soon-to-be doctors interact in a more authentic way with real patients and their illness experiences. We balance this against the extra work required for all involved and suggest the biggest challenge is in the reorientation work required for both Faculty and students who are institutionalised to expect standardisation above all in assessment. CONCLUSION: We advocate for involving real patients in summative OSCEs and hope that readers may feel compelled and empowered to foster this shift in mindset required to introduce this practice into their assessments.

Thoracic ultrasound competence for ultrasound guided pleural procedures: The creation and validation of an assessment tool for use in the certification of basic thoracic ultrasound competence.

OBJECTIVES: Focused thoracic ultrasound (TUS) provides an increased safety profile when undertaking invasive pleural procedures. This has led to the requirement for defined curricula, high quality teaching and robust, validated assessment tools among physicians to ensure patient safety and clinical excellence. Current UK practice is based almost exclusively on expert consensus, but assessment methods employed have been shown to have low reliability and validity and are potentially open to bias. As a result, several assessment tools have been developed, although each has its own limitations. METHODS: This study aimed to develop and validate an assessment tool corresponding to those skills associated with the most basic level of practice, defined recently as an emergency level operator in the British Thoracic Society Training Standards for Thoracic Ultrasound. RESULTS: A total of 27 candidates were enrolled by two examiners based in Belfast and Oxford over a 10-month period between February and November 2019. Mean score of the inexperienced group was 44.3 (95% CI 39.2-49.4, range 28-54) compared with 74.9 (95% CI 72.8-77, range 64-80) in the experienced group providing an estimated mean difference of 30.7 between the two groups (95% CI 24.7-36.7; p < .001). CONCLUSIONS: This tool appears to discriminate between trainees with limited experience of TUS performance and those with no experience. It has the potential to form part of the assessment strategy for trainees in the United Kingdom and beyond, alongside well established assessment tools in postgraduate training.

Enhancing authenticity, diagnosticity and equivalence (AD-Equiv) in multicentre OSCE exams in health professionals education: protocol for a complex intervention study.

INTRODUCTION: Objective structured clinical exams (OSCEs) are a cornerstone of assessing the competence of trainee healthcare professionals, but have been criticised for (1) lacking authenticity, (2) variability in examiners' judgements which can challenge assessment equivalence and (3) for limited diagnosticity of trainees' focal strengths and weaknesses. In response, this study aims to investigate whether (1) sharing integrated-task OSCE stations across institutions can increase perceived authenticity, while (2) enhancing assessment equivalence by enabling comparison of the standard of examiners' judgements between institutions using a novel methodology (video-based score comparison and adjustment (VESCA)) and (3) exploring the potential to develop more diagnostic signals from data on students' performances. METHODS AND ANALYSIS: The study will use a complex intervention design, developing, implementing and sharing an integrated-task (research) OSCE across four UK medical schools. It will use VESCA to compare examiner scoring differences between groups of examiners and different sites, while studying how, why and for whom the shared OSCE and VESCA operate across participating schools. Quantitative analysis will use Many Facet Rasch Modelling to compare the influence of different examiners groups and sites on students' scores, while the operation of the two interventions (shared integrated task OSCEs; VESCA) will be studied through the theory-driven method of Realist evaluation. Further exploratory analyses will examine diagnostic performance signals within data. ETHICS AND DISSEMINATION: The study will be extra to usual course requirements and all participation will be voluntary. We will uphold principles of informed consent, the right to withdraw, confidentiality with pseudonymity and strict data security. The study has received ethical approval from Keele University Research Ethics Committee. Findings will be academically published and will contribute to good practice guidance on (1) the use of VESCA and (2) sharing and use of integrated-task OSCE stations.

Systemic inflammation and the relationship between periodontitis, edentulism, and all-cause mortality: A 17-year prospective cohort study.

AIM: The aim was to investigate the role of systemic inflammation in the relationship between periodontitis, edentulism, and all-cause mortality in a group of men in Northern Ireland aged 58-72 years. MATERIALS AND METHODS: A representative sample of 1558 men had a detailed dental examination between 2001 and 2003. The primary end point was death from any cause. Cox's proportional hazards model was used to assess the longitudinal relationship between periodontitis, edentulism, and all-cause mortality. Accelerated failure time modelling was performed to investigate the mediating role of systemic inflammation. RESULTS: Mean age of the men at baseline was 64.3 (standard deviation 2.9) years. During a median follow-up of 17 years, 500 (32.1%) men died. After adjustment for confounding variables, compared to men with no/mild periodontitis, edentulous men had a hazard ratio for all-cause mortality of 1.52 (95% confidence interval [CI] 1.16-1.99) p < .01 and for those with severe periodontitis, it was 1.34 (95% CI 1.06-1.70) p = .01. Systemic inflammation accounted only for a minor mediating pathway effect of 10%. CONCLUSIONS: There was evidence in this group of men that those who were edentulous or had severe periodontitis had a significantly increased risk of all-cause mortality. Systemic inflammation was not a major explanatory mediator of this association.

Scenes, symbols and social roles: raising the curtain on OSCE performances.

INTRODUCTION: Objective structured clinical examinations (OSCEs) are a complex form of assessment, where candidates can interact with 'patients' in a constructed socio-clinical encounter. Conceptualizing OSCEs as a complex socially and culturally situated activity offers important research affordances. There are concerns that OSCEs may encourage more strategic 'tick-box' candidate behaviours and have a potential negative impact on learner identity formation. This study explored, at a micro-level, the social roles and behaviours occurring within the OSCE triad of simulated patients, candidates and examiners. We used a theoretical framework drawn from Goffman's dramaturgy metaphor. METHODS: OSCE candidates, examiners and simulated patients were invited, consented and recruited using maximal variation sampling. Participants were allocated to a summative OSCE circuit that had unobtrusive video cameras. Video footage of 18 stations was transcribed. Analysis was interpretative and iterative until a rich and thick description was achieved. RESULTS: Focusing on elements of Goffman's dramaturgy metaphor, we foregrounded our analysis by considering the performers, costumes, props and the theatre of the OSCE. A combination of symbols, both physical and semiotic, was used to construct and maintain layered roles and identities within this tightly defined socio-clinical setting. Informed by this foregrounding, we then considered the social interactions and behaviours within the OSCE: 'Creating the right impression?', 'A performance of contradictions?' and 'Simulated patients: patients or props?' DISCUSSION: In the pursuit of standardization, OSCEs have potential to mediate less desirable test-taking behaviours that are not entirely patient-centric, and beyond this may have an impact on professional identity. Whilst OSCE checklists provide objectivity, they have potential to promote a presentation of self that is in tension with good medical practice. The certainty of checklists needs to be looked at afresh in order to better reflect the many uncertainties that doctors face in real clinical practice. This research opens up new ways of thinking and enhancing future assessment practices.

Thoracic ultrasound competence for ultrasound-guided pleural procedures.

Focused thoracic ultrasound has become essential in the guidance and direction of pleural interventions to reduce unwanted complications and as a result now forms a crucial component of physician training. Current training standards along with assessment methods vary widely, and are often not robust enough to ensure adequate competence.This review assesses the current state of training and assessment of thoracic ultrasound competence in various settings, allowing comparison with alternative competency based programmes. Future directions for training and assessment of thoracic ultrasound competence are discussed.

Chronic periodontitis and reduced respiratory function.

OBJECTIVE: To investigate whether there was an association between chronic periodontitis (CP) and reduced respiratory function. METHODS: A group of dentate 58- to 72-year-old men in Northern Ireland had a comprehensive periodontal examination. Parallel to the periodontal examination, participants completed questionnaires gathering information on their medical history, social circumstances, demographic background and tobacco use. A physical examination assessed anthropometric measures. Fasting blood samples were obtained and analysed for high-sensitivity C-reactive protein (hs-CRP). Spirometry measures were performed using a wedge bellows spirometer (Vitalograph S Model). The primary outcome variable of interest was the percentage predicted forced expiratory volume in one-second (% predicted FEV1 ). Analysis included multiple linear regression with adjustment for various confounders and a regression-based mediation analysis. RESULTS: A total of 1,380 men were included in the analysis. The mean age was 63.7 years (SD 3.0). Multiple linear regression analysis showed that a doubling in mean clinical attachment loss (CAL) equated to a -3.33% (95% CI: -4.80, -1.86), p < 0.001 change in % predicted FEV1 after adjustment for all other potential confounding variables. Systemic inflammation, as measured by hs-CRP, only accounted for a minor mediating pathway effect (9%). CONCLUSIONS: In this homogenous group of dentate men, CP was significantly associated with a reduced respiratory function.

Fluency training in medical education: Improving competence in IV fluid therapy knowledge and skills.

This article was migrated. The article was marked as recommended. Objectives: Intravenous fluid (IV) therapy is an important component of care for many hospital patients, especially in perioperative and acute care settings. However, errors in fluid composition and dosing can be life-threatening. To achieve competent professional performance, i.e., accurate and fluent, it is vitally important that medical students receive effective training in IV fluid therapy. Methods: In this study, we explored how Precision Teaching (PT), a behaviour analytic teaching method, can enhance outcomes of usual medical education techniques. A total of 178 third-year medical students participated in the study during the IV fluid therapy training week. All students completed a multiple-choice test pre- and post-training. In addition to standard IV fluid therapy teaching, the experimental intervention group (n=83 students) used SAFMEDS ( Say All Fast Minute Every Day Shuffled) cards approximately 3-5 times per day for 5 days. The other 95 students (control group) received teaching as usual, but did not undergo the additional training. Results: Results show that the SAFMEDS boosted performance of the intervention group on the MCQ by 20 percentage points when compared to the control group. Fluency (accuracy and speed) of performance on SAFMED trials increased markedly during the intervention week and there was evidence that weaker students benefitted in particular. Conclusions: Implications for medical education are outlined.

Keratinocyte growth factor for the treatment of the acute respiratory distress syndrome (KARE): a randomised, double-blind, placebo-controlled phase 2 trial.

BACKGROUND: Data from in-vitro, animal, and human lung injury models suggest that keratinocyte growth factor (KGF) might be beneficial in acute respiratory distress syndrome (ARDS). The objective of this trial was to investigate the effect of KGF in patients with ARDS. METHODS: We did a double-blind, allocation concealed, randomised, placebo-controlled phase 2 trial in two intensive care units in the UK, involving patients fulfilling the American-European Consensus Conference Definition of ARDS. Patients were randomly assigned (1:1) by computer-generated randomisation schedule with variable block size stratified by site and presence of severe sepsis requiring vasopressors to receive either recombinant human KGF (palifermin 60 µg/kg) or placebo (0·9% sodium chloride solution) daily for a maximum of 6 days. Both patients and investigators were masked to treatment. The primary endpoint was oxygenation index (OI) at day 7. Analyses were by intention to treat. The trial is registered with International Standard Randomised Controlled Trial Registry, number ISRCTN95690673. FINDINGS: Between Feb 23, 2011, and Feb 26, 2014, 368 patients were assessed for eligibility for inclusion in the trial. Of the 60 patients recruited, 29 patients were randomly assigned to receive KGF and 31 to placebo; all were included in the analysis of the primary outcome. There was no significant difference between the two groups in OI at day 7 (mean 62·3 [SD 57·8] in the KGF group, 43·1 [33·5] in the placebo group; mean difference 19·2, 95% CI -5·6 to 44·0, p=0·13). Of interest, although not defined as outcome measures a priori, the KGF group, compared with placebo, had fewer median ventilator-free days (1 day [IQR 0 to 17] in the KGF group vs 20 days [13-22] in the placebo group; difference -8 days, 95% CI -17 to -2; p=0·0002), a longer median duration of ventilation in survivors to day 90 (16 days [IQR 13-30] in the KGF group vs 11 days [8-16] in the placebo group; difference 6 days, 95% CI 2 to 14; p=0·002), and a higher mortality at 28 days (nine [31%] vs three [10%] deaths; risk ratio 3·2, 95% CI 1·0 to 10·7, p=0·054). Adverse events were more frequent in the KGF group than the placebo group (14 vs 5 events; odds ratio 4·9, 95% CI 1·3 to 20·3, p=0·008). The two adverse events assessed as related to KGF were due to pyrexia. INTERPRETATION: KGF did not improve physiological or clinical outcomes in ARDS and might be harmful to patient health. FUNDING: The Northern Ireland Public Health Agency Research and Development Division.

The association between subgingival periodontal pathogens and systemic inflammation.

AIM: To investigate associations between periodontal disease pathogens and levels of systemic inflammation measured by C-reactive protein (CRP). METHODS: A representative sample of dentate 60-70-year-old men in Northern Ireland had a comprehensive periodontal examination. Men taking statins were excluded. Subgingival plaque samples were analysed by quantitative real time PCR to identify the presence of Aggregatibacter actinomycetemcomitans, Porphyromonas gingivalis, Treponema denticola and Tannerella forsythia. High-sensitivity CRP (mg/l) was measured from fasting blood samples. Multiple linear regression analysis was performed using log-transformed CRP concentration as the dependent variable, with the presence of each periodontal pathogen as predictor variables, with adjustment for various potential confounders. RESULTS: A total of 518 men (mean age 63.6 SD 3.0 years) were included in the analysis. Multiple regression analysis showed that body mass index (p < 0.001), current smoking (p < 0.01), the detectable presence of P. gingivalis (p < 0.01) and hypertension (p = 0.01), were independently associated with an increased CRP. The detectable presence of P. gingivalis was associated with a 20% (95% confidence interval 4-35%) increase in CRP (mg/l) after adjustment for all other predictor variables. CONCLUSION: In these 60-70-year-old dentate men, the presence of P. gingivalis in subgingival plaque was significantly associated with a raised level of C-reactive protein.