ABSTRACT
The Medical Students' Non-Technical Skills (Medi-StuNTS) is a behavioural marker scheme (BMS) designed to assess non-technical skills (NTS) in medical students in emergency simulations. This study aimed to assess the evidence for validity and usability of Medi-StuNTS by naive, near-peer educators. Nine doctors assessed four students in simulations of common medical emergencies. The scores were used to assess inter-rater reliability, inter-class correlation, and observability. Students and assessors completed questionnaires that assessed the tool's usability and consequence. Inter-rater agreement across all skill elements was "high" with rWG scores >0.8. An inter-class correlation was "good" with ICC3K kappa scores of 0.86 and 0.89 overall, when measured per simulation and per skills element respectively. Overall skill observability was high (>80%) except for coping with stress. Assessors found the tool "difficult to use" but "useful for feeding back in a constructive way". Students appreciated the comprehensiveness of the feedback as well as knowing what to expect during debriefs. This study has shown that the Medi-StuNTS BMS has good usability and evidence of validity in naive assessors and near-peer educators. It shows the particularly good internal structure and overall beneficial consequences. Further study will be necessary to understand how best to deploy it in formative and summative contexts.
ABSTRACT
BACKGROUND: Ankle fractures are one of the most common fractures in adults aged 20-65 years. The British Orthopaedic Association (BOA) and British Orthopaedic Foot and Ankle Society (BOFAS) jointly produced Standards for Trauma (BOAST) BOAST 12, with the aim of reducing morbidity by standardising care of these injuries. The primary aim of the AUGMENT study was to determine the extent and clinical effect of variation from BOAST 12. METHODS: AUGMENT was a multi-centre prospective trainee led audit of consecutive patients presenting with an ankle fracture within a four-week period. Data were collected on patient demographics, comorbidities, management and 12-week outcome. The BOAST 12 standards were divided into four subgroups; documentation, imaging, management and follow-up. Percentage compliance with each subgroup was analysed. A multivariate logistic regression analysis was used to determine impact of overall compliance on likelihood of discharge in follow-up period. FINDINGS: 971 patients were included across 52 sites. The overall rate of BOAST 12 compliance was 41.7%. Variations in practice were observed in clinical documentation, especially of neurovascular status, (40.7%) and VTE assessment (61.5%). Patient management compliance with all 16 of the BOAST 12 standards was associated with a higher rate of discharge during the 12-week follow-up period (p = 0.005). CONCLUSION: AUGMENT has demonstrated that the management of ankle fractures is variable across the UK. Over half of patients had aspects of their care that were not BOAST 12 compliant. When compliance was observed, it was associated with earlier discharge from orthopaedic care.
