Deconstructing programmatic assessment.

We describe programmatic assessment and the problems it might solve in relation to assessment and learning, identify some models implemented internationally, and then outline what we believe are programmatic assessment's key components and what these components might achieve. We then outline some issues around implementation, which include blueprinting, data collection, decision making, staff support, and evaluation. Rather than adopting an all-or-nothing approach, we suggest that elements of programmatic assessment can be gradually introduced into traditional assessment systems.

Disorganized junior doctors fail the MRCP (UK).

Career progression during undergraduate and early postgraduate years is currently determined by successfully passing examinations. Both academic factors (secondary school examination results, learning style and training opportunities) and non-academic factors (maturity, ethnic origin, gender and motivation) have been identified as predicting examination outcome. Few studies have examined organization skills. Disorganized medical students are more likely to perform poorly in end-of-year examinations but this observation has not been examined in junior doctors. This study asked whether organization skills relate to examination outcome amongst junior doctors taking the clinical Part II examination for the Membership of the Royal College of Physicians (Practical Assessment of Clinical Examination Skills). The study was conducted prospectively at four consecutive clinical courses that provided clinical teaching and practice to prepare trainees for the examination. Arrival time at registration for the course was the chosen surrogate for organization skills. Trainees were advised that they should arrive promptly at 8.00 a.m. for registration and it was explained that the course would start at 8.30 a.m. Recorded arrival times were compared with the pass lists published by the Royal College of Physicians. The mean arrival time was 8.17 a.m. A total of 81 doctors (53.3%) passed the examination with a mean arrival time of 8.14 a.m. However, 71 doctors failed the exam and arrived, on average, six minutes later than doctors who passed (p?=?0.006). Better-prepared junior doctors were more likely to pass the final examination. Arriving on time represents a composite of several skills involved in the planning of appropriate travel arrangements and is therefore a valid marker of organization skills and preparation. This novel study has shown that good time-keeping skills are positively associated with examination outcome.

Do different mattresses affect the quality of cardiopulmonary resuscitation?

OBJECTIVE: To determine the effect of different mattresses on cardiopulmonary resuscitation performance and establish whether emergency deflation of an inflatable mattress improves the quality of resuscitation. DESIGN AND SETTING: Randomised controlled cross-over trial performed in a general ICU PARTICIPANTS: Critical care staff from a general ICU. INTERVENTIONS: Cardiopulmonary resuscitation on a manikin on the floor or on a bed with a standard foam mattress and inflated and deflated pressure redistributing mattresses. Maximal compression force was measured at different bed heights. MEASUREMENTS AND RESULTS: Compression depth, duty cycle and rate and percentage correct expired air ventilation were recorded on a manikin. Compression depth was significantly lower on the foam (35.2 mm), inflated (37.2 mm) and deflated mattress (39.1 mm) than the floor (44.2 mm). There were no clinically important differences in duty cycle or compression rate. The quality of ventilation was poor on all surfaces. Maximal compression force declined as bed height increased. CONCLUSIONS: Resuscitation performance is adversely affected when performed on a bed (irrespective of mattress type) compared to the floor. There were no differences between the inflated and deflated mattresses, although the deflation process did not adversely affect performance. This study does not support the routine deflation of an inflated mattress during resuscitation and questions the potential benefits from using a backboard. The finding that bed height affects maximal compression forces, challenges the recommendation that cardiopulmonary resuscitation be performed with the bed at middle-thigh level and requires further investigation.

Legal vulnerability of assessment tools.

Legal challenges relating to assessment results are increasing around the world. Until recently such challenges were not possible in the UK. With changes to the law, including the Human Rights Act, it is now possible for an Examining Body to have its assessment process challenged. Defending an assessment tool is potentially easy but not being prepared could lead to embarrassing defeat, with significant costs and damages to pay. Judgement may be made as to what constitutes appropriate methods of evaluating and the levels that assessments must attain. There are more questions than answers as to what will happen and who will be the true beneficiaries of potential and real challenges.