Global rating scale for the assessment of paramedic clinical competence.

OBJECTIVE: The aim of this study was to develop and critically appraise a global rating scale (GRS) for the assessment of individual paramedic clinical competence at the entry-to-practice level. METHODS: The development phase of this study involved task analysis by experts, contributions from a focus group, and a modified Delphi process using a national expert panel to establish evidence of content validity. The critical appraisal phase had two raters apply the GRS, developed in the first phase, to a series of sample performances from three groups: novice paramedic students (group 1), paramedic students at the entry-to-practice level (group 2), and experienced paramedics (group 3). Using data from this process, we examined the tool's reliability within each group and tested the discriminative validity hypothesis that higher scores would be associated with higher levels of training and experience. RESULTS: The development phase resulted in a seven-dimension, seven-point adjectival GRS. The two independent blinded raters scored 81 recorded sample performances (n = 25 in group 1, n = 33 in group 2, n = 23 in group 3) using the GRS. For groups 1, 2, and 3, respectively, interrater reliability reached 0.75, 0.88, and 0.94. Intrarater reliability reached 0.94 and the internal consistency ranged from 0.53 to 0.89. Rater differences contributed 0-5.7% of the total variance. The GRS scores assigned to each group increased with level of experience, both using the overall rating (means = 2.3, 4.1, 5.0; p < 0.001) and considering each dimension separately. Applying a modified borderline group method, 54.9% of group 1, 13.4% of group 2, and 2.9% of group 3 were below the cut score. CONCLUSION: The results of this study provide evidence that the scores generated using this scale can be valid for the purpose of making decisions regarding paramedic clinical competence.

Validation of a rule for termination of resuscitation in out-of-hospital cardiac arrest.

BACKGROUND: We prospectively evaluated a clinical prediction rule to be used by emergency medical technicians (EMTs) trained in the use of an automated external defibrillator for the termination of basic life support resuscitative efforts during out-of-hospital cardiac arrest. The rule recommends termination when there is no return of spontaneous circulation, no shocks are administered, and the arrest is not witnessed by emergency medical-services personnel. Otherwise, the rule recommends transportation to the hospital, in accordance with routine practice. METHODS: The study included 24 emergency medical systems in Ontario, Canada. All patients 18 years of age or older who had an arrest of presumed cardiac cause and who were treated by EMTs trained in the use of an automated external defibrillator were included. The patients were treated according to standard guidelines. Characteristics of diagnostic tests for the prediction rule were calculated. These characteristics include sensitivity, specificity, and positive and negative predictive values. RESULTS: Follow-up data were obtained for all 1240 patients. Of 776 patients with cardiac arrest for whom the rule recommended termination, 4 survived (0.5 percent). The rule had a specificity of 90.2 percent for recommending transport of survivors to the emergency department and had a positive predictive value for death of 99.5 percent when termination was recommended. Implementation of this rule would result in a decrease in the rate of transportation from 100 percent of patients to 37.4 percent. The addition of other criteria (a response interval greater than eight minutes or a cardiac arrest not witnessed by a bystander) would further improve both the specificity and positive predictive value of the rule but would result in the transportation of a larger proportion of patients. CONCLUSIONS: The use of a clinical prediction rule for the termination of resuscitation may help clinicians decide whether to terminate basic life support resuscitative efforts in patients having an out-of-hospital cardiac arrest.