Validation of the Script Concordance Test as an instrument to assess clinical reasoning of residents in pediatric emergency medicine in Mexico

ABSTRACT

Background. Clinical reasoning is a crucial skill to be acquired during a residency training program. In pediatric emergency medicine, physicians are challenged by diagnostic, investigative, and treatment uncertainties. The Script Concordance Test (SCT) uses authentic clinical scenarios to compare trainee’s judgement skills with those of experts. The purpose of this study was to evaluate the clinical reasoning using a pediatric emergency medicine SCT and to determine if it would be able to differentiate between different levels of residency training, validating it in Mexico. Methods. A SCT containing 58 questions nested in 14 cases was administered to pediatric and senior residents at one academic institution. Fourteen experienced emergency medicine pediatricians were part of a reference panel to establish the basis for the scoring process. Results. Ninety six residents consented to participate. Thirteen residents were fellows of pediatric intensive care medicine or pediatric emergency medicine, and there were 83 pediatric residents. Overall, there was a significant difference in performance across levels of training. The difference between all levels was significant. Conclusions. This pediatric emergency medicine Script Concordance Test was useful to assess the progression of clinical reasoning during residency training in Mexico.