Objective structured clinical examination (OSCE) in psychiatry new curriculum undergraduate posting and its standard setting procedure: An experience in Universiti Kebangsaan Malaysia (UKM)

ABSTRACT

Objective: This study aims to report on the process of standard settings (SS) and to compare the passing rates between the norm-reference and SS methods, for OSCE in psychiatry undergraduate examination at UKM for 2009/2010 session. Methods: In the SS method, examiners were asked to imagine the performance of a minimally competent student and gave marks using a standardized check-list. The marks in particular outliers were discussed. After the first round, the examiners went through the same process again, to rate the minimally competent students independently. The median of the marks was taken as the passing mark for the particular question. The passing rate using the passing mark of 50% in the norm-reference method was compared to the passing rate from the passing mark obtained from the settings method. Results: For question 1, the passing rate with the norm-reference method (i.e. passing mark of 50%) was 93% (106/114) and that by the SS method was 72.8% (83/114). For question 2, the pass rate with the norm-reference method was 92% (105/114) and that by the SS method was 67.5% (77/114). Conclusion: The passing rates between the two methods showed significant differences. Although OSCE is an improvement to the undergraduate psychiatry examination in Universiti Kebangsaan Malaysia, there were few limitations and challenges that need to be tackled for further improvement.