Implementation and evaluation of objective structured clinical examination for Postgraduate Year 1 surgery residents / 中华医学教育探索杂志

ABSTRACT

Objective To investigate the effectiveness and rationality of objective structured clinical examination (OSCE) used as achievement assessment for Postgraduate Year 1 surgery residents.Then the form and content of training and examination can be improved according to test results.Methods 31 Postgraduate Year 1 surgery residents were involved in the examination.The examination was composed of 5 stations,which were case analysis,wound dressing change,plaster fixation,laparoscopic simulator basic skills and irregular wound debridement suture.Each station was evaluated by centesimal system score and limited in 15 minutes.A questionnaire on their opinion and perception of the examination was given to each resident at the end of examination.A total number of 31 questionnaires were issued and recycled.The difficulty,discrimination and reliability of each station were calculated,and the correlation between each station was analyzed.Results The average OSCE score was (74.66 ± 4.39).The difficulty of total stations was 0.747.The distinction was 0.578 and the reliability was 0.402.The second station was lowest difficulty,and the fifth station was most difficult.Every station's discrimination was larger than 0.400.The reliability of the second and the fourth station was low.There was moderate correlation between the first station and the second station,as well as the first station and the fourth station.But there was no significant correlation between other stations.Residents' questionnaire survey showed that the fourth and the fifth stations were considered as the most difficult,and the second station was the simplest.They thought the fourth was most helpful for clinic.They performed best at the second station and worst at the fifth station.Conclusions OSCE can effectively evaluate the efficacy of the resident training.The residents' practical competency skills can be assessed better by examination simulating complex clinical scenario.Besides,after examination,we need to objectively evaluate the assessment efficiency,and dynamically adjust the training content and examination form according to residents' subjective opinions.