Analysis of the results of clinical skills completion assessment for standardized residency training of radiology in Liaoning province in 2020 / 中华医学教育探索杂志

ABSTRACT

Objective:To improve training quality and to standardize the assessment procedures of radiology standardized residency training by analyzing the results of the clinical skills completion assessment for radiology standardized residency training in Liaoning Province in 2020.Methods:Totally 186 trainees participated the assessment with 6 exams in 3 days, including "Man-Machine interview" and "oral interview". Reliability and validity of the test were analyzed first. The accuracy were compared among the three parts of radiology, ultrasound and nuclear medicine, and also among the three portions of imaging description, diagnosis and relative question. Trainees of different type, gender and from different regions were further compared respectively. Scores of different examiners were also compared. SPSS 20.0 software was used for t-test and one-way ANOVA. Results:The Cronbach's α coefficient ranged from 0.65 to 0.87, and KMO values were nearly or higher than 0.7. Scores of both "Man-Machine interview" and "oral interview" parts were better relative to the total scores (relativity coefficient 0.698-0.969). The accuracy of radiology was relatively higher and more stable (nearly 80%), nuclear medicine had the lowest accuracy (nearly 50%), and that of ultrasound fluctuated obviously (56.2%-88.8%). The accuracy was the highest for imaging description, followed by diagnosis, and the lowest for relative question portion. There were significant differences between male and female residents in "Man-Machine interview" portion ( P=0.028), while there was not in "oral interview" ( P=0.050). There were significantly statistical differences in trainees' scores between different regions ( P=0.009 for "Man-Machine interview" and P<0.001 for "oral interview"). Trainees from Shenyang and Dalian got almost the same scores, which were significantly higher than those from other cities. Trainees with master's degree were scored higher than others trainees that were not (all P<0.001). Significant score differences were found between the two examiners in only one examiner group (1/18) ( P=0.011). Conclusion:By the analysis of test results, we find the shortage of both training and assessment process, which is beneficial to adjusting the training process, improving the training quality, and promoting the further standardization and development of the assessment system of radiology standardized residency training.