The Comparison of Clinical Performance Examination Scores according to the Different Testing Time: Six Medical Schools in Seoul.Gyeonggi CPX Consortium 2005 / 한국의학교육

PURPOSE: Clinical performance examination(CPX) using standardized patients(SPs) is an acceptable method of testing medical professionals, but there has been some concerns about security. The objective of this work is to examine whether the day of the examination influences the scores of examinees of different medical schools at different times throughout the examination period. METHODS: Six medical schools, which had participated in the Seoul-Gyeonggi CPX Consortium 2005, were enrolled. Each station, controlled by the same regulations, included 12 minutes of SP encounter and 5 minutes of writing a short essay. We compared the mean scores using ANOVA and linear trends with multiple regression analyses and SPSS version 11.0. RESULTS: The mean score of examinees from all 6 medical schools was 63.2+/-.9. There was no difference in total mean scores among the medical schools according to the period when CPX was conducted. Classified by their examination day, there was no difference among the mean scores of the 1st, 2nd, and 3rd day, but in one school where the examination was performed for 5days, the mean scores of the 4th day was higher than the others(p<0.05). There were trends of linear increases over the five days for the 'physical examination'question, but not for 'physician-patient interaction'and 'patient education'. CONCLUSION: The changes in scores according to the examination day in this study did not show consistent results. However, the variable results seen according to school, test question, and examination day need further analysis for test security issues.

Comparison of the Evaluation Results of Faculty with Those of Standardized Patients in a Clinical Performance Examination Experience / 한국의학교육

PURPOSE: To compare the evaluation results of faculties to those of Standardized Patients (SP) participating in a Clinical Performance Examination (CPX) administered at Ewha Womans University College of Medicine. METHODS: The CPX was taken by 77 fourth year medical students. Cases and checklist were developed by the medical school consortium in capital area. Six cases were used and 24 SPs participated and evaluated the students' performances. The whole session was recorded on videotapes so that 6 medical school faculties could analyze and evaluate the students' performances as well. The results were compared and analyzed by SPSS package. RESULTS: The agreement between the faculties and the SPs was relatively good (r=0.79), but not good enough. In every case, SPs gave higher marks than did the faculties. Clear disease entity cases like "hepatitis" and "anemia" showed better agreement than obscure clinical contexts such as "bad news delivery". Better agreement was seen in the items of physical exam category (r=0.91), but the agreement was very poor in the items of doctor-patient (Dr-Pt) relationship category (r=0.54). The construction of checklist and the character of each evaluation item should influence the differences. CONCLUSION: More detailed guidelines and clear/specific evaluating items are necessary to improve the agreement rate. In certain categories like physical exam and brief history taking, the SP' s evaluation can replace the faculties', but for complex contexts like Dr-Pt relationship.