Primary investigation of immediate oral feedback in objective structure clinical examination / 中华医学教育探索杂志

Objective To investigate the immediate oral feedback after objective structure clinical examination (OSCE) for postgraduate year 1 & 2 surgery residents (PGY1 & 2).Methods 37 PGY1 and 38 PGY2 wereevaluated.The examination was composed of 6 stationsand limited to15 minutes per station.Each station was evaluated by centesimal system score.Immediate oral feedback was given in the last2 minutes.A questionnaire was given to each resident and examiner at the end of OSCE.All data analyses were conducted using SPSS version 22.0,repeated measures ANOVA and LSD test were used,and correlations were tested by the Pearson correlation test.Results The average scores for PGY1 & 2 were (68.97 ± 5.40) and (68.35 ± 5.00),the between-and inter-round differences in average score were not statistically significant.There was no significant correlation about theevaluation of the residents' performance during OSCE between the examiners and the residents.The necessity and effectiveness of immediate oral feedback were confirmed by both the examiners and the residents.Conclusions Immediate oral feedback isfeasible with limited impact on OSCE score,but the plan should be furtherrefined.Follow-up study isnecessary to identify the long-term effect on the clinical competency.

Implementation and evaluation of objective structured clinical examination for Postgraduate Year 1 surgery residents / 中华医学教育探索杂志

Objective To investigate the effectiveness and rationality of objective structured clinical examination (OSCE) used as achievement assessment for Postgraduate Year 1 surgery residents.Then the form and content of training and examination can be improved according to test results.Methods 31 Postgraduate Year 1 surgery residents were involved in the examination.The examination was composed of 5 stations,which were case analysis,wound dressing change,plaster fixation,laparoscopic simulator basic skills and irregular wound debridement suture.Each station was evaluated by centesimal system score and limited in 15 minutes.A questionnaire on their opinion and perception of the examination was given to each resident at the end of examination.A total number of 31 questionnaires were issued and recycled.The difficulty,discrimination and reliability of each station were calculated,and the correlation between each station was analyzed.Results The average OSCE score was (74.66 ± 4.39).The difficulty of total stations was 0.747.The distinction was 0.578 and the reliability was 0.402.The second station was lowest difficulty,and the fifth station was most difficult.Every station's discrimination was larger than 0.400.The reliability of the second and the fourth station was low.There was moderate correlation between the first station and the second station,as well as the first station and the fourth station.But there was no significant correlation between other stations.Residents' questionnaire survey showed that the fourth and the fifth stations were considered as the most difficult,and the second station was the simplest.They thought the fourth was most helpful for clinic.They performed best at the second station and worst at the fifth station.Conclusions OSCE can effectively evaluate the efficacy of the resident training.The residents' practical competency skills can be assessed better by examination simulating complex clinical scenario.Besides,after examination,we need to objectively evaluate the assessment efficiency,and dynamically adjust the training content and examination form according to residents' subjective opinions.

Management of esophagcal varices at Suratthani Hospital.

This is a retrospective study of 279 patients with bleeding esophageal varices in the medical department of Suratthani Hospital from 1 July 1996 to 30 April 2003. All patients were treated with endoscopic interventions (endoscopic sclerotherpy and/or rubber band ligation). The patients consisted of 67% men, and had an average of 54.9 years. Underlying diseases included liver cirrhosis (98.2%) and was alcoholic cirrhosis (59.5%), Child Pugh class B and C (77.7%), and EV grade III (62.1%). Clinical bleeding was considered moderate to severe upper GI hemorrhage in 64.4%) of patients. The patients were already in a high risk group, so mortality the rate was high (22.2%). Secondary prevention of recurrent bleeding with propanolol and endoscopic intervention should be widely used in general hospitals to decrease the rate of rebleeding and increase and increase early detection of esophageal varices in high risk patients.

The validity and reliability of clinical performance assessment of residents in the general surgery residency program.

A retrospective study of clinical performance assessment of residents in the general surgery residency program at the Department of Surgery,Faculty of Medicine Siriraj Hospital, during the 200-2001 and 2001-2002 academic years was done to evaluate the inter-rater reliability, internal structure, and ducational discriminant validity of the assessment. The inter-rater reliabilities were determined by using the intraclass correlation. Correlations between individual performance ratings were checked to determine how well faculty members differentiate their ratings with individual clinical skills. Finally, the percentage of marginal or unsatisfactory ratings was checked to demonstrate how sensitive the ratings were in identifying performance deficiencies among residents. From the evaluation of 42 residents in the 2000-2001 academic year, inter-rater reliability coefficients of individual ratings ranged from 0.06 to 0.93 with an average of 0.51. From the evaluation of 47 residents in the 2001-2002 academic year, inter-rater reliability coefficients ranged from 0.04 to 0.85 with an average of 0.49. Inter-rater reliabilities of performance ratings of third-year residents were at an acceptable standard for a medium-stake assessment. However, those of first and second-year residents should need some improvement. Tasks performed by first and second-year residents seem to have been inadequate for faculty members to evaluate their performance reliably. The correlation study between individual performance ratings demonstrated the lack of discrimination between many clinical skills in faculty ratings. Faculty members need some guidelines to differentiate between many items including relationship with patients, relationship with other doctors, and relationship with other workers; knowledge and judgment; work concentration and work effectiveness; and punctuality and responsibility. About ten percent of ratings were marginal or unsatisfactory which indicated that these ratings were sensitive enough to identify performance deficiencies among residents.

Predictive power of resident selection criteria for clinical performance in general surgery residency.

To evaluate the ability of the resident selection criteria to predict clinical performance of general surgery residents, the application files and resident evaluations of 35 general surgery residents who were in the residency program of the Department of Surgery, Faculty of Medicine Siriraj Hospital during the 2000- 2001 and 2001- 2002 academic years were reviewed. A correlation study was done using scores from three selection criteria (medical school grades, letters of recommendation, and interview) predictors and clinical performance ratings as outcomes. The interview scores were the best predictor for overall performance of residents in the first and second years. The GPA scores were the best predictor for overall third–year performance. Each selection criterion contributed unique predictive ability for resident performance. The combination of interview scores, scores from letters of recommendation, GPA scores, and ages at admission could predict 60.5% of the total variance in the overall first-year performance scores (R=0.778, p=0.012). The combination of interview scores and score from letters of recommendation could predict 31.4% of the total variance in the overall performance score in the second year (R=0.56, p=0.049). None of the multiple regression models demonstrated statistically significant prediction for the third-year overall performance.