Assessment of a surgery clerkship's performance evaluation system.

BACKGROUND: This study was designed to examine the validity of a surgery clerkship's performance evaluation system. The study also assessed faculty members' confidence in how clerks are evaluated and promotion decisions made. METHODS: Student files from five classes (n = 339) were analyzed. A 25-item published survey designed to study faculty perceptions of a student evaluation system was distributed. Chi-square tests of independence and descriptive statistics were used. RESULTS: Faculty survey results showed faculty perceptions of strengths and weaknesses in the evaluation system. Significant relationships were found with prior performance indicators and clerkship performance yielding evidence of concurrent and predictive validity. CONCLUSIONS: Findings provide guidance for enhancing how clerks are evaluated as well as specific profiles of students who may need special attention or additional challenges during the surgery clerkship. This study provides a model for other clerkships to assess their student evaluations systems.

Evaluation of students' physical examination skills during their surgery clerkship.

BACKGROUND: Faculty often presume that students possess adequate physical examination skills upon graduation. Yet assessments of their performance with these skills often reveal deficiencies. This study was designed to determine if students' physical examination skills improved during their clerkship year. METHODS: Sixty-six students performed four specific physical examinations on patients during the first and last week of their surgery clerkship. Four consecutive clerkship rotations were examined. Encounters were videotaped and evaluated by faculty members. RESULTS: Posttest mean percent correct scores significantly improved for three examinations (P <0.01). Analysis of variance found no significant differences between clerkship mean percent correct scores. CONCLUSIONS: Students' physical examination skills improved slightly during their clerkship, however, no relationship was found between clerkship rotation and performance. These findings suggest unsupervised experiences during the third year do not positively influence student performance with physical examination skill proficiency.

Is test security a concern when OSCE stations are repeated across clerkship rotations?

PURPOSE: To examine the issue of test security when the same stations on an objective structured clinical examination (OSCE) are repeated across clerkship rotations. Specifically, is there a significant difference in students' scores on stations repeated in three or four rotations within a single academic year? METHOD: The sample consisted of 15 stations in the OSCE given at the end of the third-year surgery clerkship at the Southern Illinois University School of Medicine from 1989-90 through 1993-94. Each station was administered three or four times a year. One-way analyses of variance with contrast coding to test for linear trends were used. Results were considered significant at or below the .05 level. RESULTS: Only three of the 15 stations showed significant linear trends. A two-part couplet orthopedic station showed a significant decreasing linear trend (p=.0001). Two stations showed significant increasing linear trends: a general surgery couplet station (p=.0004) and a plastic surgery station with an essay question (p=.0253). CONCLUSION: There was no consistent evidence that students scored increasingly higher on OSCE stations repeated throughout the year. Thus, it would appear that a clerkship can repeat OSCE stations within an academic year without risk of a trend toward increasing scores.

Patients' attitudes toward the involvement of medical students in their care.

BACKGROUND: Research has shown that medical students are generally accepted by patients, but specific details that elucidate patient perceptions of the advantages and disadvantages to student involvement have not been documented. This study was designed to determine variables that influence patient satisfaction with students. PATIENTS AND METHODS: Patients were interviewed by one of two faculty members using a questionnaire-style format that covered 12 variables regarding patient care. Patients were asked to rate the extent to which medical students helped or hindered their hospital stay, with regard to the 12 variables. RESULTS: Patients' attitudes were favorable regardless of the students' extent of clinical experience or clinical abilities or the patients' age or length of hospital stay. Patients reported that students spent time with them and answered their questions. Most patients stated that they would allow students to participate in their future hospital care. CONCLUSION: Positive patient-student interactions can have important effects on patients' expectations and their acceptance of future encounters with students. This fact is becoming increasingly important due to the changes in health care and the decreasing incidence of inpatient surgical encounters.