Structured Assessment to Evaluate a Family Medicine Clerkship Program / 의학교육논단

This correction is being published to revise the acknowledgements of the above article.

Structured Assessment to Evaluate a Family Medicine Clerkship Program / 의학교육논단

This study was conducted to analyze the strengths and weaknesses of a 3-week family medicine clerkship program based on the results of an online survey taken by the students (N=127) and a structured interview with a focus group (n=10), aimed to improve the quality of the clerkship program. The online survey contained questions pertaining to goals, schedule, contents, arrangement, atmosphere, environment, evaluation, and satisfaction regarding the clerkship. The focus group interview addressed the schedule and achievements of the program. Scores were reported on a 5-point Likert scale. Most students were highly satisfied with the overall quality of the clerkship. The structured interview results showed that 97.6% of the clerkship program was executed according to the schedule. The focus group reported a perfect score of 5 points on several measures including: accomplishment of the educational goals of the family medicine clerkship, providing many chances to obtain medical histories and perform physical examinations on real patients, experience with various symptoms and diseases, positive attitudes of faculty members when teaching, notification of the guidelines for evaluation beforehand, well-constructed and effective clerkship schedule, and reflection of student feedback. However, the focus group gave low scores on: support for health accidents of students, access to patient information, enough opportunities to practice clinical skills, appropriate rest facilities for students, and fairness of clerkship evaluation process. In conclusion, the structured evaluation performed after the 3-week clerkship program motivated students and helped them ensure an efficient clerkship. This structured evaluation also suggested basic data to make the professor who is subject of the assessment. This study shows that structured assessment is an effective method which can be used to improve the quality of clerkships.

Two-and-a-half year follow-up study of strategy factors in successful learning to predict academic achievements in medical education / 한국의학교육

PURPOSE: We performed a two-and-a-half year follow-up study of strategy factors in successful learning to predict academic achievements in medical education. METHODS: Strategy factors in successful learning were identified using a content analysis of open-ended responses from 30 medical students who were ranked in the top 10 of their class. Core words were selected among their responses in each category and the frequency of the words were counted. Then, a factors survey was conducted among year 2 students, before the second semester. Finally, we performed an analysis to assess the association between the factors score and academic achievement for the same students 2.5 years later. RESULTS: The core words were "planning and execution," "daily reviews" in the study schedule category; "focusing in class" and "taking notes" among class-related category; and "lecture notes," "previous exams or papers," and "textbooks" in the primary self-learning resources category. There were associations between the factors scores for study planning and execution, focusing in class, and taking notes and academic achievement, representing the second year second semester credit score, third year written exam scores and fourth year written and skill exam scores. Study planning was only one independent variable to predict fourth year summative written exam scores. CONCLUSION: In a two-and-a-half year follow-up study, associations were founded between academic achievement and the factors scores for study planning and execution, focusing in class, and taking notes. Study planning as only one independent variable is useful for predicting fourth year summative written exam score.

Experience of clinical skills assessment in the Busan-Gyeongnam Consortium / 한국의학교육

PURPOSE: The purpose of this study is to judge the quality of clinical skills assessment in Busan-Gyeongnam Consortium. METHODS: Fourth grade medical school students (n=350 in 2012 and n=419 in 2013) in the Busan-Gyeongnam Consortium were included in the study. The examination was consisted of 6 clinical performance examination (CPX) and 6 objective structured clinical examination (OSCE) stations. The students were divided into groups to take the exam in 4 sites during 3 days. The overall reliability was estimated by Cronbach alpha coefficient across the stations and the case reliability was by alpha across checklist items. Analysis of variance and between-group variation were used to evaluate the variation of examinee performance across different days and sites. RESULTS: The mean total CPX/OSCE score was 67.0 points. The overall alpha across-stations was 0.66 in 2012 and 0.61 in 2013. The alpha across-items within a station was 0.54 to 0.86 in CPX, 0.51 to 0.92 in OSCE. There was no significant increase in scores between the different days. The mean scores over sites were different in 30 out of 48 stations but between-group variances were under 30%, except 2 cases. CONCLUSION: The overall reliability was below 0.70 and standardization of exam sites was unclear. To improve the quality of exam, case development, item design, training of standardized patients and assessors, and standardization of sites are necessary. Above of all, we need to develop the well-organized matrix to measure the quality of the exam.

Group Counseling for Medical Students with Drop-Out Experiences / 한국의학교육

PURPOSE: The purpose of this research was to describe our group counseling methods for medical students with drop-out experiences. METHODS: Group counseling was offered to 11 medical students with drop-out experiences in their previous second semester. All subjects provided written informed consent before participating and completed a 2-day group counseling program using the Gestalt approach. The self-assertiveness training group counseling program consisted of 6 sessions, each of which lasted 90 minutes. Experience reports by participants after the program and data from semi-structured qualitative interviews were qualitatively analyzed. RESULTS: Program participants reported that they were moderately satisfied with the program regarding its usefulness and helpfulness on self-awareness, understanding, and reminding them of attempts to change behavior. Most students showed heightened levels of sincerity perceptions and positive attitudes in every session. The results demonstrated significant changes in experience in self-esteem, self-recognition, and interpersonal relationships. CONCLUSION: A group counseling program using the Gestalt approach could help medical students with drop-out experiences to adjust with 1 year their juniors, enhance their self-esteem, contribute to their psychological well-being, and prevent student re-failure through effective stress management and improved interpersonal relationships.

Instructional Analysis of Lecture Video Recordings and Its Application for Quality Improvement of Medical Lectures / 한국의학교육

PURPOSE: The lecture is a technique for delivering knowledge and information cost-effectively to large medical classes in medical education. The aim of this study was to analyze teaching quality, based on triangle analysis of video recordings of medical lectures, to strengthen teaching competency in medical school. METHODS: The subjects of this study were 13 medical professors who taught 1st- and 2nd-year medical students and agreed to a triangle analysis of video recordings of their lectures. We first performed triangle analysis, which consisted of a professional analysis of video recordings, self-assessment by teaching professors, and feedback from students, and the data were crosschecked by five school consultants for reliability and consistency. RESULTS: Most of the distress that teachers experienced during the lecture occurred in uniform teaching environments, such as larger lecture classes. Larger lectures that primarily used PowerPoint as a medium to deliver information effected poor interaction with students. Other distressing factors in the lecture were personal characteristics and lack of strategic faculty development. CONCLUSION: Triangle analysis of video recordings of medical lectures gives teachers an opportunity and motive to improve teaching quality. Faculty development and various improvement strategies, based on this analysis, are expected to help teachers succeed as effective, efficient, and attractive lecturers while improving the quality of larger lecture classes.