Trial of Student Evaluations of the Didactic Lectures of One Instructor (1992-1994) / 医学教育

As the second phase of a trial of student evaluations of didactic lectures, a modified questionnaire (B5 type, consisting of seven items, each having five multiple-choice responses and more space for written responses) was filled out anonymously by all students receiving didactic lectures of one instructor in a preventive medicine and community health course from 1992 through 1994. The frequency of written responses was 51.8% higher than in our previous trial (1990-91). Multivariate analysis was also applied to investigate the items most related to the summative assessment. The minimal essential questionnaire items and the necessity of space for written responses in frequent trials is discussed.

A Further Five Years' Experience in Evaluating Learning by Two Dimensional Criteria (1989-94) / 医学教育

A new method of evaluating learning, combining the 2 categories of knowledge/skills and attitude, has been introduced into the course on preventive medicine and community health. The goal was to improve student attitudes towards learning. In this article, our five years' experience from 1989 to 1993 is reported and follows a previous similar study from 1986 to 1988. This time, the records of 3 of 490 students were judged to be inadequate for promotion to the next grade. Although one-half of the students agreed with this method of evaluation, 15 % disagreed. The usefulness ofthis new method is discussed, based on our results.

Student Evaluations of Didactic Lectures by One Instructor / 医学教育

The 2nd year student evaluation of didactic lectures by one instrustor was carried out anonymously in 1991 in order to establish the most appropriate set of questionnaire items (including 11 types of questions with 5 choices of responses each and space for a free answer). The study was repeated 11 times, with a total of 286 responses collected. There was a certain amount of variability in the means and standard deviations in the data. Mutivariate analysis, such as multiple regression, was appled and three principal components (students' concern and lecturer's attitude, utilization of visual aids, and preparation and clarity of lectures) were extracted out 11 items by means of principal component analysis. In concluding, the author stresses the necessity of the further studies.

Student Behavior and Performance During Field Work Sessions for a Public Health Course. A Survey of On Site Collaborators, 1990-92 / 医学教育

We conducted an opinion survey of on-site collaborators after three field work sessions during the period from 1990 to 1992. As part of our public health course, these field work sessions were implemented on a small-group basis in various settings, such as schools and local public health centers. Selfadministered questionnaires on student behavior and performance were distributed to the collaborators on the days of the student visits. Completed questionnaires were then collected by mail within a couple of weeks. The total number of respondents for the three years surveyed was 205, reflecting a response rate of 100 percent.<BR>The following results were obtained; 1. Many collaborators admired the good behavior of the students, 2. Several respondents considered student knowledge of public health issues less adequate than they had expected, and 3. Some respondents commented on the passiveness of student involvement in their work.<BR>These survey results provided the faculty with valuable insights on the implementation of the field work sessions.

Evaluation of the MCQ type examination by the percentage of correct answers and the discriminating index of phi coefficient / 医学教育

In our university, the 5 th and 6 th years medical students receive the MCQ type examination twice a year, in Internal Medicine, Surgery, Pediatrics, Obstetrics and Gynecology and Public Health.<BR>The authors determined the validity of each question about public health (total 130 questions, 1984-1988) according to the percentage of correct answers and the phi coefficient. The results were as follows: 1) With most of the questions, the 6 th year students showed a higher percentage of correct answers and phi coefficient, than the 5 th year students. 2) Most of the questions with a low percentage of correct answers showed a low phi coefficient. 3) The authors analyzed the content and answer pattern of questions with both a low percentage of correct answers and a low phi coefficient, and found to typical reasons for these results, that is, students' lack of knowledge and an inappropriate question. Generally speaking, a question with both a low percentage of correct answers and a low phi coefficient is considered an inappropriate question. Our results showed that in some cases the students' lack of knowlege was responsible for both low figures. It is essential for the teaching staff to determine the validity of the MCQ type examination that they make by means of this kind of analysis.

Three years' experience in learning evaluation by means of two-dimensional criteria (1986-1988) / 医学教育

In addition to the conventional Knowledge Skill Scale (K. S scale) evaluated by examinations and reports, the Attitude Scale (AT scale) has been introduced for the final summative eavaluation in the public health course, in order to make medical students learn the importance of social manners as doctors; for example, punctuality in completing the report assignment and participation in obligatory seminars.<BR>The authors observed that after introduction of the AT scale, the students' AT scales improved during the next three years. The proper role of the introduction of the two -dimensional criteria (K. S scale and AT scale) in the public health course is discussed.