Students' perceptions of aspects affecting seminar learning.

BACKGROUND: Many medical and veterinary schools have curricula in which they use seminars of approximately 25 students to achieve their learning goals. There is not much research on seminar learning. AIM: To explore students' views regarding aspects that affect seminar learning. METHODS: Twenty-four second-year students of a 3-year bachelor curriculum participated in semi-structured focus group interviews. The sessions were audio-taped and transcribed. Two researchers independently coded the data using qualitative methods. An iterative process of data reduction resulted in emerging aspects. The participating students were asked to comment on the preliminary results. RESULTS: Course schedule, coherence and alignment of the different educational methods, the amount and type of seminar questions and the amount and clarity of the preparation materials affected seminar learning. Also, the didactic approach and facilitating methods used by the teachers, the group composition, size and atmosphere, the amount of active student participation and interaction and assessment influenced seminar learning according to students. CONCLUSION: Most aspects that affect seminar learning are consistent with aspects affecting small group learning. Course schedule and alignment seem to have a stronger impact on seminar learning.

Can students differentiate between PBL tutors with different tutoring deficiencies?

Many medical schools evaluate the performance of their tutors by using questionnaires. One of the aims of these evaluations is to provide tutors with diagnostic feedback on strong and weak aspects of their performance. Although everyone will agree that students are able to distinguish between poor and excellent tutors, one can question whether students are also able to differentiate between tutors with different tutoring deficiencies--tutors who perform badly on a specific key aspect of their performance. The aim of this study was to investigate to what degree students are able to differentiate between tutors with different tutoring deficiencies, how effective tutors are with different deficiencies and what kind of tips students give for improvement of a tutor's behaviour. Based on students' ratings on a tutor evaluation questionnaire, tutors were ranked in groups with different deficiencies and the average overall tutor performance score was computed for each group with a particular deficiency. In addition, students' tips for improvement given in the open-ended question at the end of the questionnaire were analysed. The results demonstrated that on average one out of five tutors showed a deficiency on only one key aspect. Tutors who did not stimulate students towards active learning were perceived as least effective. Furthermore, students' tips for improvement could be categorized into four groups: tutors who do not evaluate adequately, tutors who are too directive, tutors who are too passive and tutors who lack content knowledge. The results of this study demonstrate that students are not only able to distinguish between poor and excellent tutors, but are also able to diagnose tutors with different tutoring deficiencies and are able to provide tutors with specific feedback to improve their performance.

Providing physicians with feedback on how they supervise students during patient contacts.

In this descriptive study an instrument is presented that has been developed to provide physicians with feedback about their strengths and weaknesses in facilitating student learning during patient contacts. The instrument is strongly theory based, i.e. it is based on current general theories of context-bound learning environments, and forms of facilitation promoting transfer of knowledge to actual professional practice. In addition, it has been developed in cooperation with physicians supervising students during patient contacts. The authors have shown how physicians can be provided with individualized feedback on their performance in supervising students during patient contacts.

From quality assurance to total quality management: how can quality assurance result in continuous improvement in health professions education?

CONTEXT: Quality assurance is a hot topic in many institutes for higher education. Quality assurance is a cyclic process, consisting of three steps: measuring, judging and improving. Many institutes in higher education collect data about the quality of their educational programme on a regular basis and with proper frequency, but these evaluative data are not always used to improve the quality of the programme. PURPOSE: The aim of this article is to demonstrate which conditions need to be fulfilled to ensure that quality assurance is a cyclic process resulting in continuous improvement. CONCLUSIONS: Quality assurance can only be successful, i.e. result in continuous improvement, if three conditions are met: the evaluation activities are carried out in (1). a systematic and (2). structural fashion and (3). are integrated in the organization's regular work patterns. Parts of the system for quality assurance at the Maastricht Medical School are presented to demonstrate how the three conditions can be realized in practice.

Students' perceptions of relationships between some educational variables in the out-patient setting.

BACKGROUND: Medical education uses the cognitive apprenticeship model of student learning extensively. Students rotate among different hospitals and out- patient clinics where they are exposed to a range of professionally relevant contexts. Here they learn to think and act in different domains under the supervision of experts. Previous research has shown that these learning situations involve little teaching. Students see a narrow range of patient problems and feedback is limited. The aim of this study is to investigate relationships among some educational variables in the out-patient clinic. METHOD: This paper provides a theoretical model that specifies the factors influencing the effectiveness of student rotations at out-patient clinics. The model makes distinctions between input variables, such as organizational quality, number of students contemporaneously involved and available space, and process variables, such as patient mix and supervision, and the output variable of the effectiveness of rotations in out-patient clinics. RESULTS: The model was tested against empirical data from evaluative surveys and showed a reasonable fit. The model offers suggestions for improving the learning environment of clinical rotations. DISCUSSION: The strength of this study lies in its process evaluation perspective which investigates interactions between intervening variables rather than the influence of particular variables in isolation from other variables.

The Dutch system of external quality assessment: description and experiences.

CONTEXT: Generally speaking, quality assurance in Dutch higher education consists of four parts: a self-evaluation, written by the faculty, a review committee, consisting of experts, the site visit, and a public report of the assessment outcomes. TASK OF THE REVIEW COMMITTEE: The organization, in which all universities are united, appoints a review committee for each educational program. Most educational programs are taught at different universities. Consequently, the review committee visits several universities. The task of the review committee is: to assess the overall quality of these educational programs in The Netherlands; and to assess the quality of each school separately. METHOD: The members of the review committee start their activities by formulating the evaluation criteria (standards) for the content of an educational program and for the educational process. This ends with a paper that will be used as a reference for the assessment. Then the review committee studies the self-evaluation reports. The faculties write these reports along established guidelines. In cases where the self-evaluation is not completely clear, or not sufficient, the committee formulates questions and asks for additional information. Then the committee visits the faculties. These visits take usually two days each. During these visits, the committee gets information from the dean of the faculty, the program committee, teachers, students, and from other employees of the faculty. In addition, the members of the committee inspect the facilities of the faculty, e.g. the library. RESULT: Directly after the visit, the chair of the committee gives, orally, a first impression of the findings. After visiting all faculties, the committee starts their deliberations, which result in a report of the assessment of the overall quality of the educational programs. The committee also assesses the quality of each faculty separately, often ending with recommendations. CONCLUSION: The Dutch system of quality assurance in higher education is much copied by other countries. The essence is the self-evaluation on one hand, and the site visit on the other. Committees try to act as consultants, and not as executioners. Therefore, the way the members of the committee play their role is very important.

Students' perceptions of time spent during clinical rotations.

Some rotations during clinical education are characterized by a high number of hours spent per week in the hospital because students panicipate in a hospital on-call system, i.e. hours beyond usual working hours, e.g. at night. However, students complain about spending too many hours in the hospital on non-instructive activities. This study was undertaken to investigate differences among rotations in time spent in hospital, in on-call hours, in self-study and in non-instructive activities and to investigate the relationship between time spent on the various activities and the overall effectiveness as perceived by students. A questionnaire was administered to students at the end of various clinical rotations. Rotations differ considerably in time spent in hospital, on call (i.e. beyond usual working hours), on self-study and on non-instructive activities. In some rotations students report spending on average 18-20% of their time in the hospital on non-instructive activities. Furthermore, the numbers of hours spent in hospital do not correlate with the overall effectiveness as perceived by students, unless the numbers of hours spent in non-instructive activities are taken into account. The effectiveness of a rotation does not automatically improve if students spend more hours in hospital. The number of hours spent on non-instructive activities should be reduced in some rotations and should be kept as low as possible. Further research is needed to find out which activities are perceived as non-instructive.

Clerkship assessment assessed.

This article reviews consistent research findings concerning the assessment of clinical competence during the clerkship phase of the undergraduate medical training programme on issues of reliability, validity, effect on training programme and learning behaviour, acceptability and costs. Subsequently, research findings on the clinical clerkship as a learning environment are discussed demonstrating that the clinical attachment provides a rather unstructured educational framework. Five fundamental questions (why, what, when, how, who) are addressed to generate general suggestions for improving assessment on the basis of the evidence on assessment and clinical training. Good assessment requires a thoughtful compromise between what is achievable and what is ideal. It is argued that educational effects are eminently important in this compromise, particularly in the unstructured clinical setting. Maximizing educational effects can be achieved in combination with improvements of other measurement qualities of the assessment. Two concrete examples are provided to illustrate the recommended assessment strategies.

The Relation Between Time Spent on Individual Study and Academic Achievement in a Problem-Based Curriculum.

Logically a relation is expected between time spent on individual study and achievement. The purpose of this study is to examine whether a positive relation exists between the amount of time spent on individual study and academic achievement and whether this differs when using a test measuring short-term knowledge or one measuring long-term knowledge. Data were collected in a problem-based medical curriculum. The results suggest that time spent on individual study correlates poorly with scores on the test measuring short-term knowledge but also with those on the test measuring long-term knowledge. This study reaffirms the complexity of the relationship and it demonstrates the importance to search for qualitative factors about the way students learn.