Goal orientations of health profession students throughout the undergraduate program: a multilevel study.

BACKGROUND: The achievement goal theory defines two major foci of students' learning goals (1) primarily interested in truly mastering a task (mastery orientation), and (2) striving to show ones competences to others (performance orientation). The present study is undertaken to better understand if and how health profession students' goal orientations change during the undergraduate program and to what degree gender, academic achievement, and self-efficacy are associated with mastery and performance orientation between students and within students over time. METHOD: By means of an online questionnaire, students of medical, pharmaceutical, and veterinary sciences (N = 2402) were asked to rate themselves on mastery orientation, performance orientation, and self-efficacy at the beginning of five consecutive semesters. Data on grades and gender were drawn from university's files. Multilevel analyses were used for data analysis. RESULTS: Students' goal orientations showed relative stability over time, but substantial fluctuations within individual students were found. These fluctuations were associated with fluctuations in self-efficacy. Students' gender, high school grades, study grades, and self-efficacy were all associated with differences in mastery or performance orientation between students. Self-efficacy was the strongest predictor for mastery orientation and grades for performance orientation. CONCLUSIONS: The relatively strong association between the goal orientations and students' self-efficacy found in this study emphasizes the potential of enhancing self-efficacy in health profession students. Also, for educators and researchers, fluctuations of both goal orientations within individual students are important to consider.

Feedback-giving behaviour in performance evaluations during clinical clerkships.

CONTEXT: Narrative feedback documented in performance evaluations by the teacher, i.e. the clinical supervisor, is generally accepted to be essential for workplace learning. Many studies have examined factors of influence on the usage of mini-clinical evaluation exercise (mini-CEX) instruments and provision of feedback, but little is known about how these factors influence teachers' feedback-giving behaviour. In this study, we investigated teachers' use of mini-CEX in performance evaluations to provide narrative feedback in undergraduate clinical training. METHODS: We designed an exploratory qualitative study using an interpretive approach. Focusing on the usage of mini-CEX instruments in clinical training, we conducted semi-structured interviews to explore teachers' perceptions. Between February and June 2013, we conducted interviews with 14 clinicians participated as teachers during undergraduate clinical clerkships. Informed by concepts from the literature, we coded interview transcripts and iteratively reduced and displayed data using template analysis. RESULTS: We identified three main themes of interrelated factors that influenced teachers' practice with regard to mini-CEX instruments: teacher-related factors; teacher-student interaction-related factors, and teacher-context interaction-related factors. Four issues (direct observation, relationship between teacher and student, verbal versus written feedback, formative versus summative purposes) that are pertinent to workplace-based performance evaluations were presented to clarify how different factors interact with each other and influence teachers' feedback-giving behaviour. Embedding performance observation in clinical practice and establishing trustworthy teacher-student relationships in more longitudinal clinical clerkships were considered important in creating a learning environment that supports and facilitates the feedback exchange. CONCLUSION: Teachers' feedback-giving behaviour within the clinical context results from the interaction between personal, interpersonal and contextual factors. Increasing insight into how teachers use mini-CEX instruments in daily practice may offer strategies for creating a professional learning culture in which feedback giving and seeking would be enhanced.

Factors Influencing Seminar Learning and Academic Achievement.

Many veterinary curricula use seminars, interactive educational group formats in which some 25 students discuss questions and issues relating to course themes. To get indications on how to optimize the seminar learning process for students, we aimed to investigate relationships between factors that seem to be important for the seminar learning process, and to determine how these seminar factors account for differences in students' achievement scores. A 57-item seminar evaluation (USEME) questionnaire was administered to students right after they attended a seminar. In total, 80 seminars distributed over years 1, 2, and 3 of an undergraduate veterinary medicine curriculum were sampled and 988 questionnaires were handed in. Principal factor analysis (PFA) was conducted on 410 questionnaires to examine which items could be grouped together as indicators of the same factor, and to determine correlations between the derived factors. Multilevel regression analysis was performed to explore the effects of these seminar factors and students' prior achievement scores on students' achievement scores. Within the questionnaire, four factors were identified that influence the seminar learning process: teacher performance, seminar content, student preparation, and opportunities for interaction within seminars. Strong correlations were found between teacher performance, seminar content, and group interaction. Prior achievement scores and, to a much lesser extent, the seminar factor group interaction appeared to account for differences in students' achievement scores. The factors resulting from the present study and their relation to the method of assessment should be examined further, for example, in an experimental setup.

International survey of veterinarians to assess the importance of competencies in professional practice and education.

OBJECTIVE: To determine the perceived importance of specific competencies in professional veterinary practice and education among veterinarians in several countries. DESIGN: Survey-based prospective study. SAMPLE: 1,137 veterinarians in 10 countries. PROCEDURES: Veterinarians were invited via email to participate in the study. A framework of 18 competencies grouped into 7 domains (veterinary expertise, communication, collaboration, entrepreneurship, health and welfare, scholarship, and personal development) was used. Respondents rated the importance of each competency for veterinary professional practice and for veterinary education by use of a 9-point Likert scale in an online questionnaire. Quantitative statistical analyses were performed to assess the data. RESULTS: All described competencies were perceived as having importance (with overall mean ratings [all countries] ≥ 6.45/9) for professional practice and education. Competencies related to veterinary expertise had the highest ratings (overall mean, 8.33/9 for both professional practice and education). For the veterinary expertise, entrepreneurship, and scholarship domains, substantial differences (determined on the basis of statistical significance and effect size) were found in importance ratings among veterinarians in different countries. CONCLUSIONS AND CLINICAL RELEVANCE: Results indicated a general consensus regarding the importance of specific types of competencies in veterinary professional practice and education. Further research into the definition of competencies essential for veterinary professionals is needed to help inform an international dialogue on the subject.

Investigating teaching performance in seminars; a questionnaire study with a multi-level approach.

BACKGROUND: Teachers play an important role in seminars as facilitators and content experts. However, contextual factors like students' preparation, group size, group interaction, and content appear to influence their performance. Understanding the impact of these contextual factors on students' perception of teaching performance may help to further understand seminar teaching. Besides that, it may help curriculum organisers and teachers to get more insight in how to optimise their versatile role in seminars. The aim of this study is to investigate how students' perception of teaching performance in seminars is explained by students' extent of preparation, seminar group size, group interaction, and content. METHODS: The Utrecht Seminar Evaluation (USEME) questionnaire was used to collect information on teaching performance and the aforementioned explanatory variables. To account for intra-student, intra-seminar, and intra-teacher correlation in the data, multilevel regression was used to analyse 988 completed questionnaires in 80 seminars with 36 different teachers. RESULTS: Group interaction and seminar content had large (B = 0.418) and medium (B = 0.212) positive effects on perceived teaching performance scores, whereas the effects of students' preparation (B = -0.055) and group size (B = -0.130) were small and negative. CONCLUSIONS: This study provides curriculum organisers and teachers indications on how to optimise variables that influence perceived teaching performance in seminars. It is suggested that teachers should search for the most appropriate combination of motivating and challenging content and facilitation method within seminars to optimise discussion opportunities between students.

Programmatic assessment of competency-based workplace learning: when theory meets practice.

BACKGROUND: In competency-based medical education emphasis has shifted towards outcomes, capabilities, and learner-centeredness. Together with a focus on sustained evidence of professional competence this calls for new methods of teaching and assessment. Recently, medical educators advocated the use of a holistic, programmatic approach towards assessment. Besides maximum facilitation of learning it should improve the validity and reliability of measurements and documentation of competence development. We explored how, in a competency-based curriculum, current theories on programmatic assessment interacted with educational practice. METHODS: In a development study including evaluation, we investigated the implementation of a theory-based programme of assessment. Between April 2011 and May 2012 quantitative evaluation data were collected and used to guide group interviews that explored the experiences of students and clinical supervisors with the assessment programme. We coded the transcripts and emerging topics were organised into a list of lessons learned. RESULTS: The programme mainly focuses on the integration of learning and assessment by motivating and supporting students to seek and accumulate feedback. The assessment instruments were aligned to cover predefined competencies to enable aggregation of information in a structured and meaningful way. Assessments that were designed as formative learning experiences were increasingly perceived as summative by students. Peer feedback was experienced as a valuable method for formative feedback. Social interaction and external guidance seemed to be of crucial importance to scaffold self-directed learning. Aggregating data from individual assessments into a holistic portfolio judgement required expertise and extensive training and supervision of judges. CONCLUSIONS: A programme of assessment with low-stakes assessments providing simultaneously formative feedback and input for summative decisions proved not easy to implement. Careful preparation and guidance of the implementation process was crucial. Assessment for learning requires meaningful feedback with each assessment. Special attention should be paid to the quality of feedback at individual assessment moments. Comprehensive attention for faculty development and training for students is essential for the successful implementation of an assessment programme.

Clarifying students' feedback-seeking behaviour in clinical clerkships.

CONTEXT: Why and how do students seek feedback on their performance in the clinical workplace and which factors influence this? These questions have remained largely unanswered in research into workplace learning during clinical clerkships. Research on feedback has focused mainly on feedback providers. Whether and how feedback recipients actively seek feedback are under-examined issues. Research in organisational psychology has proposed a mechanism whereby feedback seeking is influenced by motives and goal orientation mediated by the perceived costs and benefits of feedback. Building on a recently published model of resident doctors' feedback-seeking behaviour, we conducted a qualitative study to explore students' feedback-seeking behaviours in the clinical workplace. METHODS: Between April and June 2011, we conducted semi-structured face-to-face interviews with veterinary medicine students in Years 5 and 6 about their feedback-seeking behaviour during clinical clerkships. In the interviews, 14 students were asked about their goals and motives for seeking feedback, the characteristics of their feedback-seeking behaviour and factors influencing that behaviour. Using template analysis, we coded the interview transcripts and iteratively reduced and displayed the data until agreement on the final template was reached. RESULTS: The students described personal and interpersonal factors to explain their reasons for seeking feedback. The factors related to intentions and the characteristics of the feedback provider, and the relationship between the feedback seeker and provider. Motives relating to image and ego, particularly when students thought that feedback might have a positive effect on image and ego, influenced feedback-seeking behaviour and could induce specific behaviours related to students' orientation towards particular sources of feedback, their orientation towards particular topics for and timing of feedback, and the frequency and method of feedback-seeking behaviour. CONCLUSIONS: This study shows that during clinical clerkships, students actively seek feedback according to personal and interpersonal factors. Perceived costs and benefits influenced this active feedback-seeking behaviour. These results may contribute towards the optimising and developing of meaningful educational opportunities during clerkships.

Teachers' perceptions of aspects affecting seminar learning: a qualitative study.

BACKGROUND: Many medical schools have embraced small group learning methods in their undergraduate curricula. Given increasing financial constraints on universities, active learning groups like seminars (with 25 students a group) are gaining popularity. To enhance the understanding of seminar learning and to determine how seminar learning can be optimised it is important to investigate stakeholders' views. In this study, we qualitatively explored the views of teachers on aspects affecting seminar learning. METHODS: Twenty-four teachers with experience in facilitating seminars in a three-year bachelor curriculum participated in semi-structured focus group interviews. Three focus groups met twice with an interval of two weeks led by one moderator. Sessions were audio taped, transcribed verbatim and independently coded by two researchers using thematic analysis. An iterative process of data reduction resulted in emerging aspects that influence seminar learning. RESULTS: Teachers identified seven key aspects affecting seminar learning: the seminar teacher, students, preparation, group functioning, seminar goals and content, course coherence and schedule and facilities. Important components of these aspects were: the teachers' role in developing seminars ('ownership'), the amount and quality of preparation materials, a non-threatening learning climate, continuity of group composition, suitability of subjects for seminar teaching, the number and quality of seminar questions, and alignment of different course activities. CONCLUSIONS: The results of this study contribute to the unravelling of the 'the black box' of seminar learning. Suggestions for ways to optimise active learning in seminars are made regarding curriculum development, seminar content, quality assurance and faculty development.

Development of critically reflective dialogues in communities of health professionals.

Critically reflective dialogues (CRD) are important for knowledge sharing and creating meaning in communities. CRD includes different aspects: being open about mistakes, critical opinion sharing, asking for and giving feedback, experimentation, challenging groupthink and research utilisation. In this article we explore whether CRD aspects change over time, through a study of two dialogues each from six different communities of veterinary health professionals. Change was studied from the perspective of observations, through analysing transcripts of dialogues, and from the perspective of community members' perceptions, through an evaluative discussion with members. The results showed that some communities became more open about mistakes, a finding that is related to an increase in trust. Other observed aspects of CRD seemed to be fairly stable over time. Community members perceived research utilisation and asking for and giving feedback to have been increased. From an analysis of perceptions of the community members it emerged that limited interaction could be associated with the epistemological conceptions of community members.

Effectiveness of a programme design for the development of competence in solving clinical problems.

BACKGROUND: To apply what has been learned theoretically in a clinical context is for many students a major challenge. In order to ease their transition into practice, a training programme was developed, focusing on learning to solve clinical problems. AIMS: The programme is designed for veterinary medicine students in the preclinical phase with already a sound theoretical base in biomedical and clinical sciences. The design is based on the engagement in learning and work processes derived from clinical practice and exposure to a large variety of real and paper-based cases. This article addresses the effectiveness of this programme design. METHOD: Programme effectiveness was defined in terms of the progress made by the students. This progress was established using methodological triangulation of the results from student questionnaires, performance observations and (pre and post) assessment. RESULTS: On all dimensions of effectiveness, the results consistently showed that the programme was perceived as effective and led to improved performances in solving clinical problems and better solutions in the assessment. The students' progress was substantial. CONCLUSIONS: At preclinical level, a course design based on the work processes in clinical practice and a mixture of real and paper-based patients is effective in enhancing problem-solving competence.

Evaluating clinical teachers with the Maastricht clinical teaching questionnaire: how much 'teacher' is in student ratings?

BACKGROUND: Students are a popular source of data to evaluate the performance of clinical teachers. Instruments to obtain student evaluations must have proven validity. One aspect of validity that often remains underexposed is the possibility of effects of between-student differences and teacher and student characteristics not directly related to teaching performance. AIM: The authors examined the occurrence of such effects, using multilevel analysis to analyse data from the Maastricht clinical teaching questionnaire (MCTQ), a validated evaluation instrument, in a veterinary curriculum. METHODS: The 15-item MCTQ covers five domains. The authors used multilevel analysis to divide the variance in the domain scores in components related to, respectively, teachers and students. They estimated subsequent models to explore how the MCTQ scores are dependent on teacher and student characteristics. RESULTS: Significant amounts of variance in student ratings were due to between-teacher differences, particularly for learning climate, modelling and coaching. The effects of teacher and student characteristics were mostly non-significant or small. CONCLUSION: Large portions of variance in MCTQ scores were due to differences between teachers, while the contribution of student and teacher characteristics was negligible. The results support the validity of student ratings obtained with the MCTQ for evaluating teacher performance.

An instructional model for training competence in solving clinical problems.

We examined the design of a course that aims to ease the transition from pre-clinical learning into clinical work. This course is based on the premise that many of the difficulties with which students are confronted in this transition result from a lack of experience in applying knowledge in real practice situations. It is focused on the development of competence in solving clinical problems; uses an instructional model with alternating clinical practicals, demonstrations, and tutorials; and extends throughout the last pre-clinical year. We used a "proof-of-concept" approach to establish whether the core principles of the course design are feasible with regard to achieving the intended results. With the learning functions and processes as a frame of reference, retrospective analysis of the course's design features shows that this design matches the conditions from theories of the development of competence in solving clinical problems and instructional design. Three areas of uncertainty in the design are identified: the quality of the cases (information, openness), effective teaching (student and teacher roles), and adjustment to the development of competence (progress, coherence).

Developing an online professional network for veterinary education: the NOVICE project.

An online professional network for veterinarians, veterinary students, veterinary educationalists, and ICT (Information and Communication Technology) educationalists is being developed under the EU (European Union) Lifelong Learning Programme. The network uses Web 2.0, a term used to describe the new, more interactive version of the Internet, and includes tools such as wikis, blogs, and discussion boards. Focus groups conducted with qualified and student veterinarians within the project's five founding countries (The Netherlands, Germany, United Kingdom, Hungary, Romania) demonstrated that online professional communities can be valuable for accessing information and establishing contacts. Online networks have the potential to overcome common challenges to face-to-face communities-such as distance, cost, and timing-but they have their own drawbacks, such as security and professionalism issues. The Network Of Veterinary ICt in Education (NOVICE) was developed using Elgg, an open-source, free social networking platform, after several software options had been considered. NOVICE aims to promote the understanding of Web 2.0, confidence to use social software tools, and participation in an online community. Therefore, the Web site contains help sections, Frequently Asked Questions, and access to support from ICT experts. Five months after the network's launch (and just over one year into the project) 515 members from 28 countries had registered. Further research will include analysis of a core group's activities, which will inform ongoing support for and development of informal, lifelong learning in a veterinary context.

Peer group reflection helps clinical teachers to critically reflect on their teaching.

BACKGROUND: Student evaluations can help clinical teachers to reflect on their teaching skills and find ways to improve their teaching. Studies have shown that the mere presentation of student evaluations is not a sufficient incentive for teachers to critically reflect on their teaching. AIM: We evaluated and compared the effectiveness of two feedback facilitation strategies that were identical except for a peer reflection meeting. METHOD: In this study, 54 clinical teachers were randomly assigned to two feedback strategies. In one strategy, a peer reflection was added as an additional step. All teachers completed a questionnaire evaluating the strategy that they had experienced. We analysed the reflection reports and the evaluation questionnaire. RESULTS: Both strategies stimulated teachers to reflect on feedback and formulate alternative actions for their teaching practice. The teachers who had participated in the peer reflection meeting showed deeper critical reflection and more concrete plans to change their teaching. All feedback strategies were considered effective by the majority of the teachers. CONCLUSIONS: Strategies with student feedback and self-assessment stimulated reflection on teaching and helped clinical teachers to formulate plans for improvement. A peer reflection meeting seemed to enhance reflection quality. Further research should establish whether it can have lasting effects on teaching quality.

Development and validation of a competency framework for veterinarians.

Changing demands from society and the veterinary profession call for veterinary medical curricula that can deliver veterinarians who are able to integrate specific and generic competencies in their professional practice. This requires educational innovation directed by an integrative veterinary competency framework to guide curriculum development. Given the paucity of relevant information from the veterinary literature, a qualitative multi-method study was conducted to develop and validate such a framework. A competency framework was developed based on the analysis of focus group interviews with 54 recently graduated veterinarians and clients and subsequently validated in a Delphi procedure with a panel of 29 experts, representing the full range and diversity of the veterinary profession. The study resulted in an integrated competency framework for veterinary professionals, which consists of 16 competencies organized in seven domains: veterinary expertise, communication, collaboration, entrepreneurship, health and welfare, scholarship, and personal development. Training veterinarians who are able to use and integrate the seven domains in their professional practice is an important challenge for today's veterinary medical schools. The Veterinary Professional (VetPro) framework provides a sound empirical basis for the ongoing debate about the direction of veterinary education and curriculum development.

WSAVA Nutritional Assessment Guidelines.

Careful assessment of nutritional needs of dogs and cats must be taken into consideration in order to maintain optimum health, be part of a treatment regimen for a diseased state, or to maximize the quality of life in all animals. Therefore, the goal of these WSAVA Guidelines is that a nutritional assessment and specific nutritional recommendation be made on every patient on every visit. This will become known as the 5th Vital Assessment (5VA), following the four vital assessments of temperature, pulse, respiration, and pain that are already addressed on each patient interaction.

Undergraduate research internships: veterinary students' experiences and the relation with internship quality.

UNLABELLED: The learning environment of undergraduate research internships has received little attention, compared to postgraduate research training. This study investigates students' experiences with research internships, particularly the quality of supervision, development of research skills, the intellectual and social climate, infrastructure support, and the clarity of goals and the relationship between the experiences and the quality of students' research reports and their overall satisfaction with internships. METHOD: A questionnaire (23 items, a 5-point Likert scale) was administered to 101 Year five veterinary students after completion of a research internship. Multiple linear regression analyses were conducted with quality of supervision, development of research skills, climate, infrastructure and clarity of goals as independent variables and the quality of students' research reports and students' overall satisfaction as dependent variables. RESULTS: The response rate was 79.2%. Students' experiences are generally positive. Students' experiences with the intellectual and social climate are significantly correlated with the quality of research reports whilst the quality of supervision is significantly correlated with both the quality of research reports and students' overall satisfaction with the internship. CONCLUSION: Both the quality of supervision and the climate are found to be crucial factors in students' research learning and satisfaction with the internship.