How can we teach EBM in clinical practice? An analysis of barriers to implementation of on-the-job EBM teaching and learning.

INTRODUCTION: Evidence-based medicine (EBM) improves the quality of health care. Courses on how to teach EBM in practice are available, but knowledge does not automatically imply its application in teaching. We aimed to identify and compare barriers and facilitators for teaching EBM in clinical practice in various European countries. METHODS: A questionnaire was constructed listing potential barriers and facilitators for EBM teaching in clinical practice. Answers were reported on a 7-point Likert scale ranging from not at all being a barrier to being an insurmountable barrier. RESULTS: The questionnaire was completed by 120 clinical EBM teachers from 11 countries. Lack of time was the strongest barrier for teaching EBM in practice (median 5). Moderate barriers were the lack of requirements for EBM skills and a pyramid hierarchy in health care management structure (median 4). In Germany, Hungary and Poland, reading and understanding articles in English was a higher barrier than in the other countries. CONCLUSION: Incorporation of teaching EBM in practice faces several barriers to implementation. Teaching EBM in clinical settings is most successful where EBM principles are culturally embedded and form part and parcel of everyday clinical decisions and medical practice.

How are "teaching the teachers" courses in evidence based medicine evaluated? A systematic review.

BACKGROUND: Teaching of evidence-based medicine (EBM) has become widespread in medical education. Teaching the teachers (TTT) courses address the increased teaching demand and the need to improve effectiveness of EBM teaching. We conducted a systematic review of assessment tools for EBM TTT courses. To summarise and appraise existing assessment methods for teaching the teachers courses in EBM by a systematic review. METHODS: We searched PubMed, BioMed, EmBase, Cochrane and Eric databases without language restrictions and included articles that assessed its participants. Study selection and data extraction were conducted independently by two reviewers. RESULTS: Of 1230 potentially relevant studies, five papers met the selection criteria. There were no specific assessment tools for evaluating effectiveness of EBM TTT courses. Some of the material available might be useful in initiating the development of such an assessment tool. CONCLUSION: There is a need for the development of educationally sound assessment tools for teaching the teachers courses in EBM, without which it would be impossible to ascertain if such courses have the desired effect.

Effectiveness of an e-learning course in evidence-based medicine for foundation (internship) training.

AIM: To evaluate the educational effectiveness of a clinically integrated e-learning course for teaching basic evidence-based medicine (EBM) among postgraduate medical trainees compared to a traditional lecture-based course of equivalent content. METHODS: We conducted a cluster randomized controlled trial to compare a clinically integrated e-learning EBM course (intervention) to a lecture-based course (control) among postgraduate trainees at foundation or internship level in seven teaching hospitals in the UK West Midlands region. Knowledge gain among participants was measured with a validated instrument using multiple choice questions. Change in knowledge was compared between groups taking into account the cluster design and adjusted for covariates at baseline using generalized estimating equations (GEE) model. RESULTS: There were seven clusters involving teaching of 237 trainees (122 in the intervention and 115 in the control group). The total number of postgraduate trainees who completed the course was 88 in the intervention group and 72 in the control group. After adjusting for baseline knowledge, there was no difference in the amount of improvement in knowledge of EBM between the two groups. The adjusted post course difference between the intervention group and the control group was only 0.1 scoring points (95% CI -1.2-1.4). CONCLUSION: An e-learning course in EBM was as effective in improving knowledge as a standard lecture-based course. The benefits of an e-learning approach need to be considered when planning EBM curricula as it allows standardization of teaching materials and is a potential cost-effective alternative to standard lecture-based teaching.

Teaching trainers to incorporate evidence-based medicine (EBM) teaching in clinical practice: the EU-EBM project.

BACKGROUND: Evidence based medicine (EBM) is considered an integral part of medical training, but integration of teaching various EBM steps in everyday clinical practice is uncommon. Currently EBM is predominantly taught through theoretical courses, workshops and e-learning. However, clinical teachers lack confidence in teaching EBM in workplace and are often unsure of the existing opportunities for teaching EBM in the clinical setting. There is a need for continuing professional development (CPD) courses that train clinical trainers to teach EBM through on-the-job training by demonstration of applied EBM real time in clinical practice. We developed such a course to encourage clinically relevant teaching of EBM in post-graduate education in various clinical environments. METHODS: We devised an e-learning course targeting trainers with EBM knowledge to impart educational methods needed to teach application of EBM teaching in commonly used clinical settings. The curriculum development group comprised experienced EBM teachers, clinical epidemiologists, clinicians and educationalists from institutions in seven European countries. The e-learning sessions were designed to allow participants (teachers) to undertake the course in the workplace during short breaks within clinical activities. An independent European steering committee provided input into the process. RESULTS: The curriculum defined specific learning objectives for teaching EBM by exploiting educational opportunities in six different clinical settings. The e-modules incorporated video clips that demonstrate practical and effective methods of EBM teaching in everyday clinical practice. The course encouraged focussed teaching activities embedded within a trainer's personal learning plan and documentation in a CPD portfolio for reflection. CONCLUSION: This curriculum will help senior clinicians to identify and make the best use of available opportunities in everyday practice in clinical situations to teach various steps of EBM and demonstrate their applicability to clinical practice. Once fully implemented, the ultimate outcome of this pilot project will be a European qualification in teaching EBM, which will be used by doctors, hospitals, professional bodies responsible for postgraduate qualifications and continuing medical education.

The effectiveness of a clinically integrated e-learning course in evidence-based medicine: a cluster randomised controlled trial.

BACKGROUND: To evaluate the educational effects of a clinically integrated e-learning course for teaching basic evidence-based medicine (EBM) among postgraduates compared to a traditional lecture-based course of equivalent content. METHODS: We conducted a cluster randomised controlled trial in the Netherlands and the UK involving postgraduate trainees in six obstetrics and gynaecology departments. Outcomes (knowledge gain and change in attitude towards EBM) were compared between the clinically integrated e-learning course (intervention) and the traditional lecture based course (control). We measured change from pre- to post-intervention scores using a validated questionnaire assessing knowledge (primary outcome) and attitudes (secondary outcome). RESULTS: There were six clusters involving teaching of 61 postgraduate trainees (28 in the intervention and 33 in the control group). The intervention group achieved slightly higher scores for knowledge gain compared to the control, but these results were not statistically significant (difference in knowledge gain: 3.5 points, 95% CI -2.7 to 9.8, p = 0.27). The attitudinal changes were similar for both groups. CONCLUSION: A clinically integrated e-learning course was at least as effective as a traditional lecture based course and was well accepted. Being less costly than traditional teaching and allowing for more independent learning through materials that can be easily updated, there is a place for incorporating e-learning into postgraduate EBM curricula that offer on-the-job training for just-in-time learning. TRIAL REGISTRATION NUMBER: ACTRN12609000022268.

How far did we get? How far to go? A European survey on postgraduate courses in evidence-based medicine.

BACKGROUND: Over the past decade, evidence-based medicine (EBM) has gained recognition as a means to improve the quality of health care provision. However, little is known about learning opportunities to acquire EBM-associated skills. The EUebm-Unity partnership explored current educational activities for EBM practice for doctors across Europe. METHODS: We surveyed organizations offering postgraduate EBM courses across Europe inquiring about their course programme, teaching content and strategies, and interest in a Europe-wide curriculum in EBM. RESULTS: One hundred and fifty-six organizers in eight European countries reported 403 courses that had started first-time from 1996 to 2006. Despite a steady increase, in absolute terms, the frequency of courses was low and varied from 1 first-time offering of a course per 640 doctors (Spain) to 1 first-time offering per 5600 doctors (Austria) over 10 years. Most adopted the McMaster EBM teaching concept of small group, problem-based learning focussing on interventions, diagnostic tests and guidelines, and included efforts to link EBM to patient care. Teaching staff consisted of doctors from academic and non-academic settings, supported by methodologists. Efforts to formally integrate EBM in postgraduate activities were only partially successful. Most organizations welcomed a standardized European qualification in EBM. A limitation of the survey is the lack of follow-up information about the continuation of courses following the first-time offering. CONCLUSIONS: All countries offer some EBM courses with varying teaching intensity. Learning opportunities are insufficient to ensure widespread dissemination of knowledge and skills. Most countries welcome more efforts to develop inexpensive and feasible educational activities at a postgraduate level.

Harmonising evidence-based medicine teaching: a study of the outcomes of e-learning in five European countries.

BACKGROUND: We developed and evaluated the outcomes of an e-learning course for evidence based medicine (EBM) training in postgraduate medical education in different languages and settings across five European countries. METHODS: We measured changes in knowledge and attitudes with well-developed assessment tools before and after administration of the course. The course consisted of five e-learning modules covering acquisition (formulating a question and search of the literature), appraisal, application and implementation of findings from systematic reviews of therapeutic interventions, each with interactive audio-visual learning materials of 15 to 20 minutes duration. The modules were prepared in English, Spanish, German and Hungarian. The course was delivered to 101 students from different specialties in Germany (psychiatrists), Hungary (mixture of specialties), Spain (general medical practitioners), Switzerland (obstetricians-gynaecologists) and the UK (obstetricians-gynaecologists). We analysed changes in scores across modules and countries. RESULTS: On average across all countries, knowledge scores significantly improved from pre- to post-course for all five modules (p < 0.001). The improvements in scores were on average 1.87 points (14% of total score) for module 1, 1.81 points (26% of total score) for module 2, 1.9 points (11% of total score) for module 3, 1.9 points (12% of total score) for module 4 and 1.14 points (14% of total score) for module 5. In the country specific analysis, knowledge gain was not significant for module 4 in Spain, Switzerland and the UK, for module 3 in Spain and Switzerland and for module 2 in Spain. Compared to pre-course assessment, after completing the course participants felt more confident that they can assess research evidence and that the healthcare system in their country should have its own programme of research about clinical effectiveness. CONCLUSION: E-learning in EBM can be harmonised for effective teaching and learning in different languages, educational settings and clinical specialties, paving the way for development of an international e-EBM course.

A clinically integrated curriculum in evidence-based medicine for just-in-time learning through on-the-job training: the EU-EBM project.

BACKGROUND: Over the last years key stake holders in the healthcare sector have increasingly recognised evidence based medicine (EBM) as a means to improving the quality of healthcare. However, there is considerable uncertainty about the best way to disseminate basic knowledge of EBM. As a result, huge variation in EBM educational provision, setting, duration, intensity, content, and teaching methodology exists across Europe and worldwide. Most courses for health care professionals are delivered outside the work context ('stand alone') and lack adaptation to the specific needs for EBM at the learners' workplace. Courses with modern 'adaptive' EBM teaching that employ principles of effective continuing education might fill that gap. We aimed to develop a course for post-graduate education which is clinically integrated and allows maximum flexibility for teachers and learners. METHODS: A group of experienced EBM teachers, clinical epidemiologists, clinicians and educationalists from institutions from eight European countries participated. We used an established methodology of curriculum development to design a clinically integrated EBM course with substantial components of e-learning. An independent European steering committee provided input into the process. RESULTS: We defined explicit learning objectives about knowledge, skills, attitudes and behaviour for the five steps of EBM. A handbook guides facilitator and learner through five modules with clinical and e-learning components. Focussed activities and targeted assignments round off the learning process, after which each module is formally assessed. CONCLUSION: The course is learner-centred, problem-based, integrated with activities in the workplace and flexible. When successfully implemented, the course is designed to provide just-in-time learning through on-the-job-training, with the potential for teaching and learning to directly impact on practice.