Effectiveness of an Online Preceptor Development Program Across Health Professions.

Introduction: An online Preceptor Development Program (PDP) was developed to meet the needs of geographically dispersed preceptors across health professions. We aimed to measure the audience, their engagement, and effectiveness of an online PDP developed and implemented amid the COVID-19 pandemic. Methods: The mixed methods study included survey and attendance data for live and asynchronous formats. T-tests compared overall session perception to self-reported session impact. Objective alignment and self-reported measures of impact were analyzed around Kirkpatrick's levels of reaction, learning, and behavior. Results: Participants engaged in live and/or asynchronous PDP sessions from various professions, specialties, and geographical locations. Quantitative findings indicated significant associations between overall session perception and knowledge (session 2), competence (sessions 1, 2), and performance (session 1). Objectives were met, and key learning takeaways were reported. While most participants indicated no barriers to implementation, two barriers identified were a lack of time and uninterested students. Conclusion: Participants were afforded flexibility and choice and likely benefitted in the areas of knowledge, competence, and behavior. This online PDP effectively addressed preceptor needs in common areas, including feedback. Future program development may include advisory group input and interactive learning opportunities.

Anesthesia in medical school: A simulation-based curriculum proposal

Introduction Most medical students are not familiar with Anesthesiology, as it is infrequently addressed properly in medical school curricula. However, anesthesiology skills are widely practiced across specialties and commonly performed by general practitioners. Currently, anesthesia curricula are often based on shadowing and lectures without emphasizing relevant skills, behaviors, and attitudes, whereas simulation-based curricula enable a holistic evaluation of the trainee. Objective To implement and assess the perceptions of students and professors of a novel simulation-based anesthesiology curriculum. Methods A descriptive study was planned for evaluating the new proposal. A simulation-based 3-week curriculum was organized using a blended course with skill laboratories. We designed flipped classroom-based lectures (2 weeks) combined with activities using standardized patients, manikins, and hybrid scenarios (1 week). After each activity, feedback was given by an anesthesiologist, as well as individual grading and a survey based on the Kirkpatrick levels. Results From June to November 2020, 53 students were enrolled in the clerkship. Each week, every group of 6-8 students was assigned to the same specialist to perform the activities and track individual progress. The response rate of the survey was 83%. Across the levels of Kirkpatrick, there was an excellent opinion of the activities, as well as a high similarity between the perception of both students and professors. Conclusion Our simulation-based curriculum, which was highly appraised by students and professors, was found to be feasible, appealing, and offered a good introduction to the principles and practices of anesthesiology to medical students.

Introducción: La mayoría de los estudiantes de medicina no están familiarizados con la Anestesiología, ya que la materia pocas veces se aborda adecuadamente en el programa académico de la facultad de medicina. Sin embargo, las habilidades en anestesiología son ampliamente utilizadas por los médicos generales. En la actualidad los currículos de anestesiología suelen basarse en prácticas y conferencias donde no se enfatizan las destrezas pertinentes, las conductas y las actitudes, mientras que los currículos basados en simulación permiten una evaluación integral del aprendiz. Objetivo: Implementar y evaluar las percepciones de estudiantes y de los profesores de un novedoso plan de estudios de anestesiología basado en la simulación. Métodos: Se diseñó un estudio descriptivo para valorar la nueva propuesta. Se organizó un plan de estudios de 3 semanas, basado en simulación, utilizando un curso mixto con habilidades de laboratorio. Diseñamos conferencias basadas en el modelo de aula invertida (2 semanas), combinadas con actividades basadas en pacientes estandarizados, maniquíes y escenarios híbridos (1 semana). Luego de cada actividad, un anestesiólogo ofrecía su retroalimentación, así como calificaciones individuales y una encuesta basada en los niveles de Kirkpatrick. Resultados: Se inscribieron 53 estudiantes en la pasantía de junio a noviembre de 2020. Cada semana se asignaba un grupo de 6-8 estudiantes a un mismo especialista para llevar a cabo las actividades y hacer un seguimiento al progreso alcanzado de manera individual. La tasa de respuesta de la encuesta fue de 83%. En todos los niveles de Kirkpatrick, hubo una excelente opinión sobre las actividades y una elevada similitud en la percepción, tanto de los estudiantes como de los profesores. Conclusión: Nuestro currículo basado en simulación fue muy bien valorado por estudiantes y profesores y se consideró factible, atractivo y que ofrecía a los estudiantes una buena introducción a los principios y prácticas de la anestesiología.

Feasibility of Including Hands-On Microteaching in the Medical Faculty Development Program in India: A Mixed-Methods Study.

Background Medical faculty development programs (FDPs) often lack hands-on training in teaching skills. Microteaching, a short, focused teaching practice, could be a feasible way to bridge this gap. This study aimed to explore the feasibility of including hands-on microteaching in a medical FDP in India. Methodology This mixed-methods study involved fresh medical faculty members who never attended FDP on the basics of medical education technologies, stakeholders, and students from a recently established autonomous medical institute of national importance in India. Participants completed a pre-test survey on their teaching skills and received a hands-on microteaching session during an FDP. After the session, participants completed a post-test survey and provided feedback on the feasibility and acceptability of hands-on microteaching in the program. Program evaluation was done by application of Kirkpatrick's Model levels one, two, and three. Results According to the Kirkpatrick Model of Evaluation level one (Reaction), the participants reported improved teaching skills and greater confidence in their ability to teach after the microteaching session. They also reported that hands-on microteaching was an effective way to learn teaching skills and receive feedback. Stakeholders opined that microteaching is a very effective tool for improving teaching skills and should be a part of FDP. Evaluation at level two (Learning) shows that there was a significant improvement in the mean score of post-tests. As per level three (Behaviour Change) evaluation, the majority of the students informed that there is observable improvement in the effectiveness of teaching of faculties in the past two months, i.e., since the participation of faculty in hands-on microteaching in FDP. Conclusions Hands-on microteaching could be a feasible and effective way to enhance the teaching skills of medical faculty members in India. The study findings suggest that including hands-on microteaching in FDPs could help bridge the gap between theoretical knowledge and practical teaching skills.

Analysing synthesis of evidence in a systematic review in health professions education: observations on struggling beyond Kirkpatrick.

Background: Systematic reviews in health professions education may well under-report struggles to synthesize disparate evidence that defies standard quantitative approaches. This paper reports further process analysis in a previously reported systematic review about mobile devices on clinical placements.Objective: For a troublesome systematic review: (1) Analyse further the distribution and reliability of classifying the evidence to Maxwell quality dimensions (beyond 'Does it work?') and their overlap with Kirkpatrick K-levels. (2) Analyse how the abstracts represented those dimensions of the evidence-base. (3) Reflect on difficulties in synthesis and merits of Maxwell dimensions.Design: Following integrative synthesis of 45 K2-K4 primary studies (by combined content-thematic analysis in the pragmatism paradigm): (1) Hierarchical cluster analysis explored overlap between Maxwell dimensions and K-levels. Independent and consensus-coding to Maxwell dimensions compared (using: percentages; kappa; McNemar hypothesis-testing) pre- vs post-discussion and (2) article abstract vs main body. (3) Narrative summary captured process difficulties and merits.Results: (1) The largest cluster (five-cluster dendrogram) was acceptability-accessibility-K1-appropriateness-K3, with K1 and K4 widely separated. For article main bodies, independent coding agreed most for appropriateness (good; adjusted kappa = 0.78). Evidence increased significantly pre-post-discussion about acceptability (p = 0.008; 31/45→39/45), accessibility, and equity-ethics-professionalism. (2) Abstracts suggested efficiency significantly less than main bodies evidenced: 31.1% vs 44.4%, p = 0.031. 3) Challenges and merits emerged for before, during, and after the review.Conclusions: There should be more systematic reporting of process analysis about difficulties synthesizing suboptimal evidence-bases. In this example, Maxwell dimensions were a useful framework beyond K-levels for classifying and synthesizing the evidence-base.

What is the impact of multi-professional emergency obstetric and neonatal care training?

This paper reviews evidence regarding change in health-care provider behaviour and maternal and neonatal outcomes as a result of emergency obstetric and neonatal care (EmONC) training. A refined version of the Kirkpatrick classification for programme evaluation was used to focus on change in efficiency and impact of training (levels 3 and 4). Twenty-three studies were reviewed - five randomised controlled trials, two quasi-experimental studies and 16 before-and-after observational studies. Training programmes had all been developed in high-income countries and adapted for use in low- and middle-income countries. Nine studies reported on behaviour change and 13 on process and patient outcomes. Most showed positive results. Every maternity unit should provide EmONC teamwork training, mandatory for all health-care providers. The challenges are as follows: scaling up such training to all institutions, sustaining regular in-service training, integrating training into institutional and health-system patient safety initiatives and 'thinking out of the box' in evaluation research.