Comparative Effectiveness of Training with Simulators Versus Traditional Instruction in Veterinary Education: Meta-Analysis and Systematic Review.

One of the greatest challenges in veterinary education is adequately preparing students with the clinical skills they need to be successful health care providers. Integration of simulators, devices used to represent real world phenomena under test conditions, into the veterinary curriculum can help address challenges to clinical instruction. The use of simulators in veterinary education is increasing; however, their effectiveness remains unclear. This meta-analysis seeks to synthesize the evidence for simulator training in veterinary education to provide a consensus of effect, guide the integration of simulators into the curriculum, and direct the development of future simulation-based research in veterinary medicine. A systematic search identified 416 potential manuscripts from which 60 articles were included after application of inclusion criteria. Information was extracted from 71 independent experiments. The overall weighted mean effect size for simulator training was g = 0.49 for the random-effects model. The outcome measures of knowledge, time, process, and product all produced statistically significant mean effect sizes favoring simulation (d = 0.41, 0.35, 0.70, 0.53, respectively). A moderator analysis revealed that study characteristics and instructional design features moderated the effectiveness of simulator training. Overall, the results indicate that simulator training in veterinary education can be effective for knowledge and clinical skill outcomes.

Development of a veterinary emergency open standard competency framework using a competency-based model of medical education.

OBJECTIVE: To address the shortage of emergency veterinarians, the profession is exploring accelerated training pathways. We sought to contribute to the solution by developing the foundation for an open standard, competency-based veterinary emergency training curriculum for use by any program. We also developed a curricular delivery, tracking, and assessment system to demonstrate how the framework can be integrated into training programs.  DESIGN: Hybrid Delphi method.  SETTING: Academia and referral practice.  ANIMALS: None. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: An emergency veterinary competency framework was developed by adapting the human Model of the Clinical Practice of Emergency Medicine, which aligns with the Competency-Based Veterinary Education framework, to produce 4 areas of core competency: Patient Care, Interpersonal/Communication, Professionalism, and Practice-based Learning/Improvement. A comprehensive list of veterinary emergency skills was generated and organized within the framework utilizing the hybrid Delphi method. An initial survey completed by 133 emergency and critical care specialists and emergency room clinicians produced data regarding the value of specific skills. An 11-member focus group consisting of survey participants iterated upon the survey results to produce a master library of skills and cases, including 56 Patient Care, 43 Interpersonal/Communication, 11 Practice-based Learning/Improvement, and 20 Professionalism skills, as well as 155 case types. The curricular delivery system tracks and assesses case management proficiency and development of knowledge and professional skills using a patient care eLearning program and simulation training environment.  CONCLUSIONS: The increasing need for emergency veterinarians is a shared industry-wide challenge. To contribute toward a collective solution, we have undergone an evidence-based process to create the foundation for an open standard competency framework composed of a library of skills and cases. We offer this open standard framework to the veterinary profession and hope it continues to grow and evolve as we drive toward developing competency-based training programs that address the shortage of emergency veterinarians.

Evaluating a Multimodal Clinical Anesthesia Course Integrated Into an Existing Veterinary Curriculum.

INTRODUCTION: This study evaluated a multimodal, simulation-based course in veterinary anesthesia integrated into an existing veterinary curriculum. METHODS: A simulation-based, multimodal training course in clinical anesthesia was evaluated using outcomes from multiple levels of the Kirkpatrick Model of Training Evaluation. Cognitive and affective outcomes were evaluated before and after instruction. Head-mounted cameras were used to record clinical performance during students' first live patient anesthesia experience in the curriculum. RESULTS: Pretest-posttest analysis of cognitive and affective outcomes for course participants revealed significant increases in knowledge and self-efficacy. Course participants received higher ratings on clinical task performance and professional skills (ie, communication and collaboration) compared with a matched control group when evaluated by blinded, external raters using a standardized rubric. CONCLUSIONS: These findings indicate that implementing a multimodal anesthesia simulation-based course directly into the curriculum can enhance cognitive and affective outcomes and prepare students for subsequent anesthesia-related patient care experiences.

A systematic review of digital badges in health care education.

OBJECTIVES: A challenge to competency-based medical education is the verification of skill acquisition. Digital badges represent an innovative instruction strategy involving the credentialing of competencies to provide evidence for achievement. Despite increasing interest in digital badges, there has been no synthesis of the health care education literature regarding this credentialing strategy. The present authors proposed to address this gap by conducting the first systematic review of digital badges in health care education, to reveal pedagogical and research limitations, and to provide an evidence-based foundation for the design and implementation of digital badges. METHODS: A systematic search of the medical education literature from January 2008 to March 2019 was conducted using MEDLINE, Web of Science, CAB Abstracts and ScienceDirect. Included studies described digital badges in academic or professional medical education programmes in any health care profession. Included studies were appraised and quality assessment, methodological scoring, quantitative analysis and thematic extraction were conducted. RESULTS: A total of 1050 relevant records were screened for inclusion; 201 full text articles were then assessed for eligibility, which resulted in the identification of 30 independent papers for analysis. All records had been published since 2013; 77% were journal articles, and 83% involved academic health care education programmes. Scores for quality were relatively moderate. Thematic analyses revealed implications for the design and implementation of digital badges: learner characteristics may moderate student outcomes; the novelty effect can negate the value of digital badges, and educators may overcome instruction-related challenges with digital badges using design and implementation strategies such as the creation of badging ecosystems. CONCLUSIONS: The results indicate a growing momentum for the use of digital badges as an innovative instruction and credentialing strategy within higher education and provide evidence for outcomes within a learner-centred, competency-based model of medical education. There is a paucity of research to support the design and implementation of this credentialing system in health care education. The potential benefits necessitate future high-quality analyses reporting institutional, patient and workplace-based outcomes to evaluate the effectiveness and moderating conditions of digital badges.

Is a Picture Worth a Thousand Words? Evaluating the Design of Instructional Animations in Veterinary Education.

Empirical evidence demonstrates that student learning outcomes improve when animations are developed in alignment with the design principles of the cognitive theory of multimedia learning (CTML). The extent to which these principles are used in the design of veterinary instructional animations is unknown. In this study, we reviewed the veterinary education literature for articles that discussed specific veterinary medical animations as learning resources. The 30 referenced animations accessed through this search were analyzed to determine whether they used the CTML's 11 major design principles. Analysis revealed that the animations most commonly adhered to only 4 principles: coherence, redundancy, modality, and spatial contiguity. The majority of the 11 CTML principles were used in fewer than 40% of the animations. We also examined the alignment between raters' perceptions of the effectiveness and enjoyment of the animations and adherence to the design principles. Analyses revealed that the animations deemed by raters as most enjoyable and effective did not utilize more design principles than animations they viewed as least enjoyable and effective. The results of this study indicate many missed opportunities to increase learning by developing animated learning resources according to empirically based design principles. Decisions to include specific animations in instruction should be based on whether the resources include elements that have been shown to increase learning rather than subjective perceptions of effectiveness and enjoyment.

Magnetic resonance imaging versus computed tomography to plan hemilaminectomies in chondrodystrophic dogs with intervertebral disc extrusion.

OBJECTIVE: To determine the influence of preoperative computed tomography (CT) versus magnetic resonance (MR) on hemilaminectomies planned to treat thoracolumbar (TL) intervertebral disc (IVD) extrusions in chondrodystrophic dogs. STUDY DESIGN: Prospective clinical study. SAMPLE POPULATION: Forty chondrodystrophic dogs with TL IVD extrusion and preoperative CT and MR studies. METHODS: MR and CT images were randomized and reviewed by 4 observers masked to the dog's identity and corresponding imaging studies. Observers planned the location along the spine, side, and extent (number of articular facets to be removed) based on individual reviews of CT and MR studies. Intra-observer agreement was determined between overall surgical plan, location, side, and size of the hemilaminectomy planned on CT versus MR of the same dog. RESULTS: Similar surgical plans were developed based on MR versus CT in 43.5%-66.6% of dogs, depending on the observer. Intra-observer agreement in location, side, and size of the planned hemilaminectomy based on CT versus MR ranged between 48.7%-66.6%, 87%-92%, and 51.2%-71.7% of dogs, respectively. Observers tended to plan larger laminectomy defects based on MR versus CT of the same dog. CONCLUSION: Findings from this study indicated considerable differences in hemilaminectomies planned on preoperative MR versus CT imaging. Surgical location and size varied the most; the side of planned hemilaminectomies was most consistent between imaging modalities.

Instrument Motion Metrics for Laparoscopic Skills Assessment in Virtual Reality and Augmented Reality.

OBJECTIVE: To determine the construct and concurrent validity of instrument motion metrics for laparoscopic skills assessment in virtual reality and augmented reality simulators. STUDY DESIGN: Evaluation study. SAMPLE POPULATION: Veterinarian students (novice, n = 14) and veterinarians (experienced, n = 11) with no or variable laparoscopic experience. METHODS: Participants' minimally invasive surgery (MIS) experience was determined by hospital records of MIS procedures performed in the Teaching Hospital. Basic laparoscopic skills were assessed by 5 tasks using a physical box trainer. Each participant completed 2 tasks for assessments in each type of simulator (virtual reality: bowel handling and cutting; augmented reality: object positioning and a pericardial window model). Motion metrics such as instrument path length, angle or drift, and economy of motion of each simulator were recorded. RESULTS: None of the motion metrics in a virtual reality simulator showed correlation with experience, or to the basic laparoscopic skills score. All metrics in augmented reality were significantly correlated with experience (time, instrument path, and economy of movement), except for the hand dominance metric. The basic laparoscopic skills score was correlated to all performance metrics in augmented reality. The augmented reality motion metrics differed between American College of Veterinary Surgeons diplomates and residents, whereas basic laparoscopic skills score and virtual reality metrics did not. CONCLUSION: Our results provide construct validity and concurrent validity for motion analysis metrics for an augmented reality system, whereas a virtual reality system was validated only for the time score.