Integrating virtual patients into undergraduate health professions curricula: a framework synthesis of stakeholders' opinions based on a systematic literature review.

BACKGROUND: Virtual patients (VPs) are widely used in health professions education. When they are well integrated into curricula, they are considered to be more effective than loosely coupled add-ons. However, it is unclear what constitutes their successful integration. The aim of this study was to identify and synthesise the themes found in the literature that stakeholders perceive as important for successful implementation of VPs in curricula. METHODS: We searched five databases from 2000 to September 25, 2023. We included qualitative, quantitative, mixed-methods and descriptive case studies that defined, identified, explored, or evaluated a set of factors that, in the perception of students, teachers, course directors and researchers, were crucial for VP implementation. We excluded effectiveness studies that did not consider implementation characteristics, and studies that focused on VP design factors. We included English-language full-text reports and excluded conference abstracts, short opinion papers and editorials. Synthesis of results was performed using the framework synthesis method with Kern's six-step model as the initial framework. We appraised the quality of the studies using the QuADS tool. RESULTS: Our search yielded a total of 4808 items, from which 21 studies met the inclusion criteria. We identified 14 themes that formed an integration framework. The themes were: goal in the curriculum; phase of the curriculum when to implement VPs; effective use of resources; VP alignment with curricular learning objectives; prioritisation of use; relation to other learning modalities; learning activities around VPs; time allocation; group setting; presence mode; VPs orientation for students and faculty; technical infrastructure; quality assurance, maintenance, and sustainability; assessment of VP learning outcomes and learning analytics. We investigated the occurrence of themes across studies to demonstrate the relevance of the framework. The quality of the studies did not influence the coverage of the themes. CONCLUSIONS: The resulting framework can be used to structure plans and discussions around implementation of VPs in curricula. It has already been used to organise the curriculum implementation guidelines of a European project. We expect it will direct further research to deepen our knowledge on individual integration themes.

The association between quality of connections and diagnostic accuracy in student-generated concept maps for clinical reasoning education with virtual patients.

Objectives: Concept maps are a learning tool that fosters clinical reasoning skills in healthcare education. They can be developed by students in combination with virtual patients to create a visual representation of the clinical reasoning process while solving a case. However, in order to optimize feedback, there is a need to better understand the role of connections between concepts in student-generated maps. Therefore, in this study we investigated whether the quality of these connections is indicative of diagnostic accuracy. Methods: We analyzed 40 concept maps created by fifth-year medical students in the context of four virtual patients with commonly encountered diagnoses. Half of the maps were created by students who made a correct diagnosis on the first attempt; the other half were created by students who made an error in their first diagnosis. The connections in the maps were rated by two reviewers using a relational scoring system. Analysis of covariance was employed to examine the difference in mean connection scores among groups while controlling for the number of connections. Results: There were no differences between the groups in the number of concepts or connections in the maps; however, maps made by students who made a correct first diagnosis had higher scores for the quality of connections than those created by students who made an incorrect first diagnosis (12.13 vs 9.09; p=0.03). We also observed students' general reluctance to use connections in their concept maps. Conclusion: Our results suggest that the quality, not the quantity, of connections in concept maps is indicative of their diagnostic accuracy.

Medical education in times of war: a mixed-methods needs analysis at Ukrainian medical schools.

BACKGROUND: As Ukraine struggles with the education of healthcare professionals due to the war, we aimed to identify the specific effects of the war on medical education, the resulting needs, and the expected consequences for schools, faculty, staff, students, and the healthcare system. METHODS: In October and November 2022, we performed a survey of students, faculty, and staff of medical schools in Ukraine and conducted semi-structured interviews with faculty leaders (i.e., rectors, vice-rectors). We conducted a descriptive analysis of the survey's closed-ended questions. The survey and the interviews included open-ended questions about war-related restrictions to teaching and learning, resulting needs, and expected consequences, for which we applied a thematic analysis. RESULTS: We received 239 survey responses (N = 49 faculty and staff, N = 190 students) and conducted nine interviews with faculty leaders across Ukraine. Most survey participants indicated that they had experienced restrictions or changes to their work or study due to the war (86% of faculty and staff, 69% of students). From the thematic analysis of the survey and interviews, we identified eight themes: disruption of teaching, increased workload, mental stress, financial restrictions, non-war related needs, international cooperation, quality of education, and prospects of future professionals. The quality of healthcare education in Ukraine was threatened, and schools, faculty, staff, and students were under great strain. While already established international cooperation has been supportive, some needs have still not been addressed. CONCLUSIONS: We hope that our findings will help researchers and educators from abroad contribute to meeting Ukraine's needs in medical education.

Clinical reasoning: What do nurses, physicians, and students reason about.

Clinical reasoning is a core ability in the health professions, but the term is conceptualised in multiple ways within and across professions. For interprofessional teamwork it is indispensable to recognise the differences in understanding between professions. Therefore, our aim was to investigate how nurses, physicians, and medical and nursing students define clinical reasoning. We conducted 43 semi-structured interviews with an interprofessional group from six countries and qualitatively analysed their definitions of clinical reasoning based on a coding guide. Our results showed similarities across professions, such as the emphasis on clinical skills as part of clinical reasoning. But we also revealed differences, such as a more patient-centered view and a broader understanding of the clinical reasoning concept in nurses and nursing students. The explicit sharing and discussion of differences in the understanding of clinical reasoning across health professions can provide valuable insights into the perspectives of different team members on clinical practice and education. This understanding may lead to improved interprofessional collaboration, and our study's categories and themes can serve as a basis for such discussions.

Developing a European longitudinal and interprofessional curriculum for clinical reasoning.

Clinical reasoning is a complex and crucial ability health professions students need to acquire during their education. Despite its importance, explicit clinical reasoning teaching is not yet implemented in most health professions educational programs. Therefore, we carried out an international and interprofessional project to plan and develop a clinical reasoning curriculum with a train-the-trainer course to support educators in teaching this curriculum to students. We developed a framework and curricular blueprint. Then we created 25 student and 7 train-the-trainer learning units and we piloted 11 of these learning units at our institutions. Learners and faculty reported high satisfaction and they also provided helpful suggestions for improvements. One of the main challenges we faced was the heterogeneous understanding of clinical reasoning within and across professions. However, we learned from each other while discussing these different views and perspectives on clinical reasoning and were able to come to a shared understanding as the basis for developing the curriculum. Our curriculum fills an important gap in the availability of explicit clinical reasoning educational materials both for students and faculty and is unique with having specialists from different countries, schools, and professions. Faculty time and time for teaching clinical reasoning in existing curricula remain important barriers for implementation of clinical reasoning teaching.

Differences in clinical reasoning between female and male medical students.

OBJECTIVES: In undergraduate medical education virtual patients (VPs) are a suitable method to teach clinical reasoning and support the visualization of this thinking process in a safe environment. The aim of our study was to investigate differences in the clinical reasoning process and diagnostic accuracy of female and male medical students. METHODS: During the summer term 2020, we provided access to 15 VPs for undergraduate students enrolled in a medical school in Bavaria, Germany. All interactions of the 179 learners within the VP system CASUS were recorded, exported, and analyzed. RESULTS: We found significant differences in the clinical reasoning of female and male learners. Female students documented more findings, differential diagnoses, tests, and treatment options and more often created a summary statement about the VP. Their overall performance was higher than those of their male peers, but we did not see any significant differences in diagnostic accuracy. CONCLUSIONS: The significant differences between male and female medical students should be considered when planning teaching and research activities. A future study should investigate whether these differences can also be found in physicians.

Publication activities relating to digital teaching and learning in the GMS Journal for Medical Education - a descriptive analysis (1984-2020).

Aims and objectives: Digital teaching, learning and assessment have been part of medical education and continuing education for decades. The objective of this review paper is to highlight developments and perspectives in these areas in the GMS Journal for Medical Education (GMS JME). Methodology: In the spring of 2020, we conducted a systematic literature search of the Journal for Medical Education (JME) and analysed the articles with regard to different categories such as article type, digital tools used or mode of data collection. Results: Of the 132 articles analysed, 78 were digital interventions (53 of which were exploratory-descriptive), 28 were project descriptions, 16 were surveys of needs or equipment and 10 were concept papers. About one-third of the studies and project reports each dealt with virtual patients or case-based learning, whereas no articles were published on trends such as serious games or virtual reality. Overall, our analysis shows that in many respects, the studies on digital teaching were more broadly based, especially between 2006 and 2010, after which this trend tended to decline again. Conclusions: Our analysis shows that publications in the JME consider some key aspects of digital teaching in medical education and continuing education, such as educational videos or virtual patients. The variability of information and methods of presentation advocate the use of guidelines to optimise the quality of scientific papers. Furthermore, clues for future research topics and experimental study designs are identified.

How is the situation of women in leadership positions in medical education in Germany?

In Germany, about two thirds of students and doctoral candidates in medicine are female. The proportion is only about 35% for post-doctoral degrees and much lower for many leadership positions at medical schools and on medical education committees. Although reasons for this have long been known, changes are slow in coming. Therefore, with this commentary, we would like to shed light on the current situation regarding gender equality in Germany in medical education and identify and discuss measures. These include, for example, mentoring and networking programs as well as greater consideration of women in committees.

Implementing Remote Collaboration in a Virtual Patient Platform: Usability Study.

BACKGROUND: Learning with virtual patients is highly popular for fostering clinical reasoning in medical education. However, little learning with virtual patients is done collaboratively, despite the potential learning benefits of collaborative versus individual learning. OBJECTIVE: This paper describes the implementation of student collaboration in a virtual patient platform. Our aim was to allow pairs of students to communicate remotely with each other during virtual patient learning sessions. We hypothesized that we could provide a collaborative tool that did not impair the usability of the system compared to individual learning and that this would lead to better diagnostic accuracy for the pairs of students. METHODS: Implementing the collaboration tool had five steps: (1) searching for a suitable software library, (2) implementing the application programming interface, (3) performing technical adaptations to ensure high-quality connections for the users, (4) designing and developing the user interface, and (5) testing the usability of the tool in 270 virtual patient sessions. We compared dyad to individual diagnostic accuracy and usability with the 10-item System Usability Scale. RESULTS: We recruited 137 students who worked on 6 virtual patients. Out of 270 virtual patient sessions per group (45 dyads times 6 virtual patients, and 47 students working individually times 6 virtual patients minus 2 randomly selected deleted sessions) the students made successful diagnoses in 143/270 sessions (53%, SD 26%) when working alone and 192/270 sessions (71%, SD 20%) when collaborating (P=.04, η2=0.12). A usability questionnaire given to the students who used the collaboration tool showed a usability score of 82.16 (SD 1.31), representing a B+ grade. CONCLUSIONS: The collaboration tool provides a generic approach for collaboration that can be used with most virtual patient systems. The collaboration tool helped students diagnose virtual patients and had good overall usability. More broadly, the collaboration tool will provide an array of new possibilities for researchers and medical educators alike to design courses for collaborative learning with virtual patients.

Planning a Collection of Virtual Patients to Train Clinical Reasoning: A Blueprint Representative of the European Population.

BACKGROUND: Virtual patients (VPs) are a suitable method for students to train their clinical reasoning abilities. We describe a process of developing a blueprint for a diverse and realistic VP collection (prior to VP creation) that facilitates deliberate practice of clinical reasoning and meets educational requirements of medical schools. METHODS: An international and interdisciplinary partnership of five European countries developed a blueprint for a collection of 200 VPs in four steps: (1) Defining the criteria (e.g., key symptoms, age, sex) and categorizing them into disease-, patient-, encounter- and learner-related, (2) Identifying data sources for assessing the representativeness of the collection, (3) Populating the blueprint, and (4) Refining and reaching consensus. RESULTS: The blueprint is publicly available and covers 29 key symptoms and 176 final diagnoses including the most prevalent medical conditions in Europe. Moreover, our analyses showed that the blueprint appears to be representative of the European population. CONCLUSIONS: The development of the blueprint required a stepwise approach, which can be replicated for the creation of other VP or case collections. We consider the blueprint an appropriate starting point for the actual creation of the VPs, but constant updating and refining is needed.

Why is it so difficult to implement a longitudinal clinical reasoning curriculum? A multicenter interview study on the barriers perceived by European health professions educators.

BACKGROUND: Effective clinical reasoning is a core competency of health professionals that is necessary to assure patients' safety. Unfortunately, adoption of longitudinal clinical reasoning curricula is still infrequent. This study explores the barriers that hinder the explicit teaching of clinical reasoning from a new international perspective. METHODS: The context of this study was a European project whose aim is to develop a longitudinal clinical reasoning curriculum. We collected data in semi-structured interviews with responders from several European countries who represent various health professions and have different backgrounds, roles and experience. We performed a qualitative content analysis of the gathered data and constructed a coding frame using a combined deductive/inductive approach. The identified themes were validated by parallel coding and in group discussions among project members. RESULTS: A total of 29 respondents from five European countries participated in the interviews; the majority of them represent medicine and nursing sciences. We grouped the identified barriers into eight general themes: Time, Culture, Motivation, Clinical Reasoning as a Concept, Teaching, Assessment, Infrastructure and Others. Subthemes included issues with discussing errors and providing feedback, awareness of clinical reasoning teaching methods, and tensions between the groups of professionals involved. CONCLUSIONS: This study provides an in-depth analysis of the barriers that hinder the teaching of explicit clinical reasoning. The opinions are presented from the perspective of several European higher education institutions. The identified barriers are complex and should be treated holistically due to the many interconnections between the identified barriers. Progress in implementation is hampered by the presence of reciprocal causal chains that aggravate this situation. Further research could investigate the perceptual differences between health professions regarding the barriers to clinical reasoning. The collected insights on the complexity and diversity of these barriers will help when rolling out a long-term agenda for overcoming the factors that inhibit the implementation of clinical reasoning curricula.

Clinical Reasoning Needs to Be Explicitly Addressed in Health Professions Curricula: Recommendations from a European Consortium.

Clinical reasoning entails the application of knowledge and skills to collect and integrate information, typically with the goal of arriving at a diagnosis and management plan based on the patient's unique circumstances and preferences. Evidence-informed, structured, and explicit teaching and assessment of clinical reasoning in educational programs of medical and other health professions remain unmet needs. We herein summarize recommendations for clinical reasoning learning objectives (LOs), as derived from a consensus approach among European and US researchers and health professions educators. A four-step consensus approach was followed: (1) identification of a convenience sample of the most relevant and applied national LO catalogues for health professions educational programs (N = 9) from European and US countries, (2) extraction of LOs related to clinical reasoning and translation into English, (3) mapping of LOs into predefined categories developed within the Erasmus+ Developing, implementing, and disseminating an adaptive clinical reasoning curriculum for healthcare students and educators (DID-ACT) consortium, and (4) synthesis of analysis findings into recommendations for how LOs related to clinical reasoning could be presented and incorporated in LO catalogues, upon consensus. Three distinct recommendations were formulated: (1) make clinical reasoning explicit, (2) emphasize interprofessional and collaboration aspects of clinical reasoning, and (3) include aspects of teaching and assessment of clinical reasoning. In addition, the consortium understood that implementation of bilingual catalogues with English as a common language might contribute to lower heterogeneity regarding amount, structure, and level of granularity of clinical reasoning LOs across countries. These recommendations will hopefully motivate and guide initiatives towards the implementation of LOs related to clinical reasoning in existing and future LO catalogues.

Adaptation of an international virtual patient collection to the COVID-19 pandemic.

The COVID-19 pandemic posed new global challenges for teaching. We met these challenges as an international collaboration by adapting a collection of virtual patients for clinical reasoning training to this novel context.

Digital teaching as an instrument for cross-location teaching networks in medical informatics: opportunities and challenges.

The increasingly digitized healthcare system requires new skills from all those involved. In order to impart these competencies, appropriate courses must be developed at educational institutions. In view of the rapid development of new aspects of digitization, this presents a challenge; suitable teaching formats must be developed successively. The establishment of cross-location teaching networks is one way to better meet training needs and to make the necessary spectrum of educational content available. As part of the Medical Informatics Initiative, the HiGHmed consortium is establishing such a teaching network, in the field of medical informatics, which covers many topics related to the digitization of the health care system. Various problem areas in the German education system were identified that hinder the development of the teaching network. These problem areas were prioritized firstly according to the urgency of the solution from the point of view of the HiGHmed consortium and secondly according to existing competencies in the participating societies. A workshop on the four most relevant topics was organized with experts from the German Society for Medical Informatics, Biometry and Epidemiology (GMDS), the Society for Medical Education (GMA) and the HiGHmed consortium. These are: recognition of exam results from teaching modules that are offered digitally and across locations, and their integration into existing curricula; recognition of digital, cross-location teaching in the teachers' teaching load; nationwide uniform competencies for teachers, in order to be able to conduct digital teaching effectively and with comparable quality; technical infrastructure to efficiently and securely communicate and manage the recognition of exam results between educational institutions. For all subject areas, existing preliminary work was identified on the basis of working questions, and short- and long-term needs for action were formulated. Finally, a need for the redesign of a technologically supported syntactic and semantic interoperability of learning performance recording was identified.

Automatic analysis of summary statements in virtual patients - a pilot study evaluating a machine learning approach.

BACKGROUND: The ability to compose a concise summary statement about a patient is a good indicator for the clinical reasoning abilities of healthcare students. To assess such summary statements manually a rubric based on five categories - use of semantic qualifiers, narrowing, transformation, accuracy, and global rating has been published. Our aim was to explore whether computer-based methods can be applied to automatically assess summary statements composed by learners in virtual patient scenarios based on the available rubric in real-time to serve as a basis for immediate feedback to learners. METHODS: We randomly selected 125 summary statements in German and English composed by learners in five different virtual patient scenarios. Then we manually rated these statements based on the rubric plus an additional category for the use of the virtual patients' name. We implemented a natural language processing approach in combination with our own algorithm to automatically assess 125 randomly selected summary statements and compared the results of the manual and automatic rating in each category. RESULTS: We found a moderate agreement of the manual and automatic rating in most of the categories. However, some further analysis and development is needed, especially for a more reliable assessment of the factual accuracy and the identification of patient names in the German statements. CONCLUSIONS: Despite some areas of improvement we believe that our results justify a careful display of the computer-calculated assessment scores as feedback to the learners. It will be important to emphasize that the rating is an approximation and give learners the possibility to complain about supposedly incorrect assessments, which will also help us to further improve the rating algorithms.

Blended learning: ten tips on how to implement it into a curriculum in healthcare education.

Blended learning is a meaningful combination of online and face-to-face teaching and learning. In this article we summarize relevant aspects of this format and provide ten tips for educators and curriculum developers on implementing a blended learning curriculum in healthcare education. These general tips are derived from our experience and the available literature and cover the planning and implementation process.

The influence of prompts on final year medical students' learning process and achievement in ECG interpretation.

Objective: ECG interpretation is prone to errors that can lead to relevant misdiagnoses and incorrect treatment. Prompts are one way in lectures to encourage learning from one's own mistakes and to reduce error rates. Prompts are measures such as questions, hints, and suggestions of content-related or metacognitive nature, which can lead to self-explanation in the learner and thus to a deeper understanding of an issue. The aim of the study was therefore to investigate whether the use of prompts can reduce the error rate in ECG interpretation among students. Method: In a 2x2 experimental test and control group design, N=100 final year medical students carried out ECG interpretation tasks in the form of online case vignettes in CASUS®. In these tasks, justification prompts (B) and error analysis prompts (F) were systematically varied in four groups and the learning success was measured using a knowledge test. In addition, prior knowledge in ECG interpretation, motivation, interest in the topic, subjective confidence in ECG interpretation, and cognitive load was collected. Results: Neither error analysis prompts nor justification prompts had a significant effect on the correct ECG interpretation by students, F(1,96)=1.03, p=.31. Justification prompts seemed to have a positive effect on the confidence of answering the questions, F(1,96)=10.15, p=.002, partial η2 =.10; and a negative effect on student motivation, F(1,96)=8.13 , p=.005, partial η2 =.08; but both with comparable diagnostic accuracy. Conclusion: The present study could not confirm the positive effects of prompts on the error rate in ECG interpretation reported in the literature but showed significant effects on subjective confidence and motivation which should be investigated in further studies.

Learning clinical reasoning: how virtual patient case format and prior knowledge interact.

INTRODUCTION: Clinical reasoning has been fostered with varying case formats including the use of virtual patients. Existing literature points to different conclusions regarding which format is most beneficial for learners with diverse levels of prior knowledge. We designed our study to better understand which case format affects clinical reasoning outcomes and cognitive load, dependent on medical students' prior knowledge. METHODS: Overall, 142 medical students (3 rd to 6 th year) were randomly assigned to either a whole case or serial cue case format. Participants worked on eight virtual patients in their respective case format. Outcomes included diagnostic accuracy, knowledge, and cognitive load. RESULTS: We found no effect of case format on strategic knowledge scores pre- vs post-test (whole case learning gain = 3, 95% CI. -.01 to .01, serial cue learning gain = 3, 95% CI. -.06 to .00 p = .50). In both case formats, students with high baseline knowledge (determined by median split on the pre-test in conceptual knowledge) benefitted from learning with virtual patients (learning gain in strategic knowledge = 5, 95% CI .03 to .09, p = .01) while students with low prior knowledge did not (learning gain = 0, 95%CI -.02 to .02). We found no difference in diagnostic accuracy between experimental conditions (difference = .44, 95% CI -.96 to .08, p = .22), but diagnostic accuracy was higher for students with high prior knowledge compared to those with low prior knowledge (difference = .8, 95% CI 0.31 to 1.35, p < .01). Students with low prior knowledge experienced higher extraneous cognitive load than students with high prior knowledge (multiple measurements, p < .01). CONCLUSIONS: The whole case and serial cue case formats alone did not affect students' knowledge gain or diagnostic accuracy. Students with lower knowledge experienced increased cognitive load and appear to have learned less from their interaction with virtual patients. Cognitive load should be taken into account when attempting to help students learn clinical reasoning with virtual patients, especially for students with lower knowledge.

The need for longitudinal clinical reasoning teaching and assessment: Results of an international survey.

Background: Clinical reasoning is a key ability essential for practising health professionals. However, little is known about the current global adoption of clinical reasoning teaching and assessment.Purpose: We aimed to provide insights into how clinical reasoning is deliberately taught and assessed in curricula worldwide and to identify needs and perceived barriers for teaching clinical reasoning to students and educators.Methods: A questionnaire was devised by an international expert group and distributed in a large international medical education community. Data were collected in 2018 and analysed using descriptive statistics. We identified themes in free-text responses using content analysis.Results: Three hundred and thirteen responses from 76 countries were collected. Most respondents were from Europe (34%). While the presence of a longitudinal clinical reasoning curriculum was only reported by 28%, 85% stated that such a curriculum was needed. The lack of awareness of the need to explicitly teach clinical reasoning was the most commonly identified barrier. For assessment, the greatest need identified was for more workplace-based assessment.Conclusions: Global respondents indicate the need to implement explicit longitudinal clinical reasoning curricula. Our findings suggest that efforts should be put into improving faculty development, including evidence-based materials on how to teach and assess clinical reasoning.