Integrating virtual patients into undergraduate health professions curricula: a framework synthesis of stakeholders' opinions based on a systematic literature review.

BACKGROUND: Virtual patients (VPs) are widely used in health professions education. When they are well integrated into curricula, they are considered to be more effective than loosely coupled add-ons. However, it is unclear what constitutes their successful integration. The aim of this study was to identify and synthesise the themes found in the literature that stakeholders perceive as important for successful implementation of VPs in curricula. METHODS: We searched five databases from 2000 to September 25, 2023. We included qualitative, quantitative, mixed-methods and descriptive case studies that defined, identified, explored, or evaluated a set of factors that, in the perception of students, teachers, course directors and researchers, were crucial for VP implementation. We excluded effectiveness studies that did not consider implementation characteristics, and studies that focused on VP design factors. We included English-language full-text reports and excluded conference abstracts, short opinion papers and editorials. Synthesis of results was performed using the framework synthesis method with Kern's six-step model as the initial framework. We appraised the quality of the studies using the QuADS tool. RESULTS: Our search yielded a total of 4808 items, from which 21 studies met the inclusion criteria. We identified 14 themes that formed an integration framework. The themes were: goal in the curriculum; phase of the curriculum when to implement VPs; effective use of resources; VP alignment with curricular learning objectives; prioritisation of use; relation to other learning modalities; learning activities around VPs; time allocation; group setting; presence mode; VPs orientation for students and faculty; technical infrastructure; quality assurance, maintenance, and sustainability; assessment of VP learning outcomes and learning analytics. We investigated the occurrence of themes across studies to demonstrate the relevance of the framework. The quality of the studies did not influence the coverage of the themes. CONCLUSIONS: The resulting framework can be used to structure plans and discussions around implementation of VPs in curricula. It has already been used to organise the curriculum implementation guidelines of a European project. We expect it will direct further research to deepen our knowledge on individual integration themes.

Case-based MCQ generator: A custom ChatGPT based on published prompts in the literature for automatic item generation.

WHAT IS THE EDUCATIONAL CHALLENGE?: A fundamental challenge in medical education is creating high-quality, clinically relevant multiple-choice questions (MCQs). ChatGPT-based automatic item generation (AIG) methods need well-designed prompts. However, the use of these prompts is hindered by the time-consuming process of copying and pasting, a lack of know-how among medical teachers, and the generalist nature of standard ChatGPT, which often lacks the medical context. WHAT ARE THE PROPOSED SOLUTIONS?: The Case-based MCQ Generator, a custom GPT, addresses these challenges. It has been trained by using GPT Builder, which is a platform designed by OpenAI for customizing ChatGPT to meet specific needs, in order to allow users to generate case-based MCQs. By using this free tool for those who have ChatGPT Plus subscription, health professions educators can easily select a prompt, input a learning objective or item-specific test point, and generate clinically relevant questions. WHAT ARE THE POTENTIAL BENEFITS TO A WIDER GLOBAL AUDIENCE?: It enhances the efficiency of MCQ generation and ensures the generation of contextually relevant questions, surpassing the capabilities of standard ChatGPT. It streamlines the MCQ creation process by integrating prompts published in medical education literature, eliminating the need for manual prompt input. WHAT ARE THE NEXT STEPS?: Future development aims at sustainability and addressing ethical and accessibility issues. It requires regular updates, integration of new prompts from emerging health professions education literature, and a supportive digital ecosystem around the tool. Accessibility, especially for educators in low-resource countries, is vital, demanding alternative access models to overcome financial barriers.

The association between quality of connections and diagnostic accuracy in student-generated concept maps for clinical reasoning education with virtual patients.

Objectives: Concept maps are a learning tool that fosters clinical reasoning skills in healthcare education. They can be developed by students in combination with virtual patients to create a visual representation of the clinical reasoning process while solving a case. However, in order to optimize feedback, there is a need to better understand the role of connections between concepts in student-generated maps. Therefore, in this study we investigated whether the quality of these connections is indicative of diagnostic accuracy. Methods: We analyzed 40 concept maps created by fifth-year medical students in the context of four virtual patients with commonly encountered diagnoses. Half of the maps were created by students who made a correct diagnosis on the first attempt; the other half were created by students who made an error in their first diagnosis. The connections in the maps were rated by two reviewers using a relational scoring system. Analysis of covariance was employed to examine the difference in mean connection scores among groups while controlling for the number of connections. Results: There were no differences between the groups in the number of concepts or connections in the maps; however, maps made by students who made a correct first diagnosis had higher scores for the quality of connections than those created by students who made an incorrect first diagnosis (12.13 vs 9.09; p=0.03). We also observed students' general reluctance to use connections in their concept maps. Conclusion: Our results suggest that the quality, not the quantity, of connections in concept maps is indicative of their diagnostic accuracy.

Game Elements in the Design of Simulations in Military Trauma Management Training: Protocol for a Systematic Review.

BACKGROUND: Military trauma teams are commonly operating in civilian hospitals during peacetime; in a war situation they must adjust their practices to the austere conditions. Simulations can replicate austere conditions to allow training in a safe environment that tolerates errors. Gamification, understood as the use of game elements to motivate and engage learners in nongame contexts, is gaining interest in medical education and military training. Applying game elements in the design of military trauma management simulations has the potential to provide learners with active learning opportunities and prepare them for providing medical services under austere conditions. Although gamification is known for its engaging and motivational benefits, there are controversies about its pedagogical value. The controversies can be attributed to the fact that various gamification strategies may consist of a different combination of game elements, leading to different outcomes. OBJECTIVE: This systematic review aims to understand how game elements are used in the design of simulations in military trauma management training and their reported outcomes. METHODS: We have designed a search strategy for the purpose of the review. Two researchers will independently assess the identified studies based on the defined inclusion and exclusion criteria. The selection process will be represented using a PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram. The search will be repeated and updated as necessary prior to publication of the review. Two reviewers will independently extract and manage the data for each of the articles using a structured data extraction form. Any disagreement that arises between reviewers will be resolved through discussion, and a third review author will be consulted when needed. We are going to conduct a thematic synthesis of the extracted game element descriptions. The results are going to be presented in a diagrammatic or tabular form, alongside a narrative summary. The quality of the studies will be assessed. RESULTS: We implemented and tested the developed search strategy in May 2023. We retrieved 1168 study abstracts, which were reduced to 630 abstracts after deduplication. We have piloted the screening on 20% (126/630) of the identified abstracts in groups of 2 reviewers. CONCLUSIONS: Although gamification has the potential to motivate learners in various ways, there is a lack of understanding about specific game elements and how they can inform instructional design in different contexts. Our findings will increase the understanding of how game elements are used in the design of simulations in military trauma management training and, thus, contribute to more effective development of future simulations. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/45969.

Clinical reasoning: What do nurses, physicians, and students reason about.

Clinical reasoning is a core ability in the health professions, but the term is conceptualised in multiple ways within and across professions. For interprofessional teamwork it is indispensable to recognise the differences in understanding between professions. Therefore, our aim was to investigate how nurses, physicians, and medical and nursing students define clinical reasoning. We conducted 43 semi-structured interviews with an interprofessional group from six countries and qualitatively analysed their definitions of clinical reasoning based on a coding guide. Our results showed similarities across professions, such as the emphasis on clinical skills as part of clinical reasoning. But we also revealed differences, such as a more patient-centered view and a broader understanding of the clinical reasoning concept in nurses and nursing students. The explicit sharing and discussion of differences in the understanding of clinical reasoning across health professions can provide valuable insights into the perspectives of different team members on clinical practice and education. This understanding may lead to improved interprofessional collaboration, and our study's categories and themes can serve as a basis for such discussions.

Developing a European longitudinal and interprofessional curriculum for clinical reasoning.

Clinical reasoning is a complex and crucial ability health professions students need to acquire during their education. Despite its importance, explicit clinical reasoning teaching is not yet implemented in most health professions educational programs. Therefore, we carried out an international and interprofessional project to plan and develop a clinical reasoning curriculum with a train-the-trainer course to support educators in teaching this curriculum to students. We developed a framework and curricular blueprint. Then we created 25 student and 7 train-the-trainer learning units and we piloted 11 of these learning units at our institutions. Learners and faculty reported high satisfaction and they also provided helpful suggestions for improvements. One of the main challenges we faced was the heterogeneous understanding of clinical reasoning within and across professions. However, we learned from each other while discussing these different views and perspectives on clinical reasoning and were able to come to a shared understanding as the basis for developing the curriculum. Our curriculum fills an important gap in the availability of explicit clinical reasoning educational materials both for students and faculty and is unique with having specialists from different countries, schools, and professions. Faculty time and time for teaching clinical reasoning in existing curricula remain important barriers for implementation of clinical reasoning teaching.

Planning a Collection of Virtual Patients to Train Clinical Reasoning: A Blueprint Representative of the European Population.

BACKGROUND: Virtual patients (VPs) are a suitable method for students to train their clinical reasoning abilities. We describe a process of developing a blueprint for a diverse and realistic VP collection (prior to VP creation) that facilitates deliberate practice of clinical reasoning and meets educational requirements of medical schools. METHODS: An international and interdisciplinary partnership of five European countries developed a blueprint for a collection of 200 VPs in four steps: (1) Defining the criteria (e.g., key symptoms, age, sex) and categorizing them into disease-, patient-, encounter- and learner-related, (2) Identifying data sources for assessing the representativeness of the collection, (3) Populating the blueprint, and (4) Refining and reaching consensus. RESULTS: The blueprint is publicly available and covers 29 key symptoms and 176 final diagnoses including the most prevalent medical conditions in Europe. Moreover, our analyses showed that the blueprint appears to be representative of the European population. CONCLUSIONS: The development of the blueprint required a stepwise approach, which can be replicated for the creation of other VP or case collections. We consider the blueprint an appropriate starting point for the actual creation of the VPs, but constant updating and refining is needed.

Why is it so difficult to implement a longitudinal clinical reasoning curriculum? A multicenter interview study on the barriers perceived by European health professions educators.

BACKGROUND: Effective clinical reasoning is a core competency of health professionals that is necessary to assure patients' safety. Unfortunately, adoption of longitudinal clinical reasoning curricula is still infrequent. This study explores the barriers that hinder the explicit teaching of clinical reasoning from a new international perspective. METHODS: The context of this study was a European project whose aim is to develop a longitudinal clinical reasoning curriculum. We collected data in semi-structured interviews with responders from several European countries who represent various health professions and have different backgrounds, roles and experience. We performed a qualitative content analysis of the gathered data and constructed a coding frame using a combined deductive/inductive approach. The identified themes were validated by parallel coding and in group discussions among project members. RESULTS: A total of 29 respondents from five European countries participated in the interviews; the majority of them represent medicine and nursing sciences. We grouped the identified barriers into eight general themes: Time, Culture, Motivation, Clinical Reasoning as a Concept, Teaching, Assessment, Infrastructure and Others. Subthemes included issues with discussing errors and providing feedback, awareness of clinical reasoning teaching methods, and tensions between the groups of professionals involved. CONCLUSIONS: This study provides an in-depth analysis of the barriers that hinder the teaching of explicit clinical reasoning. The opinions are presented from the perspective of several European higher education institutions. The identified barriers are complex and should be treated holistically due to the many interconnections between the identified barriers. Progress in implementation is hampered by the presence of reciprocal causal chains that aggravate this situation. Further research could investigate the perceptual differences between health professions regarding the barriers to clinical reasoning. The collected insights on the complexity and diversity of these barriers will help when rolling out a long-term agenda for overcoming the factors that inhibit the implementation of clinical reasoning curricula.

Clinical Reasoning Needs to Be Explicitly Addressed in Health Professions Curricula: Recommendations from a European Consortium.

Clinical reasoning entails the application of knowledge and skills to collect and integrate information, typically with the goal of arriving at a diagnosis and management plan based on the patient's unique circumstances and preferences. Evidence-informed, structured, and explicit teaching and assessment of clinical reasoning in educational programs of medical and other health professions remain unmet needs. We herein summarize recommendations for clinical reasoning learning objectives (LOs), as derived from a consensus approach among European and US researchers and health professions educators. A four-step consensus approach was followed: (1) identification of a convenience sample of the most relevant and applied national LO catalogues for health professions educational programs (N = 9) from European and US countries, (2) extraction of LOs related to clinical reasoning and translation into English, (3) mapping of LOs into predefined categories developed within the Erasmus+ Developing, implementing, and disseminating an adaptive clinical reasoning curriculum for healthcare students and educators (DID-ACT) consortium, and (4) synthesis of analysis findings into recommendations for how LOs related to clinical reasoning could be presented and incorporated in LO catalogues, upon consensus. Three distinct recommendations were formulated: (1) make clinical reasoning explicit, (2) emphasize interprofessional and collaboration aspects of clinical reasoning, and (3) include aspects of teaching and assessment of clinical reasoning. In addition, the consortium understood that implementation of bilingual catalogues with English as a common language might contribute to lower heterogeneity regarding amount, structure, and level of granularity of clinical reasoning LOs across countries. These recommendations will hopefully motivate and guide initiatives towards the implementation of LOs related to clinical reasoning in existing and future LO catalogues.

Teams managing civilian and military complex trauma: What are the competencies required in austere environments and the potential of simulation technology to address them?

Surgical training in civilian hospitals may not be sufficient for managing complex trauma in a setting where such care is not commonly practiced. Understanding the challenges that civilian teams face when moving to austere environments can inform the competencies that need to be trained. The aim of this study was to explore the competencies required in austere environments for teams managing complex trauma, and how they can be trained with simulation technologies. Ethnographic field observations were conducted, and field notes were synthesized. The field notes were structured with the elements of Activity Theory to generate the teams' competencies that need to be trained. A literature review was conducted to verify the results and identify examples of relevant simulation modalities. The analysis resulted in a structured list of competencies for civilian teams to manage complex trauma in an austere environment and recommendations which simulation technologies could be used in training of those competencies based on published studies. Our study contributes to understanding the challenges that civilian teams face when operating in an austere environment. A systematized list of competencies with suggested simulation technologies directs future research to improve quality of complex trauma training in civilian and military collaboration.

Adaptation of an international virtual patient collection to the COVID-19 pandemic.

The COVID-19 pandemic posed new global challenges for teaching. We met these challenges as an international collaboration by adapting a collection of virtual patients for clinical reasoning training to this novel context.

The need for longitudinal clinical reasoning teaching and assessment: Results of an international survey.

Background: Clinical reasoning is a key ability essential for practising health professionals. However, little is known about the current global adoption of clinical reasoning teaching and assessment.Purpose: We aimed to provide insights into how clinical reasoning is deliberately taught and assessed in curricula worldwide and to identify needs and perceived barriers for teaching clinical reasoning to students and educators.Methods: A questionnaire was devised by an international expert group and distributed in a large international medical education community. Data were collected in 2018 and analysed using descriptive statistics. We identified themes in free-text responses using content analysis.Results: Three hundred and thirteen responses from 76 countries were collected. Most respondents were from Europe (34%). While the presence of a longitudinal clinical reasoning curriculum was only reported by 28%, 85% stated that such a curriculum was needed. The lack of awareness of the need to explicitly teach clinical reasoning was the most commonly identified barrier. For assessment, the greatest need identified was for more workplace-based assessment.Conclusions: Global respondents indicate the need to implement explicit longitudinal clinical reasoning curricula. Our findings suggest that efforts should be put into improving faculty development, including evidence-based materials on how to teach and assess clinical reasoning.

Virtual Patient Simulations in Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration.

BACKGROUND: Virtual patients are interactive digital simulations of clinical scenarios for the purpose of health professions education. There is no current collated evidence on the effectiveness of this form of education. OBJECTIVE: The goal of this study was to evaluate the effectiveness of virtual patients compared with traditional education, blended with traditional education, compared with other types of digital education, and design variants of virtual patients in health professions education. The outcomes of interest were knowledge, skills, attitudes, and satisfaction. METHODS: We performed a systematic review on the effectiveness of virtual patient simulations in pre- and postregistration health professions education following Cochrane methodology. We searched 7 databases from the year 1990 up to September 2018. No language restrictions were applied. We included randomized controlled trials and cluster randomized trials. We independently selected studies, extracted data, and assessed risk of bias and then compared the information in pairs. We contacted study authors for additional information if necessary. All pooled analyses were based on random-effects models. RESULTS: A total of 51 trials involving 4696 participants met our inclusion criteria. Furthermore, 25 studies compared virtual patients with traditional education, 11 studies investigated virtual patients as blended learning, 5 studies compared virtual patients with different forms of digital education, and 10 studies compared different design variants. The pooled analysis of studies comparing the effect of virtual patients to traditional education showed similar results for knowledge (standardized mean difference [SMD]=0.11, 95% CI -0.17 to 0.39, I2=74%, n=927) and favored virtual patients for skills (SMD=0.90, 95% CI 0.49 to 1.32, I2=88%, n=897). Studies measuring attitudes and satisfaction predominantly used surveys with item-by-item comparison. Trials comparing virtual patients with different forms of digital education and design variants were not numerous enough to give clear recommendations. Several methodological limitations in the included studies and heterogeneity contributed to a generally low quality of evidence. CONCLUSIONS: Low to modest and mixed evidence suggests that when compared with traditional education, virtual patients can more effectively improve skills, and at least as effectively improve knowledge. The skills that improved were clinical reasoning, procedural skills, and a mix of procedural and team skills. We found evidence of effectiveness in both high-income and low- and middle-income countries, demonstrating the global applicability of virtual patients. Further research should explore the utility of different design variants of virtual patients.

Virtual Reality for Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration.

BACKGROUND: Virtual reality (VR) is a technology that allows the user to explore and manipulate computer-generated real or artificial three-dimensional multimedia sensory environments in real time to gain practical knowledge that can be used in clinical practice. OBJECTIVE: The aim of this systematic review was to evaluate the effectiveness of VR for educating health professionals and improving their knowledge, cognitive skills, attitudes, and satisfaction. METHODS: We performed a systematic review of the effectiveness of VR in pre- and postregistration health professions education following the gold standard Cochrane methodology. We searched 7 databases from the year 1990 to August 2017. No language restrictions were applied. We included randomized controlled trials and cluster-randomized trials. We independently selected studies, extracted data, and assessed risk of bias, and then, we compared the information in pairs. We contacted authors of the studies for additional information if necessary. All pooled analyses were based on random-effects models. We used the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach to rate the quality of the body of evidence. RESULTS: A total of 31 studies (2407 participants) were included. Meta-analysis of 8 studies found that VR slightly improves postintervention knowledge scores when compared with traditional learning (standardized mean difference [SMD]=0.44; 95% CI 0.18-0.69; I2=49%; 603 participants; moderate certainty evidence) or other types of digital education such as online or offline digital education (SMD=0.43; 95% CI 0.07-0.79; I2=78%; 608 participants [8 studies]; low certainty evidence). Another meta-analysis of 4 studies found that VR improves health professionals' cognitive skills when compared with traditional learning (SMD=1.12; 95% CI 0.81-1.43; I2=0%; 235 participants; large effect size; moderate certainty evidence). Two studies compared the effect of VR with other forms of digital education on skills, favoring the VR group (SMD=0.5; 95% CI 0.32-0.69; I2=0%; 467 participants; moderate effect size; low certainty evidence). The findings for attitudes and satisfaction were mixed and inconclusive. None of the studies reported any patient-related outcomes, behavior change, as well as unintended or adverse effects of VR. Overall, the certainty of evidence according to the GRADE criteria ranged from low to moderate. We downgraded our certainty of evidence primarily because of the risk of bias and/or inconsistency. CONCLUSIONS: We found evidence suggesting that VR improves postintervention knowledge and skills outcomes of health professionals when compared with traditional education or other types of digital education such as online or offline digital education. The findings on other outcomes are limited. Future research should evaluate the effectiveness of immersive and interactive forms of VR and evaluate other outcomes such as attitude, satisfaction, cost-effectiveness, and clinical practice or behavior change.

Uncovering the relation between clinical reasoning and diagnostic accuracy - An analysis of learner's clinical reasoning processes in virtual patients.

BACKGROUND: Clinical reasoning is an important topic in healthcare training, assessment, and research. Virtual patients (VPs) are a safe environment to teach, assess and perform research on clinical reasoning and diagnostic accuracy. Our aim was to explore the details of the clinical reasoning process and diagnostic accuracy of undergraduate medical students when working with VPs using a concept mapping tool. METHODS: Over seven months we provided access to 67 German and 30 English VPs combined with a concept mapping tool to visualize and measure the clinical reasoning process of identifying problems, differential diagnoses, recommended tests and treatment options, and composing a summary statement about a VP. A final diagnosis had to be submitted by the learners in order to conclude the VP scenario. Learners were allowed multiple attempts or could request the correct diagnosis from the system. RESULTS: We analyzed 1,393 completed concept maps from 317 learners. We found significant differences between maps with a correct final diagnosis on one or multiple attempts and maps in which learners gave up and requested the solution from the system. These maps had lower scores, fewer summary statements, and fewer problems, differential diagnoses, tests, and treatments. CONCLUSIONS: The different use patterns and scores between learners who had the correct final diagnosis on one or multiple attempts and those who gave up, indicate that diagnostic accuracy in the form of a correct final diagnosis on the first attempt has to be reconsidered as a sole indicator for clinical reasoning competency. For the training, assessment, and research of clinical reasoning we suggest focusing more on the details of the process to reach a correct diagnosis, rather than whether it was made in the first attempt.

Modelling Feedback in Virtual Patients: An Iterative Approach.

Virtual Patients (VPs) offer learners the opportunity to practice clinical reasoning skills and have recently been integrated in Massive Open Online Courses (MOOCs). Feedback is a central part of a branched VP, allowing the learner to reflect on the consequences of their decisions and actions. However, there is insufficient guidance on how to design feedback models within VPs and especially in the context of their application in MOOCs. In this paper, we share our experiences from building a feedback model for a bladder cancer VP in a Urology MOOC, following an iterative process in three steps. Our results demonstrate how we can systematize the process of improving the quality of VP components by the application of known literature frameworks and extend them with a feedback module. We illustrate the design and re-design process and exemplify with content from our VP. Our results can act as starting point for discussions on modelling feedback in VPs and invite future research on the topic.

Advancing clinical reasoning in virtual patients - development and application of a conceptual framework.

Background: Clinical reasoning is a complex skill students have to acquire during their education. For educators it is difficult to explain their reasoning to students, because it is partly an automatic and unconscious process. Virtual Patients (VPs) are used to support the acquisition of clinical reasoning skills in healthcare education. However, until now it remains unclear which features or settings of VPs optimally foster clinical reasoning. Therefore, our aims were to identify key concepts of the clinical reasoning process in a qualitative approach and draw conclusions on how each concept can be enhanced to advance the learning of clinical reasoning with virtual patients. Methods: We chose a grounded theory approach to identify key categories and concepts of learning clinical reasoning and develop a framework. Throughout this process, the emerging codes were discussed with a panel of interdisciplinary experts. In a second step we applied the framework to virtual patients. Results: Based on the data we identified the core category as the "multifactorial nature of learning clinical reasoning". This category is reflected in the following five main categories: Psychological Theories, Patient-centeredness, Context, Learner-centeredness, and Teaching/Assessment. Each category encompasses between four and six related concepts. Conclusions: With our approach we were able to elaborate how key categories and concepts of clinical reasoning can be applied to virtual patients. This includes aspects such as allowing learners to access a large number of VPs with adaptable levels of complexity and feedback or emphasizing dual processing, errors, and uncertainty.

A Clinical Reasoning Tool for Virtual Patients: Design-Based Research Study.

BACKGROUND: Clinical reasoning is a fundamental process medical students have to learn during and after medical school. Virtual patients (VP) are a technology-enhanced learning method to teach clinical reasoning. However, VP systems do not exploit their full potential concerning the clinical reasoning process; for example, most systems focus on the outcome and less on the process of clinical reasoning. OBJECTIVES: Keeping our concept grounded in a former qualitative study, we aimed to design and implement a tool to enhance VPs with activities and feedback, which specifically foster the acquisition of clinical reasoning skills. METHODS: We designed the tool by translating elements of a conceptual clinical reasoning learning framework into software requirements. The resulting clinical reasoning tool enables learners to build their patient's illness script as a concept map when they are working on a VP scenario. The student's map is compared with the experts' reasoning at each stage of the VP, which is technically enabled by using Medical Subject Headings, which is a comprehensive controlled vocabulary published by the US National Library of Medicine. The tool is implemented using Web technologies, has an open architecture that enables its integration into various systems through an open application program interface, and is available under a Massachusetts Institute of Technology license. RESULTS: We conducted usability tests following a think-aloud protocol and a pilot field study with maps created by 64 medical students. The results show that learners interact with the tool but create less nodes and connections in the concept map than an expert. Further research and usability tests are required to analyze the reasons. CONCLUSIONS: The presented tool is a versatile, systematically developed software component that specifically supports the clinical reasoning skills acquisition. It can be plugged into VP systems or used as stand-alone software in other teaching scenarios. The modular design allows an extension with new feedback mechanisms and learning analytics algorithms.

Implementation of targeted temperature management after cardiac arrest in Polish intensive care units. What has changed in the last five years?

BACKGROUND: Studies conducted up to 2010 indicate the underuse of targeted temperature management (TTM) in Poland. AIM: This study evaluated the current degree of TTM implementation in Polish intensive care units (ICUs) and analysed the implementation process since 2010. METHODS: A telephone survey, conducted from December 2014 to July 2015, was carried out to determine the number of ICUs using TTM in patients after cardiac arrest. We collected data on the details and prevalence of TTM, and the impact of organisational and financial issues and recently published papers on its use. RESULTS: We obtained data from 271 of 396 ICUs (68.4%). In total, 79 (29.2%) ICUs indicated TTM use and 27 (34.2%) used dedicated TTM equipment. Overall, 62% of the ICUs used TTM regardless of the cardiac arrest rhythm. Target temperatures of 32-34°C and 34.1-36°C were reached by 44.3% and 43.0% of ICUs, respectively. The duration of TTM was 12-24 h in 58.2% of the ICUs. The most common barriers to TTM implementation were a lack of dedicated devices (36.3%) and organ-isational and logistical issues (31.2%). Any influence of recently published data on TTM practice modifications was reported by only 23.4% of the ICUs. CONCLUSIONS: Targeted temperature management is underused in Polish ICUs. There is a need for additional educational and implementation efforts supporting the translation of knowledge into clinical practice at the regional and national levels.

Virtual Patients in a Behavioral Medicine Massive Open Online Course (MOOC): A Qualitative and Quantitative Analysis of Participants' Perceptions.

OBJECTIVE: The purpose of this article is to explore learners' perceptions of using virtual patients in a behavioral medicine Massive Open Online Course (MOOCs) and thereby describe innovative ways of disseminating knowledge in health-related areas. METHODS: A 5-week MOOC on behavioral medicine was hosted on the edX platform. The authors developed two branched virtual patients consisting of video recordings of a live standardized patient, with multiple clinical decision points and narration unfolding depending on learners' choices. Students interacted with the virtual patients to treat stress and sleep problems. Answers to the exit survey and participant comments from the discussion forum were analyzed qualitatively and quantitatively. RESULTS: In total, 19,236 participants enrolled in the MOOC, out of which 740 received the final certificate. The virtual patients were completed by 2317 and 1640 participants respectively. Among survey respondents (n = 442), 83.1% agreed that the virtual patient exercise was helpful. The qualitative analysis resulted in themes covering what it was like to work with the virtual patient, with subthemes on learner-centered education, emotions/eustress, game comparisons, what the participants learned, what surprised them, how confident participants felt about applying interventions in practice, suggestions for improvement, and previous experiences of virtual patients. CONCLUSIONS: Students were enthusiastic about interacting with the virtual patients as a means to apply new knowledge about behavioral medicine interventions. The most common suggestion was to incorporate more interactive cases with various levels of complexity. Further research should include patient outcomes and focus on interprofessional aspects of learning with virtual patients in a MOOC.