Virtual Objective Structured Clinical Examination (OSCE) Training in the Pandemic Era: Feasibility, Satisfaction, and the Road Ahead.

INTRODUCTION: Objective Structured Clinical Examinations (OSCEs) are essential assessments for evaluating the clinical competencies of medical students. The COVID-19 pandemic caused a significant disruption in medical education, prompting institutions to adopt virtual formats for academic activities. This study analyzes the feasibility, satisfaction, and experiences of pediatric board candidates and faculty during virtual or electronic OSCE (e-OSCE) training sessions using Zoom video communication (Zoom Video Communications, Inc., San Jose, USA). METHODS: This is a post-event survey assessing the perceptions of faculty and candidates and the perceived advantages and obstacles of e-OSCE. RESULTS: A total of 142 participants were invited to complete a post-event survey, and 105 (73.9%) completed the survey. There was equal gender representation. More than half of the participants were examiners. The overall satisfaction with the virtual e-OSCE was high, with a mean score of 4.7±0.67 out of 5. Most participants were likely to recommend e-OSCE to a friend or colleague (mean score 8.84±1.51/10). More faculty (66.1%) than candidates (40.8%) preferred e-OSCE (P=0.006). CONCLUSION: Transitioning to virtual OSCE training during the pandemic proved feasible, with high satisfaction rates. Further research on virtual training for OSCE in medical education is recommended to optimize its implementation and outcomes.

Administration of the American Board of Anesthesiology's virtual APPLIED Examination: successes, challenges, and lessons learned.

In response to the COVID-19 pandemic, the American Board of Anesthesiology transitioned from in-person to virtual administration of its APPLIED Examination, assessing more than 3000 candidates for certification purposes remotely in 2021. Four hundred examiners were involved in delivering and scoring Standardized Oral Examinations (SOEs) and Objective Structured Clinical Examinations (OSCEs). More than 80% of candidates started their exams on time and stayed connected throughout the exam without any problems. Only 74 (2.5%) SOE and 45 (1.5%) OSCE candidates required rescheduling due to technical difficulties. Of those who experienced "significant issues", concerns with OSCE technical stations (interpretation of monitors and interpretation of echocardiograms) were reported most frequently (6% of candidates). In contrast, 23% of examiners "sometimes" lost connectivity during their multiple exam sessions, on a continuum from minor inconvenience to inability to continue. 84% of SOE candidates and 89% of OSCE candidates described "smooth" interactions with examiners and standardized patients/standardized clinicians, respectively. However, only 71% of SOE candidates and 75% of OSCE candidates considered themselves to be able to demonstrate their knowledge and skills without obstacles. When compared with their in-person experiences, approximately 40% of SOE examiners considered virtual evaluation to be more difficult than in-person evaluation and believed the remote format negatively affected their development as an examiner. The virtual format was considered to be less secure by 56% and 40% of SOE and OSCE examiners, respectively. The retirement of exam materials used virtually due to concern for compromise had implications for subsequent exam development. The return to in-person exams in 2022 was prompted by multiple factors, especially concerns regarding standardization and security. The technology is not yet perfect, especially for testing in-person communication skills and displaying dynamic exam materials. Nevertheless, the American Board of Anesthesiology's experience demonstrated the feasibility of conducting large-scale, high-stakes oral and performance exams in a virtual format and highlighted the adaptability and dedication of candidates, examiners, and administering board staff.

Analysis of satisfaction levels and perceptions of clinical competency: a mixed method study on objective structured clinical examinations in undergraduate dental students.

OBJECTIVE: To analyze the satisfaction levels, perceptions of developing clinical competencies through objective structured clinical examination and to explore the experiences, challenges, and suggestions of undergraduate dental students. METHODS: The study adopted a mixed-method convergent design. Quantitative data were collected from 303 participants through surveys, evaluating satisfaction levels with objective structured clinical examination (OSCE). Additionally, qualitative insights were gathered through student focus group interviews, fundamental themes were developed from diverse expressions on various aspects of OSCE assessments. The Chi-Square tests, was performed to assess associations between variables. Data integration involved comparing and contrasting quantitative and qualitative findings to derive comprehensive conclusions. RESULTS: The satisfaction rates include 69.4% for the organization of OSCE stations and 57.4% for overall effectiveness. However, a crucial challenge was identified, with only 36.7% of students receiving adequate post-OSCE feedback. Furthermore, a majority of students (50%) expressed concerns about the clinical relevance of OSCEs. The study showed a significant associations (p < 0.05) between satisfaction levels and years of study as well as previous OSCE experience. Student focus group interviews revealed diverse perspectives on OSCE assessments. While students appreciate the helpfulness of OSCEs, concerns were raised regarding time constraints, stress, examiner training, and the perceived lack of clinical relevance. CONCLUSION: The students anticipated concerns about the clinical relevance of OSCEs, highlighting the need for a more aligned assessment approach. Diverse perspectives on OSCE assessments reveal perceived helpfulness alongside challenges such as lack of feedback, examiner training, time constraints, and mental stress.

Development of a Novel Web-Based Tool to Enhance Clinical Skills in Medical Education.

Unlabelled: A significant component of Canadian medical education is the development of clinical skills. The medical educational curriculum assesses these skills through an objective structured clinical examination (OSCE). This OSCE assesses skills imperative to good clinical practice, such as patient communication, clinical decision-making, and medical knowledge. Despite the widespread implementation of this examination across all academic settings, few preparatory resources exist that cater specifically to Canadian medical students. MonkeyJacket is a novel, open-access, web-based application, built with the goal of providing medical students with an accessible and representative tool for clinical skill development for the OSCE and clinical settings. This viewpoint paper presents the development of the MonkeyJacket application and its potential to assist medical students in preparation for clinical examinations and practical settings. Limited resources exist that are web-based; accessible in terms of cost; specific to the Medical Council of Canada (MCC); and, most importantly, scalable in nature. The goal of this research study was to thoroughly describe the potential utility of the application, particularly its capacity to provide practice and scalable formative feedback to medical students. MonkeyJacket was developed to provide Canadian medical students with the opportunity to practice their clinical examination skills and receive peer feedback by using a centralized platform. The OSCE cases included in the application were developed by using the MCC guidelines to ensure their applicability to a Canadian setting. There are currently 75 cases covering 5 specialties, including cardiology, respirology, gastroenterology, neurology, and psychiatry. The MonkeyJacket application is a web-based platform that allows medical students to practice clinical decision-making skills in real time with their peers through a synchronous platform. Through this application, students can practice patient interviewing, clinical reasoning, developing differential diagnoses, and formulating a management plan, and they can receive both qualitative feedback and quantitative feedback. Each clinical case is associated with an assessment checklist that is accessible to students after practice sessions are complete; the checklist promotes personal improvement through peer feedback. This tool provides students with relevant case stems, follow-up questions that probe for differential diagnoses and management plans, assessment checklists, and the ability to review the trend in their performance. The MonkeyJacket application provides medical students with a valuable tool that promotes clinical skill development for OSCEs and clinical settings. MonkeyJacket introduces a way for medical learners to receive feedback regarding patient interviewing and clinical reasoning skills that is both formative and scalable in nature, in addition to promoting interinstitutional learning. The widespread use of this application can increase the practice of and feedback on clinical skills among medical learners. This will not only benefit the learner; more importantly, it can provide downstream benefits for the most valuable stakeholder in medicine-the patient.

A LUMP MODEL FOR MEDICAL STUDENTS' CLINICAL EVALUATION.

Introduction: Soft tissue masses are commonly encountered in surgical and general medical practice. The graduating medical student should therefore be competent in the physical examination of a lump. Paucity of real patients makes it paramount that models be used for teaching and evaluation. This study purposed to describe the perception of graduating medical students to the use of a low-cost lump model for Objective Structured Clinical Examination (OSCE). Methods: This was a cross-sectional survey of final year medical students who participated in a surgery OSCE utilizing an innovative low-cost lump model. Results: One hundred and sixty students undertook the OSCE examination while 130 (81.3%) students completed the survey questionnaire. One hundred and forty students (87.5%) passed (score 3 5) the skills assessment using the lump model. The median age of the students who completed the questionnaire was 25 (range 24-27) years. There were more males N=84 (65.6%) than females N= 44 (34.4%). Two thirds (67.2%; n=84) of the students said the model simulated a true lump. Nearly all the students agreed that the signs of site (97.6%; n=127), size (97.6%; n=127), shape (95.4%; n=124) and transillumination (95.4%; n=124) were clearly demonstrable with the model. A lower proportion of agreements were seen with signs such as tenderness (64.6%; n=82), attachment (77.7%; n=80) and warmth (58.6%; n=75) while more students disagreed with pulsatility (51.5%; n=67). Conclusion: The medical students had a positive perception to the use of the model. However, further refinements would be needed for more signs to be demonstrable.

Clues for improvement of research in objective structured clinical examination.

While objective clinical structured examination (OSCE) is a worldwide recognized and effective method to assess clinical skills of undergraduate medical students, the latest Ottawa conference on the assessment of competences raised vigorous debates regarding the future and innovations of OSCE. This study aimed to provide a comprehensive view of the global research activity on OSCE over the past decades and to identify clues for its improvement. We performed a bibliometric and scientometric analysis of OSCE papers published until March 2024. We included a description of the overall scientific productivity, as well as an unsupervised analysis of the main topics and the international scientific collaborations. A total of 3,224 items were identified from the Scopus database. There was a sudden spike in publications, especially related to virtual/remote OSCE, from 2020 to 2024. We identified leading journals and countries in terms of number of publications and citations. A co-occurrence term network identified three main clusters corresponding to different topics of research in OSCE. Two connected clusters related to OSCE performance and reliability, and a third cluster on student's experience, mental health (anxiety), and perception with few connections to the two previous clusters. Finally, the United States, the United Kingdom, and Canada were identified as leading countries in terms of scientific publications and collaborations in an international scientific network involving other European countries (the Netherlands, Belgium, Italy) as well as Saudi Arabia and Australia, and revealed the lack of important collaboration with Asian countries. Various avenues for improving OSCE research have been identified: i) developing remote OSCE with comparative studies between live and remote OSCE and issuing international recommendations for sharing remote OSCE between universities and countries; ii) fostering international collaborative studies with the support of key collaborating countries; iii) investigating the relationships between student performance and anxiety.

Exploring Factors Influencing Patients' Embarrassment and Feelings of Imposition in Objective Structured Clinical Examination Interactions.

OBJECTIVE: To identify factors influencing patient responses in potentially sensitive situations that might lead to embarrassment (defined by politeness theory (PT) as positive face-threatening acts [FTAs]) or a sense of imposition (defined by PT as negative FTAs) during Objective Structured Clinical Examinations (OSCEs) and to assess the participant's ability to mitigate such situations. METHODS: Nineteen OSCE video recordings of 10 pharmacy trainees interacting with mock patients were examined using the PT framework. All relevant participants' speech acts were coded and quantified into type of FTAs and the mitigation strategies used. Patient (assessor) responses were classified then quantified into preferred responses (ie, quick response) vs unpreferred (ie, delayed or hesitant responses) using conversation analysis. The chi-square test was used to identify any association between relevant variables according to predefined hypotheses using SPSS version 27. RESULTS: A total of 848 FTAs were analyzed. Participants failed to meet patient face needs in 32.4% of positive FTAs, negative FTAs in 11.5% of negative FTAs, and 44.4% of positive and negative FTAs. Although patients disclosing information about any inappropriate lifestyle behavior (as per OSCE scripts) expressed these via unpreferred mannerisms, participants were less likely to provide patients with reassurance when patient face needs were challenged in this way (68.2% of these unpreferred responses were not given reassuring feedback) than when they were maintained. CONCLUSION: Improving educational programs to include the context of patient face needs and conversational strategies for properly dealing with highly sensitive situations was suggested as a way to equip trainees with the skills to effectively build rapport with patients.

Ensuring robust OSCE assessments: A reflective account from a Scottish school of nursing.

AIM: This paper reflects on the experience of one Scottish University in conducting a face-to-face Objective Structured Examination (OSCE) for large cohorts of student nurses. It outlines the challenges experienced and learning gained. Borton's model of reflection frames this work due to its simplicity, ease of application and cyclical nature. BACKGROUND: The theoretical framework for the OSCE is critical thinking, enabling students to apply those skills authentically. OSCE's are designed to transfer classroom knowledge to clinical practice and offer an authentic work-based assessment. DESIGN: Validity and robustness are key considerations in any assessment and in OSCE, the number of stations that students encounter is important and debated. We used a case-study based OSCE approach initially over four stations and following reflection, changed to one long station with four phases. RESULTS: In OSCE examinations, interrater reliability is a necessity, and students expect equity of approach. We identified that despite clear marking criteria, marks were polarised, with students achieving high or low marks with little middle ground. Review of examination papers highlighted that although students' overall performance was good, some had failed in at least one station, suggesting a four-station approach may skew results. On reflection we hypothesised that using a one station case study-based, phased approach enabled the examiner to build up a more holistic picture of student knowledge and skills. It also provided the student opportunity to develop a rapport with the examiner and standardised patient, thereby putting them more at ease. We argue that this approach is holistic, authentic and student centred. CONCLUSIONS: Our experience highlights that a single station, four phase OSCE is preferrable, enabling students to integrate all aspects of the assessment and provides a holistic view of clinical skills and knowledge.

The Effectiveness of High-Fidelity Simulation on Clinical Competence Among Nursing Students.

Introduction: Clinical competence is a pre-requisite for every student nurse to showcase their proficiency in providing quality nursing care. Effective clinical experience during the study period plays a pivotal role in developing clinical competence among nursing students. Hence, the purpose of the study was to find the effectiveness of high fidelity simulation (HFS) on clinical competence among nursing students. Objectives: The objectives of the study were to determine the impact of HFS on level of clinical competence among nursing students, to find the association between selected demographic characteristics of nursing students with their level of clinical competence and also, to find the association between academic performances of nursing students with their level of competence. Method: The current study employed a quasi-experimental study design. Sixty-five nursing students from second year Bachelor of Science in Nursing (BSN) program were selected using consecutive sampling technique. The data was collected using demographic data form, objective structured clinical examination (OSCE) grade performa, and academic score sheet. SPSS version 24 was used to analyze data. Results: The study revealed a significant impact of HFS on clinical competence of nursing students. Majority (52.3%) of the nursing students obtained high level clinical competence following the HFS. The findings showed a significant association between gender and medium of instruction with the level of clinical competence of nursing students. Further, there was a significant correlation between academic performance and level of clinical competence of the nursing students. Conclusion: HFS served as a useful pedagogical approach in fulfilling the clinical learning outcomes. It further facilitated readiness of nursing students in second year BSN in terms of developing competence and confidence for clinical placement at the hospital for the third year of their study. However, further research is required to determine if HFS can be used in developing clinical reasoning skills in nursing students.

Digital Health Education for the Future: The SaNuRN (Santé Numérique Rouen-Nice) Consortium's Journey.

SaNuRN is a five-year project by the University of Rouen Normandy (URN) and the Côte d'Azur University (CAU) consortium to optimize digital health education for medical and paramedical students, professionals, and administrators. The project includes a skills framework, training modules, and teaching resources. In 2027, SaNuRN is expected to train a significant portion of the 400,000 health and paramedical professions students at the French national level. Our purpose is to give a synopsis of the SaNuRN initiative, emphasizing its novel educational methods and how they will enhance the delivery of digital health education. Our goals include showcasing SaNuRN as a comprehensive program consisting of a proficiency framework, instructional modules, and educational materials and explaining how SaNuRN is implemented in the participating academic institutions. SaNuRN is a project aimed at educating and training health-related and paramedics students in digital health. The project results from a cooperative effort between URN and CAU, covering four French departments. The project is based on the French National Referential on Digital Health (FNRDH), which defines the skills and competencies to be acquired and validated by every student in the health, paramedical, and social professions curricula. The SaNuRN team is currently adapting the existing URN and CAU syllabi to FNRDH and developing short-duration video capsules of 20 to 30 minutes to teach all the relevant material. The project aims to ensure that the largest student population earns the necessary skills, and it has developed a two-tier system involving facilitators who will enable the efficient expansion of the project's educational outreach and support the students in learning the needed material efficiently. With a focus on real-world scenarios and innovative teaching activities integrating telemedicine devices and virtual professionals, SaNuRN is committed to enabling continuous learning for healthcare professionals in clinical practice. The SaNuRN team introduced new ways of evaluating healthcare professionals by shifting from a knowledge-based to a competencies-based evaluation, aligning with the Miller teaching pyramid and using the Objective Structured Clinical Examination and Script Concordance Test in digital health education. Drawing on the expertise of URN, CAU, and their public health and digital research laboratories and partners, the SaNuRN project represents a platform for continuous innovation, including telemedicine training and living labs with virtual and interactive professional activities. The SaNuRN project provides a comprehensive, personalized 30-hour training package for health and paramedical students, addressing all 70 FNRDH competencies. The program is enhanced using AI and NLP to create virtual patients and professionals for digital healthcare simulation. SaNuRN teaching materials are open-access. The project collaborates with academic institutions worldwide to develop educational material in digital health in English and multilingual formats. SaNuRN offers a practical and persuasive training approach to meet the current digital health education requirements.

Situational simulation teaching effectively improves dental students' non-operational clinical competency and objective structured clinical examination performance.

BACKGROUND: Appropriate communication with dental patients enhances treatment outcomes and patient satisfaction. Implementing simulated patient interviews courses can improve patient-centered care and reduce conflict during clerkship training. Therefore, this study explored the relationship among student participation in a situational simulation course (SSC), academic performance, clerkship performance, and objective structured clinical examination (OSCE) performance. METHODS: This study was conducted with a sample of fifth-year dental students undergoing clerkship training. After implementing a situational simulation course to investigate the relationship among participation in SSC, academic performance, clerkship performance, and OSCE performance, a path analysis model was developed and tested. RESULTS: Eighty-seven fifth-year dental students were eligible for the SSC, and most (n = 70, 80.46%) volunteered to participate. The path analysis model revealed that academic performance had a direct effect on OSCE performance (ß = 0.281, P = 0.003) and clerkship performance (ß = 0.441, P < 0.001). In addition, SSC teaching had a direct effect on OSCE performance (ß = 0.356, P < 0.001). CONCLUSIONS: SSCs can enhance dental students' non-operational clinical competency and OSCE performance effectively. Simulated patient encounters with feedback, incorporated into the dental curricula, have led to improved communication. Based on our findings, we suggest implementing SSC teaching before the OSCE to improve communication and cognitive skills.

A level playing field? Evaluation of the virtual Objective Structured Clinical Examination in Psychiatry and Addiction Medicine: A mixed methods study.

OBJECTIVE: The Objective Structured Clinical Examination (OSCE) has been used for clinical assessment of a broad range of medical student competencies in Psychiatry and Addiction Medicine. However, there has been little research into online assessments. We investigated the virtual OSCE (v-OSCE) from the user perspective to better understand its acceptability, usefulness, benefits, challenges and potential improvements. METHODS: At the conclusion of the v-OSCE, all participants (medical students, examiners and simulated patients) were invited to participate in a brief online survey, based on the Technology and Acceptance Model. Freeform qualitative feedback was also obtained to explore participants' experiences and attitudes. RESULTS: Participants reported the v-OSCE was acceptable, efficient, convenient and easy to use. It was perceived as useful for demonstrating students' interviewing skills and interacting with the simulated patient. Benefits included greater convenience, reduced stress and travel time. Challenges were similar to those experienced in 'real world' telepsychiatry, primarily related to assessment of non-verbal cues and emotional prosody. CONCLUSIONS: Our findings inform recommendations for improving online examinations. These include increased preparation, practice and professionalism, to better simulate the in-person experience. Study credibility was strengthened by the triangulation of qualitative, quantitative and psychometric data.

Evaluation of the implementation of the objective structured clinical examination in health sciences education from a low-income context in Tunisia: A cross-sectional study.

Background: Objective structured clinical examination (OSCE) is well-established and designed to evaluate students' clinical competence and practical skills in a standardized and objective manner. While OSCEs are widespread in higher-income countries, their implementation in low-resource settings presents unique challenges that warrant further investigation. Aim: This study aims to evaluate the perception of the health sciences students and their educators regarding deploying OSCEs within the School of Health Sciences and Techniques of Sousse (SHSTS) in Tunisia and their efficacity in healthcare education compared to traditional practical examination methods. Methods: This cross-sectional study was conducted in June 2022, focusing on final-year Health Sciences students at the SHSTS in Tunisia. The study participants were students and their educators involved in the OSCEs from June 6th to June 11th, 2022. Anonymous paper-based 5-point Likert scale satisfaction surveys were distributed to the students and their educators, with a separate set of questions for each. Spearman, Mann-Whitney U and Krusakll-Wallis tests were utilized to test the differences in satisfaction with the OSCEs among the students and educators. The Wilcoxon Rank test was utilized to examine the differences in students' assessment scores in the OSCEs and the traditional practical examination methods. Results: The satisfaction scores were high among health sciences educators and above average for students, with means of 3.82 ± 1.29 and 3.15 ± 0.56, respectively. The bivariate and multivariate analyzes indicated a significant difference in the satisfaction between the students' specialities. Further, a significant difference in their assessment scores distribution in the practical examinations and OSCEs was also demonstrated, with better performance in the OSCEs. Conclusion: Our study provides evidence of the relatively high level of satisfaction with the OSCEs and better performance compared to the traditional practical examinations. These findings advocate for the efficacy of OSCEs in low-income countries and the need to sustain them.

Impact of a Mock OSCE on Student Confidence in Applying the Pharmacists' Patient Care Process.

The Medical and Pharmacy Student Collaboration (MAPSC) student organization at the University of Southern California, Alfred E. Mann School of Pharmacy and Pharmaceutical Sciences, created an extracurricular, peer-led, virtual group mock objective structured clinical examination (MOSCE) to expose first-year pharmacy students (P1s) to the Pharmacists' Patient Care Process (PPCP). The purpose of this study is to evaluate the impact of a MAPSC MOSCE on P1s self-reported confidence in applying the PPCP and on patient communication, medication knowledge, and clinical skills. An anonymous, optional, self-reported survey was administered to P1s before and after the event, where they rated their confidence on a scale of 0-100 (0 = not confident, 100 = certainly confident). The statistical analysis was a paired two-tailed t-test with a significance level of p < 0.05. A total of 152 P1s and 30 facilitators attended the MOSCE. One hundred thirty-nine students met the inclusion criteria and were included in the data analysis. There was a statistically significant difference in the change in self-reported confidence for all PPCP components and learning outcomes. The results of our study strongly indicate that introducing P1 students to the PPCP through a MAPSC MOSCE format is a valuable experience.

Internship Preparatory Clinical Course: A Timed-Station Approach to Bridging the Theory-to-Practice Gap.

BACKGROUND: Medical students' transition to internship has a discernible gap in structured preparation, particularly in practical skill application. We introduced the internship preparatory clinical course (IPCC) to address this gap.  Methods: The course was conducted at the clinical skills and simulation center at King Saud University Medical City and included a total of eight skills distributed across four stations. It employs a timed-station methodology, inspired by the Observed Structured Clinical Examination, but innovatively adapted as a teaching method. Participants were exposed to various stations, such as suturing techniques, interactive mannequins for anatomical structure demonstration, real ultrasound machines on simulated patients, IV cannulation, and urinary catheterization. To facilitate active learning, participants received course materials a day prior, equipped with QR codes for quick reference. Instructors emphasized on-the-spot review, fostering an environment where learners actively engage. Toward the end of the course, after internship a follow-up survey was administered to obtain feedback, achieving a response rate of 83% (n=45/54). RESULTS: Feedback from the course was overwhelmingly positive, with 91.1% (n=41/45) rating the course as 7 and above out of 10. Participants expressed a higher degree of confidence in providing wound care (Median: 8, IQR: 2) and inserting or removing a Foley catheter (Median: 8, IQR: 4). Lower confidence was observed in stoma examination and care (Median: 5, IQR: 4). During their internships, participants reported that 100% (n=45/45) utilized suturing skills, 48.9% (n=22/45) performed focused assessment with sonography in trauma (FAST) examinations, and 62.2% (n=28/45) attempted nasogastric tube insertions. Additionally, 88.9% (n=40/45) performed wound examinations, 77.8% (n=35/45) provided wound care and dressing, 37.8% (n=17/45) performed abscess drainage, 51.1% (n=23/45) removed and 37.8% (n=17/45) inserted a Foley catheter, and 20% (n=9/45) provided stoma care. CONCLUSION: The IPCC effectively addresses the existing gap in medical education, bridging the theory-to-practice divide. The innovative use of the timed-station approach emphasizes the importance of active learning. Our results signify the importance of simulation training, as most interns acknowledge the positive impact of the course on their internship. We recommend preparing pre-interns for internships by giving special consideration to the procedural aspects as most associated with medical errors. The timed-station approach can improve cost-effectiveness and enhance responsibility-driven learning.

Developing an innovative national ACP-OSCE program in Taiwan: a mixed method study.

OBJECTIVES: To evaluate the process and the comprehensiveness of advance care planning (ACP), we designed a national ACP-OSCE (Objective Structured Clinical Examination) program. METHODS: The program was designed as a 40-minute OSCE test. Participants were categorized as different ACP team members to illustrate realistic scenarios. Preceptors were asked to observe ACP professionals' actions, responses, and communication skills during ACP with standardized patients (SP) through a one-way mirror. Participants' communication skills, medical expertise, legal knowledge, empathetic response and problem-solving skills of ACP were also self-evaluated before and after OSCE. Thematic analysis was used for qualitative analysis. RESULTS: In Nov 2019, a total of 18 ACP teams with 38 ACP professionals completed the ACP-OSCE program, including 15 physicians, 15 nurses, 5 social workers, and 3 psychologists. After the ACP-OSCE program, the average score of communication skills, medical expertise, legal knowledge, empathetic response, ACP problem-solving all increased. Nurses felt improved in medical expertise, legal knowledge, and problem-solving skills, psychologists and social workers felt improved in legal knowledge, while physicians felt no improved in all domain, statistically. Thematic analysis showed professional skills, doctoral-patient communication, benefit and difficulties of ACP were the topics which participants care about. Meanwhile, most participants agreed that ACP-OSCE program is an appropriate educational tool. CONCLUSION: This is the first national ACP-OSCE program in Asia. We believe that this ACP-OSCE program could be applied in other countries to improve the ACP process and quality.

Objective structured clinical examination to teach competency in planetary health care and management - a prospective observational study.

BACKGROUND: Health professionals are increasingly called upon and willing to engage in planetary health care and management. However, so far, this topic is rarely covered in medical curricula. As the need for professional communication is particularly high in this subject area, this study aimed to evaluate whether the objective structured clinical examination (OSCE) could be used as an accompanying teaching tool. METHODS: During the winter semester 2022/2023, 20 third- and fifth-year medical students voluntarily participated in a self-directed online course, three workshops, and a formal eight-station OSCE on planetary health care and management. Each examinee was also charged alternatingly as a shadower with the role of providing feedback. Experienced examiners rated students' performance using a scoring system supported by tablet computers. Examiners and shadowers provided timely feedback on candidates` performance in the OSCE. Immediately after the OSCE, students were asked about their experience using a nine-point Likert-scale survey and a videotaped group interview. Quantitative analysis included the presentation of the proportional distribution of student responses to the survey and of box plots showing percentages of maximum scores for the OSCE performance. The student group interview was analyzed qualitatively. RESULTS: Depending on the sub-theme, 60% -100% of students rated the subject of planetary health as likely to be useful in their professional lives. Similar proportions (57%-100%) were in favour of integrating planetary health into required courses. Students perceived learning success from OSCE experience and feedback as higher compared to that from online courses and workshops. Even shadowers learned from observation and feedback discussions. Examiners assessed students' OSCE performance at a median of 80% (interquartile range: 83%-77%) of the maximum score. CONCLUSIONS: OSCE can be used as an accompanying teaching tool for advanced students on the topic of planetary health care and management. It supports learning outcomes, particularly in terms of communication skills to sensitise and empower dialogue partners, and to initiate adaptation steps at the level of individual patients and local communities.

Review of Objective Structured Clinical Examination Practices Within Pharmacy Programs Throughout the United States.

OBJECTIVE: To update the description of current objective structured clinical examination (OSCE) practices within pharmacy schools in the United States and identify barriers to OSCE implementation and expansion. METHODS: A survey was deployed to all accredited Doctor of Pharmacy programs within the United States. The survey was designed to collect information regarding the curricular mapping of OSCEs, OSCE design, OSCE delivery, assessment of OSCE performance, and barriers to OSCE implementation and expansion. RESULTS: Of the 135 US-accredited programs identified, 109 (81%) programs completed the survey. In total, 93 (85%) programs reported using OSCEs to assess students; however, implementation throughout the curriculum and current practices varied by institution. Most programs place OSCEs within specific courses (96%), with the applied skills coursework being the most used (80%). The most common number of OSCEs that occur throughout a curriculum is 6 (18%), however, 20 (22%) programs execute 10 or more OSCEs throughout their curriculum. Forty (43%) programs use OSCEs as high-stakes assessments where poor performance could prevent a student from progressing to advanced pharmacy practice experiences. Of the responding programs, over half (56%) use teaching objective structured examinations to enhance learning. Common barriers to OSCE expansion exist and are related to resource utilization. CONCLUSION: Significant expansion of OSCE development and implementation has occurred over the last decade. There is substantial variability in implementation and utilization among programs. Although standards of best practice for OSCEs exist for other health professions, best practices in pharmacy education have not been widely accepted or adopted.

Implementation of peer-to-peer oral care objective structured clinical examination-based learning for nursing students.

AIM: Nurses' skills and confidence in providing oral care to patients play important roles in healthcare. Studies have proved that peer-to-peer learning and assessment can help improve nurses' skills and confidence. However, no study has investigated it using an objective assessment checklist. This study investigated an oral hygiene practice training program for nursing students. It focused on their oral healthcare skills, confidence, and perspectives regarding implementing an objective structured clinical examination (OSCE). METHODS: A pre- and post-survey of 97 nursing students from a nursing school in Japan was conducted as a peer-to-peer oral health education training program that included an assessment and performance checklist. RESULTS: Confidence in performing and assessing oral care significantly improved after attending the program. Furthermore, the changes were significantly greater in the developed program than in the training program without the checklist. The mean total assessment scores (0-25) of the first, second, third, and fourth participants in the four-student groups were 22.1, 23.4, 23.9, and 24.1, respectively. The mean scores of the second, third, and fourth participant groups were significantly higher than that of the first participant group (p < .01). Fifty-two positive and 58 negative comments were received regarding the implementation of the program with professional assessments and the checklist. The most common positive comment mentioned that the evaluation by professionals improved oral care learning and skills. CONCLUSIONS: This study developed a program to improve nursing students' confidence and oral care delivery skill building in an OSCE-style delivery.

The medical licensing assessment will fall short of determining whether a UK medical graduate behaves ethically.

UK medical graduates will soon need to pass the medical licensing assessment, which assesses skills and knowledge in ethics using multiple choice questions (eg single best answer questions) and objective structured clinical examination. However, educational leaders have recognised that these methods lack the sophistication needed to accurately assess medical ethics. The reasons are two-fold. First, there may be a knowledge and practice gap in medical schools when it comes to preparing students for the assessment. To this end, this article shares peer advice about how best to use objective structured clinical examinations and single best answer questions for assessing medical ethics to help prepare students for the medical licensing assessment. Second, the design of the assessment is unlikely to adequately measure graduates' ethical values and behaviour in real world scenarios. Further work is needed to design assessments that are sophisticated enough to examine candidates' ethical reasoning and their actual behaviour.