Is ChatGPT 'ready' to be a learning tool for medical undergraduates and will it perform equally in different subjects? Comparative study of ChatGPT performance in tutorial and case-based learning questions in physiology and biochemistry.

PURPOSE: Generative AI will become an integral part of education in future. The potential of this technology in different disciplines should be identified to promote effective adoption. This study evaluated the performance of ChatGPT in tutorial and case-based learning questions in physiology and biochemistry for medical undergraduates. Our study mainly focused on the performance of GPT-3.5 version while a subgroup was comparatively assessed on GPT-3.5 and GPT-4 performances. MATERIALS AND METHODS: Answers were generated in GPT-3.5 for 44 modified essay questions (MEQs) in physiology and 43 MEQs in biochemistry. Each answer was graded by two independent examiners. Subsequently, a subset of 15 questions from each subject were selected to represent different score categories of the GPT-3.5 answers; responses were generated in GPT-4, and graded. RESULTS: The mean score for physiology answers was 74.7 (SD 25.96). GPT-3.5 demonstrated a statistically significant (p = .009) superior performance in lower-order questions of Bloom's taxonomy in comparison to higher-order questions. Deficiencies in the application of physiological principles in clinical context were noted as a drawback. Scores in biochemistry were relatively lower with a mean score of 59.3 (SD 26.9) for GPT-3.5. There was no statistically significant difference in the scores for higher and lower-order questions of Bloom's taxonomy. The deficiencies highlighted were lack of in-depth explanations and precision. The subset of questions where the GPT-4 and GPT-3.5 were compared demonstrated a better overall performance in GPT-4 responses in both subjects. This difference between the GPT-3.5 and GPT-4 performance was statistically significant in biochemistry but not in physiology. CONCLUSIONS: The differences in performance across the two versions, GPT-3.5 and GPT-4 across the disciplines are noteworthy. Educators and students should understand the strengths and limitations of this technology in different fields to effectively integrate this technology into teaching and learning.

Learning during the pandemic: Perspectives of medical students in Singapore

The COVID-19 pandemic has significantly disrupted medical education, particularly affecting clinical-year students. Educational institutions often had to halt, shorten or impose significant restrictions on their hospital rotations due to strict infection control and social-distancing guidelines implemented in tertiary healthcare institutions, as well as manpower and logistical constraints amid the pandemic. Thus, distance-based learning platforms such as online lectures and case-based teaching were increasingly adopted in place of bedside and face-to-face tutorials. While interactive virtual case-based discussions are generally useful in imparting clinical reasoning skills to medical students, they are unfortunately not able to fully replicate the experience of clerking, examining and managing real patients in the wards, which is a quintessential process towards building clinical acumen and attaining core clinical competencies. Therefore, for final year medical students who are preparing for their Bachelor of Medicine and Bachelor of Surgery (MBBS) examinations, many are naturally concerned by how learning in this "new normal" may affect their ability to make the transition to become competent junior doctors. As such, we seek to share our learning experiences as the first batch of medical students to have completed our entire final year of clinical education amid the COVID-19 pandemic, and offer 4 practical suggestions to future batches of students on how to adapt and optimise clinical learning under these circumstances: actively engaging in virtual learning, making the most of every clinical encounter, learning how to construct peer teaching/practice sessions, and maintaining physical and psychological well-being.

Mobile learning in clinical settings: unveiling the paradox / 한국의학교육

Purpose@#The use of mobile devices among medical students and residents to access online material in real-time has become more prevalent. Most literature focused on the technical/functional aspects of mobile use. This study, on the other hands, explored students, doctors and patients’ preferences and reasons towards the use of mobile devices in clinical settings underpinned by the Technology Acceptance Model 2 (TAM 2). @*Methods@#This research employs an exploratory research design using survey and semi-structured interviews. An online survey was administered to clinical year medical students, followed by semi-structured interviews with the doctors and patients. Questions for the online survey and semi-structured interviews were derived from previous literature and was then reviewed by authors and an expert panel. A convenience sampling was used to invite voluntary participants. @*Results@#Survey findings showed that most medical students used their devices to find drug information and practice guidelines. The majority of the students accessed UpToDate followed by Google to access medical resources. Key barriers that students often encountered during the use of mobile devices were internet connectivity in the clinical settings, reliability of the information, and technical issues. Thematic analysis of the interviews revealed four themes: general usage by students, receptivity of the use of mobile devices by students, features in selecting resources for mobile learning, and limitation in the current use of mobile devices for learning. @*Conclusion@#The findings from this study assist in recommending suitable material using mobile devices to enhance learning in the clinical environment and expand the TAM 2.

Admission policies and methods at crossroads: a review of medical school admission policies and methods in seven Asian countries / 한국의학교육

Selecting the right applicants is an important part of medical student admission. While one universally accepted selection criterion is academic capacity, there are other criteria such as communication skills and local criteria (e.g., socio-cultural values) that are no less important. This article reviews the policies and methods of selection to medical schools in seven countries with varying socio-economic conditions and healthcare systems. Senior academics involved in medical education in Indonesia, Japan, Malaysia, the Philippines, Singapore, Sri Lanka, and Taiwan completed a pre-agreed pro-forma per each country to describe the country’s admission policies and methods. The details were then compared and contrasted. This review identifies tension between many of the policies and methods used in medical school admissions, such as between the need to assess non-cognitive abilities and widen access, and between the need for more medical professionals and the requirement to set high entry standards. Finding the right balance requires careful consideration of all variables, including the country’s human resource needs; socio-economic status; graduates’ expected competencies; and the school’s vision, mission, and availability of resources.

Faculty development in medical education: an environmental scan in countries within the Asia pacific region / 한국의학교육

Purpose@#In recent years, faculty development (FD) research is more noticeable within an inter-professional context and in allied health education. However, there is a paucity of published literature on FD medical education programs in Asia. With the formation of the Asia Pacific Medical Education Network (APME-Net) in 2015, a scoping review of an environmental scan of FD medical education programs in main institutions in South East Asia and Australia in 2018 was conducted. @*Methods@#A survey was developed to collect data on FD in medical education after several rounds of discussion with APME-Net members. The representatives from nine countries in Asia and Australia were invited to partner in this research project. They sent the questionnaire to the Dean of all different medical schools after ethical clearance. The data collected was analyzed using descriptive statistics. @*Results@#Only institutions in four countries responded to the questionnaire. The medical/health professions education center/department/unit has been established in most educational institutions in these countries. These centers/departments/units mostly carry out FD programs to improve the teaching and learning skills of trained participants, particularly clinical teachers via workshops and seminars. Staffing issues and participant buy-in are the current key priorities of the center/department/unit in terms of FD. Lastly, research related FD program has not been well-supported in these countries, hence, the lack of publication in this area. @*Conclusion@#Collaboration between countries to address key areas of interest and develop more standardized and productive FD medical education is required especially in research.

Improving a newly adapted teaching and learning approach: Collaborative Learning Cases using an action research / 한국의학교육

PURPOSE: Although medical curricula are now better structured for integration of biomedical sciences and clinical training, most teaching and learning activities still follow the older teacher-centric discipline-specific formats. A newer pedagogical approach, known as Collaborative Learning Cases (CLCs), was adopted in the medical school to facilitate integration and collaborative learning. Before incorporating CLCs into the curriculum of year 1 students, two pilot runs using the action research method was carried out to improve the design of CLCs. METHODS: We employed the four-phase Kemmis and McTaggart's action research spiral in two cycles to improve the design of CLCs. A class of 300 first-year medical students (for both cycles), 11 tutors (first cycle), and 16 tutors (second cycle) were involved in this research. Data was collected using the 5-points Likert scale survey, open-ended questionnaire, and observation. RESULTS: From the data collected, we learned that more effort was required to train the tutors to understand the principles of CLCs and their role in the CLCs sessions. Although action research enables the faculty to improve the design of CLCs, finding the right technology tools to support collaboration and enhance learning during the CLCs remains a challenge. CONCLUSION: The two cycles of action research was effective in helping us design a better learning environment during the CLCs by clarifying tutors' roles, improving group and time management, and meaningful use of technology.

Impact of faculty development programs for positive behavioural changes among teachers: a case study / 한국의학교육

PURPOSE: Faculty development (FD) is essential to prepare faculty members to become effective teachers to meet the challenges in medical education. Despite the growth of FD programmes, most evaluations were often conducted using short questionnaires to assess participants’ satisfaction immediately after they attended a programme. Consequently, there were calls for more rigorous evaluations based on observed changes in participants’ behaviours. Hence, this study aims to explore how the FD workshops run by the Centre for Medical Education, Yong Loo Lin School of Medicine, National University of Singapore have impacted behavioural changes in the educators. METHODS: We followed up with the educators at least half a year after they have attended the workshops. With limited literature as reference, we initiated a small-scale case-study research design involving semi-structured interviews with six educators which was triangulated with three focus group discussions with their students. This allowed us to explore behavioural changes among the educators as well as evaluate the feasibility of this research methodology. RESULTS: We identified three emerging categories among the educators: ignorance to awareness, from intuition to confirmation and expansion, and from individualism to community of practice. CONCLUSION: Although FD have placed much emphasis on teaching and learning approaches, we found that the teacher-student interaction or human character components (passionate, willing to sacrifice, are open to feedback) in becoming a good educator are lacking in our FD workshops.