Item Analysis of Single Best Response Type Multiple Choice Questions for Formative Assessment in Obstetrics and Gynaecology.

Background: MCQs (multiple choice questions) can be used to assess higher-order skills and be utilised for creating a question bank. Purpose of Study Aim: To perform post-validation item analysis of MCQs constructed by medical faculty for formative assessment of final-year medical students and to explore the association between difficulty index (p value) and discrimination indices (DI) with distractor efficiency (DE). Methods: An observational study was conducted involving 50 final-year MBBS students and 10 faculty members for a period of one year (October 2020 to September 2021). After training the faculty in item analysis, a MCQ test was prepared after collecting the peer-reviewed 25 MCQs (five each from various subtopics of the subject). The result of this test was used to calculate the FV (facility value), DI (discrimination index), and DE (distractor efficiency) of each item. Student and faculty feedback was also obtained on a five-point Likert scale. Results: The mean FV was 46.3 ± 19.3 and 64% of questions were difficult; the mean DI was 0.3 ± 0.1 and 92% of questions could differentiate between HAG (high achiever's group) and LAG (low achiever's group); the mean DE was 82% ± 19.8 and 48% of items had no NFDs (non-functional distractors). Conclusion: MCQs can be used to assess all the levels of Bloom's taxonomy. Item analysis yielded 23 out of 25 MCQs that were suitable for the question bank.

Exploring cross-linguistic differences in parental input and their associations with child expressive language in ASD: Bulgarian versus English comparison.

BACKGROUND: Parental input plays a central role in typical language acquisition and development. In autism spectrum disorder (ASD), characterized by social communicative and language difficulties, parental input presents an important avenue for investigation as a target for intervention. A rich body of literature has identified which aspects of grammatical complexity and lexical diversity are most associated with child language ability in both typical development and autism. Yet, the majority of these studies are conducted with English-speaking children, thus potentially overlooking nuances in parental input derived from cross-linguistic variation. AIMS: To examine the differences in verbal parental input to Bulgarian- and English-speaking children with ASD. To examine whether aspects of verbal parental input found to be concurrent predictors of English-speaking children's expressive language ability are also predictors of the expressive language of Bulgarian-speaking children with ASD. METHODS & PROCEDURES: We compared parental input to Bulgarian-speaking (N = 37; 2;7-9;10 years) and English-speaking (N = 37; 1;8-4;9 years) children with ASD matched on expressive language. Parent-child interactions were collected during free play with developmentally appropriate toys. These interactions were transcribed, and key measures of parental input were extracted. OUTCOMES & RESULTS: English-speaking parents produced more word tokens and word types than Bulgarian-speaking parents. However, Bulgarian parents produced more verbs in relation to nouns and used more statements and exclamations but asked fewer questions than English-speaking parents. In addition, child age and parents' use of questions were significant concurrent predictors of child expressive vocabulary. CONCLUSIONS & IMPLICATIONS: This is one of the first studies to conduct a cross-linguistic comparison of parental input in ASD. The differences found emphasize the need to further study parental input to Bulgarian children and adapt naturalistic parent-mediated interventions to the local language and its specific characteristics. WHAT THIS PAPER ADDS: What is already known on the subject A rich body of literature has identified the specific aspects of grammatical complexity, lexical diversity, and question-asking that are concurrently and longitudinally associated with the language ability of children with typical development and of children with ASD. Yet, the majority of these studies are conducted with English-speaking children. What this paper adds to the existing knowledge The present study finds that there are specific differences in verbal parental input to Bulgarian- and English-speaking children with autism in terms of lexical composition and question-asking. Bulgarian parents used more verbs than nouns, and the opposite pattern was found for English-speaking parents. In addition, Bulgarian parents asked fewer questions but used more statements and exclamations. Nevertheless, parental question use was significantly correlated with children's language ability across both groups, suggesting that question-asking should be further examined as a potential target for parent-mediated language interventions for Bulgarian children with autism. What are the potential or actual clinical implications of this work? Most language and social communication interventions for autism are designed and piloted with English-speaking children. These interventions are often simply translated and used in different countries, with different populations and in different contexts. However, considering that one of the defining characteristics of autism is language difficulty, more studies should examine (1) how these language difficulties manifest in languages other than English, and (2) what characterizes verbal parental input in these other contexts. Such research investigations should inform future language and social communication interventions. The present study emphasizes the cross-linguistic differences between Bulgarian- and English-speaking parents' verbal input to their children with autism.

Evaluating the Effectiveness of Online Assessments and Their Parameters as Predictors of Academic Performance in Undergraduate Medical Education.

Background and objectives Considering the increasing utilization of online educational tools in medical education, it is essential to evaluate the reliability and validity of online assessments to accurately assess student proficiency and predict academic success. This study investigated the predictive efficacy of different online assessment methods in comparison to standard offline methods within the medical educational setting. Methods This study utilized a mixed-methods crossover design, involving 125 first-year medical students who were randomly assigned to either online or traditional examinations. The students then crossed over to the other type of assessment. The assessments consisted of multiple-choice questions (MCQs), viva voce, objective structured clinical examinations, and written theory examinations. Quantitative data on results, finishing times, and academic metrics were analyzed, along with qualitative data from student interviews exploring perceptions of each format. Results The online MCQs had the highest average scores and a moderately positive correlation with performance on the theory examination (r=0.326). Regression models indicated that online and offline MCQs were moderate positive predictors of theoretical marks (R2=0.106 and 0.107, respectively). Qualitative responses emphasized advantages such as flexibility and accessibility for online examinations but also concerns regarding technological challenges, interaction, and integrity compared to traditional formats. Conclusions Online MCQ assessments showed promise as indicators of medical student academic performance. However, additional online forms require improvement to match conventional assessments reliably. As medical education involves digital technologies, cautious implementation of online evaluations substantiated by further research is needed to preserve educational quality standards.

Performance of ChatGPT on questions from the Brazilian College of Radiology annual resident evaluation test.

Objective: To test the performance of ChatGPT on radiology questions formulated by the Colégio Brasileiro de Radiologia (CBR, Brazilian College of Radiology), evaluating its failures and successes. Materials and Methods: 165 questions from the CBR annual resident assessment (2018, 2019, and 2022) were presented to ChatGPT. For statistical analysis, the questions were divided by the type of cognitive skills assessed (lower or higher order), by topic (physics or clinical), by subspecialty, by style (description of a clinical finding or sign, clinical management of a case, application of a concept, calculation/classification of findings, correlations between diseases, or anatomy), and by target academic year (all, second/third year, or third year only). Results: ChatGPT answered 88 (53.3%) of the questions correctly. It performed significantly better on the questions assessing lower-order cognitive skills than on those assessing higher-order cognitive skills, providing the correct answer on 38 (64.4%) of 59 questions and on only 50 (47.2%) of 106 questions, respectively (p = 0.01). The accuracy rate was significantly higher for physics questions than for clinical questions, correct answers being provided for 18 (90.0%) of 20 physics questions and for 70 (48.3%) of 145 clinical questions (p = 0.02). There was no significant difference in performance among the subspecialties or among the academic years (p > 0.05). Conclusion: Even without dedicated training in this field, ChatGPT demonstrates reasonable performance, albeit still insufficient for approval, on radiology questions formulated by the CBR.

Objetivo: Testar o desempenho do ChatGPT em questões de radiologia formuladas pelo Colégio Brasileiro de Radiologia (CBR), avaliando seus erros e acertos. Materiais e Métodos: 165 questões da avaliação anual dos residentes do CBR (2018, 2019 e 2022) foram apresentadas ao ChatGPT. Elas foram divididas, para análise estatística, em questões que avaliavam habilidades cognitivas de ordem superior ou inferior e de acordo com a subespecialidade, o tipo da questão (descrição de um achado clínico ou sinal, manejo clínico de um doente, aplicação de um conceito, cálculo ou classificação dos achados descritos, associação entre doenças ou anatomia) e o ano da residência (R1, R2 ou R3). Resultados: O ChatGPT acertou 53,3% das questões (88/165). Houve diferença estatística entre o desempenho em questões de ordem cognitiva inferior (64,4%; 38/59) e superior (47,2%; 50/106) (p = 0,01). Houve maior índice de acertos em física (90,0%; 18/20) do que em questões clínicas (48,3%; 70/145) (p = 0,02). Não houve diferença significativa de desempenho entre subespecialidades ou ano de residência (p > 0,05). Conclusão: Mesmo sem treinamento dedicado a essa área, o ChatGPT apresenta desempenho razoável, mas ainda insuficiente para aprovação, em questões de radiologia formuladas pelo CBR.

Exploring the experiences of content experts with item vetting during item bank development.

Objective: To explore content experts' experiences with item vetting during item bank development at a public sector medical university of Rawalpindi, Pakistan. Methods: An exploratory study was carried out from December 2022 to February 2023 at a public sector medical college of Rawalpindi. A purposive sampling technique was employed to collect data from all content experts of the study institute who participated in item vetting activity during pre-exam moderation in the university. A pilot-tested semi-structured interview guide was utilized, interviews were audio recorded and later transcribed. Participants' anonymity was ensured. Various quality assurance strategies were employed to ensure the trustworthiness of the findings. Thematic analysis was performed on the transcribed data and themes were finalized by achieving consensus among all authors. Results: Six themes overarching the fourteen subthemes emerged from the data. Participants expressed a profound sense of satisfaction and valued their experience in refining expertise in constructing multiple-choice questions (MCQs). It was widely acknowledged that such activities not only contribute to the enhancement of item development skills but also improve quality of items. Conclusions: The consistent implementation of item vetting routines, in conjunction with diligent adherence to item writing protocols, contributes to quality assurance measures in assessment. Item bank development for fair and transparent assessment ensures production of competent healthcare professionals filtering incompetent ones hence improving health care services in the community.

The intersection of parent questions, child skills, and activity context in informal science, technology, engineering, and math learning.

Adult verbal input occurs frequently during parent-child interactions. However, few studies have considered how parent language varies across informal STEM (science, technology, engineering, and math) activities. In this study, we examined how open and closed parent questions (a) differed across three STEM activities and (b) related to math, science, and vocabulary knowledge in their preschool-aged children. A total of 173 parents and their preschool children (Mage = 4 years) from lower socioeconomic households were video-recorded participating in three STEM-related activities: (a) a pretend grocery store activity, (b) a bridge-building challenge, and (c) a book read about a science topic. Parent questions were categorized as open or closed according to the presence of key question terms. Results indicate that the three activities elicited different frequencies of parent open and closed questions, with the grocery store activity containing the most open and closed questions. Children's science knowledge was predicted by the frequency and proportion of parent open questions during the book read. These results enhance our understanding of the role of parent questions in young children's language environments in different informal learning contexts.

The Utility of Multiple-Choice Assessment in Current Medical Education: A Critical Review.

In recent years, healthcare education providers have boasted about a conscious shift towards increasing clinical competence via assessment tests that promote more active learning. Despite this, multiple-choice questions remain amongst the most prevalent forms of assessment. Various literature justifies the use of multiple-choice testing by its high levels of validity and reliability. Education providers also benefit from requiring fewer resources and costs in the development of questions and easier adaptivity of questions to compensate for neurodiversity. However, when testing these (and other) variables via a structured approach in terms of their utility, it is elucidated that these advantages are largely dependent on the quality of the questions that are written, the level of clinical competence that is to be attained by learners and the impact of negating confounding variables such as differential attainment. Attempts at improving the utility of multiple-choice question testing in modern healthcare curricula are discussed in this review, as well as the impact of these modifications on performance.

Contributions of shared book reading to children's learning of new semantic facts through memory integration.

Young children rapidly learn facts about the world. One mechanism supporting knowledge acquisition is memory integration: derivation of new knowledge by combining separate, yet related facts accumulated over time. There are both developmental changes and individual differences in young children's learning through memory integration. However, there is little research on how everyday social interactions may promote memory integration and contribute to individual differences. Accordingly, we investigated how the everyday social interactions of caregiver-child shared book reading support 5- to 6-year-olds' memory integration (N = 82 parent-child dyads; 47 female children; M age 6.10; 56.5% White non-Latinx, 15% Black, 6% White Latinx, 5.5% Asian, 17% more than one race). Caregivers read a narrative book that included opportunities to integrate facts. Half the dyads were assigned to an embedded questions condition (questions on facts included throughout the book) and half to a no embedded questions condition (statements only). We measured dyads' extratextual talk while reading for the extent to which they integrated the facts (integration talk). Children's learning was tested with both memory integration and fact recall questions. Dyads in the embedded questions condition had more integration talk. The extent to which the dyads integrated while reading predicted children's integration performance, above and beyond condition effects. This effect was specific to memory integration: integration talk nor condition accounted for fact recall. These results suggest that shared book reading can support young children's integration, especially when books engage dyads through embedded questions and dyads integrate facts while reading.

Dynamic answer-dependent multiple-choice questions and holistic assessment analysis in high-enrollment courses.

Many 4-year public institutions face significant pedagogical challenges due to the high ratio of students to teaching team members. To address the issue, we developed a workflow using the programming language R as a method to rapidly grade multiple-choice questions, adjust for errors, and grade answer-dependent style multiple-choice questions, thus shifting the teaching teams' time commitment back to student interaction. We provide an example of answer-dependent style multiple-choice questions and demonstrate how the output allows for discrete analysis of questions based on various categories such as Fundamental Statements or Bloom's Taxonomy Levels. Additionally, we show how student demographics can be easily integrated to yield a holistic perspective on student performance in a course. The workflow offers dynamic grading opportunities for multiple-choice questions and versatility through its adaptability to assessment analyses. This approach to multiple-choice questions allows instructors to pinpoint factors affecting student performance and respond to changes to foster a healthy learning environment.

Frontiers and future perspectives of neuroimmunology.

Neuroimmunology is an interdisciplinary branch of biomedical science that emerges from the intersection of studies on the nervous system and the immune system. The complex interplay between the two systems has long been recognized. Research efforts directed at the underlying functional interface and associated pathophysiology, however, have garnered attention only in recent decades. In this narrative review, we highlight significant advances in research on neuroimmune interplay and modulation. A particular focus is on early- and middle-career neuroimmunologists in China and their achievements in frontier areas of "neuroimmune interface", "neuro-endocrine-immune network and modulation", "neuroimmune interactions in diseases", "meningeal lymphatic and glymphatic systems in health and disease", and "tools and methodologies in neuroimmunology research". Key scientific questions and future directions for potential breakthroughs in neuroimmunology research are proposed.

Validation of the Chinese version of the Whooley questions for community screening of postpartum depression.

BACKGROUND: The study aims to validate the Whooley questions for screening postpartum depression in Chinese women in a community setting. METHODS: The Whooley questions was translated into Chinese following Beaton's intercultural debugging guidelines. From December 1, 2020 to June 30, 2021, primary maternal and child health workers in Kaifu District and Changsha County in Changsha City recruited women aged 18 years or older who had recently given birth during home visits within seven days of discharge from hospital. Participants women completed the Whooley questions online and underwent a diagnostic interview for DSM-IV within 7 days of the visit. We evaluated Cronbach's alpha, split-half reliability, area under the ROC curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and optimal cut-off value of the Whooley questions. RESULTS: Of the 3,004 eligible women, 1,862 completed the Whooley questions and diagnostic interviews. Sixty-two women (3.3%) were diagnosed with depressive disorders. The Cronbach's alpha coefficient was 0.64, the split-half reliability was 0.64. The optimal cut-off value was when at least one questions was answered "yes", with an AUC of 0.84 (SE=0.03, 95%CI 0.78-0.90, P<0.001), sensitivity of 0.77 (95%CI 0.65-0.87), specificity of 0.89 (95%CI 0.88-0.90), PPV of 0.20 (95%CI 0.15-0.25) and NPV of 0.99 (95%CI 0.98-1.00). CONCLUSION: This study shows that the Chinese version of the Whooley questions is a reliable tool for screening postpartum depression in the community, but it may lead to many false positive cases.

Going Above and Beyond With SJTs: Impact of Applicant Characteristics on Open Response SJT Participation.

BACKGROUND: Situational judgment tests (SJT) have gained popularity as a standardized assessment of nontechnical competencies for applicants to medical school and residency. SJT formats range from rating the effectiveness of potential response options to solely open response. We investigated differences in test-taking patterns between responders and nonresponders to optional open response SJT questions during the application process. METHODS: This was a prospective multi-institutional study of general surgery applicants to seven residency programs. Applicants completed a 32-item SJT designed to measure ten core competencies: adaptability, attention to detail, communication, dependability, feedback receptivity, integrity, professionalism, resilience, self-directed learning, and team orientation. Each SJT item included an optional, nonscored, open response space for applicants to provide a behavioral response if they desired. Trends in applicant gender, race, ethnicity, medical school ranking, and USMLE scores were examined between the responder versus nonresponder group. RESULTS: In total, 1491 general surgery applicants were invited to complete the surgery-specific SJT. Of these, 1454 (97.5%) candidates completed the assessment and 1177 (78.9%) provided additional responses to at least one of the 32 SJT scenario sets. There were no differences in overall SJT performance, USMLE scores (Step 1: 235, SD 14, Step 2: 250, SD 11), race and/or ethnicity between the responder and nonresponder groups. Responders were more likely to be from a top 25 medical school (p < 0.05) compared to the nonresponder group. Among applicants who completed any open response questions, women completed a significantly higher number of questions compared to men (7.21 vs 6.07, p = 0.003). The number of open responses provided correlated with higher scores on SJT items measuring dependability (r = 0.07, p = 0.007). CONCLUSIONS: SJT design and format has the potential to impact test-taker response patterns. SJT developers and adopters should ensure test format and design have no unintended consequences prior to implementation.

ChatGPT prompts for generating multiple-choice questions in medical education and evidence on their validity: a literature review.

ChatGPT's role in creating multiple-choice questions (MCQs) is growing but the validity of these artificial-intelligence-generated questions is unclear. This literature review was conducted to address the urgent need for understanding the application of ChatGPT in generating MCQs for medical education. Following the database search and screening of 1920 studies, we found 23 relevant studies. We extracted the prompts for MCQ generation and assessed the validity evidence of MCQs. The findings showed that prompts varied, including referencing specific exam styles and adopting specific personas, which align with recommended prompt engineering tactics. The validity evidence covered various domains, showing mixed accuracy rates, with some studies indicating comparable quality to human-written questions, and others highlighting differences in difficulty and discrimination levels, alongside a significant reduction in question creation time. Despite its efficiency, we highlight the necessity of careful review and suggest a need for further research to optimize the use of ChatGPT in question generation. Main messages  Ensure high-quality outputs by utilizing well-designed prompts; medical educators should prioritize the use of detailed, clear ChatGPT prompts when generating MCQs. Avoid using ChatGPT-generated MCQs directly in examinations without thorough review to prevent inaccuracies and ensure relevance. Leverage ChatGPT's potential to streamline the test development process, enhancing efficiency without compromising quality.

Evaluating the associations between compliance with CKD guideline component metrics and renal outcomes.

Understanding the association between compliance to the Chronic Kidney Disease (CKD) guidelines in real-world clinical settings and renal outcomes remains a critical gap in knowledge. A comprehensive analysis was conducted using data from a national, multicenter CKD registry. This study included 4,455 patients with an estimated glomerular filtration rate (eGFR) measurement on the index date and eight additional metrics recorded within six months. These metrics comprised serum electrolyte levels, low-density lipoprotein cholesterol, hemoglobin, and the use of renin-angiotensin system inhibitors. The primary outcome was a composite of renal events, defined by a decline in eGFR to < 15 mL/min/1.73 m2 or a reduction of ≥ 30% in eGFR, confirmed by follow-up tests. Over a median follow-up of 513 days, 838 renal events were observed. High serum potassium levels (> 5.4 mmol/L) were associated with increased event rates compared to lower levels. Similarly, low serum sodium-chloride levels (< 33) correlated with higher event rates. Usage of renin-angiotensin system inhibitors, low serum calcium (< 8.4 mg/dL), and high uric acid levels (> 7.0 mg/dL) were also linked to increased events. Conversely, higher hemoglobin levels (≥ 13 g/dL) were associated with lower event rates. Compliance to guidelines, categorized into quartiles based on the number of met metrics, revealed a significantly reduced risk of events in the highest compliance group (meeting 8 metrics) compared to the lowest (0-5 metrics). Compliance to CKD guidelines in clinical practice is significantly associated with improved renal outcomes, emphasizing the need for guideline-concordant care in the management of CKD.

[ChatGPT and the German board examination for ophthalmology: an evaluation]. / ChatGPT und die deutsche Facharztprüfung für Augenheilkunde: eine Evaluierung.

PURPOSE: In recent years artificial intelligence (AI), as a new segment of computer science, has also become increasingly more important in medicine. The aim of this project was to investigate whether the current version of ChatGPT (ChatGPT 4.0) is able to answer open questions that could be asked in the context of a German board examination in ophthalmology. METHODS: After excluding image-based questions, 10 questions from 15 different chapters/topics were selected from the textbook 1000 questions in ophthalmology (1000 Fragen Augenheilkunde 2nd edition, 2014). ChatGPT was instructed by means of a so-called prompt to assume the role of a board certified ophthalmologist and to concentrate on the essentials when answering. A human expert with considerable expertise in the respective topic, evaluated the answers regarding their correctness, relevance and internal coherence. Additionally, the overall performance was rated by school grades and assessed whether the answers would have been sufficient to pass the ophthalmology board examination. RESULTS: The ChatGPT would have passed the board examination in 12 out of 15 topics. The overall performance, however, was limited with only 53.3% completely correct answers. While the correctness of the results in the different topics was highly variable (uveitis and lens/cataract 100%; optics and refraction 20%), the answers always had a high thematic fit (70%) and internal coherence (71%). CONCLUSION: The fact that ChatGPT 4.0 would have passed the specialist examination in 12 out of 15 topics is remarkable considering the fact that this AI was not specifically trained for medical questions; however, there is a considerable performance variability between the topics, with some serious shortcomings that currently rule out its safe use in clinical practice.

Question banks: credit? Or debit? A qualitative exploration of their use among medical students.

BACKGROUND: Online question banks are the most widely used education resource amongst medical students. Despite this there is an absence of literature outlining how and why they are used by students. Drawing on Deci and Ryan's self-determination theory, our study aimed to explore why and how early-stage medical students use question banks in their learning and revision strategies. METHODS: The study was conducted at Newcastle University Medical School (United Kingdom and Malaysia). Purposive, convenience and snowball sampling of year two students were employed. Ten interviews were conducted. Thematic analysis was undertaken iteratively, enabling exploration of nascent themes. Data collection ceased when no new perspectives were identified. RESULTS: Students' motivation to use question banks was predominantly driven by extrinsic motivators, with high-stakes exams and fear of failure being central. Their convenience and perceived efficiency promoted autonomy and thus motivation. Rapid feedback cycles and design features consistent with gamification were deterrents to intrinsic motivation. Potentially detrimental patterns of question bank use were evident: cueing, avoidance and memorising. Scepticism regarding veracity of question bank content was absent. CONCLUSIONS: We call on educators to provide students with guidance about potential pitfalls associated with question banks and to reflect on potential inequity of access to these resources.

The Crosswise Model for Surveys on Sensitive Topics: A General Framework for Item Selection and Statistical Analysis.

When surveys contain direct questions about sensitive topics, participants may not provide their true answers. Indirect question techniques incentivize truthful answers by concealing participants' responses in various ways. The Crosswise Model aims to do this by pairing a sensitive target item with a non-sensitive baseline item, and only asking participants to indicate whether their responses to the two items are the same or different. Selection of the baseline item is crucial to guarantee participants' perceived and actual privacy and to enable reliable estimates of the sensitive trait. This research makes the following contributions. First, it describes an integrated methodology to select the baseline item, based on conceptual and statistical considerations. The resulting methodology distinguishes four statistical models. Second, it proposes novel Bayesian estimation methods to implement these models. Third, it shows that the new models introduced here improve efficiency over common applications of the Crosswise Model and may relax the required statistical assumptions. These three contributions facilitate applying the methodology in a variety of settings. An empirical application on attitudes toward LGBT issues shows the potential of the Crosswise Model. An interactive app, Python and MATLAB codes support broader adoption of the model.

Information-seeking behaviour of primary care clinicians in Singapore at the point-of-care: A qualitative study.

BACKGROUND: Clinicians' information-seeking behaviours impact patient care quality. Earlier studies indicated that barriers to accessing information deter clinicians from seeking answers to clinical questions. OBJECTIVES: To explore primary care clinicians' information-seeking behaviour at point-of-care, focusing on when and how they seek answers to clinical questions. METHODS: Semi-structured interviews were conducted with 45 clinicians after clinical sessions to investigate their information-seeking habits. Follow-up interviews were conducted after a week for those intending to address unanswered queries. RESULTS: Two thirds of clinicians encountered questions during care, with nearly three quarters resolving them during the session. Colleagues, guidelines and online platforms were common information sources, with smartphones being used to access Google, WhatsApp or UpToDate®. Facilitators included reliable sources and the drive to confirm knowledge, while barriers included ineffective search methods and high workload. Despite challenges, most clinicians expressed satisfaction with their information-seeking process. DISCUSSION: The findings underscore the increasing use of smartphones for accessing clinical information among Singaporean primary care clinicians and suggest the need for tailored training programmes and guidelines to optimise information-seeking practices. CONCLUSION: Insights from this study can inform the development of training programmes and guidelines aimed at improving information-seeking practices among primary care clinicians, potentially enhancing patient care quality.