Performance of generative pre-trained transformers (GPTs) in Certification Examination of the College of Family Physicians of Canada.

INTRODUCTION: The application of large language models such as generative pre-trained transformers (GPTs) has been promising in medical education, and its performance has been tested for different medical exams. This study aims to assess the performance of GPTs in responding to a set of sample questions of short-answer management problems (SAMPs) from the certification exam of the College of Family Physicians of Canada (CFPC). METHOD: Between August 8th and 25th, 2023, we used GPT-3.5 and GPT-4 in five rounds to answer a sample of 77 SAMPs questions from the CFPC website. Two independent certified family physician reviewers scored AI-generated responses twice: first, according to the CFPC answer key (ie, CFPC score), and second, based on their knowledge and other references (ie, Reviews' score). An ordinal logistic generalised estimating equations (GEE) model was applied to analyse repeated measures across the five rounds. RESULT: According to the CFPC answer key, 607 (73.6%) lines of answers by GPT-3.5 and 691 (81%) by GPT-4 were deemed accurate. Reviewer's scoring suggested that about 84% of the lines of answers provided by GPT-3.5 and 93% of GPT-4 were correct. The GEE analysis confirmed that over five rounds, the likelihood of achieving a higher CFPC Score Percentage for GPT-4 was 2.31 times more than GPT-3.5 (OR: 2.31; 95% CI: 1.53 to 3.47; p<0.001). Similarly, the Reviewers' Score percentage for responses provided by GPT-4 over 5 rounds were 2.23 times more likely to exceed those of GPT-3.5 (OR: 2.23; 95% CI: 1.22 to 4.06; p=0.009). Running the GPTs after a one week interval, regeneration of the prompt or using or not using the prompt did not significantly change the CFPC score percentage. CONCLUSION: In our study, we used GPT-3.5 and GPT-4 to answer complex, open-ended sample questions of the CFPC exam and showed that more than 70% of the answers were accurate, and GPT-4 outperformed GPT-3.5 in responding to the questions. Large language models such as GPTs seem promising for assisting candidates of the CFPC exam by providing potential answers. However, their use for family medicine education and exam preparation needs further studies.

Medical interns' training in family medicine at a district hospital and primary health care clinics in Middelburg, Mpumalanga.

Training of medical interns at the Middelburg district hospital has been introduced as part of the mandatory 6 months' rotation in Family Medicine department since 2021. This report provides an overview of what has been attained in 2021 and 2022. It covers various aspects of the activities medical interns have been exposed to in the Middelburg hospital and the surrounding primary health care clinics.Contribution: Sharing experiences of family medicine training for medical interns in district hospitals is essential because the 6 months' rotation is new for most family physician trainers, especially those in small hospitals and primary health care clinics. Taking into account the paucity of evidence on the topic, the report brings current information that supports that training medical interns in district hospitals and primary health care clinics prepares them to be comfortable and competent clinicians for the generalist work during the community service year ahead.

A Virtual Communication Workshop to Increase Confidence Using Telehealth Modalities.

INTRODUCTION: COVID-19 ended in-person communication training workshops at our institution, so we sought to provide a way for family medicine residents to hone their telephone and audio-visual skills online. METHODS: We developed a 2-hour online workshop where residents practiced delivering serious news to family members via telephone or videoconferencing call and measured participant confidence via pre-, post-, and 6-month surveys. RESULTS: Participant confidence in delivering serious news via telephone and videoconferencing increased. Sustained confidence at 6-month follow-up was not confirmed. DISCUSSION/CONCLUSIONS: Offering an online opportunity to practice delivering serious news by telephone or videoconferencing call appears to be a successful way to bolster confidence. Participants found using realistic scenarios and discussion of best practices most helpful.

Strengthening healthcare through family medicine training in The Gambia: The journey so far.

According to the World Health Organizations (WHO) family medicine forms the bedrock upon for accessible, affordable and equitable healthcare for any country. The need for family doctors is more acute for low income countries like The Gambia. More so that The Gambian health infrastructure is suboptimal and appropriate health personnel is low. This is worsened by brain drain leading to poor health indices. Despite these challenges and more, the department of Family Medicine was accredited for training in the Gambia with improved infrastructure (at the training centre), with 7 residents. Though there are still challenges there are also opportunities and strengths. There is therefore hope that the right personnel will be produced for an improved Gambian health system.

Improving healthcare delivery at a district hospital through teaching interns - A short report.

Every district in Malawi has at least two doctors managing the social and healthcare needs of the local population. The medical doctors at the district are involved in administrative work and have minimal time for clinical practice. As such in most district hospitals, clinical officers (COs) form the backbone of patient care provision. These are cadres that have a 3-year training in clinical medicine; they work side by side with medical assistants (MAs) and nurses. Apart from the Ministry of Health (MoH) workforce, the Department of Family Medicine (FM) of Kamuzu University of Health Sciences (KUHeS) has its main district site at Mangochi. Family physicians and residents from FM department assist in provision of mentorship and teaching to other cadres. Work-based learning requires various strategies and approaches. The experience reported here involves deliberate mentorship and support to enhance the learning of other cadres. Family medicine residents learn through the active participation in these sessions to become future consultants and leaders in primary health care.

Don't wait for the perfect moment: The national training program in family medicine in Angola.

Like many Sub-Saharan countries, Angola struggles with a shortage of trained health professionals, especially for primary care. In 2021, the Angolan Ministry of Health in collaboration with the Angolan Medical Council launched the National Program for the Expansion of Family Medicine as a long-term strategy for the provision, fixation and training of family physicians in community health centres. Of the 425 residents 411 (96.7%) who entered the programme in 2021 will get their diplomas in the following months and will be certified as family physicians. Three main aspects make this National Programme unique in the Angolan context: (1) the common effort and engagement of the Ministry of Health with the Angolan Medical Council and local health authorities in designing and implementing this programme; (2) decentralisation of the training sites, with residents in all 18 provinces, including in rural areas and (3) using community health centres as the main site of practice and training. Despite this undeniable success, many educational improvements must be made, such as expanding the use of new educational resources, methodologies and assessment tools, so that aspects related to knowledge, practical skills and professional attitudes can be better assessed. Moreover, the programme must invest in faculty development courses aiming to create the next generation of preceptors, so that all residents can have in every rotation one preceptor or tutor responsible for the supervision of their clinical activities, case discussions and sharing their clinical duties, both at community health centres and municipal hospitals.

Cultivating leaders for primary health care: A revised approach for transformative development.

Family physicians require leadership skills to strengthen team-based primary care services. Interviews with South African district managers confirmed the need to develop leadership skills in family physicians. The updated national programmatic learning outcomes for South African family physician training were published in 2021. They sparked the need for curriculum renewal at the University of Cape Town's Division of Family Medicine. A review of the leadership and governance module during registrar training showed that the sessions were perceived to be content heavy with insufficient opportunities for reflection. Following a series of stakeholder engagements, the module convenors co-designed a revised module that was blueprinted on the updated learning outcomes. The module incorporates a group coaching style, facilitating learning through reflection on one's experiences. The revised module was implemented in 2022. It aims to provide a transformative learning experience centred on students' perceptions of themselves as leaders, as well as professional identity formation and resilience building. This short report describes preliminary insights from the revised module's developmental phase and forms part of an ongoing iterative evaluation process.Contribution: Family physicians should lead across all their defined roles. Formal and informal learning opportunities are needed to facilitate their growth as leaders and help them to meet the health needs of communities served by an evolving health care system. This short report describes an example of a revised postgraduate module on leadership and governance, which may be of value to clinician educators and academic departments exploring innovative methods for the African region.

Longitudinal integrated clerkships from start to finish: A medical curriculum innovation.

Stellenbosch University embarked on a renewal of its MBChB programme guided by an updated set of core values developed by the multidisciplinary curriculum task team. These values acknowledged the important role of (among others) context and generalism in the development of our graduates as doctors of the future for South Africa. This report describes the overall direction of the renewed curriculum focusing on two of the innovative educational methods for Family Medicine and Primary Health Care training that enabled us to respond to these considerations. These innovations provide students with both early longitudinal clinical experience (now approximately 72 h per year for each of the first 3 years) and a final longitudinal capstone experience (36 weeks) outside the central tertiary teaching hospital. While the final year experience will run for the first time in 2027 (the first year launched in 2022), the initial experience has got off to a good start with students expressing the value that it brings to their integrated, holistic learning and their identity formation aligned with the mission statement of this renewed curriculum. These two curricular innovations were designed on sound educational principles, utilising contextually appropriate research and by aligning with the goals of the healthcare system in which our students would be trained. The first has created opportunities for students to develop a professional identity that is informed by a substantial and longitudinal primary healthcare experience.Contribution: The intention is to consolidate this in their final district-based experience under the supervision of specialist family physicians and generalist doctors.

Registrars' experience with research in family medicine training programmes in South Africa.

BACKGROUND:  Completion of a research assignment is a requirement for specialist training in South Africa. Difficulty with completion delays graduation and the supply of family physicians. The aim of this study was to explore the experience of registrars with their research in postgraduate family medicine training programmes. METHODS:  An explorative descriptive qualitative study. Extreme case purposive sampling selected registrars who had and had not completed their research on time, from all nine training programmes. Saturation was achieved after 12 semi-structured interviews. The framework method was used for data analysis, assisted by ATLAS.ti software. RESULTS:  The assumption of prior learning by teachers and supervisors contributed to a sense of being overwhelmed and stressed. Teaching modules should be more standardised and focussed on the practical tasks and skills, rather than didactic theory. Lengthy provincial and ethics processes, and lack of institutional support, such as scholarly services and financial support, caused delays. The expertise of the supervisor was important, and the registrar-supervisor relationship should be constructive, collaborative and responsive. The individual research experience was dependent on choosing a feasible project and having dedicated time. The balancing of personal, professional and academic responsibilities was challenging. CONCLUSION:  Training programmes should revise the teaching of research and improve institutional processes. Supervisors need to become more responsive, with adequate expertise. Provincial support is needed for streamlined approval and dedicated research time.Contribution: The study highlights ways in which teaching, and completion of research can be improved, to increase the supply of family physicians to the country.

Evidence of learning in workplace-based assessments in a Family Medicine Training Programme.

BACKGROUND:  Learning portfolios (LPs) provide evidence of workplace-based assessments (WPBAs) in clinical settings. The educational impact of LPs has been explored in high-income countries, but the use of portfolios and the types of assessments used for and of learning have not been adequately researched in sub-Saharan Africa. This study investigated the evidence of learning in registrars' LPs and the influence of the training district and year of training on assessments. METHODS:  A cross-sectional study evaluated 18 Family Medicine registrars' portfolios from study years 1-3 across five decentralised training sites affiliated with the University of the Witwatersrand. Descriptive statistics were calculated for the portfolio and quarterly assessment (QA) scores and self-reported clinical skills competence levels. The competence levels obtained from the portfolios and university records served as proxy measures for registrars' knowledge and skills. RESULTS:  The total LP median scores ranged from 59.9 to 81.0, and QAs median scores from 61.4 to 67.3 across training years. The total LP median scores ranged from 62.1 to 83.5 and 62.0 to 67.5, respectively in QAs across training districts. Registrars' competence levels across skill sets did not meet the required standards. Higher skills competence levels were reported in the women's health, child health, emergency care, clinical administration and teaching and learning domains. CONCLUSION:  The training district and training year influence workplace-based assessment (WPBA) effectiveness. Ongoing faculty development and registrar support are essential for WPBA.Contribution: This study contributes to the ongoing discussion of how to utilise WPBA in resource-constrained sub-Saharan settings.

Results of the study of the attitude of women of reproductive age to the integrated gynecological care provision by family physicians.

OBJECTIVE: Aim: To study and analyze the attitude of women of reproductive age to the integrated gynecological care provision by family physicians, their readiness to receive some gynecological services from family physicians, as well as to analyze the level of women's support and readiness for the integrated provision of gynecological care depending on age and level of education. PATIENTS AND METHODS: Materials and Methods: For the survey, anonymous questionnaires containing questions on the attitude of women of reproductive age to the integrated provision of certain types of gynecological care by family physicians were developed. 181 women from the Kyiv region took part in the survey. RESULTS: Results: Support of more than 80% of respondents regarding the integrated gynecological care provision by family physicians received the following questions: counseling on the prevention of sexually transmitted infections and human immunodeficiency virus/acquired immunodeficiency syndrome (HIV/AIDS) (92,3%); counseling on family planning and prevention of unwanted pregnancy (83,4%); counseling on the use of various methods of contraception (82,3%); examination and palpation of mammary glands (80,1%); referral of women to a higher level of obstetric and gynecological care (if necessary (86,2%). CONCLUSION: Conclusions: The majority of respondents (67,4%) are ready or better ready than not ready to receive certain types of gynecological care services from family physicians. Almost the same percentage ratio (more than 60%) of women of each age group and all levels of education are ready or better ready than not ready to receive gynecological care services, which they supported, from family physicians.

Machine Learning to Identify Clusters in Family Medicine Diplomate Motivations and Their Relationship to Continuing Certification Exam Outcomes: Findings and Potential Future Implications.

BACKGROUND: The potential for machine learning (ML) to enhance the efficiency of medical specialty boards has not been explored. We applied unsupervised ML to identify archetypes among American Board of Family Medicine (ABFM) Diplomates regarding their practice characteristics and motivations for participating in continuing certification, then examined associations between motivation patterns and key recertification outcomes. METHODS: Diplomates responding to the 2017 to 2021 ABFM Family Medicine continuing certification examination surveys selected motivations for choosing to continue certification. We used Chi-squared tests to examine difference proportions of Diplomates failing their first recertification examination attempt who endorsed different motivations for maintaining certification. Unsupervised ML techniques were applied to generate clusters of physicians with similar practice characteristics and motivations for recertifying. Controlling for physician demographic variables, we used logistic regression to examine the effect of motivation clusters on recertification examination success and validated the ML clusters by comparison with a previously created classification schema developed by experts. RESULTS: ML clusters largely recapitulated the intrinsic/extrinsic framework devised by experts previously. However, the identified clusters achieved a more equal partitioning of Diplomates into homogenous groups. In both ML and human clusters, physicians with mainly extrinsic or mixed motivations had lower rates of examination failure than those who were intrinsically motivated. DISCUSSION: This study demonstrates the feasibility of using ML to supplement and enhance human interpretation of board certification data. We discuss implications of this demonstration study for the interaction between specialty boards and physician Diplomates.

The Scope of Multimorbidity in Family Medicine: Identifying Age Patterns Across the Lifespan.

INTRODUCTION: Multimorbidity rates are both increasing in prevalence across age ranges, and also increasing in diagnostic importance within and outside the family medicine clinic. Here we aim to describe the course of multimorbidity across the lifespan. METHODS: This was a retrospective cohort study across 211,953 patients from a large northeastern health care system. Past medical histories were collected in the form of ICD-10 diagnostic codes. Rates of multimorbidity were calculated from comorbid diagnoses defined from the ICD10 codes identified in the past medical histories. RESULTS: We identify 4 main age groups of diagnosis and multimorbidity. Ages 0 to 10 contain diagnoses which are infectious or respiratory, whereas ages 10 to 40 are related to mental health. From ages 40 to 70 there is an emergence of alcohol use disorders and cardiometabolic disorders. And ages 70 to 90 are predominantly long-term sequelae of the most common cardiometabolic disorders. The mortality of the whole population over the study period was 5.7%, whereas the multimorbidity with the highest mortality across the study period was Circulatory Disorders-Circulatory Disorders at 23.1%. CONCLUSION: The results from this study provide a comparison for the presence of multimorbidity within age cohorts longitudinally across the population. These patterns of comorbidity can assist in the allocation to practice resources that will best support the common conditions that patients need assistance with, especially as the patients transition between pediatric, adult, and geriatric care. Future work examining and comparing multimorbidity indices is warranted.

Research to Improve Clinical Care in Family Medicine: Big Data, Telehealth, Artificial Intelligence, and More.

This issue highlights changes in medical care delivery since the start of the COVID-19 pandemic and features research to advance the delivery of primary care. Several articles report on the effectiveness of telehealth, including its use for hospital follow-up, medication abortion, management of diabetes, and as a potential tool for reducing health disparities. Other articles detail innovations in clinical practice, from the use of artificial intelligence and machine learning to a validated simple risk score that can support outpatient triage decisions for patients with COVID-19. Notably one article reports the impact of a voluntary program using scribes in a large health system on physician documentation behaviors and performance. One article addresses the wage gap between early-career female and male family physicians. Several articles report on inappropriate testing for common health problems; are you following recommendations for ordering Pulmonary Function Tests, mt-sDNA for colon cancer screening, and HIV testing?

The Gender Wage Gap Among Early-Career Family Physicians.

PURPOSE: Numerous studies have documented salary differences between male and female physicians. For many specialties, this wage gap has been explored by controlling for measurable factors that influence pay such as productivity, work-life balance, and practice patterns. In family medicine where practice activities differ widely between physicians, it is important to understand what measurable factors may be contributing to the gender wage gap, so that employers and policymakers and can address unjust disparities. METHODS: We used data from the 2017 to 2020 American Board of Family Medicine (ABFM) National Graduate Survey (NGS) which is administered to family physicians 3 years after residency (n = 8608; response rate = 63.9%, 56.2% female). The survey collects clinical income and practice patterns. Multiple linear regression analysis was performed, which included variables on hours worked, degree type, principal professional activity, rural/urban, and region. RESULTS: Although early-career family physician incomes averaged $225,278, female respondents reported incomes that were $43,566 (17%) lower than those of male respondents (P = .001). Generally, female respondents tended toward lower-earning principal professional activities and US regions; worked fewer hours (2.9 per week); and tended to work more frequently in urban settings. However, in adjusted models, this gap in income only fell to $31,804 (13% lower than male respondents, P = .001). CONCLUSION: Even after controlling for measurable factors such as hours worked, degree type, principal professional activity, population density, and region, a significant wage gap persists. Interventions should be taken to eliminate gender bias in wage determinations for family physicians.

Family Medicine Clinician Screening and Barriers to Communication on Food Insecurity: A CERA General Membership Survey.

PURPOSE: Food insecurity (FI) is a hidden epidemic associated with worsening health outcomes affecting 33.8 million people in the US in 2021. Although studies demonstrate the importance of health care clinician assessment of a patient's food insecurity, little is known about whether Family Medicine clinicians (FMC) discuss FI with patients and what barriers influence their ability to communicate about FI. This study evaluated FM clinicians' food insecurity screening practices to evaluate screening disparities and identify barriers that influence the decision to communicate about FI. METHODS: Data were gathered and analyzed as part of the 2022 Council of Academic Family Medicine's Educational Research Alliance survey of Family Medicine general membership. RESULTS: The majority of respondents reported (66.9%) that their practice has a screening system for food insecurity, and most practices used a verbal screen with staff other than the clinician (41%) at specific visits (63.8%). Clinicians reported "rarely or never asking about FI" 40% of the time and only asking "always or frequently" 6.7% of the time. Inadequate time during appointments (44.5%) and other medical issues taking priority (29.4%) were identified as the most common barriers. The lack of resources available in the community was a significant barrier for clinicians who worked in rural areas. CONCLUSIONS: This survey provides insight into food insecurity screening disparities and identifies obstacles to FMC screening, such as time constraints, lack of resources, and knowledge of available resources. Understanding current communication practices could create opportunities for interventions to identify food insecurity and impact "Food as Medicine."

Data Disaggregation of Asian-American Family Physicians.

The singular label of "Asian" obscures socioeconomic differences between Asian ethnic groups that affect matriculation into the field of medicine. Using data from American Board of Family Medicine Examination candidates in 2023, we found that compared to the US population, among Asian-American family physicians, Indians were present at higher rates, while Chinese and Filipinos were underrepresented, suggesting the importance of continued disaggregation of Asian ethnicities in medicine.

Perception of the compatibility of Quebec residency program characteristics with the advanced access model: a cross-sectional study.

BACKGROUND: The advanced access (AA) model is among the most recommended innovations for improving timely access in primary care (PC). AA is based on core pillars such as comprehensive planning for care needs and supply, regularly adjusting supply to demand, optimizing appointment systems, and interprofessional collaborative practices. Exposure of family medicine residents to AA within university-affiliated family medicine groups (U-FMGs) is a promising strategy to widen its dissemination and improve access. Using four AA pillars as a conceptual model, this study aimed to determine the theoretical compatibility of Quebec's university-affiliated clinics' residency programs with the key principles of AA. METHODS: A cross-sectional online survey was sent to the chief resident and academic director at each participating clinic. An overall response rate of 96% (44/46 U-FMGs) was obtained. RESULTS: No local residency program was deemed compatible with all four considered pillars. On planning for needs and supply, only one quarter of the programs were compatible with the principles of AA, owing to residents in out-of-clinic rotations often being unavailable for extended periods. On regularly adjusting supply to demand, 54% of the programs were compatible. Most (82%) programs' appointment systems were not very compatible with the AA principles, mostly because the proportion of the schedule reserved for urgent appointments was insufficient. Interprofessional collaboration opportunities in the first year of residency allowed 60% of the programs to be compatible with this pillar. CONCLUSIONS: Our study highlights the heterogeneity among local residency programs with respect to their theoretical compatibility with the key principles of AA. Future research to empirically test the hypotheses raised by this study is warranted.