Exploring the Performance of ChatGPT Versions 3.5, 4, and 4 With Vision in the Chilean Medical Licensing Examination: Observational Study.

Background: The deployment of OpenAI's ChatGPT-3.5 and its subsequent versions, ChatGPT-4 and ChatGPT-4 With Vision (4V; also known as "GPT-4 Turbo With Vision"), has notably influenced the medical field. Having demonstrated remarkable performance in medical examinations globally, these models show potential for educational applications. However, their effectiveness in non-English contexts, particularly in Chile's medical licensing examinations-a critical step for medical practitioners in Chile-is less explored. This gap highlights the need to evaluate ChatGPT's adaptability to diverse linguistic and cultural contexts. Objective: This study aims to evaluate the performance of ChatGPT versions 3.5, 4, and 4V in the EUNACOM (Examen Único Nacional de Conocimientos de Medicina), a major medical examination in Chile. Methods: Three official practice drills (540 questions) from the University of Chile, mirroring the EUNACOM's structure and difficulty, were used to test ChatGPT versions 3.5, 4, and 4V. The 3 ChatGPT versions were provided 3 attempts for each drill. Responses to questions during each attempt were systematically categorized and analyzed to assess their accuracy rate. Results: All versions of ChatGPT passed the EUNACOM drills. Specifically, versions 4 and 4V outperformed version 3.5, achieving average accuracy rates of 79.32% and 78.83%, respectively, compared to 57.53% for version 3.5 (P<.001). Version 4V, however, did not outperform version 4 (P=.73), despite the additional visual capabilities. We also evaluated ChatGPT's performance in different medical areas of the EUNACOM and found that versions 4 and 4V consistently outperformed version 3.5. Across the different medical areas, version 3.5 displayed the highest accuracy in psychiatry (69.84%), while versions 4 and 4V achieved the highest accuracy in surgery (90.00% and 86.11%, respectively). Versions 3.5 and 4 had the lowest performance in internal medicine (52.74% and 75.62%, respectively), while version 4V had the lowest performance in public health (74.07%). Conclusions: This study reveals ChatGPT's ability to pass the EUNACOM, with distinct proficiencies across versions 3.5, 4, and 4V. Notably, advancements in artificial intelligence (AI) have not significantly led to enhancements in performance on image-based questions. The variations in proficiency across medical fields suggest the need for more nuanced AI training. Additionally, the study underscores the importance of exploring innovative approaches to using AI to augment human cognition and enhance the learning process. Such advancements have the potential to significantly influence medical education, fostering not only knowledge acquisition but also the development of critical thinking and problem-solving skills among health care professionals.

¿Cuáles son las medidas de aislamiento implementadas a nivel internacional tras el término de la emergencia de salud pública de importancia internacional por COVID-19?: síntesis rápida de evidencia: experiencias internacionales / What are the isolation measures implemented at the international level, after the end of the public health emergency of international concern by COVID-19?: rapid evidence synthesis: international experiences

ANTECEDENTES Y OBJETIVO Tras 3 años de pandemia, la OMS ha declarado que el COVID-19 no constituye una Emergencia de Salud Pública de Importancia Internacional. En Chile, la Comisión Nacional de Respuesta Pandémica del Ministerio de Salud se ha propuesto reevaluar las medidas de aislamiento y las licencias laborales de casos positivos por COVID-19, para lo cual ha solicitado la presente Síntesis Rápida de Evidencia. METODOLOGÍA Para analizar las indicaciones internacionales de aislamiento de casos positivos de COVID-19 y la correspondiente licencia médica, se definieron las siguientes preguntas orientadoras: ¿Cuántos días de aislamiento se recomiendan para casos positivos de COVID-19?; ¿El aislamiento es obligatorio para los casos positivos de COVID-19?; ¿Cuáles son las indicaciones de cuidado de los casos positivos de COVID-19?; y ¿Cuáles son los criterios para entregar licencia médica a trabajadores que resulten positivos de COVID-19?. Selección de países de interés. Para definir los países de interés, se utilizó el Ranking de Resiliencia de COVID, el cual los jerarquiza en función de su desempeño y logros durante la pandemia. Este ranking se basa en 11 indicadores. Los países seleccionados fueron: Irlanda; Noruega; Arabia Saudita; Dinamarca; Países Bajos; Australia; Suiza; Colombia; Singapur; Bélgica; Israel; y Alemania. Se buscó información exclusivamente en las páginas web oficiales y en documentos elaborados por instituciones gubernamentales. RESULTADO - De los 12 países revisados, 10 no establecen el aislamiento como obligatorio para los casos positivos de COVID-19. - Colombia y Arabia Saudita mantienen indicaciones de aislamiento obligatorio a mayo del 2023, estableciendo periodos de 7 y de 7 a 21 días, respectivamente. - Ocho de los países actualizaron sus indicaciones de aislamiento durante el primer semestre del año 2023.

¿Cuál es el periodo de infección de la variante ómicron del SARS-CoV-2?: síntesis rápida de evidencia / What is the infection period of the omicron variant of SARS-Cov-2?: rapid evidence synthesis

ANTECEDENTES Y OBJETIVO Tras 3 años de pandemia, la OMS ha declarado que el COVID-19 no constituye una Emergencia de Salud Pública de Importancia Internacional. En Chile, la Comisión Nacional de Respuesta Pandémica del Ministerio de Salud se ha propuesto reevaluar las medidas de aislamiento y las licencias laborales de casos positivos por COVID-19, para lo cual ha solicitado la presente Síntesis Rápida de Evidencia. METODOLOGÍA Se realizó una estrategia de búsqueda amplia en EMBASE y MEDLINE, a través de OVID, y una búsqueda específica en GOOGLE, sin filtrar por estudios primarios o secundarios. Se identificaron 2.128 referencias, de las cuales se incluyeron 3 estudios tras eliminar los duplicados y aplicar los criterios de inclusión y exclusión. Se utiliza la metodología de la certeza de evidencia GRADE. RESULTADOS Se describen normativas de 12 países - La variante ómicron tiene un periodo medio de contagio de 3,6 días, IC 95%: 3,5 a 6,6 días (certeza de la evidencia alta). - El 81% de los contagios ocurren antes del 5to día desde el inicio de síntomas (certeza de la evidencia alta). - No se identificó evidencia respecto al impacto del aislamiento obligatorio en la morbi-mortalidad asociada al COVID-19, en los estudios incluidos.

Current Views on the New United States Medical Licensing Examination Step 1 Pass/Fail Format: A Review of the Literature.

INTRODUCTION: Residency programs have historically used numerical Step 1 scores to screen applicants, making it a career-defining, high-stakes examination. Step 1 scores will be reported as pass/fail starting in January 2022, fundamentally reshaping the residency application review process. This review aimed to identify opinions of physicians and medical students about the new format, identify arguments in support of or against the change, and determine the implications of this change on the residency selection process. METHODS: A comprehensive PubMed review was performed in May 2021 to identify articles that discussed the new Step 1 format. Non-English and duplicate articles were excluded. Data collected from each article included publication year, specialty, subjects, and key findings. RESULTS: A total of 81 articles were included, 26 of which discussed the impact of the new format within surgical fields (32.1%). Remaining articles discussed the implications within the medical community as a whole (n = 33, 40.7%) and nonsurgical fields (n = 22, 27.2%). Studies suggest Program Directors will rely on Step 2 Clinical Knowledge (CK) scores, medical school reputation, applicant familiarity, Dean's letters, recommendation letters, and research in lieu of numerical Step 1 scores. In addition, concerns have been raised that the new format will disadvantage international, osteopathic, and minority applicants while increasing stress surrounding Step 2 CK. CONCLUSIONS: Within the medical community, there are concerns that Step 2 CK will be used to substitute Step 1 and that resident diversity will diminish due to the new Step 1 format. Holistic candidate consideration will be increasingly important.

A comparative study of the traditional medicine systems of South Korea and Taiwan: Focus on administration, education and license.

BACKGROUND: Traditional medicine (TM) is widely used in South Korea and Taiwan, and both societies have similar systems for the management of TM. This study aimed to compare the TM systems in South Korea and Taiwan. METHODS: We searched for studies on the TM systems and collected statistical data from the websites of relevant government agencies in both countries. Interviews were conducted with experts on TM and officials from government agencies. The two TM systems were described and examined in terms of policies, resources, utilization, licensing, and educational systems. RESULTS: Both South Korea and Taiwan have a dual system that separates the administration, licensing and educational systems between TM and Western Medicine (WM), and the TM systems are well established and highly standardized. Comparing with South Korea, however, Taiwan has a more flexible dual medical system in which education courses for producing dual licensure are provided. Additionally, in the system in Taiwan, dual license holders can use both TM and WM methods without limitations and WM doctors can apply acupuncture under some circumstances. Because of the strict dual medical system in South Korea, TM and WM conflict with each other on most health issues. CONCLUSION: Both South Korea and Taiwan have the advantages of preserving TM, as TM and WM are systemically independent and together provide a more holistic approach. The institutionalization of TM in South Korea and Taiwan may be a good reference for countries considering modernization of their TM.

Implications of the United States Medical Licensing Examination Step 1 Examination Transition to Pass/Fail on Medical Students Education and Future Career Opportunities.

BACKGROUND: United States Medical Licensing Examination (USMLE) Step 1 will transition to pass/fail score by 2022. We aim to investigate US medical students' perspectives on the potential implications this transition would have on their education and career opportunities. METHODS: A cross-sectional study investigating US medical students' perspectives on the implications of transition of the USMLE Step 1 exam to pass/fail. Students were asked their preferences regarding various aspects of the USMLE Step 1 examination, including activities, educational opportunities, expenses regarding preparation for the examination, and future career opportunities. RESULTS: 215 medical students responded to the survey, 59.1% were women, 80.9% were allopathic vs. 19.1% osteopathic students. 34.0% preferred the USMLE Step 1 to be graded on a pass/fail score, whereas 53.5% preferred a numeric scale. Osteopathic vs. allopathic students were more likely to report that the pass/fail transition will negatively impact their residency match (aOR = 1.454, 95% CI: 0.515, 4.106) and specialty of choice (aOR = 3.187, 95% CI: 0.980, 10.359). 57.7% of respondents reported that the transition to a pass/fail grading system will change their study habits. CONCLUSIONS: The transition of the USMLE Step 1 to a pass/fail system has massive implications on medical students and residency programs alike. Though the majority of medical students did not prefer the USMLE Step 1 to have a pass/fail score, they must adapt their strategies to remain competitive for residency applications. Residency programs should create a composite score based off all aspects of medical students' applications in order to create a holistic and fair evaluation and ranking system.

Introduction of basic medicine examination in Korean Medical License Examination to improve physician's science competency

Physicians play a central role in the fields of medical service, research, and industry, so it is imperative to produce well-qualified doctors. Medicine is composed of science and arts, both necessary for its practice, and thus, the education outcomes in basic medical education in a medical school include basic biomedical sciences, social sciences and clinical sciences. Adequate science competencies create a deeper and better understanding of scientific knowledge, concepts, and methods fundamental to clinical science, and contribute to the scientific, technological, and clinical developments. The science competencies are primarily obtained by studying basic medicine in basic medical education, which has been criticized for failing to do so sufficiently in Korea. The failure is attributed to insufficient education time, teachers, and budgets, but the most critical factor is the lack of awareness regarding the importance of the science competencies of the physicians. Such ignorance also affects the Korean Medical Licensing Examination (KMLE). The KMLE tests competency in clinical sciences, preventive medicine, and medical laws, but not in basic biomedical sciences, which might result in insufficient science competency of the physicians and a decrease in the overall quality of the medical health service. Tests must be urgently introduced in KMLE on the competencies of basic biomedical sciences to improve the science competency of the physicians. The representative organizations of the medical society should take vigorous actions for the introduction of the basic medicine examination in KMLE.

[Medical Safety Systems in Washington State in the United States of America].

The safety system for medicine in Washington State in the United States of America (USA) consists of three systems, namely, hospital-based risk management, county-based death investigation, and state-based quality assurance for the license system. Risk managers in hospitals, medical examiners in counties and medical quality assurance commission in the state government represent those three systems. It has been revealed that each of the three organizational systems functions independently within their own jurisdiction without knowledge or information sharing other than via medical records or death certification for the same event. I also reviewed the re-education program for medical practitioners who committed serious misconducts. There are well organized re-education programs such as the physician assessment and clinical program in California, but the number of re-education programs are very limited all over the USA. It is very important to recognize that the safety system of medical practice is closely linked to the management of medical licenses by the state government to assure a high quality of medicine for patients.

The comparative study on the practical skills of Sino-US licensed doctors' practical skill examination evaluation index system / 中华医学教育探索杂志

In this paper,the constitute elements of Sino-US licensed doctors' practical skill examination evaluation index system are expounded.Through comparison,the differences on the formulation basis,classification principle,test content,and ability requirements are inferred;On the basis of referring to the advanced experience and practice of the United States,and by combining the requirements of the most basic requirements of global medical education,suggestions for improving the Chinese licensed doctors' practical skill examination evaluation index system are proposed in terms of integrating the test syllabus classification,adjusting the distribution of clinical practice ability examination content,increasing the proportion of medical humanities content test,as well as establishing a scientific examination evaluation index weight table.

Practice challenges of intensive care unit telemedicine.

For more than 20 years, a 100-year-old state-based system for medical licensure has not progressed commensurate with the level of 21st century technology development. Despite government and nongovernment organizational attempts, each state maintains a process of variable and time-consuming requirements with lack of reciprocity. Lack of available reimbursement for Tele-ICU physician services is thought to be a long-standing and significant barrier to the rapid adoption of Tele-ICU programs. By reviewing the reimbursement guidelines for telehealth services across all major patient financial classes, a model is discussed for developing financial projections to determine exactly what reimbursement is available for Tele-ICU programs.

A survey and review of telemedicine license portability.

BACKGROUND: One of the major barriers to the practice of telemedicine is the state-to-state inconsistency and variability of requirements for physicians to obtain a medical license. MATERIALS AND METHODS: Invitations were extended to 61 individuals, representing 21 companies and healthcare systems. The participants had to meet strict inclusion criteria. Health professionals who process well over 1,000 applicants a year were provided a 30-question survey asking about state medical boards and their assessment, including ease of obtaining a license as well as difficulties. RESULTS: Responses were received from 40 of 61 (66%) individuals. Responders ranked their expectations of state medical boards for the following qualities: responsiveness to questions, cooperation, willingness to expedite the application, and knowledge. Although 46% of respondents perceived the state medical board licensing to be reasonable, 54% reported a prolonged application process owing to variable requirements and a deficiency of board office assistance. When respondents were asked about difficulty in dealing with the state medical boards, the reasons listed included the following: failure to respond to e-mails or calls, failure to provide updates on missing content, lack of cooperation, lack of uniform process/consistency, provision of erroneous information, and failure to use the Federation Credentials Verification Service. Lost documents was a problem in that 79% had to resubmit documents that were lost. CONCLUSIONS: The rapid growth of telemedicine is consistently meeting resistance because of the timely, costly, and variable process of medical license portability. A survey of professionals who, combined, annually process over 1,000 applications revealed major disparities among states. The survey demonstrated delayed responsiveness by the medical board, lost documents, and lack of access online as to the current applicant's status. Many of the respondents felt a standardized process or even a national license was a viable solution. Several models for a solution are presented.

Advanced Objective Structured Clinical Examination Trial at Hyogo College of Medicine / 医学教育

The objective structured clinical examination (OSCE) is expected to be used for the Japanese medical license exami-nation (Advanced OSCE). An Advanced OSCE trial was conducted at Hyogo College of Medicine. We examined 96 stu-dents in 11 areas in 1 day with 58 examiners, 5 simulated patients, 70 student volunteers, and 34 clerks. According to thequestionnaire filled out by the students and examiners, this trial was moderately or rather difficult. This trial suggeststhat the Advanced OSCE can be used for the license examination, although some aspects should be improved.

A History of Medical License in Korea / 의사학

Medical license is to qualify a person for medical practice and to attribute him/her a privileged right in the practice. This privileged and exclusive right asks for protection from the side of a state and the state in turn needs qualified medical personnel in order to carry out her task of public health, one of the main duties of modern states. In Europe, physicians succeeded in obtaining medical license that guarantees the privileged right in a highly competitive medical market against other practitioners. The first regulation for medical license in Korea was made in 1900 when few Korean doctors trained in Western medicine was in practice. The regulation aimed at controlling traditional medical practitioners who had been practicing medicine without any qualification as a physician. The regulation was very brief, consisting of only seven articles. A newly revised regulation appeared in 1913 when Korea was under the occupation of Japan. The Japanese Government-General enacted a series of regulations about medical personnel, including dentists and traditional medical practitioners. This heralds its full-scale engagement in medical affaires in Korea. Unlike the case of European countries where medical license was obtained after a long struggle with other practitioners, in Korea, medical license was given to doctors too easily from the state. And this experience played a very important role in the formation of identity of Korean doctors.

Success Rate on the National Medical License Examination and Matriculation Rate of Medical Colleges / 医学教育

The success rate on the national medical license examination was calculated as the number of successful new graduates divided by the number of students at matriculation. Statistical analysis revealed that private medical colleges could be divided into two different groups: a large group A and a small group B. Furthermore, group A and national medical colleges could be regarded as one group. The conclusions are as follows. 1. The success rate of group A is almost equal to that of national medical colleges. 2. In the two groups, no significant correlation was observed between the success rate and the matriculation rate. 3. The success rate is a reliable index of the teaching efficiency of medical colleges.