ChatGPT's learning and reasoning capacity in anesthesiology

Introduction: Over the past few months, ChatGPT has raised a lot of interest given its ability to perform complex tasks through natural language and conversation. However, its use in clinical decision-making is limited and its application in the field of anesthesiology is unknown. Objective: To assess ChatGPT's basic and clinical reasoning and its learning ability in a performance test on general and specific anesthesia topics. Methods: A three-phase assessment was conducted. Basic knowledge of anesthesia was assessed in the first phase, followed by a review of difficult airway management and, finally, measurement of decision-making ability in ten clinical cases. The second and the third phases were conducted before and after feeding ChatGPT with the 2022 guidelines of the American Society of Anesthesiologists on difficult airway management. Results: On average, ChatGPT succeded 65% of the time in the first phase and 48% of the time in the second phase. Agreement in clinical cases was 20%, with 90% relevance and 10% error rate. After learning, ChatGPT improved in the second phase, and was correct 59% of the time, with agreement in clinical cases also increasing to 40%. Conclusions: ChatGPT showed acceptable accuracy in the basic knowledge test, high relevance in the management of specific difficult airway clinical cases, and the ability to improve after learning.

Introducción: En los últimos meses, ChatGPT ha suscitado un gran interés debido a su capacidad para realizar tareas complejas a través del lenguaje natural y la conversación. Sin embargo, su uso en la toma de decisiones clínicas es limitado y su aplicación en el campo de anestesiología es desconocido. Objetivo: Evaluar el razonamiento básico, clínico y la capacidad de aprendizaje de ChatGPT en una prueba de rendimiento sobre temas generales y específicos de anestesiología. Métodos: Se llevó a cabo una evaluación dividida en tres fases. Se valoraron conocimientos básicos de anestesiología en la primera fase, seguida de una revisión del manejo de vía aérea difícil y, finalmente, se midió la toma de decisiones en diez casos clínicos. La segunda y tercera fases se realizaron antes y después de alimentar a ChatGPT con las guías de la Sociedad Americana de Anestesiólogos del manejo de la vía aérea difícil del 2022. Resultados: ChatGPT obtuvo una tasa de acierto promedio del 65 % en la primera fase y del 48 % en la segunda fase. En los casos clínicos, obtuvo una concordancia del 20 %, una relevancia del 90 % y una tasa de error del 10 %. Posterior al aprendizaje, ChatGPT mejoró su tasa de acierto al 59 % en la segunda fase y aumentó la concordancia al 40 % en los casos clínicos. Conclusiones: ChatGPT demostró una precisión aceptable en la prueba de conocimientos básicos, una alta relevancia en el manejo de los casos clínicos específicos de vía aérea difícil y la capacidad de mejoría secundaria a un aprendizaje.

Artificial intelligence, applications and challenges in simulation-based education

The rapid advancement of Artificial Intelligence (AI) has taken the world by "surprise" due to the lack of regulation over this technological innovation which, while promising application opportunities in different fields of knowledge, including education, simultaneously generates concern, rejection and even fear. In the field of Health Sciences Education, clinical simulation has transformed educational practice; however, its formal insertion is still heterogeneous, and we are now facing a new technological revolution where AI has the potential to transform the way we conceive its application.

El rápido avance de la inteligencia artificial (IA) ha tomado al mundo por "sorpresa" debido a la falta de regulación sobre esta innovación tecnológica, que si bien promete oportunidades de aplicación en diferentes campos del conocimiento, incluido el educativo, también genera preocupación e incluso miedo y rechazo. En el campo de la Educación en Ciencias de la Salud la Simulación Clínica ha transformado la práctica educativa; sin embargo, aún es heterogénea su inserción formal, y ahora nos enfrentamos a una nueva revolución tecnológica, en la que las IA tienen el potencial de transformar la manera en que concebimos su aplicación.

ChatGPT: oportunidades y riesgos en la asistencia, docencia e investigación médica / ChatGPT: opportunities and risks in the fields of medical care, teaching, and research

Resumen ChatGPT es un asistente virtual con inteligencia artificial que utiliza lenguaje natural para comunicarse, es decir, mantiene conversaciones como las que se tendrían con otro humano. Puede aplicarse en educación a todos los niveles, que incluye la educación médica, tanto para la formación, la investigación, la escritura de artículos científicos, la atención clínica y la medicina personalizada. Puede modificar la interacción entre médicos y pacientes para mejorar los estándares de calidad de la atención médica y la seguridad, por ejemplo, al sugerir medidas preventivas en un paciente que en ocasiones no son consideradas por el médico por múltiples causas. Los usos potenciales del ChatGPT en la educación médica, como una herramienta de ayuda en la redacción de artículos científicos, un asistente en la atención para pacientes y médicos para una práctica más personalizada, son algunas de las aplicaciones que se analizan en este artículo. Los aspectos éticos, originalidad, contenido inapropiado o incorrecto, citas incorrectas, ciberseguridad, alucinaciones y plagio son ejemplos de las situaciones a tomar en cuenta al usar las herramientas basadas en inteligencia artificial en medicina.

Abstract ChatGPT is a virtual assistant with artificial intelligence (AI) that uses natural language to communicate, i.e., it holds conversations as those that would take place with another human being. It can be applied at all educational levels, including medical education, where it can impact medical training, research, the writing of scientific articles, clinical care, and personalized medicine. It can modify interactions between physicians and patients and thus improve the standards of healthcare quality and safety, for example, by suggesting preventive measures in a patient that sometimes are not considered by the physician for multiple reasons. ChatGPT potential uses in medical education, as a tool to support the writing of scientific articles, as a medical care assistant for patients and doctors for a more personalized medical approach, are some of the applications discussed in this article. Ethical aspects, originality, inappropriate or incorrect content, incorrect citations, cybersecurity, hallucinations, and plagiarism are some examples of situations to be considered when using AI-based tools in medicine.

Chatbots, generative AI, and scholarly manuscripts: WAME recommendations on chatbots and generative artificial intelligence in relation to scholarly publications

This statement revises our earlier "WAME Recommendations on ChatGPT and Chatbots in Relation to Scholarly Publications" (January 20, 2023). The revision reflects the proliferation of chatbots and their expanding use in scholarly publishing over the last few months, as well as emerging concerns regarding lack of authenticity of content when using chatbots. These recommendations are intended to inform editors and help them develop policies for the use of chatbots in papers published in their journals. They aim to help authors and reviewers understand how best to attribute the use of chatbots in their work and to address the need for all journal editors to have access to manuscript screening tools. In this rapidly evolving field, we will continue to modify these recommendations as the software and its applications develop.

Esta declaración revisa las anteriores "Recomendaciones de WAME sobre ChatGPT y Chatbots en Relation to Scholarly Publications" (20 de enero de 2023). La revisión refleja la proliferación de chatbots y su creciente uso en las publicaciones académicas en los últimos meses, así como la preocupación por la falta de autenticidad de los contenidos cuando se utilizan chatbots. Estas recomendaciones pretenden informar a los editores y ayudarles a desarrollar políticas para el uso de chatbots en los artículos sometidos en sus revistas. Su objetivo es ayudar a autores y revisores a entender cuál es la mejor manera de atribuir el uso de chatbots en su trabajo y a la necesidad de que todos los editores de revistas tengan acceso a herramientas de selección de manuscritos. En este campo en rápida evolución, seguiremos modificando estas recomendaciones a medida que se desarrollen el software y sus aplicaciones.

ChatGPT for Veterinary Anatomy Education: An Overview of the Prospects and Drawbacks / ChatGPT para la Educación en Anatomía Veterinaria: Una Descripción General de las Perspectivas y los Inconvenientes

SUMMARY: The integration of artificial intelligence in veterinary medical education has the potential to revolutionize the way students learn veterinary anatomy. ChatGPT, launched by OpenAI in November 2022, has been the fastest-growing artificial intelligence (AI) application as a learning tool in the past few months. ChatGPT is a virtual assistant that provides students with detailed and relevant anatomical knowledge based on internet sources. Apart from the advantages of ChatGPT in veterinary anatomy education, the challenges and limitations must also be considered, as highlighted in this letter. Further research and evaluation are necessary to ensure the optimal integration of the ChatGPT tool into veterinary anatomy education. ChatGPT can provide students with valuable insights and educational support but cannot replace hands-on experiences; dissection-based laboratory sessions remain essential for developing practical skills and spatial understanding in veterinary anatomy education.

La integración de la inteligencia artificial en la educación médica veterinaria tiene el potencial de revolucionar la forma en que los estudiantes aprenden anatomía veterinaria. ChatGPT, lanzado por OpenAI en noviembre de 2022, ha sido la aplicación de inteligencia artificial (IA) de más rápido crecimiento como herramienta de aprendizaje en los últimos meses. ChatGPT es un asistente virtual que brinda a los estudiantes conocimientos anatómicos detallados y relevantes basados en fuentes de Internet. Además de las ventajas de ChatGPT en la educación en anatomía veterinaria, también se deben considerar los desafíos y las limitaciones, como se destaca en esta carta. Se necesitan más investigaciones y evaluaciones para garantizar la integración óptima de la herramienta ChatGPT en la educación en anatomía veterinaria. ChatGPT puede proporcionar a los estudiantes información valiosa y apoyo educativo, pero no puede reemplazar las experiencias prácticas. Las sesiones de laboratorio basadas en disecciones siguen siendo esenciales para desarrollar habilidades prácticas y comprensión espacial en la educación de la anatomía veterinaria.

Tan lejos de la investigación científica, tan cerca de la inteligencia artificial / So far from scientific research, so close to artificial intelligence

En este editorial se exploran los posibles riesgos que representa el uso de la inteligencia artificial para la elaboración de trabajos académicos y científicos. Además, se presenta una lista de riesgos para la investigación científica elaborada por la plataforma ChatGPT con el objetivo de explorar su precisión en la generación de textos.

This editorial explores the possible risks posed by the use of artificial intelligence for the preparation of academic and scientific work. Additionally, a list of risks for scientific research is presented by the ChatGPT platform with the aim of exploring its accuracy in generating texts.

Exploration of application of ChatGPT in radiation medicine / 中华放射医学与防护杂志

ChatGPT, as a high-profile generative large language model (LLM) of artificial intelligence(AI), brings people immersive learning experience and a unique interactive platform; meanwhile, it provides an innovative tool and new opportunities for the development in many fields. With the increasing importance of radiation medicine in disease diagnosis and treatment, manned spaceflight, and nuclear energy and nuclear technology, it can be foreseen that AI LLMs like ChatGPT will play an important role in the development of radiation medicine. This article reviews the application prospects and challenges of ChatGPT in radiation medicine, aiming to promote the application research of AI LLMs in radiation medicine.

Prospects and Suggestions for the Application of ChatGPT in Medical Ethics Education / 中国医学伦理学

ChatGPT represents the approaching singularity, which brings opportunity to medical ethics education, but is also constrained by issues such as unfairness, discrimination, and loss of autonomy caused by technological logic. This paper explored the intermediary relationship model of generative AI in medical ethics education, and analyzed the potential positive and negative values of this technology as a human creation, as well as the challenges that ChatGPT brings to medical ethics education. Based on this, suggestions are put for ward from the following four aspects. First, The role division and construction of different responsible subjects was explored based on the change in teacher-student relationship. Second, we shonld cultivate students’ ability to think and question. Third, the forward-looking responsibility was discussed based on the future development of intelligent education. Fourthly, from the perspective of technical logic, it presupposes the coexistence of human-machine dual subjects.

On the Possible Ethical Risks and Corresponding Prevention Paths of ChatGPT in the Medical Field / 中国医学伦理学

With the continuous development of artificial intelligence technology, ChatGPT, as an emerging natural language processing technology, although there is currently no mature application mode, its application prospects in the medical field are becoming increasingly broad. However, its application also faces some possible ethical risks and challenges, including personal privacy data leakage, discrimination and bias in machine algorithms, difficulty in defining responsibility, inexplicability of algorithms, and lack of supervision and so on. It is necessary to strengthen the training of relevant personnel, guide public opinion to pay attention to risks, focus on algorithm validation standards, emphasize multi-party cooperation and co-governance, strengthen medical ethics research, as well as deepen regulatory supervision and standardization construction to solve the above problems.

Bridging the gap or widening the divide: A call for capacity-building in Artificial Intelligence for Healthcare in the Philippines

@#The emerging field of generative artificial intelligence (GAI) and some of its well-known technologies: ChatGPT, Google Bard and Claude, have gained substantial popularity due to their enormous potential in healthcare applications, as seen in medically fine-tuned models such as Med-PaLM and ChatDoctor. While these advancements are impressive, the dependence of AI development on data volume and quality raises questions about the generalizability of these models. Regions with lower medical research output risk bias and misrepresentation in AI-generated content, especially when used to assist clinical practice. Upon testing of a prompt concerning the isoniazid dosing of Filipinos versus other ethnic and racial groups, responses from GPT-4, GPT-3, Bard and Claude resulted in 3 out of 4 outputs showing convincing but false content, with extended prompting illustrating how response hallucination happens in GAI models. To address this, model refinement techniques such as fine-tuning and prompt ensembles are suggested; however, refining AI models for local contextualization requires data availability, data quality and quality assurance frameworks. Clinicians and researchers in the Philippines and other underrepresented regions are called to initiate capacity-building efforts to prepare for AI in healthcare. Early efforts from all stakeholders are needed to prevent the exacerbation of health inequities, especially in the new clinical frontiers brought about by GAI.

Development and application of ChatGPT in medical research management / 中华医学科研管理杂志

Objective:To analyze the development prospect of ChatGPT in the field of medical research management and the feasibility of application.Methods:The literature was reviewed and analyzed.Results:This paper describes the application of ChatGPT involving the orderly promotion of medical scientific research projects, the working mode of scientific research managers, and the development of scientific research management platform.Conclusions:The development of ChatGPT makes it have its unique advantages in medical scientific research management, but also has some shortcomings, which need to be reasonably understood and scientifically applied.

Impact and challenges of ChatGPT on medical science research management / 中华医学科研管理杂志

Objective:To explore the influence and challenge of ChatGPT technology on medical scientific research management, and to provide references for better meeting the change of scientific research paradigm generated by artificial intelligence.Methods:Through literature research and case testing, combined with the main characteristics of ChatGPT, the possible application scenarios, risks, and challenges of ChatGPT technology in medical scientific research management were analyzed.Results:Countermeasures and suggestions were proposed from the perspective of medical institutions and research managers.Conclusions:ChatGPT technology will have a broad application prospect in medical scientific research management, and bring new risks and challenges. It is suggested to comply with the trend and actively face it by improving laws, regulations, and institutional norms, strengthening research and supervision, and improving the ability and quality of medical scientific research management personnel.

Impact of ChatGPT on the medical research management / 中华医学科研管理杂志

Objective:This stndy aims to analyze the influence of ChatGPT on medical research and give suggestions on GhatGPT.Methods:This paper expounded the background of ChatGPT, analyze the connection between ChatGPT and medical research management, application and threats of ChatGPT , and gave suggestions to avoid GhatGPT′s damage.Results:Technology will promote the evolution of medical research management. It is recommended to strengthen the supervision of the ChatGPT and research integrity education.Conclusions:It is urgent to establish a scientific management mechanism to take usage the advantages of GhatGPT.

Discussion on the application of ChatGPT in scientific research statistics / 中华医学科研管理杂志

Objective:This study aims to explore the feasibility and practicality of ChatGPT in scientific research statistics through examples, in order to better understand and evaluate the application value of ChatGPT in scientific research statistics.Methods:Literature research was used to illustrate the principles of ChatGPT artificial intelligence model, combined with practical examples and tests, to assess the reliability of its results and analyze the advantages and limitations of ChatGPT in scientific research statistics.Results:ChatGPT can be applied to various scenarios in scientific research statistics, such as literature retrieval and organization, experimental design, statistical analysis programming, and statistical graphing. It can provide efficient scientific research statistical analysis capabilities, but it also has limitations.Conclusions:Although there are limitations, ChatGPT has a promising future in scientific research statistics, and it will be applied widely and deeply to greatly facilitate scientific research.

Evaluation and impact analysis of ChatGPT′s competence in ethical review management / 中华医学科研管理杂志

Objective:This paper tried to have a dialogue with ChatGPT about ethics review, to understand the degree of intelligence of this application in the field of ethical management, and to analyze its possible impact on the future ethics review work.Methods:The research team sorted out 43 questions, then the research team member at abroad accomplish the dialogue with ChatGPT in both Chinese and English. Feedback answers were summarized and analyzed to explore their advantages and problems.Results:Most of the ChatGPT′s answers of this test were reasonable, with obvious advantages in response speed, and the rigor and friendliness were relatively good. However, there were also problems in consistency, comprehensiveness and expertise, the accuracy and computing power also still have a lot of space for improvement.Conclusions:It is too early for AI to replace professionals, but we should fully develop and utilize the advantages of AI to help professionals get rid of inefficient labor and play a better role.

ChatGPT and medical research ethics: Debates and norms / 中华医学科研管理杂志

Objective:Analyze the ethical issues encountered or potential in the use of ChatGPT and explore its ethical norms and requirements.Methods:Based on the ethical perspective of medical scientific research, this paper analyzed the disputes existing in ChatGPT from the perspectives of morality, fairness, responsibility and supervision, and explored the reasons for the disputes from both subjective and objective aspects.Results:ChatGPT has ethical issues, fairness issues, accountability issues, and regulatory issues.Conclusions:Ethical issues in ChatGPT should be regulated from the perspectives of people-oriented, limiting monopoly, strengthening responsibility and insisting on development, to reduce potential risks and negative effects.

Assessing the reliability of ChatGPT: a content analysis of self-generated and self-answered questions on clear aligners, TADs and digital imaging

ABSTRACT Introduction: Artificial Intelligence (AI) is a tool that is already part of our reality, and this is an opportunity to understand how it can be useful in interacting with patients and providing valuable information about orthodontics. Objective: This study evaluated the accuracy of ChatGPT in providing accurate and quality information to answer questions on Clear aligners, Temporary anchorage devices and Digital imaging in orthodontics. Methods: forty-five questions and answers were generated by the ChatGPT 4.0, and analyzed separately by five orthodontists. The evaluators independently rated the quality of information provided on a Likert scale, in which higher scores indicated greater quality of information (1 = very poor; 2 = poor; 3 = acceptable; 4 = good; 5 = very good). The Kruskal-Wallis H test (p< 0.05) and post-hoc pairwise comparisons with the Bonferroni correction were performed. Results: From the 225 evaluations of the five different evaluators, 11 (4.9%) were considered as very poor, 4 (1.8%) as poor, and 15 (6.7%) as acceptable. The majority were considered as good [34 (15,1%)] and very good [161 (71.6%)]. Regarding evaluators' scores, a slight agreement was perceived, with Fleiss's Kappa equal to 0.004. Conclusions: ChatGPT has proven effective in providing quality answers related to clear aligners, temporary anchorage devices, and digital imaging within the context of interest of orthodontics.

RESUMO Introdução: A Inteligência Artificial (IA) é uma ferramenta que já faz parte de nossa realidade, e esta é uma oportunidade de entendermos como ela pode ser útil na interação com os pacientes e no fornecimento de informações valiosas sobre Ortodontia. Objetivo: O objetivo deste estudo foi avaliar a precisão do ChatGPT em responder a perguntas sobre Alinhadores transparentes, Dispositivos de ancoragem temporária, e Imagens digitais em Ortodontia. Métodos: 45 perguntas e respostas foram geradas pelo ChatGPT 4.0 e analisadas separadamente por cinco ortodontistas que, de forma independente, avaliaram a qualidade das informações fornecidas, usando uma escala de Likert, na qual pontuações mais altas indicavam uma maior qualidade das informações (1 = muito ruim; 2 = ruim; 3 = aceitável; 4 = bom; 5 = muito bom). Aplicou-se o teste H de Kruskal-Wallis (p < 0,05) e comparações pareadas post-hoc com correção de Bonferroni. Resultados: Das 225 avaliações dos cinco avaliadores diferentes, 11 (4,9%) foram consideradas como muito ruins, 4 (1,8%) como ruins, e 15 (6,7%) como aceitáveis. A maioria foi considerada boa [34 (15,1%)] ou muito boa [161 (71,6%)]. Com relação às pontuações dos avaliadores, percebeu-se uma leve concordância, com o Kappa de Fleiss igual a 0,004. Conclusões: O ChatGPT mostrou eficácia em fornecer respostas de qualidade para questões relacionadas a Alinhadores transparentes, Dispositivos de ancoragem temporária e Imagens digitais.