ABSTRACT
PURPOSE: This study explores the potential of the Chat-Generative Pre-Trained Transformer (Chat-GPT), a Large Language Model (LLM), in assisting healthcare professionals in the diagnosis of obstructive sleep apnea (OSA). It aims to assess the agreement between Chat-GPT's responses and those of expert otolaryngologists, shedding light on the role of AI-generated content in medical decision-making. METHODS: A prospective, cross-sectional study was conducted, involving 350 otolaryngologists from 25 countries who responded to a specialized OSA survey. Chat-GPT was tasked with providing answers to the same survey questions. Responses were assessed by both super-experts and statistically analyzed for agreement. RESULTS: The study revealed that Chat-GPT and expert responses shared a common answer in over 75% of cases for individual questions. However, the overall consensus was achieved in only four questions. Super-expert assessments showed a moderate agreement level, with Chat-GPT scoring slightly lower than experts. Statistically, Chat-GPT's responses differed significantly from experts' opinions (p = 0.0009). Sub-analysis revealed areas of improvement for Chat-GPT, particularly in questions where super-experts rated its responses lower than expert consensus. CONCLUSIONS: Chat-GPT demonstrates potential as a valuable resource for OSA diagnosis, especially where access to specialists is limited. The study emphasizes the importance of AI-human collaboration, with Chat-GPT serving as a complementary tool rather than a replacement for medical professionals. This research contributes to the discourse in otolaryngology and encourages further exploration of AI-driven healthcare applications. While Chat-GPT exhibits a commendable level of consensus with expert responses, ongoing refinements in AI-based healthcare tools hold significant promise for the future of medicine, addressing the underdiagnosis and undertreatment of OSA and improving patient outcomes.
Subject(s)
Clinical Decision-Making , Sleep Apnea, Obstructive , Humans , Cross-Sectional Studies , Prospective Studies , Alanine Transaminase , Sleep Apnea, Obstructive/diagnosis , Sleep Apnea, Obstructive/therapyABSTRACT
BACKGROUND: This international study aimed at determining current routine palate surgeries and surgical methods adopted by otolaryngologists who practice surgical management of obstructive sleep apnea (OSA). METHODS: An international online survey was developed with the collaboration of the YO-IFOS (Young Otolaryngologists-International Federation of Otorhinolaryngological Societies) to assess the current routines in palatal procedures. The surgeons were asked 33 multiple-choice questions. RESULTS: A total of 141 sleep surgeons answered the questionnaire, of whom 27% were from Africa, 30% from Asia, 24% from Centre-South America, and 19% from Europe. According to otolaryngology surgical specialties, 51% were sleep surgeons, 31% general ENTs, 8% Rhinologists, 7% Head & Neck surgeons, 2% otologists, and 1% maxillofacial surgeons. Of the 141 respondents, 51% answered they were sleep specialists, whereas 49% were non-sleep specialists. According to specific medical degree, 38% were specialists, 33% were consultants, 25% were professors, and 4% were residents or trainees. CONCLUSION: This study gives an overview of the current surgical practice in OSA management in otolaryngology in different countries.
