Chat GPT for the management of obstructive sleep apnea: do we have a polar star?

Nov 20, 2023

Contributors: Felipe Ahumada Mira,Valentin Favier,Heloisa Dos Santos Sobreira Nunes,Joana Vaz de Castro,Florent Carsuzaa,Giuseppe Meccariello,Claudio Vicini,Andrea De Vito,Jerome R Lechien,Carlos Chiesa Estomba,Antonino Maniaci,Giannicola Iannella,Eduardo Peña Rojas,Jenifer Barros Cornejo,Giovanni Cammaroto

This study explores the potential of the Chat-Generative Pre-Trained Transformer (Chat-GPT), a Large Language Model (LLM), in assisting healthcare professionals in the diagnosis of obstructive sleep apnea (OSA). It aims to assess the agreement between Chat-GPT’s responses and those of expert otolaryngologists, shedding light on the role of AI-generated content in medical decision-making.
A prospective, cross-sectional study was conducted, involving 350 otolaryngologists from 25 countries who responded to a specialized OSA survey. Chat-GPT was tasked with providing answers to the same survey questions. Responses were assessed by both super-experts and statistically analyzed for agreement.
The study revealed that Chat-GPT and expert responses shared a common answer in over 75% of cases for individual questions. However, the overall consensus was achieved in only four questions. Super-expert assessments showed a moderate agreement level, with Chat-GPT scoring slightly lower than experts. Statistically, Chat-GPT’s responses differed significantly from experts’ opinions (p = 0.0009). Sub-analysis revealed areas of improvement for Chat-GPT, particularly in questions where super-experts rated its responses lower than expert consensus.
Chat-GPT demonstrates potential as a valuable resource for OSA diagnosis, especially where access to specialists is limited. The study emphasizes the importance of AI-human collaboration, with Chat-GPT serving as a complementary tool rather than a replacement for medical professionals. This research contributes to the discourse in otolaryngology and encourages further exploration of AI-driven healthcare applications. While Chat-GPT exhibits a commendable level of consensus with expert responses, ongoing refinements in AI-based healthcare tools hold significant promise for the future of medicine, addressing the underdiagnosis and undertreatment of OSA and improving patient outcomes.

© 2023. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.

Author

admin

View all posts

ABOUT THE CONTRIBUTORS

Felipe Ahumada Mira,Valentin Favier,Heloisa Dos Santos Sobreira Nunes,Joana Vaz de Castro,Florent Carsuzaa,Giuseppe Meccariello,Claudio Vicini,Andrea De Vito,Jerome R Lechien,Carlos Chiesa Estomba,Antonino Maniaci,Giannicola Iannella,Eduardo Peña Rojas,Jenifer Barros Cornejo,Giovanni Cammaroto

Felipe Ahumada Mira

ENT Department, Hospital of Linares, Linares, Chile.

Young Otolaryngologists-International Federations of Oto-Rhinolaryngological Societies (YO-IFOS), Paris, France.

Valentin Favier

ENT Department, University Hospital of Montpellier, Montpellier, France.

Young Otolaryngologists-International Federations of Oto-Rhinolaryngological Societies (YO-IFOS), Paris, France.

Heloisa Dos Santos Sobreira Nunes

ENT and Sleep Medicine Department, Nucleus of Otolaryngology, Head and Neck Surgery and Sleep Medicine of São Paulo, São Paulo, Brazil.

Young Otolaryngologists-International Federations of Oto-Rhinolaryngological Societies (YO-IFOS), Paris, France.

Joana Vaz de Castro

ENT Department, Armed Forces Hospital, Lisbon, Portugal.

Young Otolaryngologists-International Federations of Oto-Rhinolaryngological Societies (YO-IFOS), Paris, France.

Florent Carsuzaa

ENT Department, University Hospital of Poitiers, Poitiers, France.

Young Otolaryngologists-International Federations of Oto-Rhinolaryngological Societies (YO-IFOS), Paris, France.

Giuseppe Meccariello

Head and Neck Department, ENT & Oral Surgery Unity, G.B. Morgagni, L. Pierantoni Hospital, Via Forlanini, 47121, Forlì, Italy.

Claudio Vicini

Head and Neck Department, ENT & Oral Surgery Unity, G.B. Morgagni, L. Pierantoni Hospital, Via Forlanini, 47121, Forlì, Italy.

Andrea De Vito

Head and Neck Department, ENT & Oral Surgery Unity, G.B. Morgagni, L. Pierantoni Hospital, Via Forlanini, 47121, Forlì, Italy.

Jerome R Lechien

Division of Laryngology and Broncho-Esophagology, Department of Otolaryngology and Head and Neck Surgery, EpiCURA Hospital, UMONS Research Institute for Health Sciences and Technology, University of Mons, Mons, Belgium.

Young Otolaryngologists-International Federations of Oto-Rhinolaryngological Societies (YO-IFOS), Paris, France.

Carlos Chiesa Estomba

Department of Otorhinolaryngology, Biodonostia Research Institute, Donostia University Hospital, Osakidetza, 20014, San Sebastian, Spain.

Young Otolaryngologists-International Federations of Oto-Rhinolaryngological Societies (YO-IFOS), Paris, France.

Antonino Maniaci

Department of Medical and Surgical Sciences and Advanced Technologies “GF Ingrassia”, ENT Section, University of Catania, Piazza Università 2, 95100, Catania, Italy.

Young Otolaryngologists-International Federations of Oto-Rhinolaryngological Societies (YO-IFOS), Paris, France.

Giannicola Iannella

Department of ‘Organi di Senso’, University “Sapienza”, Viale Dell’Università 33, 00185, Rome, Italy.

Young Otolaryngologists-International Federations of Oto-Rhinolaryngological Societies (YO-IFOS), Paris, France.

Eduardo Peña Rojas

Clínica Lircay, Talca, Chile.

Jenifer Barros Cornejo

Hospital Clínico UC Christus, Santiago, Chile.

Giovanni Cammaroto

Head and Neck Department, ENT & Oral Surgery Unity, G.B. Morgagni, L. Pierantoni Hospital, Via Forlanini, 47121, Forlì, Italy. giovanni.cammaroto@hotmail.com.

Young Otolaryngologists-International Federations of Oto-Rhinolaryngological Societies (YO-IFOS), Paris, France. giovanni.cammaroto@hotmail.com.