Response to the Comment on "Evaluating the Diagnostic Accuracy and Management Recommendations of ChatGpt in Uveitis"

被引:0
|
作者
Rojas-Carabali, William [1 ,2 ]
Cifuentes-Gonzalez, Carlos [1 ,3 ]
Wei, Xin [1 ]
Putera, Ikhwanuliman [4 ,5 ,6 ,7 ]
Sen, Alok [8 ]
Thng, Zheng Xian [1 ]
Agrawal, Rajdeep [2 ]
Elze, Tobias [9 ,10 ]
Sobrin, Lucia [9 ,10 ]
Kempen, John H. [9 ,10 ,11 ,12 ]
Lee, Bernett [2 ]
Biswas, Jyotirmay [13 ]
Nguyen, Quan Dong [14 ]
Gupta, Vishali [15 ]
de-la-Torre, Alejandra [3 ]
Agrawal, Rupesh [1 ,2 ,16 ,17 ,18 ]
机构
[1] Tan Tock Seng Hosp, Natl Healthcare Grp Eye Inst, Singapore 308433, Singapore
[2] Nanyang Technol Univ, Lee Kong Chiang Sch Med, Dept Bioinformat, Singapore, Singapore
[3] Univ Rosario, Escuela Med & Ciencias Salud, Inst Translat Med IMT, Neurosci Res Grp NEUROS,Neurovitae Ctr Neurosci, Bogota, Colombia
[4] Univ Indonesia, CiptoMangunkusmoKirana Eye Hosp, Fac Med, Dept Ophthalmol, Jakarta, Indonesia
[5] Univ Med Ctr, ErasmusMC, Dept Immunol, Lab Med Immunol, Rotterdam, Netherlands
[6] Univ Med Ctr, Dept Internal Med, Div Clin Immunol, Erasmus MC, Rotterdam, Netherlands
[7] Univ Med Ctr, Dept Ophthalmol, Erasmus MC, Rotterdam, Netherlands
[8] Sadguru Netra Chikatsalya, Dept Vitreoretinal & Uveitis, Chitrakoot, India
[9] Harvard Med Sch, Dept Ophthalmol, Massachusetts Eye & Ear, Boston, MA USA
[10] Schepens Eye Res Inst, Boston, MA USA
[11] Sight Souls, Community Ophthalmol, Bellevue, WA USA
[12] MCM Comprehens Specialized Hosp, Myungsung Med Coll, Dept Ophthalmol, Addis Ababa, Ethiopia
[13] Sankara Netralaya, Med Res Fdn, Dept Ocular Pathol & Uveitis, Chennai, India
[14] Stanford Univ, Byers Eye Inst, Palo Alto, CA USA
[15] Post Grad Inst Med Educ & Res PGIMER, Adv Eye Ctr, Chandigarh, India
[16] Duke NUS Med Sch, Dept Ophthalmol & Visual Sci, Acad Clin Program, Singapore, Singapore
[17] NHS Fdn Trust, Moorfields Eye Hosp, London, England
[18] The Academia, Singapore Eye Res Inst, Singapore, Singapore
基金
英国医学研究理事会;
关键词
Artificial intelligence; chatbot; diagnosis; natural language processing; ophthalmology;
D O I
10.1080/09273948.2023.2293924
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
Introduction: Accurate diagnosis and timely management are vital for favorable uveitis outcomes. Artificial Intelligence (AI) holds promise in medical decision-making, particularly in ophthalmology. Yet, the diagnostic precision and management advice from AI-based uveitis chatbots lack assessment. Methods: We appraised diagnostic accuracy and management suggestions of an AI-based chatbot, ChatGPT, versus five uveitis-trained ophthalmologists, using 25 standard cases aligned with new Uveitis Nomenclature guidelines. Participants predicted likely diagnoses, two differentials, and next management steps. Comparative success rates were computed. Results: Ophthalmologists excelled (60–92%) in likely diagnosis, exceeding AI (60%). Considering fully and partially accurate diagnoses, ophthalmologists achieved 76–100% success; AI attained 72%. Despite an 8% AI improvement, its overall performance lagged. Ophthalmologists and AI agreed on diagnosis in 48% cases, with 91.6% exhibiting concurrence in management plans. Conclusions: The study underscores AI chatbots' potential in uveitis diagnosis and management, indicating their value in reducing diagnostic errors. Further research is essential to enhance AI chatbot precision in diagnosis and recommendations. © 2023 Taylor & Francis Group, LLC.
引用
收藏
页码:1905 / 1906
页数:2
相关论文
共 50 条
  • [1] Diagnostic Accuracy and Management Recommendations of ChatGpt and Uveitis: Comment
    Daungsupawong, Hinpetch
    Wiwanitkit, Viroj
    OCULAR IMMUNOLOGY AND INFLAMMATION, 2024, 32 (08) : 1904 - 1904
  • [2] Evaluating ChatGPT's Accuracy in Lung Cancer Prevention and Screening Recommendations
    Haver, Hana L.
    Lin, Cheng Ting
    Sirajuddin, Arlene
    Yi, Paul H.
    Jeudy, Jean
    RADIOLOGY-CARDIOTHORACIC IMAGING, 2023, 5 (04):
  • [3] Ensuring Consistency and Accuracy in Evaluating ChatGPT-4 for Clinical Recommendations
    Zhu, Lingxuan
    Mou, Weiming
    Luo, Peng
    CLINICAL GASTROENTEROLOGY AND HEPATOLOGY, 2025, 23 (01) : 189 - 190
  • [4] Evaluating Diagnostic Performance of ChatGPT in Radiology: Delving into Methods Response
    Ueda, Daiju
    Mitsuyama, Yasuhito
    Takita, Hirotaka
    Horiuchi, Daisuke
    Walston, Shannon L.
    Tatekawa, Hiroyuki
    Miki, Yukio
    RADIOLOGY, 2023, 308 (03)
  • [5] Evaluating the Performance of ChatGPT in Urology: Comment
    Kleebayoon, Amnuay
    Wiwanitkit, Viroj
    JOURNAL OF ENDOUROLOGY, 2024,
  • [6] Evaluating ChatGPT-4's Diagnostic Accuracy: Impact of Visual Data Integration
    Hirosawa, Takanobu
    Harada, Yukinori
    Tokumasu, Kazuki
    Ito, Takahiro
    Suzuki, Tomoharu
    Shimizu, Taro
    JMIR MEDICAL INFORMATICS, 2024, 12
  • [7] Evaluating the Diagnostic Accuracy and Management Protocols In Reply to Strasberg
    Joseph, Bellal
    Jehan, Faisal
    Riall, Taylor S.
    JOURNAL OF THE AMERICAN COLLEGE OF SURGEONS, 2018, 227 (06) : 624 - 626
  • [8] Response to "Can ChatGPT Vision diagnose melanoma? An exploratory diagnostic accuracy study"
    Koga, Shunsuke
    Du, Wei
    Ono, Daisuke
    JOURNAL OF THE AMERICAN ACADEMY OF DERMATOLOGY, 2024, 91 (03) : e61 - e62
  • [9] Evaluating the concordance of ChatGPT and physician recommendations for bariatric surgery
    Kahlon, Sunny
    Sleet, Mary
    Sujka, Joseph
    Docimo, Salvatore
    Ducoin, Christopher
    Dimou, Francesca
    Mhaskar, Rahul
    CANADIAN JOURNAL OF PHYSIOLOGY AND PHARMACOLOGY, 2025, 103 (02) : 70 - 74
  • [10] Diagnostic management of childhood uveitis
    Bodaghi, B.
    Terrada, C.
    LeHoang, P.
    Ouartier, P.
    Kone-Paut, I.
    ARCHIVES DE PEDIATRIE, 2009, 16 (06): : 524 - 525