ChatGPT for shaping the future of dentistry: the potential of multi-modal large language model

被引:84
|
作者
Huang, Hanyao [1 ,2 ,3 ]
Zheng, Ou [4 ]
Wang, Dongdong [4 ]
Yin, Jiayi [1 ,2 ,3 ]
Wang, Zijin [4 ]
Ding, Shengxuan [5 ]
Yin, Heng [1 ,2 ,3 ]
Xu, Chuan [6 ,7 ]
Yang, Renjie [8 ,9 ,10 ]
Zheng, Qian [1 ,2 ,3 ]
Shi, Bing [1 ,2 ,3 ]
机构
[1] Sichuan Univ, West China Hosp Stomatol, State Key Lab Oral Dis, Chengdu, Peoples R China
[2] Sichuan Univ, West China Hosp Stomatol, Natl Clin Res Ctr Oral Dis, Chengdu, Peoples R China
[3] Sichuan Univ, West China Hosp Stomatol, Dept Oral & Maxillofacial Surg, Chengdu, Peoples R China
[4] Univ Cent Florida, Dept Civil Environm & Construct Engn, Orlando, FL 32816 USA
[5] Univ Cent Florida, Coll Transportat Engn, Orlando, FL USA
[6] Southwest Jiaotong Univ, Sch Transportat & Logist, Chengdu, Peoples R China
[7] NYU, Ctr C2SMART, Tandon Sch Engn, Brooklyn, NY USA
[8] Sichuan Univ, West China Hosp Stomatol, State Key Lab Oral Dis, Chengdu, Peoples R China
[9] Sichuan Univ, West China Hosp Stomatol, Natl Clin Res Ctr Oral Dis, Chengdu, Peoples R China
[10] Sichuan Univ, West China Hosp Stomatol, Eastern Clin, Chengdu, Peoples R China
关键词
DIAGNOSIS; OUTCOMES; RECORDS; CANCER;
D O I
10.1038/s41368-023-00239-y
中图分类号
R78 [口腔科学];
学科分类号
1003 ;
摘要
The ChatGPT, a lite and conversational variant of Generative Pretrained Transformer 4 (GPT-4) developed by OpenAI, is one of the milestone Large Language Models (LLMs) with billions of parameters. LLMs have stirred up much interest among researchers and practitioners in their impressive skills in natural language processing tasks, which profoundly impact various fields. This paper mainly discusses the future applications of LLMs in dentistry. We introduce two primary LLM deployment methods in dentistry, including automated dental diagnosis and cross-modal dental diagnosis, and examine their potential applications. Especially, equipped with a cross-modal encoder, a single LLM can manage multi-source data and conduct advanced natural language reasoning to perform complex clinical operations. We also present cases to demonstrate the potential of a fully automatic Multi-Modal LLM AI system for dentistry clinical application. While LLMs offer significant potential benefits, the challenges, such as data privacy, data quality, and model bias, need further study. Overall, LLMs have the potential to revolutionize dental diagnosis and treatment, which indicates a promising avenue for clinical application and research in dentistry.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] ChatGPT for shaping the future of dentistry: the potential of multi-modal large language model
    Hanyao Huang
    Ou Zheng
    Dongdong Wang
    Jiayi Yin
    Zijin Wang
    Shengxuan Ding
    Heng Yin
    Chuan Xu
    Renjie Yang
    Qian Zheng
    Bing Shi
    International Journal of Oral Science, 15
  • [2] ChatGPT for shaping the future of dentistry:the potential of multi-modal large language model
    Hanyao Huang
    Ou Zheng
    Dongdong Wang
    Jiayi Yin
    Zijin Wang
    Shengxuan Ding
    Heng Yin
    Chuan Xu
    Renjie Yang
    Qian Zheng
    Bing Shi
    InternationalJournalofOralScience, 2023, 15 (03) : 377 - 389
  • [3] Multi-modal large language models in radiology: principles, applications, and potential
    Shen, Yiqiu
    Xu, Yanqi
    Ma, Jiajian
    Rui, Wushuang
    Zhao, Chen
    Heacock, Laura
    Huang, Chenchan
    ABDOMINAL RADIOLOGY, 2024,
  • [4] The Inspiration Brought by ChatGPT to LLM and the New Development Ideas of Multi-modal Large Model
    Chaoyang Z.
    Guibo Z.
    Jinqiao W.
    Data Analysis and Knowledge Discovery, 2023, 7 (03) : 26 - 35
  • [5] Visual Hallucinations of Multi-modal Large Language Models
    Huang, Wen
    Liu, Hongbin
    Guo, Minxin
    Gong, Neil Zhenqiang
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: ACL 2024, 2024, : 9614 - 9631
  • [6] A Model and Query Language for Multi-modal Hybrid Query
    Hu, Chuan
    Mao, Along
    Zhao, Zihao
    Shen, Zhihong
    SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT 36TH INTERNATIONAL CONFERENCE, SSDBM 2024, 2024,
  • [7] Generative Multi-Modal Knowledge Retrieval with Large Language Models
    Long, Xinwei
    Zeng, Jiali
    Meng, Fandong
    Ma, Zhiyuan
    Zhang, Kaiyan
    Zhou, Bowen
    Zhou, Jie
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 18733 - 18741
  • [8] PSALM: Pixelwise SegmentAtion with Large Multi-modal Model
    Zhang, Zheng
    Ma, Yeyao
    Zhang, Enming
    Bai, Xiang
    COMPUTER VISION - ECCV 2024, PT XXXIV, 2025, 15092 : 74 - 91
  • [9] The future of action recognition: are multi-modal visual language models the key?
    Gumuskaynak, Enes
    Eken, Suleyman
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (04)
  • [10] GPT-4 Vision: Multi-Modal Evolution of ChatGPT and Potential Role in Radiology
    Javan, Ramin
    Kim, Theodore
    Mostaghni, Navid
    CUREUS JOURNAL OF MEDICAL SCIENCE, 2024, 16 (08)