ChatGPT for shaping the future of dentistry: the potential of multi-modal large language model

被引:84
|
作者
Huang, Hanyao [1 ,2 ,3 ]
Zheng, Ou [4 ]
Wang, Dongdong [4 ]
Yin, Jiayi [1 ,2 ,3 ]
Wang, Zijin [4 ]
Ding, Shengxuan [5 ]
Yin, Heng [1 ,2 ,3 ]
Xu, Chuan [6 ,7 ]
Yang, Renjie [8 ,9 ,10 ]
Zheng, Qian [1 ,2 ,3 ]
Shi, Bing [1 ,2 ,3 ]
机构
[1] Sichuan Univ, West China Hosp Stomatol, State Key Lab Oral Dis, Chengdu, Peoples R China
[2] Sichuan Univ, West China Hosp Stomatol, Natl Clin Res Ctr Oral Dis, Chengdu, Peoples R China
[3] Sichuan Univ, West China Hosp Stomatol, Dept Oral & Maxillofacial Surg, Chengdu, Peoples R China
[4] Univ Cent Florida, Dept Civil Environm & Construct Engn, Orlando, FL 32816 USA
[5] Univ Cent Florida, Coll Transportat Engn, Orlando, FL USA
[6] Southwest Jiaotong Univ, Sch Transportat & Logist, Chengdu, Peoples R China
[7] NYU, Ctr C2SMART, Tandon Sch Engn, Brooklyn, NY USA
[8] Sichuan Univ, West China Hosp Stomatol, State Key Lab Oral Dis, Chengdu, Peoples R China
[9] Sichuan Univ, West China Hosp Stomatol, Natl Clin Res Ctr Oral Dis, Chengdu, Peoples R China
[10] Sichuan Univ, West China Hosp Stomatol, Eastern Clin, Chengdu, Peoples R China
关键词
DIAGNOSIS; OUTCOMES; RECORDS; CANCER;
D O I
10.1038/s41368-023-00239-y
中图分类号
R78 [口腔科学];
学科分类号
1003 ;
摘要
The ChatGPT, a lite and conversational variant of Generative Pretrained Transformer 4 (GPT-4) developed by OpenAI, is one of the milestone Large Language Models (LLMs) with billions of parameters. LLMs have stirred up much interest among researchers and practitioners in their impressive skills in natural language processing tasks, which profoundly impact various fields. This paper mainly discusses the future applications of LLMs in dentistry. We introduce two primary LLM deployment methods in dentistry, including automated dental diagnosis and cross-modal dental diagnosis, and examine their potential applications. Especially, equipped with a cross-modal encoder, a single LLM can manage multi-source data and conduct advanced natural language reasoning to perform complex clinical operations. We also present cases to demonstrate the potential of a fully automatic Multi-Modal LLM AI system for dentistry clinical application. While LLMs offer significant potential benefits, the challenges, such as data privacy, data quality, and model bias, need further study. Overall, LLMs have the potential to revolutionize dental diagnosis and treatment, which indicates a promising avenue for clinical application and research in dentistry.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Towards a multi-modal perceptual model
    Hollier, MP
    Voelcker, R
    BT TECHNOLOGY JOURNAL, 1997, 15 (04): : 162 - 171
  • [32] Multi-modal Background Model Initialization
    Bloisi, Domenico D.
    Grillo, Alfonso
    Pennisi, Andrea
    Iocchi, Luca
    Passaretti, Claudio
    NEW TRENDS IN IMAGE ANALYSIS AND PROCESSING - ICIAP 2015 WORKSHOPS, 2015, 9281 : 485 - 492
  • [33] TOMGPT: Reliable Text-Only Training Approach for Cost-Effective Multi-modal Large Language Model
    Chen, Yunkai
    Wang, Qimeng
    Wu, Shiwei
    Gao, Yan
    Xu, Tong
    Hu, Yao
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (07)
  • [34] Multi-Modal Large Language Model Enhanced Pseudo 3D Perception Framework for Visual Commonsense Reasoning
    Zhu, Jian
    Wang, Hanli
    Shi, Miaojing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (11) : 11682 - 11694
  • [35] A question answering system for assembly process of wind turbines based on multi-modal knowledge graph and large language model
    Hu, Zhiqiang
    Li, Xinyu
    Pan, Xinyu
    Wen, Sijie
    Bao, Jinsong
    JOURNAL OF ENGINEERING DESIGN, 2023,
  • [36] Future Potential Challenges of Using Large Language Models Like ChatGPT in Medical Practice
    Sedaghat, Sam
    JOURNAL OF THE AMERICAN COLLEGE OF RADIOLOGY, 2024, 21 (02) : 344 - 345
  • [37] Multi-modal Language Models for Lecture Video Retrieval
    Chen, Huizhong
    Cooper, Matthew
    Joshi, Dhiraj
    Girod, Bernd
    PROCEEDINGS OF THE 2014 ACM CONFERENCE ON MULTIMEDIA (MM'14), 2014, : 1081 - 1084
  • [38] Analogy and multi-modal exploration in the teaching of language theory
    Jeffries, L
    STYLE, 2003, 37 (01) : 67 - +
  • [39] Skeleton aware multi-modal sign language recognition
    Jiang, Songyao
    Sun, Bin
    Wang, Lichen
    Bai, Yue
    Li, Kunpeng
    Fu, Yun
    IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2021, : 3408 - 3418
  • [40] Multi-modal Dialogue System with Sign Language Capabilities
    Hruz, M.
    Campr, P.
    Krnoul, Z.
    Zelezny, M.
    Aran, Oya
    Santemiz, Pinar
    ASSETS 11: PROCEEDINGS OF THE 13TH INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, 2011, : 265 - 266