A pathology foundation model for cancer diagnosis and prognosis prediction

被引:17
|
作者
Wang, Xiyue [1 ,2 ]
Zhao, Junhan [1 ,3 ]
Marostica, Eliana [1 ,4 ]
Yuan, Wei [5 ]
Jin, Jietian [6 ]
Zhang, Jiayu [5 ]
Li, Ruijiang [2 ]
Tang, Hongping [7 ]
Wang, Kanran [8 ]
Li, Yu [9 ]
Wang, Fang [10 ]
Peng, Yulong [11 ]
Zhu, Junyou [12 ]
Zhang, Jing [5 ]
Jackson, Christopher R. [1 ,13 ,14 ]
Zhang, Jun [15 ]
Dillon, Deborah [16 ]
Lin, Nancy U. [17 ]
Sholl, Lynette [16 ,18 ]
Denize, Thomas [16 ,18 ]
Meredith, David [16 ]
Ligon, Keith L. [16 ,18 ]
Signoretti, Sabina [16 ,18 ]
Ogino, Shuji [16 ,19 ,20 ]
Golden, Jeffrey A. [16 ,21 ]
Nasrallah, MacLean P. [22 ]
Han, Xiao [15 ]
Yang, Sen [1 ,2 ]
Yu, Kun-Hsing [1 ,16 ,23 ]
机构
[1] Harvard Med Sch, Dept Biomed Informat, Boston, MA 02115 USA
[2] Stanford Univ, Dept Radiat Oncol, Sch Med, Stanford, CA 94305 USA
[3] Harvard TH Chan Sch Publ Hlth, Dept Biostat, Boston, MA USA
[4] Harvard MIT, Div Hlth Sci & Technol, Boston, MA USA
[5] Sichuan Univ, Coll Biomed Engn, Chengdu, Peoples R China
[6] Sun Yat Sen Univ Canc Ctr, Dept Pathol, Guangzhou, Peoples R China
[7] Shenzhen Matern & Child Healthcare Hosp, Dept Pathol, Shenzhen, Peoples R China
[8] Chongqing Univ Canc Hosp, Dept Radiat Oncol, Chongqing, Peoples R China
[9] Chongqing Univ Canc Hosp, Dept Pathol, Chongqing, Peoples R China
[10] Qingdao Univ, Affiliated Yantai Yuhuangding Hosp, Dept Pathol, Yantai, Peoples R China
[11] Jinan Univ, Affiliated Hosp 1, Dept Pathol, Guangzhou, Peoples R China
[12] Sun Yat Sen Univ, Affiliated Hosp 1, Dept Burn, Guangzhou, Peoples R China
[13] Penn State Univ, Dept Pathol & Lab Med, Hummelstown, PA USA
[14] Massachusetts Gen Hosp, Dept Pathol, Boston, MA USA
[15] Tencent AI Lab, Shenzhen, Peoples R China
[16] Brigham & Womens Hosp, Dept Pathol, Boston, MA 02115 USA
[17] Dana Farber Canc Inst, Dept Med Oncol, Boston, MA USA
[18] Dana Farber Canc Inst, Dept Pathol, Boston, MA USA
[19] Harvard TH Chan Sch Publ Hlth, Dept Epidemiol, Boston, MA USA
[20] Broad Inst MIT & Harvard, Cambridge, MA USA
[21] Cedars Sinai Med Ctr, Dept Pathol, Los Angeles, CA USA
[22] Univ Penn, Dept Pathol & Lab Med, Perelman Sch Med, Philadelphia, PA USA
[23] Harvard Univ, Harvard Data Sci Initiat, Cambridge, MA 02138 USA
基金
美国国家卫生研究院;
关键词
ARTIFICIAL-INTELLIGENCE;
D O I
10.1038/s41586-024-07894-z
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Histopathology image evaluation is indispensable for cancer diagnoses and subtype classification. Standard artificial intelligence methods for histopathology image analyses have focused on optimizing specialized models for each diagnostic task1,2. Although such methods have achieved some success, they often have limited generalizability to images generated by different digitization protocols or samples collected from different populations3. Here, to address this challenge, we devised the Clinical Histopathology Imaging Evaluation Foundation (CHIEF) model, a general-purpose weakly supervised machine learning framework to extract pathology imaging features for systematic cancer evaluation. CHIEF leverages two complementary pretraining methods to extract diverse pathology representations: unsupervised pretraining for tile-level feature identification and weakly supervised pretraining for whole-slide pattern recognition. We developed CHIEF using 60,530 whole-slide images spanning 19 anatomical sites. Through pretraining on 44 terabytes of high-resolution pathology imaging datasets, CHIEF extracted microscopic representations useful for cancer cell detection, tumour origin identification, molecular profile characterization and prognostic prediction. We successfully validated CHIEF using 19,491 whole-slide images from 32 independent slide sets collected from 24 hospitals and cohorts internationally. Overall, CHIEF outperformed the state-of-the-art deep learning methods by up to 36.1%, showing its ability to address domain shifts observed in samples from diverse populations and processed by different slide preparation methods. CHIEF provides a generalizable foundation for efficient digital pathology evaluation for patients with cancer. A study describes the development of a generalizable foundation machine learning framework to extract pathology imaging features for cancer diagnosis and prognosis prediction.
引用
收藏
页码:970 / 978
页数:25
相关论文
共 50 条
  • [21] A radiopathomics model for prognosis prediction in patients with gastric cancer
    Zhao, Yuanshen
    Duan, Jingxian
    Li, Zhi-Cheng
    Chai, Ningli
    Li, Longsong
    2022 14TH BIOMEDICAL ENGINEERING INTERNATIONAL CONFERENCE (BMEICON 2022), 2022,
  • [22] Application of Deep Learning in Cancer Prognosis Prediction Model
    Zhang, Heng
    Xi, Qianyi
    Zhang, Fan
    Li, Qixuan
    Jiao, Zhuqing
    Ni, Xinye
    TECHNOLOGY IN CANCER RESEARCH & TREATMENT, 2023, 22
  • [23] Application of deep learning in cancer prognosis prediction model
    Chen W.
    Wang X.
    Duan H.
    Zhang X.
    Dong T.
    Nie S.
    1600, West China Hospital, Sichuan Institute of Biomedical Engineering (37): : 918 - 929
  • [24] Prognosis and prediction in medicine and pathology in a historical context
    Mozgovoi, S.
    Abrosimova, E.
    Kononov, A.
    VIRCHOWS ARCHIV, 2021, 479 (SUPPL 1) : S126 - S126
  • [25] Predicting Nottingham grade in breast cancer digital pathology using a foundation model
    Jun Seo Kim
    Jeong Hoon Lee
    Yousung Yeon
    Do-Yeon An
    Seok Jun Kim
    Myung-Giun Noh
    Suehyun Lee
    Breast Cancer Research, 27 (1)
  • [26] MicroRNAs as biomarkers for early breast cancer diagnosis, prognosis and therapy prediction
    Nassar, Farah J.
    Nasr, Rihab
    Talhouk, Rabih
    PHARMACOLOGY & THERAPEUTICS, 2017, 172 : 34 - 49
  • [27] Exosomal microRNAs in breast cancer and their potential in diagnosis, prognosis and treatment prediction
    Faraji, Ghazale
    Moeini, Pedram
    Ranjbar, Mohammad Hasan
    PATHOLOGY RESEARCH AND PRACTICE, 2022, 238
  • [28] Metabolomic Biomarkers of Prostate Cancer: Prediction, Diagnosis, Progression, Prognosis, and Recurrence
    Kelly, Rachel S.
    Heiden, Matthew G. Vander
    Giovannucci, Edward
    Mucci, Lorelei A.
    CANCER EPIDEMIOLOGY BIOMARKERS & PREVENTION, 2016, 25 (06) : 887 - 906
  • [29] Role of Artificial Intelligence and Machine Learning in Prediction, Diagnosis, and Prognosis of Cancer
    Gaur, Kritika
    Jagtap, Miheer M.
    CUREUS JOURNAL OF MEDICAL SCIENCE, 2022, 14 (11)
  • [30] Diagnosis and prognosis prediction of pancreatic cancer by 5-aminolevulinic acid
    Ikeura, Tsukasa
    Hori, Yuichi
    Mitsuyama, Toshiyuki
    Miyoshi, Hideaki
    Shimatani, Masaaki
    Takaoka, Makoto
    Okazaki, Kazuichi
    JOURNAL OF GASTROENTEROLOGY AND HEPATOLOGY, 2019, 34 : 296 - 296