Interpretable deep learning model to predict the molecular classification of endometrial cancer from haematoxylin and eosin-stained whole-slide images: a combined analysis of the PORTEC randomised trials and clinical cohorts

被引:28
|
作者
Fremond, Sarah [1 ]
Andani, Sonali [4 ,5 ,6 ]
Wolf, Jurriaan Barkey [1 ]
Dijkstra, Jouke [2 ]
Melsbach, Sinead [1 ]
Jobsen, Jan J. [7 ]
Brinkhuis, Mariel [8 ]
Roothaan, Suzan [8 ]
Jurgenliemk-Schulz, Ina [9 ]
Lutgens, Ludy C. H. W. [10 ]
Nout, Remi A. [11 ]
van der Steen-Banasik, Elzbieta M. [12 ]
de Boer, Stephanie M. [3 ]
Powell, Melanie E. [13 ]
Singh, Naveena [14 ]
Mileshkin, Linda R. [15 ]
Mackay, Helen J. [16 ]
Leary, Alexandra [17 ]
Nijman, Hans W. [18 ]
Smit, Vincent T. H. B. M. [1 ]
Creutzberg, Carien L. [3 ]
Horeweg, Nanda [3 ]
Koelzer, Viktor H. [5 ,20 ]
Bosse, Tjalling [1 ,19 ]
机构
[1] Leiden Univ, Dept Pathol, Med Ctr, Leiden, Netherlands
[2] Leiden Univ, Dept Vasc & Mol Imaging J Dijkstra PhD, Med Ctr, Leiden, Netherlands
[3] Leiden Univ, Dept Radiat Oncol, Med Ctr, Leiden, Netherlands
[4] Swiss Fed Inst Technol, Dept Comp Sci, Zurich, Switzerland
[5] Univ Zurich, Univ Hosp Zurich, Dept Pathol & Mol Pathol, Zurich, Switzerland
[6] Swiss Inst Bioinformat, Lausanne, Switzerland
[7] Med Spectrum Twente, Dept Radiat Oncol, Enschede, Netherlands
[8] LabPON, Dept Pathol, Hengelo, Netherlands
[9] Univ Med Ctr Utrecht, Dept Radiat Oncol, Utrecht, Netherlands
[10] Maastricht Univ, Dept Radiat Oncol, Med Ctr, Maastricht, Netherlands
[11] Erasmus Univ, Dept Radiat Oncol, Med Ctr, Rotterdam, Netherlands
[12] Radiotherapiegroep, Dept Radiat Oncol, Arnhem, Netherlands
[13] Barts Hlth NHS Trust, Dept Clin Oncol, London, England
[14] Barts Hlth NHS Trust, Dept Pathol, London, England
[15] Peter MacCallum Canc Ctr, Dept Med Oncol, Melbourne, Vic, Australia
[16] Odette Canc Ctr Sunnybrook, Dept Med Oncol & Hematol, Hlth Sci Ctr, Toronto, ON, Canada
[17] Gustave Roussy Inst, Med Oncol Dept, Villejuif, France
[18] Univ Med Ctr Groningen, Dept Obstet & Gynecol, Groningen, Netherlands
[19] Leiden Univ, Dept Pathol, Med Ctr, NL-2300 RC Leiden, Netherlands
[20] Univ Zurich, Univ Hosp Zurich, Dept Pathol & Mol Pathol, CH-8091 Zurich, Switzerland
来源
LANCET DIGITAL HEALTH | 2023年 / 5卷 / 02期
关键词
OPEN-LABEL; RADIOTHERAPY; MULTICENTER;
D O I
10.1016/S2589-7500(22)00210-2
中图分类号
R-058 [];
学科分类号
摘要
Background Endometrial cancer can be molecularly classified into POLEmut , mismatch repair deficient (MMRd), p53 abnormal (p53abn), and no specific molecular profile (NSMP) subgroups. We aimed to develop an interpretable deep learning pipeline for whole-slide-image-based prediction of the four molecular classes in endometrial cancer (im4MEC), to identify morpho-molecular correlates, and to refine prognostication. Methods This combined analysis included diagnostic haematoxylin and eosin-stained slides and molecular and clinicopathological data from 2028 patients with intermediate-to-high-risk endometrial cancer from the PORTEC-1 (n=466), PORTEC-2 (n=375), and PORTEC-3 (n=393) randomised trials and the TransPORTEC pilot study (n=110), the Medisch Spectrum Twente cohort (n=242), a case series of patients with POLEmut endometrial cancer in the Leiden Endometrial Cancer Repository (n=47), and The Cancer Genome Atlas-Uterine Corpus Endometrial Carcinoma cohort (n=395). PORTEC-3 was held out as an independent test set and a four-fold cross validation was performed. Performance was measured with the macro and class-wise area under the receiver operating characteristic curve (AUROC). Whole-slide images were segmented into tiles of 360 & mu;m resized to 224 x 224 pixels. im4MEC was trained to learn tile-level morphological features with self-supervised learning and to molecularly classify whole-slide images with an attention mechanism. The top 20 tiles with the highest attention scores were reviewed to identify morpho-molecular correlates. Predictions of a nuclear classification deep learning model serve to derive interpretable morphological features. We analysed 5-year recurrence-free survival and explored prognostic refinement by molecular class using the Kaplan-Meier method. Findings im4MEC attained macro-average AUROCs of 0 & BULL;874 (95% CI 0 & BULL;856-0 & BULL;893) on four-fold cross-validation and 0 & BULL;876 on the independent test set. The class-wise AUROCs were 0 & BULL;849 for POLEmut (n=51), 0 & BULL;844 for MMRd (n=134), 0 & BULL;883 for NSMP (n=120), and 0 & BULL;928 for p53abn (n=88). POLEmut and MMRd tiles had a high density of lymphocytes, p53abn tiles had strong nuclear atypia, and the morphology of POLEmut and MMRd endometrial cancer overlapped. im4MEC highlighted a low tumour-to-stroma ratio as a potentially novel characteristic feature of the NSMP class. 5-year recurrence-free survival was significantly different between im4MEC predicted molecular classes in PORTEC-3 (log-rank p<0 & BULL;0001). The ten patients with aggressive p53abn endometrial cancer that was predicted as MMRd showed inflammatory morphology and appeared to have a better prognosis than patients with correctly predicted p53abn endometrial cancer (p=0 & BULL;30). The four patients with NSMP endometrial cancer that was predicted as p53abn showed higher nuclear atypia and appeared to have a worse prognosis than patients with correctly predicted NSMP (p=0 & BULL;13). Patients with MMRd endometrial cancer predicted as POLEmut had an excellent prognosis, as do those with true POLEmut endometrial cancer. Interpretation We present the first interpretable deep learning model, im4MEC, for haematoxylin and eosin-based prediction of molecular endometrial cancer classification. im4MEC robustly identified morpho-molecular correlates and could enable further prognostic refinement of patients with endometrial cancer. Copyright & COPY; 2022 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 license.
引用
收藏
页码:e71 / e82
页数:12
相关论文
共 9 条
  • [1] Deep learning-based approach to predict multiple genetic mutations in colorectal and lung cancer tissues using hematoxylin and eosin-stained whole-slide images
    Konishi, Teppei
    Grynkiewicz, Mateusz
    Saito, Keita
    Kobayashi, Takuma
    Goto, Akiteru
    Umakoshi, Michinobu
    Iwata, Takashi
    Nishio, Hiroshi
    Katoh, Yuki
    Fujita, Tomonobu
    Matsui, Tomoya
    Sugawara, Masaki
    Sano, Hiroyuki
    [J]. JOURNAL OF CLINICAL ONCOLOGY, 2023, 41 (16)
  • [2] Novel deep learning-based prognostic prediction model for colorectal cancer using hematoxylin and eosin-stained whole slide images.
    Konishi, Teppei
    Grynkiewicz, Mateusz
    Saito, Keita
    Kobayashi, Takuma
    Goto, Akiteru
    Umakoshi, Michinobu
    Iwata, Takashi
    Nishio, Hiroshi
    Katoh, Yuki
    Fujita, Tomonobu
    Matsui, Tomoya
    Sugawara, Masaki
    Sano, Hiroyuki
    [J]. JOURNAL OF CLINICAL ONCOLOGY, 2023, 41 (16)
  • [3] Deep learning-based molecular characterization of lung cancers from never smokers using hematoxylin and eosin-stained whole slide images
    Saha, Monjoy
    Zhang, Tongwu
    Bhawsar, Praphulla
    Zhao, Wei
    Shi, Jianxin
    Yang, Soo Ryum
    Almeida, Jonas
    Landi, Maria Teresa
    [J]. CANCER RESEARCH, 2024, 84 (07)
  • [4] Deep Learning-Based Stratification of Gastric Cancer Patients from Hematoxylin and Eosin-Stained Whole Slide Images by Predicting Molecular Features for Immunotherapy Response
    Wei, Zheng
    Zhao, Xu
    Chen, Jing
    Sun, Qiuyan
    Wang, Zeyang
    Wang, Yanli
    Ye, Zhiyi
    Yuan, Yuan
    Sun, Liping
    Jing, Jingjing
    [J]. AMERICAN JOURNAL OF PATHOLOGY, 2023, 193 (10): : 1517 - 1527
  • [5] Prediction of OncotypeDX high risk group for chemotherapy benefit in breast cancer by deep learning analysis of hematoxylin and eosin-stained whole slide images
    Shamai, Gil
    Schley, Ran
    Kimmel, Ron
    Balint-Lahat, Nora
    Barshack, Iris
    Mayer, Chen
    [J]. CANCER RESEARCH, 2023, 83 (07)
  • [6] Comparison of deep learning approaches applied to hematoxylin and eosin-stained whole slide images from women with benign breast disease to predict risk of developing invasive breast cancer
    Saha, Monjoy
    Abubakar, Mustapha
    Rohan, Thomas E.
    Pfeiffer, Ruth M.
    Duggan, Maire A.
    Richert-Boe, Kathryn
    Figueroa, Jonine D.
    Almeida, Jonas S.
    Gierach, Gretchen L.
    [J]. CANCER RESEARCH, 2023, 83 (07)
  • [7] Deep Learning-Based Classification of Uterine Cervical and Endometrial Cancer Subtypes from Whole-Slide Histopathology Images
    Song, JaeYen
    Im, Soyoung
    Lee, Sung Hak
    Jang, Hyun-Jong
    [J]. DIAGNOSTICS, 2022, 12 (11)
  • [8] Utility of artificial intelligence with deep learning of hematoxylin and eosin-stained whole slide images to predict lymph node metastasis in T1 colorectal cancer using endoscopically resected specimens; prediction of lymph node metastasis in T1 colorectal cancer
    Joo Hye Song
    Yiyu Hong
    Eun Ran Kim
    Seok-Hyung Kim
    Insuk Sohn
    [J]. Journal of Gastroenterology, 2022, 57 : 654 - 666
  • [9] Utility of artificial intelligence with deep learning of hematoxylin and eosin-stained whole slide images to predict lymph node metastasis in T1 colorectal cancer using endoscopically resected specimens; prediction of lymph node metastasis in T1 colorectal cancer
    Song, Joo Hye
    Hong, Yiyu
    Kim, Eun Ran
    Kim, Seok-Hyung
    Sohn, Insuk
    [J]. JOURNAL OF GASTROENTEROLOGY, 2022, 57 (09) : 654 - 666