Combined molecular subtyping, grading, and segmentation of glioma using multi-task deep learning

被引:49
|
作者
van der Voort, Sebastian R. [1 ]
Incekara, Fatih [2 ,3 ]
Wijnenga, Maarten M. J. [4 ]
Kapsas, Georgios [2 ]
Gahrmann, Renske [2 ]
Schouten, Joost W. [3 ]
Tewarie, Rishi Nandoe [5 ]
Lycklama, Geert J. [6 ]
Hamer, Philip C. De Witt [9 ]
Eijgelaar, Roelant S. [9 ]
French, Pim J. [4 ]
Dubbink, Hendrikus J. [7 ]
Vincent, Arnaud J. P. E. [3 ]
Niessen, Wiro J. [1 ,8 ]
van den Bent, Martin J. [4 ]
Smits, Marion [2 ]
Klein, Stefan [1 ]
机构
[1] Erasmus MC Univ Med Ctr Rotterdam, Dept Radiol & Nucl Med, Biomed Imaging Grp Rotterdam, Dr Molewaterpl 50-60, NL-3015 GE Rotterdam, Netherlands
[2] Erasmus MC Univ Med Ctr Rotterdam, Dept Radiol & Nucl Med, Rotterdam, Netherlands
[3] Erasmus MC Univ Med Ctr Rotterdam, Brain Tumor Ctr, Dept Neurosurg, Rotterdam, Netherlands
[4] Erasmus MC, Brain Tumor Ctr, Dept Neurol, Canc Inst, Rotterdam, Netherlands
[5] Haaglanden Med Ctr, Dept Neurosurg, The Hague, Netherlands
[6] Haaglanden Med Ctr, Dept Radiol, The Hague, Netherlands
[7] Brain Tumor Ctr Erasmus MC Canc Inst, Dept Pathol, Rotterdam, Netherlands
[8] Delft Univ Technol, Fac Appl Sci, Imaging Phys, Delft, Netherlands
[9] Amsterdam UMC, Brain Tumor Ctr, Dept Neurosurg, Canc Ctr Amsterdam, Amsterdam, Netherlands
关键词
deep learning; glioma; multi-task; radiomics; segmentation; CENTRAL-NERVOUS-SYSTEM; RADIOMICS; CLASSIFICATION; CHALLENGES; TUMORS;
D O I
10.1093/neuonc/noac166
中图分类号
R73 [肿瘤学];
学科分类号
100214 ;
摘要
Background Accurate characterization of glioma is crucial for clinical decision making. A delineation of the tumor is also desirable in the initial decision stages but is time-consuming. Previously, deep learning methods have been developed that can either non-invasively predict the genetic or histological features of glioma, or that can automatically delineate the tumor, but not both tasks at the same time. Here, we present our method that can predict the molecular subtype and grade, while simultaneously providing a delineation of the tumor. Methods We developed a single multi-task convolutional neural network that uses the full 3D, structural, preoperative MRI scans to predict the IDH mutation status, the 1p/19q co-deletion status, and the grade of a tumor, while simultaneously segmenting the tumor. We trained our method using a patient cohort containing 1508 glioma patients from 16 institutes. We tested our method on an independent dataset of 240 patients from 13 different institutes. Results In the independent test set, we achieved an IDH-AUC of 0.90, an 1p/19q co-deletion AUC of 0.85, and a grade AUC of 0.81 (grade II/III/IV). For the tumor delineation, we achieved a mean whole tumor Dice score of 0.84. Conclusions We developed a method that non-invasively predicts multiple, clinically relevant features of glioma. Evaluation in an independent dataset shows that the method achieves a high performance and that it generalizes well to the broader clinical population. This first-of-its-kind method opens the door to more generalizable, instead of hyper-specialized, AI methods.
引用
收藏
页码:279 / 289
页数:11
相关论文
共 50 条
  • [41] A multi-task learning model for clinically interpretable sesamoiditis grading
    Guo, Li
    Tahir, Anas M.
    Hore, Michael
    Collins, Andrew
    Rideout, Andrew
    Wang, Z. Jane
    Computers in Biology and Medicine, 2024, 182
  • [42] Cancer Classification with Multi-task Deep Learning
    Liao, Qing
    Jiang, Lin
    Wang, Xuan
    Zhang, Chunkai
    Ding, Ye
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 76 - 81
  • [43] Deep Learning for Multi-task Plant Phenotyping
    Pound, Michael P.
    Atkinson, Jonathan A.
    Wells, Darren M.
    Pridmore, Tony P.
    French, Andrew P.
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 2055 - 2063
  • [44] Multi-task Deep Learning for Image Understanding
    Yu, Bo
    Lane, Ian
    2014 6TH INTERNATIONAL CONFERENCE OF SOFT COMPUTING AND PATTERN RECOGNITION (SOCPAR), 2014, : 37 - 42
  • [45] Deep Asymmetric Multi-task Feature Learning
    Lee, Hae Beom
    Yang, Eunho
    Hwang, Sung Ju
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [46] A Multi-Task Based Deep Learning Framework With Landmark Detection for MRI Couinaud Segmentation
    Miao, Dong
    Zhao, Ying
    Ren, Xue
    Dou, Meng
    Yao, Yu
    Xu, Yiran
    Cui, Yingchao
    Liu, Ailian
    IEEE Journal of Translational Engineering in Health and Medicine, 2024, 12 : 697 - 710
  • [47] Deep multi-task learning for a geographically-regularized semantic segmentation of aerial images
    Volpi, Michele
    Tuia, Devis
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 144 : 48 - 60
  • [48] Interdependent Multi-task Learning for Simultaneous Segmentation and Detection
    Reginthala, Mahesh
    Iwahori, Yuji
    Bhuyan, M. K.
    Hayashi, Yoshitsugu
    Achariyaviriya, Witsarut
    Kijsirikul, Boonserm
    ICPRAM: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS, 2020, : 167 - 174
  • [49] Multi-task Federated Learning for Heterogeneous Pancreas Segmentation
    Shen, Chen
    Wang, Pochuan
    Roth, Holger R.
    Yang, Dong
    Xu, Daguang
    Oda, Masahiro
    Wang, Weichung
    Fuh, Chiou-Shann
    Chen, Po-Ting
    Liu, Kao-Lang
    Liao, Wei-Chih
    Mori, Kensaku
    CLINICAL IMAGE-BASED PROCEDURES, DISTRIBUTED AND COLLABORATIVE LEARNING, ARTIFICIAL INTELLIGENCE FOR COMBATING COVID-19 AND SECURE AND PRIVACY-PRESERVING MACHINE LEARNING, CLIP 2021, DCL 2021, LL-COVID19 2021, PPML 2021, 2021, 12969 : 101 - 110
  • [50] Multi-Task Learning and Multimodal Fusion for Road Segmentation
    Cheng, Bowen
    Tian, Miaomiao
    Jiang, Shuai
    Liu, Weiwei
    Pang, Yalong
    IEEE ACCESS, 2023, 11 : 18947 - 18959