Combined molecular subtyping, grading, and segmentation of glioma using multi-task deep learning

被引:49
|
作者
van der Voort, Sebastian R. [1 ]
Incekara, Fatih [2 ,3 ]
Wijnenga, Maarten M. J. [4 ]
Kapsas, Georgios [2 ]
Gahrmann, Renske [2 ]
Schouten, Joost W. [3 ]
Tewarie, Rishi Nandoe [5 ]
Lycklama, Geert J. [6 ]
Hamer, Philip C. De Witt [9 ]
Eijgelaar, Roelant S. [9 ]
French, Pim J. [4 ]
Dubbink, Hendrikus J. [7 ]
Vincent, Arnaud J. P. E. [3 ]
Niessen, Wiro J. [1 ,8 ]
van den Bent, Martin J. [4 ]
Smits, Marion [2 ]
Klein, Stefan [1 ]
机构
[1] Erasmus MC Univ Med Ctr Rotterdam, Dept Radiol & Nucl Med, Biomed Imaging Grp Rotterdam, Dr Molewaterpl 50-60, NL-3015 GE Rotterdam, Netherlands
[2] Erasmus MC Univ Med Ctr Rotterdam, Dept Radiol & Nucl Med, Rotterdam, Netherlands
[3] Erasmus MC Univ Med Ctr Rotterdam, Brain Tumor Ctr, Dept Neurosurg, Rotterdam, Netherlands
[4] Erasmus MC, Brain Tumor Ctr, Dept Neurol, Canc Inst, Rotterdam, Netherlands
[5] Haaglanden Med Ctr, Dept Neurosurg, The Hague, Netherlands
[6] Haaglanden Med Ctr, Dept Radiol, The Hague, Netherlands
[7] Brain Tumor Ctr Erasmus MC Canc Inst, Dept Pathol, Rotterdam, Netherlands
[8] Delft Univ Technol, Fac Appl Sci, Imaging Phys, Delft, Netherlands
[9] Amsterdam UMC, Brain Tumor Ctr, Dept Neurosurg, Canc Ctr Amsterdam, Amsterdam, Netherlands
关键词
deep learning; glioma; multi-task; radiomics; segmentation; CENTRAL-NERVOUS-SYSTEM; RADIOMICS; CLASSIFICATION; CHALLENGES; TUMORS;
D O I
10.1093/neuonc/noac166
中图分类号
R73 [肿瘤学];
学科分类号
100214 ;
摘要
Background Accurate characterization of glioma is crucial for clinical decision making. A delineation of the tumor is also desirable in the initial decision stages but is time-consuming. Previously, deep learning methods have been developed that can either non-invasively predict the genetic or histological features of glioma, or that can automatically delineate the tumor, but not both tasks at the same time. Here, we present our method that can predict the molecular subtype and grade, while simultaneously providing a delineation of the tumor. Methods We developed a single multi-task convolutional neural network that uses the full 3D, structural, preoperative MRI scans to predict the IDH mutation status, the 1p/19q co-deletion status, and the grade of a tumor, while simultaneously segmenting the tumor. We trained our method using a patient cohort containing 1508 glioma patients from 16 institutes. We tested our method on an independent dataset of 240 patients from 13 different institutes. Results In the independent test set, we achieved an IDH-AUC of 0.90, an 1p/19q co-deletion AUC of 0.85, and a grade AUC of 0.81 (grade II/III/IV). For the tumor delineation, we achieved a mean whole tumor Dice score of 0.84. Conclusions We developed a method that non-invasively predicts multiple, clinically relevant features of glioma. Evaluation in an independent dataset shows that the method achieves a high performance and that it generalizes well to the broader clinical population. This first-of-its-kind method opens the door to more generalizable, instead of hyper-specialized, AI methods.
引用
收藏
页码:279 / 289
页数:11
相关论文
共 50 条
  • [31] Improving Weakly Supervised Lesion Segmentation using Multi-Task Learning
    Chu, Tianshu
    Li, Xinmeng
    Vo, Huy V.
    Summers, Ronald M.
    Sizikova, Elena
    MEDICAL IMAGING WITH DEEP LEARNING, VOL 143, 2021, 143 : 60 - 73
  • [32] Label-Efficient Multi-task Segmentation Using Contrastive Learning
    Iwasawa, Junichiro
    Hirano, Yuichiro
    Sugawara, Yohei
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES (BRAINLES 2020), PT I, 2021, 12658 : 101 - 110
  • [33] X-ray Image Segmentation using Multi-task Learning
    Park, Sejin
    Jeong, Woojin
    Moon, Young Shik
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2020, 14 (03) : 1104 - 1120
  • [34] Multi-Task Learning for Pavement Disease Segmentation Using Wavelet Transform
    Wu, Junxian
    Zhang, Yujia
    Zhao, Xiaoguang
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [35] Automated echocardiographic diastolic function grading: A hybrid multi-task deep learning and machine learning approach
    Cai, Qizhe
    Lin, Mingming
    Zhang, Miao
    Qin, Yunyun
    Meng, Yuanlong
    Wang, Jiangtao
    Leng, Chenlei
    Zhu, Weiwei
    Li, Jie
    You, Junjie
    Lu, Xiuzhang
    INTERNATIONAL JOURNAL OF CARDIOLOGY, 2024, 416
  • [36] A deep ensemble learning framework for glioma segmentation and grading prediction
    Liang Wen
    Hui Sun
    Guobiao Liang
    Yue Yu
    Scientific Reports, 15 (1)
  • [37] Attentive Multi-task Deep Reinforcement Learning
    Bram, Timo
    Brunner, Gino
    Richter, Oliver
    Wattenhofer, Roger
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT III, 2020, 11908 : 134 - 149
  • [38] Multi-task Learning for Deep Semantic Hashing
    Ma, Lei
    Li, Hongliang
    Wu, Qingbo
    Shang, Chao
    Ngan, Kingngi
    2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
  • [39] A Survey of Multi-Task Deep Reinforcement Learning
    Vithayathil Varghese, Nelson
    Mahmoud, Qusay H.
    ELECTRONICS, 2020, 9 (09) : 1 - 21
  • [40] Multi-Task Deep Reinforcement Learning with PopArt
    Hessel, Matteo
    Soyer, Hubert
    Espeholt, Lasse
    Czarnecki, Wojciech
    Schmitt, Simon
    van Hasselt, Hado
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 3796 - 3803