Combined molecular subtyping, grading, and segmentation of glioma using multi-task deep learning

被引:49
|
作者
van der Voort, Sebastian R. [1 ]
Incekara, Fatih [2 ,3 ]
Wijnenga, Maarten M. J. [4 ]
Kapsas, Georgios [2 ]
Gahrmann, Renske [2 ]
Schouten, Joost W. [3 ]
Tewarie, Rishi Nandoe [5 ]
Lycklama, Geert J. [6 ]
Hamer, Philip C. De Witt [9 ]
Eijgelaar, Roelant S. [9 ]
French, Pim J. [4 ]
Dubbink, Hendrikus J. [7 ]
Vincent, Arnaud J. P. E. [3 ]
Niessen, Wiro J. [1 ,8 ]
van den Bent, Martin J. [4 ]
Smits, Marion [2 ]
Klein, Stefan [1 ]
机构
[1] Erasmus MC Univ Med Ctr Rotterdam, Dept Radiol & Nucl Med, Biomed Imaging Grp Rotterdam, Dr Molewaterpl 50-60, NL-3015 GE Rotterdam, Netherlands
[2] Erasmus MC Univ Med Ctr Rotterdam, Dept Radiol & Nucl Med, Rotterdam, Netherlands
[3] Erasmus MC Univ Med Ctr Rotterdam, Brain Tumor Ctr, Dept Neurosurg, Rotterdam, Netherlands
[4] Erasmus MC, Brain Tumor Ctr, Dept Neurol, Canc Inst, Rotterdam, Netherlands
[5] Haaglanden Med Ctr, Dept Neurosurg, The Hague, Netherlands
[6] Haaglanden Med Ctr, Dept Radiol, The Hague, Netherlands
[7] Brain Tumor Ctr Erasmus MC Canc Inst, Dept Pathol, Rotterdam, Netherlands
[8] Delft Univ Technol, Fac Appl Sci, Imaging Phys, Delft, Netherlands
[9] Amsterdam UMC, Brain Tumor Ctr, Dept Neurosurg, Canc Ctr Amsterdam, Amsterdam, Netherlands
关键词
deep learning; glioma; multi-task; radiomics; segmentation; CENTRAL-NERVOUS-SYSTEM; RADIOMICS; CLASSIFICATION; CHALLENGES; TUMORS;
D O I
10.1093/neuonc/noac166
中图分类号
R73 [肿瘤学];
学科分类号
100214 ;
摘要
Background Accurate characterization of glioma is crucial for clinical decision making. A delineation of the tumor is also desirable in the initial decision stages but is time-consuming. Previously, deep learning methods have been developed that can either non-invasively predict the genetic or histological features of glioma, or that can automatically delineate the tumor, but not both tasks at the same time. Here, we present our method that can predict the molecular subtype and grade, while simultaneously providing a delineation of the tumor. Methods We developed a single multi-task convolutional neural network that uses the full 3D, structural, preoperative MRI scans to predict the IDH mutation status, the 1p/19q co-deletion status, and the grade of a tumor, while simultaneously segmenting the tumor. We trained our method using a patient cohort containing 1508 glioma patients from 16 institutes. We tested our method on an independent dataset of 240 patients from 13 different institutes. Results In the independent test set, we achieved an IDH-AUC of 0.90, an 1p/19q co-deletion AUC of 0.85, and a grade AUC of 0.81 (grade II/III/IV). For the tumor delineation, we achieved a mean whole tumor Dice score of 0.84. Conclusions We developed a method that non-invasively predicts multiple, clinically relevant features of glioma. Evaluation in an independent dataset shows that the method achieves a high performance and that it generalizes well to the broader clinical population. This first-of-its-kind method opens the door to more generalizable, instead of hyper-specialized, AI methods.
引用
收藏
页码:279 / 289
页数:11
相关论文
共 50 条
  • [1] Comprehensive Genomic Subtyping of Glioma Using Semi-Supervised Multi-Task Deep Learning on Multimodal MRI
    Tupe-Waghmare, Priyanka
    Malpure, Piyush
    Kotecha, Ketan
    Beniwal, Manish
    Santosh, Vani
    Saini, Jitender
    Ingalhalikar, Madhura
    IEEE ACCESS, 2021, 9 : 167900 - 167910
  • [2] Multi-task Deep Learning for Colon Cancer Grading
    Thi Le Trinh Vuong
    Lee, Daigeun
    Kwak, Jin Tae
    Kim, Kyungeun
    2020 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2020,
  • [3] Multi-Task Learning for Diabetic Retinopathy Grading and Lesion Segmentation
    Foo, Alex
    Hsu, Wynne
    Lee, Mong Li
    Lim, Gilbert
    Wong, Tien Yin
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 13267 - 13272
  • [4] Multi-Task Deep Learning for Image Segmentation Using Recursive Approximation Tasks
    Ke, Rihuan
    Bugeau, Aurelie
    Papadakis, Nicolas
    Kirkland, Mark
    Schuetz, Peter
    Schonlieb, Carola-Bibiane
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3555 - 3567
  • [5] Severity Grading of Psoriatic Plaques using Deep CNN based Multi-task Learning
    Pal, Anabik
    Chaturvedi, Akshay
    Garain, Utpal
    Chandra, Aditi
    Chatterjee, Raghunath
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 1478 - 1483
  • [6] Deep Multi-Task Learning for Diabetic Retinopathy Grading in Fundus Images
    Wang, Xiaofei
    Xu, Mai
    Zhang, Jicong
    Jiang, Lai
    Li, Liu
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2826 - 2834
  • [7] A Deep Multi-Task Learning Framework for Brain Tumor Segmentation
    Huang, He
    Yang, Guang
    Zhang, Wenbo
    Xu, Xiaomei
    Yang, Weiji
    Jiang, Weiwei
    Lai, Xiaobo
    FRONTIERS IN ONCOLOGY, 2021, 11
  • [8] MULTI-TASK DEEP LEARNING FOR SATELLITE IMAGE PANSHARPENING AND SEGMENTATION
    Khalel, Andrew
    Tasar, Onur
    Charpiat, Guillaume
    Tarabalka, Yuliya
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 4869 - 4872
  • [9] Multi-task learning for gland segmentation
    Rezazadeh, Iman
    Duygulu, Pinar
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (01) : 1 - 9
  • [10] Multi-Task Learning for Subspace Segmentation
    Wang, Yu
    Wipf, David
    Ling, Qing
    Chen, Wei
    Wassell, Ian
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 1209 - 1217