BTDNet: A Multi-Modal Approach for Brain Tumor Radiogenomic Classification

被引:1
|
作者
Kollias, Dimitrios [1 ]
Vendal, Karanjot [1 ]
Gadhavi, Priyankaben [1 ]
Russom, Solomon [1 ]
机构
[1] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 21期
关键词
RSNA-ASNR-MICCAI BraTS 2021 Challenge; brain tumor radiogenomic classification; prediction of MGMT promoter methylation status; BTDNet; multimodal approach; routing; mask layer; MixAugment; multi-class focal loss; volume-level annotations; variable-length data;
D O I
10.3390/app132111984
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Brain tumors pose significant health challenges worldwide, with glioblastoma being one of the most aggressive forms. The accurate determination of the O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation status is crucial for personalized treatment strategies. However, traditional methods are labor-intensive and time-consuming. This paper proposes a novel multi-modal approach, BTDNet, that leverages multi-parametric MRI scans, including FLAIR, T1w, T1wCE, and T2 3D volumes, to predict the MGMT promoter methylation status. BTDNet's main contribution involves addressing two main challenges: the variable volume lengths (i.e., each volume consists of a different number of slices) and the volume-level annotations (i.e., the whole 3D volume is annotated and not the independent slices that it consists of). BTDNet consists of four components: (i) data augmentation (which performs geometric transformations, convex combinations of data pairs, and test-time data augmentation); (ii) 3D analysis (which performs global analysis through a CNN-RNN); (iii) routing (which contains a mask layer that handles variable input feature lengths); and (iv) modality fusion (which effectively enhances data representation, reduces ambiguities, and mitigates data scarcity). The proposed method outperformed state-of-the-art methods in the RSNA-ASNR-MICCAI BraTS 2021 Challenge by at least 3.3% in terms of the F1 score, offering a promising avenue for enhancing brain tumor diagnosis and treatment.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Automated brain tumor segmentation on multi-modal MR image using SegNet
    Alqazzaz, Salma
    Sun, Xianfang
    Yang, Xin
    Nokes, Len
    COMPUTATIONAL VISUAL MEDIA, 2019, 5 (02) : 209 - 219
  • [42] QMLS: quaternion mutual learning strategy for multi-modal brain tumor segmentation
    Deng, Zhengnan
    Huang, Guoheng
    Yuan, Xiaochen
    Zhong, Guo
    Lin, Tongxu
    Pun, Chi-Man
    Huang, Zhixin
    Liang, Zhixin
    PHYSICS IN MEDICINE AND BIOLOGY, 2024, 69 (01):
  • [43] Improved Sentiment Classification by Multi-modal Fusion
    Gan, Lige
    Benlamri, Rachid
    Khoury, Richard
    2017 THIRD IEEE INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND APPLICATIONS (IEEE BIGDATASERVICE 2017), 2017, : 11 - 16
  • [44] Exploiting Partial Common Information Microstructure for Multi-modal Brain Tumor Segmentation
    Mei, Yongsheng
    Venkataramani, Guru
    Lan, Tian
    MACHINE LEARNING FOR MULTIMODAL HEALTHCARE DATA, ML4MHD 2023, 2024, 14315 : 64 - 85
  • [45] Multi-Modal Brain Tumor Data Completion Based on Reconstruction Consistency Loss
    Jiang, Yang
    Zhang, Shuang
    Chi, Jianning
    JOURNAL OF DIGITAL IMAGING, 2023, 36 (04) : 1794 - 1807
  • [46] COMETE: An Innovative Multi-Modal Program for Pediatric Brain Tumor Survivors and Their Family
    Pouchepadass, C.
    Lopez, C.
    Karsenti, L.
    Longaud, A.
    Da-Fonseca, C.
    Flahault, C.
    PEDIATRIC BLOOD & CANCER, 2019, 66 : S475 - S475
  • [47] Multi-modal Approach for Affective Computing
    Siddharth
    Jung, Tzyy-Ping
    Sejnowski, Terrence J.
    2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 291 - 294
  • [48] Multi-modal classification in digital news libraries
    Chen, MY
    Hauptmann, A
    JCDL 2004: PROCEEDINGS OF THE FOURTH ACM/IEEE JOINT CONFERENCE ON DIGITAL LIBRARIES: GLOBAL REACH AND DIVERSE IMPACT, 2004, : 212 - 213
  • [49] A Multi-modal Approach for Highway Assessment
    Mailer, Markus
    INTERNATIONAL SYMPOSIUM ON ENHANCING HIGHWAY PERFORMANCE (ISEHP), (7TH INTERNATIONAL SYMPOSIUM ON HIGHWAY CAPACITY AND QUALITY OF SERVICE, 3RD INTERNATIONAL SYMPOSIUM ON FREEWAY AND TOLLWAY OPERATIONS), 2016, 15 : 113 - 121
  • [50] A Hybrid Multi-Modal Approach For Flocking
    Lodge, Riley
    Zamani, Mohammad
    Marsh, Luke
    Sims, Brendan
    Hunjet, Robert
    2019 12TH ASIAN CONTROL CONFERENCE (ASCC), 2019, : 126 - 131