BTDNet: A Multi-Modal Approach for Brain Tumor Radiogenomic Classification

被引:1
|
作者
Kollias, Dimitrios [1 ]
Vendal, Karanjot [1 ]
Gadhavi, Priyankaben [1 ]
Russom, Solomon [1 ]
机构
[1] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 21期
关键词
RSNA-ASNR-MICCAI BraTS 2021 Challenge; brain tumor radiogenomic classification; prediction of MGMT promoter methylation status; BTDNet; multimodal approach; routing; mask layer; MixAugment; multi-class focal loss; volume-level annotations; variable-length data;
D O I
10.3390/app132111984
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Brain tumors pose significant health challenges worldwide, with glioblastoma being one of the most aggressive forms. The accurate determination of the O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation status is crucial for personalized treatment strategies. However, traditional methods are labor-intensive and time-consuming. This paper proposes a novel multi-modal approach, BTDNet, that leverages multi-parametric MRI scans, including FLAIR, T1w, T1wCE, and T2 3D volumes, to predict the MGMT promoter methylation status. BTDNet's main contribution involves addressing two main challenges: the variable volume lengths (i.e., each volume consists of a different number of slices) and the volume-level annotations (i.e., the whole 3D volume is annotated and not the independent slices that it consists of). BTDNet consists of four components: (i) data augmentation (which performs geometric transformations, convex combinations of data pairs, and test-time data augmentation); (ii) 3D analysis (which performs global analysis through a CNN-RNN); (iii) routing (which contains a mask layer that handles variable input feature lengths); and (iv) modality fusion (which effectively enhances data representation, reduces ambiguities, and mitigates data scarcity). The proposed method outperformed state-of-the-art methods in the RSNA-ASNR-MICCAI BraTS 2021 Challenge by at least 3.3% in terms of the F1 score, offering a promising avenue for enhancing brain tumor diagnosis and treatment.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] An Attentive Multi-Modal CNN for Brain Tumor Radiogenomic Classification
    Qu, Ruyi
    Xiao, Zhifeng
    INFORMATION, 2022, 13 (03)
  • [2] Deep Learning Approach for Radiogenomic Classification of Brain Tumor
    Spoorthy, K. R.
    Mahdev, Akash R.
    Vaishnav, B.
    Shruthi, M. L. J.
    2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [3] MULTI-MODAL APPROACH TO INDEXING AND CLASSIFICATION
    SWIFT, DF
    WINN, VA
    BRAMER, DA
    INTERNATIONAL CLASSIFICATION, 1977, 4 (02): : 90 - 94
  • [4] Multi-modal Transformer for Brain Tumor Segmentation
    Cho, Jihoon
    Park, Jinah
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2022, 2023, 13769 : 138 - 148
  • [5] Multi-modal PixelNet for Brain Tumor Segmentation
    Islam, Mobarakol
    Ren, Hongliang
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2017, 2018, 10670 : 298 - 308
  • [6] Multi-modal Music Genre Classification Approach
    Zhen, Chao
    Xu, Jieping
    PROCEEDINGS OF 2010 3RD IEEE INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION TECHNOLOGY (ICCSIT 2010), VOL 8, 2010, : 398 - 402
  • [7] A MULTI-MODAL TRANSFORMER APPROACH FOR FOOTBALL EVENT CLASSIFICATION
    Zhang, Yixiao
    Li, Baihua
    Fang, Hui
    Meng, Qinggang
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2220 - 2224
  • [8] A multi-modal approach for activity classification and fall detection
    Carlos Castillo, Jose
    Carneiro, Davide
    Serrano-Cuerda, Juan
    Novais, Paulo
    Fernandez-Caballero, Antonio
    Neves, Jose
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2014, 45 (04) : 810 - 824
  • [9] A Stratified Cascaded Approach for Brain Tumor Segmentation with the Aid of Multi-modal Synthetic Data
    Al Khalil, Yasmina
    Ayaz, Aymen
    Lorenz, Cristian
    Weese, Jurgen
    Pluim, Josien
    Breeuwer, Marcel
    DATA AUGMENTATION, LABELLING, AND IMPERFECTIONS (DALI 2022), 2022, 13567 : 92 - 101
  • [10] Multi-Modal Hybrid Encoding Approach Based on Information Bottleneck for Brain Tumor Grading
    Yu, Luyue
    Liu, Chengyuan
    Qu, Aixi
    Wu, Qiang
    Liu, Ju
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 651 - 655