BTDNet: A Multi-Modal Approach for Brain Tumor Radiogenomic Classification

被引:1
|
作者
Kollias, Dimitrios [1 ]
Vendal, Karanjot [1 ]
Gadhavi, Priyankaben [1 ]
Russom, Solomon [1 ]
机构
[1] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 21期
关键词
RSNA-ASNR-MICCAI BraTS 2021 Challenge; brain tumor radiogenomic classification; prediction of MGMT promoter methylation status; BTDNet; multimodal approach; routing; mask layer; MixAugment; multi-class focal loss; volume-level annotations; variable-length data;
D O I
10.3390/app132111984
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Brain tumors pose significant health challenges worldwide, with glioblastoma being one of the most aggressive forms. The accurate determination of the O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation status is crucial for personalized treatment strategies. However, traditional methods are labor-intensive and time-consuming. This paper proposes a novel multi-modal approach, BTDNet, that leverages multi-parametric MRI scans, including FLAIR, T1w, T1wCE, and T2 3D volumes, to predict the MGMT promoter methylation status. BTDNet's main contribution involves addressing two main challenges: the variable volume lengths (i.e., each volume consists of a different number of slices) and the volume-level annotations (i.e., the whole 3D volume is annotated and not the independent slices that it consists of). BTDNet consists of four components: (i) data augmentation (which performs geometric transformations, convex combinations of data pairs, and test-time data augmentation); (ii) 3D analysis (which performs global analysis through a CNN-RNN); (iii) routing (which contains a mask layer that handles variable input feature lengths); and (iv) modality fusion (which effectively enhances data representation, reduces ambiguities, and mitigates data scarcity). The proposed method outperformed state-of-the-art methods in the RSNA-ASNR-MICCAI BraTS 2021 Challenge by at least 3.3% in terms of the F1 score, offering a promising avenue for enhancing brain tumor diagnosis and treatment.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] A hybrid approach to news video classification with multi-modal features
    Wang, P
    Cai, R
    Yang, SQ
    ICICS-PCM 2003, VOLS 1-3, PROCEEDINGS, 2003, : 787 - 791
  • [22] Computerized segmentation of MR brain tumor: an integrated approach of multi-modal fusion and unsupervised clustering
    Lavanya K.G.
    Dhanalakshmi P.
    Nandhini M.
    International Journal of Information Technology, 2024, 16 (2) : 1155 - 1169
  • [23] Multi Modal Fusion for Radiogenomics Classification of Brain Tumor
    Mun, Timothy Sum Hon
    Doran, Simon
    Huang, Paul
    Messiou, Christina
    Blackledge, Matthew
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2021, PT I, 2022, 12962 : 344 - 355
  • [24] Giant prolactinomas: Multi-modal approach to achieve tumor control
    Ilan Shimon
    Endocrine, 2017, 56 : 227 - 228
  • [25] Giant prolactinomas: Multi-modal approach to achieve tumor control
    Shimon, Ilan
    ENDOCRINE, 2017, 56 (02) : 227 - 228
  • [26] Multi-category Graph Reasoning for Multi-modal Brain Tumor Segmentation
    Li, Dongzhe
    Yang, Baoyao
    Zhan, Weide
    He, Xiaochen
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VIII, 2024, 15008 : 445 - 455
  • [27] Modal-aware Visual Prompting for Incomplete Multi-modal Brain Tumor Segmentation
    Qiu, Yansheng
    Zhao, Ziyuan
    Yao, Hongdou
    Chen, Delin
    Wang, Zheng
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3228 - 3239
  • [28] Classification of first episode psychosis: a multi-modal multi-feature approach
    Brambilla, P.
    BIPOLAR DISORDERS, 2015, 17 : 18 - 18
  • [29] Diagnosis of Neurodegenerative Diseases Based on Multi-modal Hemodynamic Classification of the Brain
    Zwettler, Gerald
    Pichler, Robert
    Backfrieder, Werner
    COMPUTER AIDED SYSTEMS THEORY - EUROCAST 2011, PT II, 2012, 6928 : 209 - 216
  • [30] Multi-modal Semantic Place Classification
    Pronobis, A.
    Mozos, O. Martinez
    Caputo, B.
    Jensfelt, P.
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2010, 29 (2-3): : 298 - 320