Lifelong Learning with Dynamic Convolutions for Glioma Segmentation from Multi-Modal MRI

被引:0
|
作者
Banerjee, Subhashis [1 ]
Strand, Robin [1 ]
机构
[1] Uppsala Univ, Dept Informat Technol, Uppsala, Sweden
来源
MEDICAL IMAGING 2023 | 2023年 / 12464卷
关键词
Catastrophic Forgetting; Lifelong Learning; Dynamic Convolution Neural Network; Segmentation;
D O I
10.1117/12.2654200
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel solution for catastrophic forgetting in lifelong learning (LL) using Dynamic Convolution Neural Network (Dy-CNN). The proposed dynamic convolution layer can adapt convolution filters by learning kernel coefficients or weights based on the input image. The suitability of the proposed Dy-CNN in a lifelong sequential learning-based scenario with multi-modal MR images is experimentally demonstrated for the segmentation of Glioma tumors from multi-modal MR images. Experimental results demonstrated the superiority of the Dy-CNN-based segmenting network in terms of learning through multi-modal MRI images and better convergence of lifelong learning-based training.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Learning Dynamic Convolutions for Multi-modal 3D MRI Brain Tumor Segmentation
    Yang, Qiushi
    Yuan, Yixuan
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES (BRAINLES 2020), PT II, 2021, 12659 : 441 - 451
  • [2] Lifelong Learning for Heterogeneous Multi-Modal Tasks
    Liu, Huaping
    Sun, Fuchun
    Fang, Bin
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 6158 - 6164
  • [3] Multi-Modal Learning from Unpaired Images: Application to Multi-Organ Segmentation in CT and MRI
    Valindria, Vanya V.
    Pawlowski, Nick
    Rajchl, Martin
    Lavdas, Ioannis
    Aboagye, Eric O.
    Rockall, Andrea G.
    Rueckert, Daniel
    Glocker, Ben
    2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, : 547 - 556
  • [4] Multi-Modal Learning for Predicting the Genotype of Glioma
    Wei, Yiran
    Chen, Xi
    Zhu, Lei
    Zhang, Lipei
    Schonlieb, Carola-Bibiane
    Price, Stephen
    Li, Chao
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (11) : 3167 - 3178
  • [5] Glioma Segmentation-Oriented Multi-Modal MR Image Fusion With Adversarial Learning
    Yu Liu
    Yu Shi
    Fuhao Mu
    Juan Cheng
    Xun Chen
    IEEE/CAAJournalofAutomaticaSinica, 2022, 9 (08) : 1528 - 1531
  • [6] Glioma Segmentation-Oriented Multi-Modal MR Image Fusion With Adversarial Learning
    Liu, Yu
    Shi, Yu
    Mu, Fuhao
    Cheng, Juan
    Chen, Xun
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (08) : 1528 - 1531
  • [7] Brain Tumor Segmentation for Multi-Modal MRI with Missing Information
    Xue Feng
    Kanchan Ghimire
    Daniel D. Kim
    Rajat S. Chandra
    Helen Zhang
    Jian Peng
    Binghong Han
    Gaofeng Huang
    Quan Chen
    Sohil Patel
    Chetan Bettagowda
    Haris I. Sair
    Craig Jones
    Zhicheng Jiao
    Li Yang
    Harrison Bai
    Journal of Digital Imaging, 2023, 36 (5) : 2075 - 2087
  • [8] Brain Tumor Segmentation for Multi-Modal MRI with Missing Information
    Feng, Xue
    Ghimire, Kanchan
    Kim, Daniel D.
    Chandra, Rajat S.
    Zhang, Helen
    Peng, Jian
    Han, Binghong
    Huang, Gaofeng
    Chen, Quan
    Patel, Sohil
    Bettagowda, Chetan
    Sair, Haris I.
    Jones, Craig
    Jiao, Zhicheng
    Yang, Li
    Bai, Harrison
    JOURNAL OF DIGITAL IMAGING, 2023, 36 (05) : 2075 - 2087
  • [9] EFFECTIVE FUSION OF MULTI-MODAL DATA WITH GROUP CONVOLUTIONS FOR SEMANTIC SEGMENTATION OF AERIAL IMAGERY
    Chen, Kaiqiang
    Fu, Kun
    Gao, Xin
    Yan, Menglong
    Zhang, Wenkai
    Zhang, Yue
    Sun, Xian
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3911 - 3914
  • [10] Online Multi-modal Imitation Learning via Lifelong Intention Encoding
    Piao, Songhao
    Huang, Yue
    Liu, Huaping
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2019), 2019, : 786 - 792