Quality-driven deep active learning method for 3D brain MRI segmentation

被引:7
|
作者
Zhang, Zhenxi [1 ]
Li, Jie [1 ]
Tian, Chunna [1 ]
Zhong, Zhusi [1 ]
Jiao, Zhicheng [2 ]
Gao, Xinbo [1 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[2] Univ Penn, Perelman Sch Med, Philadelphia, PA 19104 USA
基金
中国国家自然科学基金;
关键词
3D Brain MRI segmentation; Deep active learning; Annotation strategy; Attention mechanism; Deep supervision; CONVOLUTIONAL NEURAL-NETWORK; IMAGE SEGMENTATION;
D O I
10.1016/j.neucom.2021.03.050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic segmentation of the brain Magnetic Resonance Imaging (MRI) plays a crucial role in many brain MRI processing algorithms, which is effective for the prevention, detection, monitoring, and treatment planning of brain disease. Currently, deep learning algorithms have shown outstanding performance in brain segmentation. Most algorithms train models with fully annotated brain MRI datasets. However, full annotation of 3D brain MRI is laborious and time-consuming. Using sparsely annotated datasets to train models may be one appropriate solution to reduce annotation cost. However, the approach of 3D dense segmentation with sparse annotation has not been fully studied. In this paper, we develop a segmentation framework combined with the quality-driven active learning (QDAL) module for suggestive annotation. In the proposed Active Learning module, attention mechanism and deep supervision mode are used to improve the segmentation accuracy and feedback segmentation quality information. Meanwhile, we observe a high correlation coefficient between the proposed two surrogate metrics and the real segmentation accuracy of per slice in one scan. We validate our framework on two public brain MRI datasets for brain region extraction and brain tissue segmentation. The comparative experiments demonstrate that the QDAL method outperforms the other four popular sampling strategies. The segmentation network with the guidance of the QDAL method only needs 15-20% annotated slices in brain extraction task, and 30-40% annotated slices in tissue segmentation task to achieve competitive results compared with training with full supervision. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:106 / 117
页数:12
相关论文
共 50 条
  • [1] A Deep Learning Driven Active Framework for Segmentation of Large 3D Shape Collections
    George, David
    Xie, Xianghua
    Lai, Yukun
    Tam, Gary K. L.
    COMPUTER-AIDED DESIGN, 2022, 144
  • [2] Deep Learning Based Ensemble Approach for 3D MRI Brain Tumor Segmentation
    Tien-Bach-Thanh Do
    Dang-Linh Trinh
    Minh-Trieu Tran
    Lee, Guee-Sang
    Kim, Soo-Hyung
    Yang, Hyung-Jeong
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2021, PT II, 2022, 12963 : 210 - 221
  • [3] 2.5D and 3D segmentation of brain metastases with deep learning on multinational MRI data
    Ottesen, Jon Andre
    Yi, Darvin
    Tong, Elizabeth
    Iv, Michael
    Latysheva, Anna
    Saxhaug, Cathrine
    Jacobsen, Kari Dolven
    Helland, Aslaug
    Emblem, Kyrre Eeg
    Rubin, Daniel L.
    Bjornerud, Atle
    Zaharchuk, Greg
    Grovik, Endre
    FRONTIERS IN NEUROINFORMATICS, 2023, 16
  • [4] Brain Tumor Segmentation on Multimodal 3D-MRI using Deep Learning Method
    Wu, Peicheng
    Chang, Qing
    2020 13TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2020), 2020, : 635 - 639
  • [5] A hybrid method for 3D segmentation of MRI Brain Images
    Zhang, X
    Zhang, DZ
    Tian, JW
    Liu, J
    2002 6TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS I AND II, 2002, : 608 - 611
  • [6] Toward quality-driven development of 3D computer games
    Graham, T. C. Nicholas
    Roberts, Will
    INTERACTIVE SYSTEMS: DESIGN, SPECIFICATION, AND VERIFICATION, 2007, 4323 : 248 - +
  • [7] Deep and statistical learning in biomedical imaging: State of the art in 3D MRI brain tumor segmentation
    Fernando, K. Ruwani M.
    Tsokos, Chris P.
    INFORMATION FUSION, 2023, 92 : 450 - 465
  • [8] An accurate segmentation method for volumetry of brain tumor in 3D MRI
    Wang, Jiahui
    Li, Qiang
    Hirai, Toshinori
    Katsuragawa, Shigehiko
    Li, Feng
    Doi, Kunio
    MEDICAL IMAGING 2008: IMAGE PROCESSING, PTS 1-3, 2008, 6914
  • [9] 3D MRI segmentation of brain structures
    Verard, L
    Fadili, J
    Ruan, S
    Bloyet, D
    PROCEEDINGS OF THE 18TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOL 18, PTS 1-5, 1997, 18 : 1081 - 1082
  • [10] A Novel U-Net Based Deep Learning Method for 3D Cardiovascular MRI Segmentation
    Lu, Yinan
    Zhao, Yan
    Chen, Xing
    Guo, Xiaoxin
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022