Multi-Model Medical Image Segmentation Using Multi-Stage Generative Adversarial Networks

被引:13
|
作者
Khaled, Afifa [1 ]
Han, Jian-Jun [1 ]
Ghaleb, Taher A. [2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Hubei, Peoples R China
[2] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON K1N 6N5, Canada
基金
美国国家科学基金会;
关键词
Brain segmentation; coarse-to-fine; generative adversarial network; semi-supervised learning; multi-stage method;
D O I
10.1109/ACCESS.2022.3158342
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image segmentation is a challenging problem in medical applications. Medical imaging has become an integral part of machine learning research, as it enables inspecting interior human body with no surgical intervention. Much research has been conducted to study brain segmentation. However, prior studies usually employ one-stage models to segment brain tissues, which could lead to a significant information loss. In this paper, we propose a multi-stage Generative Adversarial Network (GAN) model to resolve existing issues of one-stage models. To do this, we apply a coarse-to-fine method to improve brain segmentation using a multi-stage GAN. In the first stage, our model generates a coarse outline for both the background and brain tissues. Then, in the second stage, the model generates a refine outline for the white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). We perform a fusion of the coarse and refine outlines to achieve high results. Despite using very limited data, we obtain an improved Dice Coefficient (DC) accuracy of up to 5% compared to one-stage models. We conclude that our model is more efficient and accurate in practice for brain segmentation of both infants and adults. In addition, we observe that our multi-stage model is 2.69 -13.93 minutes faster than prior models. Moreover, our multi-stage model achieves higher performance with only a few-shot learning, in which only limited labeled data is available. Therefore, for medical images, our solution is applicable to a wide range of image segmentation applications for which convolution neural networks and one-stage methods have failed. This helps to advance the process of analyzing brain images, thus providing many advantages to the healthcare system, especially in critical health situations where urgent intervention is needed.
引用
收藏
页码:28590 / 28599
页数:10
相关论文
共 50 条
  • [21] Generative Image Inpainting with Multi-Stage Decoding Network
    Liu W.-R.
    Mi Y.-C.
    Yang F.
    Zhang Y.
    Guo H.-L.
    Liu Z.-M.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (03): : 625 - 636
  • [22] Multi-Stage Generation of Tile Images Based on Generative Adversarial Network
    Lu, Jianfeng
    Shi, Mengtao
    Lu, Yuhang
    Chang, Ching-Chun
    Li, Li
    Bai, Rui
    IEEE ACCESS, 2022, 10 : 127502 - 127513
  • [23] Multi-Source Medical Image Fusion Based on Wasserstein Generative Adversarial Networks
    Yang, Zhiguang
    Chen, Youping
    Le, Zhuliang
    Fan, Fan
    Pan, Erting
    IEEE ACCESS, 2019, 7 : 175947 - 175958
  • [24] SAM-GAN: Self-Attention supporting Multi-stage Generative Adversarial Networks for text-to-image synthesis
    Peng, Dunlu
    Yang, Wuchen
    Liu, Cong
    Lu, Shuairui
    NEURAL NETWORKS, 2021, 138 : 57 - 67
  • [25] SHAPE-CONSISTENT GENERATIVE ADVERSARIAL NETWORKS FOR MULTI-MODAL MEDICAL SEGMENTATION MAPS
    Segre, Leo
    Hirschorn, Or
    Ginzburg, Dvir
    Raviv, Dan
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [26] SUPERRESOLUTION AND SEGMENTATION OF OCT SCANS USING MULTI-STAGE ADVERSARIAL GUIDED ATTENTION TRAINING
    Jeihouni, Paria
    Dehzangi, Omid
    Amireskandari, Annahita
    Dabouei, Ali
    Rezai, Ali
    Nasrabadi, Nasser M.
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1106 - 1110
  • [27] Multi-ConDoS: Multimodal Contrastive Domain Sharing Generative Adversarial Networks for Self-Supervised Medical Image Segmentation
    Zhang, Jiaojiao
    Zhang, Shuo
    Shen, Xiaoqian
    Lukasiewicz, Thomas
    Xu, Zhenghua
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (01) : 76 - 95
  • [28] Lung image segmentation by generative adversarial networks
    Cai, Jiaxin
    Zhu, Hongfeng
    2019 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2019, 11321
  • [29] A novel multi-stage 3D medical image segmentation: Methodology and validation
    Xu, JF
    Gu, LX
    Zhuang, XH
    Peters, T
    COMPUTATIONAL INTELLIGENCE AND SECURITY, PT 1, PROCEEDINGS, 2005, 3801 : 884 - 889
  • [30] Efficient Generative-Adversarial U-Net for Multi-Organ Medical Image Segmentation
    Wang, Haoran
    Wu, Gengshen
    Liu, Yi
    JOURNAL OF IMAGING, 2025, 11 (01)