Multi-Model Medical Image Segmentation Using Multi-Stage Generative Adversarial Networks

被引:13
|
作者
Khaled, Afifa [1 ]
Han, Jian-Jun [1 ]
Ghaleb, Taher A. [2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Hubei, Peoples R China
[2] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON K1N 6N5, Canada
基金
美国国家科学基金会;
关键词
Brain segmentation; coarse-to-fine; generative adversarial network; semi-supervised learning; multi-stage method;
D O I
10.1109/ACCESS.2022.3158342
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image segmentation is a challenging problem in medical applications. Medical imaging has become an integral part of machine learning research, as it enables inspecting interior human body with no surgical intervention. Much research has been conducted to study brain segmentation. However, prior studies usually employ one-stage models to segment brain tissues, which could lead to a significant information loss. In this paper, we propose a multi-stage Generative Adversarial Network (GAN) model to resolve existing issues of one-stage models. To do this, we apply a coarse-to-fine method to improve brain segmentation using a multi-stage GAN. In the first stage, our model generates a coarse outline for both the background and brain tissues. Then, in the second stage, the model generates a refine outline for the white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). We perform a fusion of the coarse and refine outlines to achieve high results. Despite using very limited data, we obtain an improved Dice Coefficient (DC) accuracy of up to 5% compared to one-stage models. We conclude that our model is more efficient and accurate in practice for brain segmentation of both infants and adults. In addition, we observe that our multi-stage model is 2.69 -13.93 minutes faster than prior models. Moreover, our multi-stage model achieves higher performance with only a few-shot learning, in which only limited labeled data is available. Therefore, for medical images, our solution is applicable to a wide range of image segmentation applications for which convolution neural networks and one-stage methods have failed. This helps to advance the process of analyzing brain images, thus providing many advantages to the healthcare system, especially in critical health situations where urgent intervention is needed.
引用
收藏
页码:28590 / 28599
页数:10
相关论文
共 50 条
  • [41] Multi-domain medical image translation generation for lung image classification based on generative adversarial networks
    Chen, Yunfeng
    Lin, Yalan
    Xu, Xiaodie
    Ding, Jinzhen
    Li, Chuzhao
    Zeng, Yiming
    Xie, Weifang
    Huang, Jianlong
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 229
  • [42] Generative Adversarial Networks in Medical Image Processing
    Gong, Meiqin
    Chen, Siyu
    Chen, Qingyuan
    Zeng, Yuanqi
    Zhang, Yongqing
    CURRENT PHARMACEUTICAL DESIGN, 2021, 27 (15) : 1856 - 1868
  • [43] Multi-negative samples with Generative Adversarial Networks for image retrieval
    Li, Ruifan
    Zhang, Xuesen
    Chen, Guang
    Mao, Yuzhao
    Wang, Xiaojie
    NEUROCOMPUTING, 2020, 394 : 146 - 157
  • [44] Image Multi-Inpainting via Progressive Generative Adversarial Networks
    Cai, Jiayin
    Li, Changlin
    Tao, Xin
    Tai, Yu-Wing
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 977 - 986
  • [45] Multi model Facial Makeup Translation with Generative Adversarial Networks
    Kuang, Hailan
    Zhong, Zhenhua
    Chen, Zhuo
    Liu, Xinhua
    Ma, Xiaolin
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 1639 - 1643
  • [46] In2I: Unsupervised Multi-Image-to-Image Translation Using Generative Adversarial Networks
    Perera, Pramuditha
    Abavisani, Mahdi
    Patel, Vishal M.
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 140 - 146
  • [47] Generative Adversarial Networks for Road Crack Image Segmentation
    Gao, Ziping
    Peng, Bo
    Li, Tianrui
    Gou, Cong
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [48] Lung image segmentation via generative adversarial networks
    Cai, Jiaxin
    Zhu, Hongfeng
    Liu, Siyu
    Qi, Yang
    Chen, Rongshang
    FRONTIERS IN PHYSIOLOGY, 2024, 15
  • [49] TarGAN: Target-Aware Generative Adversarial Networks for Multi-modality Medical Image Translation
    Chen, Junxiao
    Wei, Jia
    Li, Rui
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI, 2021, 12906 : 24 - 33
  • [50] STPGANsFusion: Structure and Texture Preserving Generative Adversarial Networks for Multi-modal Medical Image Fusion
    Shah, Dhruvi
    Wani, Hareshwar
    Das, Manisha
    Gupta, Deep
    Radeva, Petia
    Bakde, Ashwini
    2022 NATIONAL CONFERENCE ON COMMUNICATIONS (NCC), 2022, : 172 - 177