Multi-Model Medical Image Segmentation Using Multi-Stage Generative Adversarial Networks

被引:13
|
作者
Khaled, Afifa [1 ]
Han, Jian-Jun [1 ]
Ghaleb, Taher A. [2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Hubei, Peoples R China
[2] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON K1N 6N5, Canada
基金
美国国家科学基金会;
关键词
Brain segmentation; coarse-to-fine; generative adversarial network; semi-supervised learning; multi-stage method;
D O I
10.1109/ACCESS.2022.3158342
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image segmentation is a challenging problem in medical applications. Medical imaging has become an integral part of machine learning research, as it enables inspecting interior human body with no surgical intervention. Much research has been conducted to study brain segmentation. However, prior studies usually employ one-stage models to segment brain tissues, which could lead to a significant information loss. In this paper, we propose a multi-stage Generative Adversarial Network (GAN) model to resolve existing issues of one-stage models. To do this, we apply a coarse-to-fine method to improve brain segmentation using a multi-stage GAN. In the first stage, our model generates a coarse outline for both the background and brain tissues. Then, in the second stage, the model generates a refine outline for the white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). We perform a fusion of the coarse and refine outlines to achieve high results. Despite using very limited data, we obtain an improved Dice Coefficient (DC) accuracy of up to 5% compared to one-stage models. We conclude that our model is more efficient and accurate in practice for brain segmentation of both infants and adults. In addition, we observe that our multi-stage model is 2.69 -13.93 minutes faster than prior models. Moreover, our multi-stage model achieves higher performance with only a few-shot learning, in which only limited labeled data is available. Therefore, for medical images, our solution is applicable to a wide range of image segmentation applications for which convolution neural networks and one-stage methods have failed. This helps to advance the process of analyzing brain images, thus providing many advantages to the healthcare system, especially in critical health situations where urgent intervention is needed.
引用
收藏
页码:28590 / 28599
页数:10
相关论文
共 50 条
  • [1] Stochastic simulation of fan deltas using parallel multi-stage generative adversarial networks
    Zhang, Ting
    Yang, Zhonghao
    Sun, Chaochao
    JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2022, 208
  • [2] Multi-stage generative adversarial networks for generating pavement crack images
    Han, Chengjia
    Ma, Tao
    Ju, Huyan
    Tong, Zheng
    Yang, Handuo
    Yang, Yaowen
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 131
  • [3] Semantic Image Inpainting with Multi-Stage Feature Reasoning Generative Adversarial Network
    Li, Guangyao
    Li, Liangfu
    Pu, Yingdan
    Wang, Nan
    Zhang, Xi
    SENSORS, 2022, 22 (08)
  • [4] Generative adversarial networks in medical image segmentation: A review
    Xun, Siyi
    Li, Dengwang
    Zhu, Hui
    Chen, Min
    Wang, Jianbo
    Li, Jie
    Chen, Meirong
    Wu, Bing
    Zhang, Hua
    Chai, Xiangfei
    Jiang, Zekun
    Zhang, Yan
    Huang, Pu
    COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 140
  • [5] Financial Forecasting Method for Generative Adversarial Networks Based on Multi-model Fusion
    Lin, Pei-Guang
    Li, Qing-Tao
    Zhou, Jia-Qian
    Wang, Ji-Hou
    Jian, Mu-Wei
    Zhang, Chen
    Journal of Computers (Taiwan), 2023, 34 (01): : 131 - 144
  • [6] Accurate generation of stochastic dynamics based on multi-model generative adversarial networks
    Lanzoni, Daniele
    Pierre-Louis, Olivier
    Montalenti, Francesco
    JOURNAL OF CHEMICAL PHYSICS, 2023, 159 (14):
  • [7] A multi-stage underwater image aesthetic enhancement algorithm based on a generative adversarial network
    Hu, Kai
    Weng, Chenghang
    Shen, Chaowen
    Wang, Tianyan
    Weng, Liguo
    Xia, Min
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [8] Learning to Generate Time-Lapse Videos Using Multi-Stage Dynamic Generative Adversarial Networks
    Xiong, Wei
    Luo, Wenhan
    Ma, Lin
    Liu, Wei
    Luo, Jiebo
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2364 - 2373
  • [9] Multi-Source Fusion Image Semantic Segmentation Model of Generative Adversarial Networks Based on FCN
    Zhao, Liang
    Wang, Ying
    Duan, Zhongxing
    Chen, Dengfeng
    Liu, Shipeng
    IEEE ACCESS, 2021, 9 : 101985 - 101993
  • [10] High-Definition Image Formation Using Multi-stage Cycle Generative Adversarial Network with Applications in Image Forensic
    Arif, Danish
    Mehmood, Zahid
    Ullah, Amin
    Winberg, Simon
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2024, 49 (03) : 3887 - 3896