Multi-Model Medical Image Segmentation Using Multi-Stage Generative Adversarial Networks

被引:13
|
作者
Khaled, Afifa [1 ]
Han, Jian-Jun [1 ]
Ghaleb, Taher A. [2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Hubei, Peoples R China
[2] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON K1N 6N5, Canada
基金
美国国家科学基金会;
关键词
Brain segmentation; coarse-to-fine; generative adversarial network; semi-supervised learning; multi-stage method;
D O I
10.1109/ACCESS.2022.3158342
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image segmentation is a challenging problem in medical applications. Medical imaging has become an integral part of machine learning research, as it enables inspecting interior human body with no surgical intervention. Much research has been conducted to study brain segmentation. However, prior studies usually employ one-stage models to segment brain tissues, which could lead to a significant information loss. In this paper, we propose a multi-stage Generative Adversarial Network (GAN) model to resolve existing issues of one-stage models. To do this, we apply a coarse-to-fine method to improve brain segmentation using a multi-stage GAN. In the first stage, our model generates a coarse outline for both the background and brain tissues. Then, in the second stage, the model generates a refine outline for the white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). We perform a fusion of the coarse and refine outlines to achieve high results. Despite using very limited data, we obtain an improved Dice Coefficient (DC) accuracy of up to 5% compared to one-stage models. We conclude that our model is more efficient and accurate in practice for brain segmentation of both infants and adults. In addition, we observe that our multi-stage model is 2.69 -13.93 minutes faster than prior models. Moreover, our multi-stage model achieves higher performance with only a few-shot learning, in which only limited labeled data is available. Therefore, for medical images, our solution is applicable to a wide range of image segmentation applications for which convolution neural networks and one-stage methods have failed. This helps to advance the process of analyzing brain images, thus providing many advantages to the healthcare system, especially in critical health situations where urgent intervention is needed.
引用
收藏
页码:28590 / 28599
页数:10
相关论文
共 50 条
  • [31] Unsupervised domain adaptation network for medical image segmentation with generative adversarial networks
    Huang, Xiji
    Chen, Lingna
    PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CYBER SECURITY, ARTIFICIAL INTELLIGENCE AND DIGITAL ECONOMY, CSAIDE 2024, 2024, : 380 - 382
  • [32] Systematic Review of Generative Adversarial Networks (GANs) for Medical Image Classification and Segmentation
    Jeong, Jiwoong J.
    Tariq, Amara
    Adejumo, Tobiloba
    Trivedi, Hari
    Gichoya, Judy W.
    Banerjee, Imon
    JOURNAL OF DIGITAL IMAGING, 2022, 35 (02) : 137 - 152
  • [33] Conditional Generative Adversarial Refinement Networks for Unbalanced Medical Image Semantic Segmentation
    Rezaei, Mina
    Yang, Haojin
    Harmuth, Konstantin
    Meinel, Christoph
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 1836 - 1845
  • [34] Systematic Review of Generative Adversarial Networks (GANs) for Medical Image Classification and Segmentation
    Jiwoong J. Jeong
    Amara Tariq
    Tobiloba Adejumo
    Hari Trivedi
    Judy W. Gichoya
    Imon Banerjee
    Journal of Digital Imaging, 2022, 35 : 137 - 152
  • [35] Image Classification Using Convolutional Neural Networks With Multi-stage Feature
    Yim, Junho
    Ju, Jeongwoo
    Jung, Heechul
    Kim, Junmo
    ROBOT INTELLIGENCE TECHNOLOGY ANDAPPLICATIONS 3, 2015, 345 : 587 - 594
  • [36] DEFORMABLE MEDICAL IMAGE REGISTRATION USING GENERATIVE ADVERSARIAL NETWORKS
    Mahapatra, Dwarikanath
    Antony, Bhavna
    Sedai, Suman
    Garnavi, Rahil
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 1449 - 1453
  • [37] MirGAN: Medical Image Reconstruction using Generative Adversarial Networks
    Dang, Nitin
    Khurana, Manju
    Tiwari, Shailendra
    PROCEEDINGS OF THE 2020 5TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND SECURITY (ICCCS-2020), 2020,
  • [38] A multi-stage chaotic encryption technique for medical image
    Tanveer, Md. Siddiqur Rahman
    Md. Rokibul Alam, Kazi
    Morimoto, Yasuhiko
    INFORMATION SECURITY JOURNAL, 2022, 31 (06): : 657 - 675
  • [39] Unpaired Multi-contrast MR Image Synthesis Using Generative Adversarial Networks
    Sohail, Muhammad
    Riaz, Muhammad Naveed
    Wu, Jing
    Long, Chengnian
    Li, Shaoyuan
    SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2019, 2019, 11827 : 22 - 31
  • [40] Fast Multi-Focus Ultrasound Image Recovery Using Generative Adversarial Networks
    Goudarzi, Sobhan
    Asif, Amir
    Rivaz, Hassan
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 1272 - 1284