MinimalGAN: diverse medical image synthesis for data augmentation using minimal training data

被引:15
|
作者
Zhang, Yipeng [1 ,2 ,3 ]
Wang, Quan [1 ,2 ]
Hu, Bingliang [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Spectral Imaging Technol, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China
[2] Key Lab Biomed Spect Xian, Xian 710119, Shaanxi, Peoples R China
[3] Univ Chinese Acad Sci, Sch Optoelect, Beijing 100190, Peoples R China
关键词
Image generation; Data augmentation; Image segmentation; Medical imaging; DIAGNOSIS;
D O I
10.1007/s10489-022-03609-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image synthesis techniques have limited application in the medical field due to unsatisfactory authenticity and precision. Additionally, synthesizing diverse outputs is challenging when the training data are insufficient, as in many medical datasets. In this work, we propose an image-to-image network named the Minimal Generative Adversarial Network (MinimalGAN), to synthesize annotated, accurate, and diverse medical images with minimal training data. The primary concept is to make full use of the internal information of the image and decouple the style from the content by separating them in the self-coding process. After that, the generator is compelled to concentrate on content detail and style separately to synthesize diverse and high-precision images. The proposed MinimalGAN includes two image synthesis techniques; the first is style transfer. We synthesized a stylized retinal fundus dataset. The style transfer deception rate is much higher than that of traditional style transfer methods. The blood vessel segmentation performance increased when only using synthetic data. The other image synthesis technique is target variation. Unlike the traditional translation, rotation, and scaling on the whole image, this approach only performs the above operations on the segmented target being annotated. Experiments demonstrate that segmentation performance improved after utilizing synthetic data.
引用
收藏
页码:3899 / 3916
页数:18
相关论文
共 50 条
  • [12] Image-to-Image Translation for Data Augmentation on Multimodal Medical Images
    Peng, Yue
    Meng, Zuqiang
    Yang, Lina
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2023, E106D (05) : 686 - 696
  • [13] Data Augmentation using Evolutionary Image Processing
    Fujita, Kosaku
    Kobayashi, Masayuki
    Nagao, Tomoharu
    2018 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2018, : 275 - 280
  • [14] Ocean image data augmentation in the USV virtual training scene
    Wang, Wei
    Li, Yang
    Luo, Xiangfeng
    Xie, Shaorong
    BIG EARTH DATA, 2020, 4 (04) : 451 - 463
  • [15] Facial Image Augmentation from Sparse Line Features Using Small Training Data
    Hung, Shih-Kai
    Gan, John Q.
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2021, PT I, 2021, 12861 : 547 - 558
  • [16] Data augmentation using learned transformations for one-shot medical image segmentation
    Zhao, Amy
    Balakrishnan, Guha
    Durand, Fredo
    Guttag, John, V
    Dalca, Adrian, V
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 8535 - 8545
  • [17] Leveraging GANs data augmentation for imbalanced medical image classification
    Ding, Hongwei
    Huang, Nana
    Cui, Xiaohui
    APPLIED SOFT COMPUTING, 2024, 165
  • [18] Comparing Transfer Learning, Data Augmentation, and Data Expansion in the Improvement of Medical Image Generation
    Woodland, M.
    Wood, J.
    Anderson, B.
    Kundu, S.
    Lin, E.
    Koay, E.
    Odisio, B.
    Chung, C.
    Kang, H.
    Venkatesan, A.
    Yedururi, S.
    De, B.
    Lin, Y.
    Patel, A.
    Brock, K.
    MEDICAL PHYSICS, 2022, 49 (06) : E134 - E134
  • [19] Diverse data augmentation for learning image segmentation with cross-modality annotations
    Chen, Xu
    Lian, Chunfeng
    Wang, Li
    Deng, Hannah
    Kuang, Tianshu
    Fung, Steve H.
    Gateno, Jaime
    Shen, Dinggang
    Xia, James J.
    Yap, Pew-Thian
    MEDICAL IMAGE ANALYSIS, 2021, 71
  • [20] Minimization of CNN Training Data by using Data Augmentation for Inline Defect Classification
    Fujishiro, Akihiro
    Nagamura, Yoshikazu
    Usami, Tatsuya
    Inoue, Masao
    2020 INTERNATIONAL SYMPOSIUM ON SEMICONDUCTOR MANUFACTURING (ISSM), 2020,