MinimalGAN: diverse medical image synthesis for data augmentation using minimal training data

被引:15
|
作者
Zhang, Yipeng [1 ,2 ,3 ]
Wang, Quan [1 ,2 ]
Hu, Bingliang [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Spectral Imaging Technol, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China
[2] Key Lab Biomed Spect Xian, Xian 710119, Shaanxi, Peoples R China
[3] Univ Chinese Acad Sci, Sch Optoelect, Beijing 100190, Peoples R China
关键词
Image generation; Data augmentation; Image segmentation; Medical imaging; DIAGNOSIS;
D O I
10.1007/s10489-022-03609-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image synthesis techniques have limited application in the medical field due to unsatisfactory authenticity and precision. Additionally, synthesizing diverse outputs is challenging when the training data are insufficient, as in many medical datasets. In this work, we propose an image-to-image network named the Minimal Generative Adversarial Network (MinimalGAN), to synthesize annotated, accurate, and diverse medical images with minimal training data. The primary concept is to make full use of the internal information of the image and decouple the style from the content by separating them in the self-coding process. After that, the generator is compelled to concentrate on content detail and style separately to synthesize diverse and high-precision images. The proposed MinimalGAN includes two image synthesis techniques; the first is style transfer. We synthesized a stylized retinal fundus dataset. The style transfer deception rate is much higher than that of traditional style transfer methods. The blood vessel segmentation performance increased when only using synthetic data. The other image synthesis technique is target variation. Unlike the traditional translation, rotation, and scaling on the whole image, this approach only performs the above operations on the segmented target being annotated. Experiments demonstrate that segmentation performance improved after utilizing synthetic data.
引用
收藏
页码:3899 / 3916
页数:18
相关论文
共 50 条
  • [41] ATAL: Active Learning Using Adversarial Training for Data Augmentation
    Lin, Xuanwei
    Liu, Ximeng
    Chen, Bijia
    Wang, Yuyang
    Dong, Chen
    Hu, Pengzhen
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (03) : 4787 - 4800
  • [42] Boosting Adversarial Training Using Robust Selective Data Augmentation
    Bader Rasheed
    Asad Masood Khattak
    Adil Khan
    Stanislav Protasov
    Muhammad Ahmad
    International Journal of Computational Intelligence Systems, 16
  • [43] Medical image segmentation data augmentation method based on channel weight and data-efficient features
    Wu X.
    Tao C.
    Li Z.
    Zhang J.
    Sun Q.
    Han X.
    Chen Y.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2024, 41 (02): : 220 - 227
  • [44] Uncertainty-aware self-training with adversarial data augmentation for semi-supervised medical image segmentation
    Cao, Juan
    Chen, Jiaran
    Liu, Jinjia
    Gu, Yuanyuan
    Chen, Lili
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 105
  • [45] Multimodal Data Augmentation for Image Captioning using Diffusion Models
    Xiao, Changrong
    Xu, Sean Xin
    Zhang, Kunpeng
    PROCEEDINGS OF THE 1ST WORKSHOP ON LARGE GENERATIVE MODELS MEET MULTIMODAL APPLICATIONS, LGM3A 2023, 2023, : 23 - 33
  • [46] Data Augmentation Using Contour Image for Convolutional Neural Network
    Hwang, Seung-Yeon
    Kim, Jeong-Joon
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (03): : 4669 - 4680
  • [47] Improving Image Classification Robustness Using Predictive Data Augmentation
    Harisubramanyabalaji, Subramani Palanisamy
    Rehman, Shafiq Ur
    Nyberg, Mattias
    Gustavsson, Joakim
    COMPUTER SAFETY, RELIABILITY, AND SECURITY, SAFECOMP 2018, 2018, 11094 : 548 - 561
  • [48] PADDIT: Probabilistic Augmentation of Data using Diffeomorphic Image Transformation
    Orbes-Arteaga, Mauricio
    Sorensen, Lauge
    Cardoso, Jorge
    Modat, Marc
    Ourselin, Sebastien
    Sommer, Stefan
    Nielsen, Mads
    Igel, Christian
    Pai, Akshay
    MEDICAL IMAGING 2019: IMAGE PROCESSING, 2019, 10949
  • [49] Hyperspectral Image Classification Using Random Occlusion Data Augmentation
    Haut, Juan Mario
    Paoletti, Mercedes E.
    Plaza, Javier
    Plaza, Antonio
    Li, Jun
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (11) : 1751 - 1755
  • [50] Enhancing Image Copy Detection through Dynamic Augmentation and Efficient Sampling with Minimal Data
    Fawzy, Mohamed
    Tawfik, Noha S.
    Saleh, Sherine Nagy
    ELECTRONICS, 2024, 13 (16)