MinimalGAN: diverse medical image synthesis for data augmentation using minimal training data

被引:15
|
作者
Zhang, Yipeng [1 ,2 ,3 ]
Wang, Quan [1 ,2 ]
Hu, Bingliang [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Spectral Imaging Technol, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China
[2] Key Lab Biomed Spect Xian, Xian 710119, Shaanxi, Peoples R China
[3] Univ Chinese Acad Sci, Sch Optoelect, Beijing 100190, Peoples R China
关键词
Image generation; Data augmentation; Image segmentation; Medical imaging; DIAGNOSIS;
D O I
10.1007/s10489-022-03609-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image synthesis techniques have limited application in the medical field due to unsatisfactory authenticity and precision. Additionally, synthesizing diverse outputs is challenging when the training data are insufficient, as in many medical datasets. In this work, we propose an image-to-image network named the Minimal Generative Adversarial Network (MinimalGAN), to synthesize annotated, accurate, and diverse medical images with minimal training data. The primary concept is to make full use of the internal information of the image and decouple the style from the content by separating them in the self-coding process. After that, the generator is compelled to concentrate on content detail and style separately to synthesize diverse and high-precision images. The proposed MinimalGAN includes two image synthesis techniques; the first is style transfer. We synthesized a stylized retinal fundus dataset. The style transfer deception rate is much higher than that of traditional style transfer methods. The blood vessel segmentation performance increased when only using synthetic data. The other image synthesis technique is target variation. Unlike the traditional translation, rotation, and scaling on the whole image, this approach only performs the above operations on the segmented target being annotated. Experiments demonstrate that segmentation performance improved after utilizing synthetic data.
引用
收藏
页码:3899 / 3916
页数:18
相关论文
共 50 条
  • [1] MinimalGAN: diverse medical image synthesis for data augmentation using minimal training data
    Yipeng Zhang
    Quan Wang
    Bingliang Hu
    Applied Intelligence, 2023, 53 : 3899 - 3916
  • [2] Data Augmentation in Logit Space for Medical Image Classification with Limited Training Data
    Hu, Yangwen
    Zhong, Zhehao
    Wang, Ruixuan
    Liu, Hongmei
    Tan, Zhijun
    Zheng, Wei-Shi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT V, 2021, 12905 : 469 - 479
  • [3] Medical Image Synthesis for Data Augmentation and Anonymization Using Generative Adversarial Networks
    Shin, Hoo-Chang
    Tenenholtz, Neil A.
    Rogers, Jameson K.
    Schwarz, Christopher G.
    Senjem, Matthew L.
    Gunter, Jeffrey L.
    Andriole, Katherine P.
    Michalski, Mark
    SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, 2018, 11037 : 1 - 11
  • [4] Cooperative Training and Latent Space Data Augmentation for Robust Medical Image Segmentation
    Chen, Chen
    Hammernik, Kerstin
    Ouyang, Cheng
    Qin, Chen
    Bai, Wenjia
    Rueckert, Daniel
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 149 - 159
  • [5] GAN based ROI conditioned Synthesis of Medical Image for Data Augmentation
    Kim, Yisak
    Lee, Jong Hyuk
    Kim, Changi
    Jin, Kwang Nam
    Park, Chang Min
    MEDICAL IMAGING 2023, 2023, 12464
  • [6] DEEPFAKE Image Synthesis for Data Augmentation
    Waqas, Nawaf
    Safie, Sairul Izwan
    Kadir, Kushsairy Abdul
    Khan, Sheroz
    Khel, Muhammad Haris Kaka
    IEEE ACCESS, 2022, 10 : 80847 - 80857
  • [7] Real Data Augmentation for Medical Image Classification
    Zhang, Chuanhai
    Tavanapong, Wallapak
    Wong, Johnny
    de Groen, Piet C.
    Oh, JungHwan
    INTRAVASCULAR IMAGING AND COMPUTER ASSISTED STENTING, AND LARGE-SCALE ANNOTATION OF BIOMEDICAL DATA AND EXPERT LABEL SYNTHESIS, 2017, 10552 : 67 - 76
  • [8] Intraoperative detection of parathyroid glands using artificial intelligence: optimizing medical image training with data augmentation methods
    Lee, Joon-Hyop
    Ku, EunKyung
    Chung, Yoo Seung
    Kim, Young Jae
    Kim, Kwang Gi
    SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2024, 38 (10): : 5732 - 5745
  • [9] Augmentation of Small Training Data Using GANs for Enhancing the Performance of Image Classification
    Hung, Shih-Kai
    Gan, John Q.
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3350 - 3356
  • [10] Medical image data augmentation: techniques, comparisons and interpretations
    Evgin Goceri
    Artificial Intelligence Review, 2023, 56 : 12561 - 12605