MinimalGAN: diverse medical image synthesis for data augmentation using minimal training data

被引:15
|
作者
Zhang, Yipeng [1 ,2 ,3 ]
Wang, Quan [1 ,2 ]
Hu, Bingliang [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Spectral Imaging Technol, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China
[2] Key Lab Biomed Spect Xian, Xian 710119, Shaanxi, Peoples R China
[3] Univ Chinese Acad Sci, Sch Optoelect, Beijing 100190, Peoples R China
关键词
Image generation; Data augmentation; Image segmentation; Medical imaging; DIAGNOSIS;
D O I
10.1007/s10489-022-03609-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image synthesis techniques have limited application in the medical field due to unsatisfactory authenticity and precision. Additionally, synthesizing diverse outputs is challenging when the training data are insufficient, as in many medical datasets. In this work, we propose an image-to-image network named the Minimal Generative Adversarial Network (MinimalGAN), to synthesize annotated, accurate, and diverse medical images with minimal training data. The primary concept is to make full use of the internal information of the image and decouple the style from the content by separating them in the self-coding process. After that, the generator is compelled to concentrate on content detail and style separately to synthesize diverse and high-precision images. The proposed MinimalGAN includes two image synthesis techniques; the first is style transfer. We synthesized a stylized retinal fundus dataset. The style transfer deception rate is much higher than that of traditional style transfer methods. The blood vessel segmentation performance increased when only using synthetic data. The other image synthesis technique is target variation. Unlike the traditional translation, rotation, and scaling on the whole image, this approach only performs the above operations on the segmented target being annotated. Experiments demonstrate that segmentation performance improved after utilizing synthetic data.
引用
收藏
页码:3899 / 3916
页数:18
相关论文
共 50 条
  • [21] On Data Augmentation for GAN Training
    Tran, Ngoc-Trung
    Tran, Viet-Hung
    Nguyen, Ngoc-Bao
    Nguyen, Trung-Kien
    Cheung, Ngai-Man
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1882 - 1897
  • [22] Data Discernment for Affordable Training in Medical Image Segmentation
    Song, Youyi
    Yu, Lequan
    Lei, Baiying
    Choi, Kup-Sze
    Qin, Jing
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (05) : 1431 - 1445
  • [23] Active Image Data Augmentation
    Oliveira Santos, Flavio Arthur
    Zanchettin, Cleber
    Matos, Leonardo Nogueira
    Novais, Paulo
    HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, HAIS 2019, 2019, 11734 : 310 - 321
  • [24] A review of medical image data augmentation techniques for deep learning applications
    Chlap, Phillip
    Min, Hang
    Vandenberg, Nym
    Dowling, Jason
    Holloway, Lois
    Haworth, Annette
    JOURNAL OF MEDICAL IMAGING AND RADIATION ONCOLOGY, 2021, 65 (05) : 545 - 563
  • [25] DEA: Data-efficient augmentation for interpretable medical image segmentation
    Wu, Xing
    Li, Zhi
    Tao, Chenjie
    Han, Xianhua
    Chen, Yen-Wei
    Yao, Junfeng
    Zhang, Jian
    Sun, Qun
    Li, Weimin
    Liu, Yue
    Guo, Yike
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 89
  • [26] Data augmentation strategies for semi-supervised medical image segmentation
    Wang, Jiahui
    Ruan, Dongsheng
    Li, Yang
    Wang, Zefeng
    Wu, Yongquan
    Tan, Tao
    Yang, Guang
    Jiang, Mingfeng
    PATTERN RECOGNITION, 2025, 159
  • [27] MIXING DATA AUGMENTATION WITH PRESERVING FOREGROUND REGIONS IN MEDICAL IMAGE SEGMENTATION
    Liu, Xiaoqing
    Ono, Kenji
    Bise, Ryoma
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [28] Data augmentation based on multiple oversampling fusion for medical image segmentation
    Wu, Liangsheng
    Zhuang, Jiajun
    Chen, Weizhao
    Tang, Yu
    Hou, Chaojun
    Li, Chentong
    Zhong, Zhenyu
    Luo, Shaoming
    PLOS ONE, 2022, 17 (10):
  • [29] Differentiable Automatic Data Augmentation by Proximal Update for Medical Image Segmentation
    Wenxuan He
    Min Liu
    Yi Tang
    Qinghao Liu
    Yaonan Wang
    IEEE/CAAJournalofAutomaticaSinica, 2022, 9 (07) : 1315 - 1318
  • [30] A data augmentation approach that ensures the reliability of foregrounds in medical image segmentation
    Liu, Xiaoqing
    Ono, Kenji
    Bise, Ryoma
    IMAGE AND VISION COMPUTING, 2024, 147