Adversarial Data Augmentation on Breast MRI Segmentation

被引:4
|
作者
Teixeira, Joao E. [1 ,2 ]
Dias, Mariana [1 ]
Batista, Eva [3 ]
Costa, Joana [3 ]
Teixeira, Luis E. [1 ,2 ]
Oliveira, Helder P. [1 ,4 ]
机构
[1] INESC TEC, P-4200465 Porto, Portugal
[2] Univ Porto, Fac Engn, P-4099002 Porto, Portugal
[3] Champalimaud Fdn, Champalimaud Clin Ctr, Breast Unit, P-1400038 Lisbon, Portugal
[4] Univ Porto, Fac Sci, P-4099002 Porto, Portugal
来源
APPLIED SCIENCES-BASEL | 2021年 / 11卷 / 10期
关键词
breast; semantic segmentation; generation; MRI; label map; data augmentation; synthetic data; generative adversarial network; U-Net;
D O I
10.3390/app11104554
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The scarcity of balanced and annotated datasets has been a recurring problem in medical image analysis. Several researchers have tried to fill this gap employing dataset synthesis with adversarial networks (GANs). Breast magnetic resonance imaging (MRI) provides complex, texture-rich medical images, with the same annotation shortage issues, for which, to the best of our knowledge, no previous work tried synthesizing data. Within this context, our work addresses the problem of synthesizing breast MRI images from corresponding annotations and evaluate the impact of this data augmentation strategy on a semantic segmentation task. We explored variations of image-to-image translation using conditional GANs, namely fitting the generator's architecture with residual blocks and experimenting with cycle consistency approaches. We studied the impact of these changes on visual verisimilarity and how an U-Net segmentation model is affected by the usage of synthetic data. We achieved sufficiently realistic-looking breast MRI images and maintained a stable segmentation score even when completely replacing the dataset with the synthetic set. Our results were promising, especially when concerning to Pix2PixHD and Residual CycleGAN architectures.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Data augmentation guided breast tumor segmentation based on generative adversarial neural networks
    Kannappan, Balaji
    MariaNavin, J. R.
    Sridevi, N.
    Suresh, P.
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 125
  • [2] Enhancing MR image segmentation with realistic adversarial data augmentation
    Chen, Chen
    Qin, Chen
    Ouyang, Cheng
    Li, Zeju
    Wang, Shuo
    Qiu, Huaqi
    Chen, Liang
    Tarroni, Giacomo
    Bai, Wenjia
    Rueckert, Daniel
    [J]. MEDICAL IMAGE ANALYSIS, 2022, 82
  • [3] Generative Adversarial Networks as an Advanced Data Augmentation Technique for MRI Data
    Konidaris, Filippos
    Tagaris, Thanos
    Sdraka, Maria
    Stafylopatis, Andreas
    [J]. PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 48 - 59
  • [4] MM-GAN: 3D MRI Data Augmentation for Medical Image Segmentation via Generative Adversarial Networks
    Sun, Yi
    Yuan, Peisen
    Sun, Yuming
    [J]. 11TH IEEE INTERNATIONAL CONFERENCE ON KNOWLEDGE GRAPH (ICKG 2020), 2020, : 227 - 234
  • [5] Conditional Generative Adversarial Networks for Data Augmentation in Breast Cancer Classification
    Wong, Weng San
    Amer, Mohammed
    Maul, Tomas
    Liao, Iman Yi
    Ahmed, Amr
    [J]. RECENT ADVANCES ON SOFT COMPUTING AND DATA MINING (SCDM 2020), 2020, 978 : 392 - 402
  • [6] Automated fibroglandular tissue segmentation in breast MRI using generative adversarial networks
    Ma, Xiangyuan
    Wang, Jinlong
    Zheng, Xinpeng
    Liu, Zhuangsheng
    Long, Wansheng
    Zhang, Yaqin
    Wei, Jun
    Lu, Yao
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2020, 65 (10):
  • [7] Data Augmentation by Adaptative Targeted Zoom for MRI Brain Tumor Segmentation
    Hernandez, Jose Armando
    [J]. COMPUTATIONAL NEUROSCIENCE, LAWCN 2023, 2024, 2108 : 14 - 24
  • [8] PIXEL LEVEL DATA AUGMENTATION FOR SEMANTIC IMAGE SEGMENTATION USING GENERATIVE ADVERSARIAL NETWORKS
    Liu, Shuangting
    Zhang, Jiaqi
    Chen, Yuxin
    Liu, Yifan
    Qin, Zengchang
    Wan, Tao
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1902 - 1906
  • [9] Rethinking data augmentation for adversarial robustness
    Eghbal-zadeh, Hamid
    Zellinger, Werner
    Pintor, Maura
    Grosse, Kathrin
    Koutini, Khaled
    Moser, Bernhard A.
    Biggio, Battista
    Widmer, Gerhard
    [J]. INFORMATION SCIENCES, 2024, 654
  • [10] Style Data Augmentation for Robust Segmentation of Multi-modality Cardiac MRI
    Ly, Buntheng
    Cochet, Hubert
    Sermesant, Maxime
    [J]. STATISTICAL ATLASES AND COMPUTATIONAL MODELS OF THE HEART: MULTI-SEQUENCE CMR SEGMENTATION, CRT-EPIGGY AND LV FULL QUANTIFICATION CHALLENGES, 2020, 12009 : 197 - 208