Improved generative adversarial networks with reconstruction loss

被引:19
|
作者
Li, Yanchun [1 ]
Xiao, Nanfeng [1 ]
Ouyang, Wanli [2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[2] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW, Australia
基金
中国国家自然科学基金;
关键词
Generative adversarial networks (GAN); Image generation; Reconstruction loss; Deep generative model;
D O I
10.1016/j.neucom.2018.10.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a simple regularization scheme to handle the problem of mode missing and unstable training in the generative adversarial networks (GAN). The key idea is to utilize the visual features learned by the discriminator. We reconstruct the real data by feeding the generator with the real data features extracted by the discriminator. A reconstruction loss is added to the GAN's objective function to enforce the generator can reconstruct from the features of the discriminator, which helps to explicitly guide the generator towards to near the probable configurations of real data. The proposed reconstruction loss improves the performance of GAN, produces higher quality images on different dataset, and can be easily combined with other regularization loss functions such as gradient penalty to improve the performance of various GANs. We conducted experiments on the widespread adopted architecture DCGAN and the complicated ResNet architecture across different datasets, the results of which show the effectiveness and robustness of our proposed method. (C) 2018 Elsevier B.V. All rights reserved.
引用
下载
收藏
页码:363 / 372
页数:10
相关论文
共 50 条
  • [21] Subsampled brain MRI reconstruction by generative adversarial neural networks
    Shaul, Roy
    David, Itamar
    Shitrit, Ohad
    Raviv, Tammy Riklin
    MEDICAL IMAGE ANALYSIS, 2020, 65
  • [22] Reconstruction of fractional vortex phase evolution by generative adversarial networks
    Gao, Heng
    Zhang, Zhihong
    Yang, Yuanjie
    APPLIED OPTICS, 2023, 62 (21) : 5707 - 5713
  • [23] A mesoscale eddy reconstruction method based on generative adversarial networks
    Ma, Xiaodong
    Zhang, Lei
    Xu, Weishuai
    Li, Maolin
    Zhou, Xingyu
    FRONTIERS IN MARINE SCIENCE, 2024, 11
  • [24] Reconstruction for beam blockage of lidar based on generative adversarial networks
    Yang, Haoyu
    Yuan, Jinlong
    Guan, Li
    Su, Lian
    Wei, Tianwen
    Xia, Haiyun
    OPTICS EXPRESS, 2024, 32 (08) : 14420 - 14434
  • [25] Generative adversarial networks based regularized image reconstruction for PET
    Xie, Zhaoheng
    Baikejiang, Reheman
    Gong, Kuang
    Zhang, Xuezhu
    Qi, Jinyi
    15TH INTERNATIONAL MEETING ON FULLY THREE-DIMENSIONAL IMAGE RECONSTRUCTION IN RADIOLOGY AND NUCLEAR MEDICINE, 2019, 11072
  • [26] License Plate Image Reconstruction Based on Generative Adversarial Networks
    Lin, Mianfen
    Liu, Liangxin
    Wang, Fei
    Li, Jingcong
    Pan, Jiahui
    REMOTE SENSING, 2021, 13 (15)
  • [27] Reconstruction of Iberian ceramic potteries using generative adversarial networks
    Pablo Navarro
    Celia Cintas
    Manuel Lucena
    José Manuel Fuertes
    Rafael Segura
    Claudio Delrieux
    Rolando González-José
    Scientific Reports, 12
  • [28] Face Reconstruction from Voice using Generative Adversarial Networks
    Wen, Yandong
    Singh, Rita
    Raj, Bhiksha
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [29] MirGAN: Medical Image Reconstruction using Generative Adversarial Networks
    Dang, Nitin
    Khurana, Manju
    Tiwari, Shailendra
    PROCEEDINGS OF THE 2020 5TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND SECURITY (ICCCS-2020), 2020,
  • [30] Blind Vocoder Speech Reconstruction using Generative Adversarial Networks
    Blum, Yoav
    Burshtein, David
    2019 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2019,