Image Super-Resolution Reconstruction Method Using Dual Discriminator Based on Generative Adversarial Networks

被引:4
|
作者
Yuan Piaoyi [1 ]
Zhang Yaping [1 ]
机构
[1] Yunnan Normal Univ, Sch Informat Sci & Technol, Kunming 650500, Yunnan, Peoples R China
关键词
image processing; generative adversarial network; image super-resolution reconstruction; convolutional neural network; KL divergence;
D O I
10.3788/LOP56.231010
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this study, we propose a dual discriminator super-resolution reconstruction network (DDSRRN) that can improve the super-resolution reconstruction quality of images. By adding a discriminator based on generative adversarial networks, the DDSRRN combines the Kullback-Leibler (KL) divergence and reverse KL divergence into a unified objective function for training two discriminators. Thus, the complementary statistical properties obtained from these divergences can be exploited to effectively diversify the pre-estimated density under multiple modes. Additionally, model collapse is effectively avoided during the reconstruction process, and the model training stability is improved. The model loss function can be designed based on the Charbonnier loss function to estimate the content loss. Furthermore, the intermediate features of the network arc used to design the perceptual loss and style loss. Finally, a deconvolution layer is designed to reconstruct the super-resolution images, thereby reducing the image reconstruction time. The proposed method is experimentally demonstrated to provide abundant details. Thus, the proposed method exhibits good generalization ability and obtains improved subjective visual evaluation and objective quantitative evaluation.
引用
收藏
页数:10
相关论文
共 26 条
  • [1] NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study
    Agustsson, Eirikur
    Timofte, Radu
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1122 - 1131
  • [2] [Anonymous], 2018, LNCS, DOI DOI 10.1007/978-3-030-01252-66
  • [3] Bevilacqua M, 2012, INT CONF ACOUST SPEE, P1289, DOI 10.1109/ICASSP.2012.6288125
  • [4] Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods
    Bruhn A.
    Weickert J.
    Schnörr C.
    [J]. International Journal of Computer Vision, 2005, 61 (3) : 1 - 21
  • [5] Dahl R, 2017, 2017 IEEE C COMP VIS
  • [6] Learning a Deep Convolutional Network for Image Super-Resolution
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 184 - 199
  • [7] Goodfellow IJ, 2017, P 27 INT C NEUR INF
  • [8] GulrajaniI Ahmed F, 2017, P 27 INT C NEUR INF
  • [9] Identity Mappings in Deep Residual Networks
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 : 630 - 645
  • [10] Kim J, 2016, PROC CVPR IEEE, P1637, DOI [10.1109/CVPR.2016.181, 10.1109/CVPR.2016.182]