An improved generative adversarial networks for remote sensing image super-resolution reconstruction via multi-scale residual block

被引:9
|
作者
Zhu, Fuzhen [1 ]
Wang, Chen [1 ]
Zhu, Bing [2 ]
Sun, Ce [1 ]
Qi, Chengxiao [1 ]
机构
[1] Heilongjiang Univ, Elect Engn Coll, Key Lab Remote Sensing Image Proc, Harbin 150080, Peoples R China
[2] Harbin Inst Technol, Inst Image Informat Technol & Engn, Harbin 150001, Heilongjiang, Peoples R China
关键词
Super -resolution reconstruction; GAN; RaGAN; Multi -scale residual block;
D O I
10.1016/j.ejrs.2022.12.008
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Existing image super-resolution algorithms still suffer from the problems of not extracting rich image features and losing realistic high-frequency details. In order to solve these problems, this paper proposes an improved generative adversarial network algorithm for super-resolution reconstruction of remote sensing images by multi-scale residual blocks. The original generative adversarial network (GAN) struc-ture is improved and multi-scale residual blocks are introduced in the generator to fuse features at dif-ferent scales. After extracting the parallel information of multi-scale features, information is exchanged between multi-resolution information streams to obtain contextual information through spatial and channel attention mechanisms, and multi-scale features are fused according to the attention mechanism. In the discriminator, the concept of relative average GAN (RaGAN) is introduced, and the loss function of the network is redesigned so that the discriminator can predict relative probabilities instead of absolute probabilities thus enabling clear learning of edge and texture details. Experimental results show that the proposed method in this paper significantly outperforms state-of-the-art (SOTA) methods in terms of both subjective and objective metrics.In three test datasets, compared with SOTA methods, the Peak Signal to Noise Ratio(PSNR) is improved by a maximum of 1.18 dB, 0.84 dB and 1.29 dB respectively, and the Structural Similarity Index (SSIM) is improved by 0.0264, 0.0077 and 0.0109 respectively in scale of 2, 3 and 4 times images super-resolution.The model proposed in this paper effectively improved the super-resolution re-construction results of remote sensing images. (c) 2022 National Authority of Remote Sensing & Space Science. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:151 / 160
页数:10
相关论文
共 50 条
  • [31] Remote sensing image super-resolution using cascade generative adversarial nets
    Guo, Dongen
    Xia, Ying
    Xu, Liming
    Li, Weisheng
    Luo, Xiaobo
    NEUROCOMPUTING, 2021, 443 : 117 - 130
  • [32] Multi-scale adversarial diffusion network for image super-resolution
    Yanli Shi
    Xianhe Zhang
    Yi Jia
    Jinxing Zhao
    Scientific Reports, 15 (1)
  • [33] Multi-Scale Residual Hierarchical Dense Networks for Single Image Super-Resolution
    Liu, Chuangchuang
    Sun, Xianfang
    Chen, Changyou
    Rosin, Paul L.
    Yan, Yitong
    Jin, Longcun
    Peng, Xinyi
    IEEE ACCESS, 2019, 7 : 60572 - 60583
  • [34] Lightweight multi-scale aggregated residual attention networks for image super-resolution
    Pang, Shurong
    Chen, Zhe
    Yin, Fuliang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) : 4797 - 4819
  • [35] Lightweight multi-scale aggregated residual attention networks for image super-resolution
    Shurong Pang
    Zhe Chen
    Fuliang Yin
    Multimedia Tools and Applications, 2022, 81 : 4797 - 4819
  • [36] Lightweight Image Super-Resolution via Weighted Multi-Scale Residual Network
    Long Sun
    Zhenbing Liu
    Xiyan Sun
    Licheng Liu
    Rushi Lan
    Xiaonan Luo
    IEEE/CAA Journal of Automatica Sinica, 2021, 8 (07) : 1271 - 1280
  • [37] Multi-scale Residual Dense Block for Video Super-Resolution
    Cui, Hetao
    Sun, Quansen
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING: VISUAL DATA ENGINEERING, PT I, 2019, 11935 : 424 - 434
  • [38] Lightweight Image Super-Resolution via Weighted Multi-Scale Residual Network
    Sun, Long
    Liu, Zhenbing
    Sun, Xiyan
    Liu, Licheng
    Lan, Rushi
    Luo, Xiaonan
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (07) : 1271 - 1280
  • [39] Image Reconstruction Algorithm Based on Improved Super-Resolution Generative Adversarial Network
    Zha Tibo
    Luo Lin
    Yang Kai
    Zhang Yu
    Li Jinlong
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (08)
  • [40] Remote-sensing image super-resolution using classifier-based generative adversarial networks
    Yue, Haosong
    Cheng, Jiaxiang
    Liu, Zhong
    Chen, Weihai
    JOURNAL OF APPLIED REMOTE SENSING, 2020, 14 (04)