An improved generative adversarial networks for remote sensing image super-resolution reconstruction via multi-scale residual block

被引:9
|
作者
Zhu, Fuzhen [1 ]
Wang, Chen [1 ]
Zhu, Bing [2 ]
Sun, Ce [1 ]
Qi, Chengxiao [1 ]
机构
[1] Heilongjiang Univ, Elect Engn Coll, Key Lab Remote Sensing Image Proc, Harbin 150080, Peoples R China
[2] Harbin Inst Technol, Inst Image Informat Technol & Engn, Harbin 150001, Heilongjiang, Peoples R China
关键词
Super -resolution reconstruction; GAN; RaGAN; Multi -scale residual block;
D O I
10.1016/j.ejrs.2022.12.008
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Existing image super-resolution algorithms still suffer from the problems of not extracting rich image features and losing realistic high-frequency details. In order to solve these problems, this paper proposes an improved generative adversarial network algorithm for super-resolution reconstruction of remote sensing images by multi-scale residual blocks. The original generative adversarial network (GAN) struc-ture is improved and multi-scale residual blocks are introduced in the generator to fuse features at dif-ferent scales. After extracting the parallel information of multi-scale features, information is exchanged between multi-resolution information streams to obtain contextual information through spatial and channel attention mechanisms, and multi-scale features are fused according to the attention mechanism. In the discriminator, the concept of relative average GAN (RaGAN) is introduced, and the loss function of the network is redesigned so that the discriminator can predict relative probabilities instead of absolute probabilities thus enabling clear learning of edge and texture details. Experimental results show that the proposed method in this paper significantly outperforms state-of-the-art (SOTA) methods in terms of both subjective and objective metrics.In three test datasets, compared with SOTA methods, the Peak Signal to Noise Ratio(PSNR) is improved by a maximum of 1.18 dB, 0.84 dB and 1.29 dB respectively, and the Structural Similarity Index (SSIM) is improved by 0.0264, 0.0077 and 0.0109 respectively in scale of 2, 3 and 4 times images super-resolution.The model proposed in this paper effectively improved the super-resolution re-construction results of remote sensing images. (c) 2022 National Authority of Remote Sensing & Space Science. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:151 / 160
页数:10
相关论文
共 50 条
  • [41] IMAGE SUPER-RESOLUTION USING COMPLEX DENSE BLOCK ON GENERATIVE ADVERSARIAL NETWORKS
    Chen, Bo-Xun
    Liu, Tsung-Jung
    Liu, Kuan-Hsien
    Liu, Hsin-Hua
    Pei, Soo-Chang
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2866 - 2870
  • [42] Image Super-Resolution Reconstruction Based on Recursive Multi-scale Convolutional Networks
    Gao Q.
    Zhao J.
    Zhou Z.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2020, 33 (11): : 972 - 980
  • [43] Improved face super-resolution generative adversarial networks
    Mengxue Wang
    Zhenxue Chen
    Q. M. Jonathan Wu
    Muwei Jian
    Machine Vision and Applications, 2020, 31
  • [44] Improved face super-resolution generative adversarial networks
    Wang, Mengxue
    Chen, Zhenxue
    Wu, Q. M. Jonathan
    Jian, Muwei
    MACHINE VISION AND APPLICATIONS, 2020, 31 (04)
  • [45] A comparison of Generative Adversarial Networks for image super-resolution
    Cobelli, Patricia
    Nesmachnow, Sergio
    Toutouh, Jamal
    2022 IEEE LATIN AMERICAN CONFERENCE ON COMPUTATIONAL INTELLIGENCE (LA-CCI), 2022, : 30 - 35
  • [46] Image Super-resolution via Residual Block Attention Networks
    Dai, Tao
    Zha, Hua
    Jiang, Yong
    Xia, Shu-Tao
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3879 - 3886
  • [47] Generative Adversarial Networks for Medical Image Super-resolution
    Zhao, Min
    Naderian, Amirkhashayar
    Sanei, Saeid
    2021 INTERNATIONAL CONFERENCE ON E-HEALTH AND BIOENGINEERING (EHB 2021), 9TH EDITION, 2021,
  • [48] Multiframe infrared image super-resolution reconstruction using generative adversarial networks
    Li F.
    He X.
    Wei Z.
    He J.
    He D.
    2018, Chinese Society of Astronautics (47):
  • [49] Image Super-Resolution Reconstruction Algorithm Based on Enhanced Multi-Scale Residual Network
    Xu Jiao
    Yuan Sannan
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (04)
  • [50] Single-image super-resolution reconstruction via generative adversarial network
    Ju, Chunwu
    Su, Xiuqin
    Yang, Haoyuan
    Ning, Hailong
    9TH INTERNATIONAL SYMPOSIUM ON ADVANCED OPTICAL MANUFACTURING AND TESTING TECHNOLOGIES: OPTOELECTRONIC MATERIALS AND DEVICES FOR SENSING AND IMAGING, 2019, 10843