Reconstruction of super-resolution from high-resolution remote sensing images based on convolutional neural networks

被引:0
|
作者
Liu, Yang [1 ]
Xu, Hu [2 ]
Shi, Xiaodong [3 ]
机构
[1] Henan Univ Econ & Law, Cloud Comp & Big Data Inst, Zhengzhou, Henan, Peoples R China
[2] Yellow River Inst Hydraul Res, Henan Key Lab Ecol Environm Protect & Restorat Yel, Zhengzhou, Henan, Peoples R China
[3] Henan Univ Econ & Law, Sch Ecommerce & Logist Management, Zhengzhou, Peoples R China
关键词
Super-resolution; Remote sensing images; Convolutional neural networks; Edge enhancement; Artifact discrimination;
D O I
10.7717/peerj-cs.2218
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this study, a novel algorithm named the Edge-enhanced Generative Adversarial Network (EGAN) is proposed to address the issues of noise corruption and edge fuzziness in the super-resolution of remote sensing images. To build upon the baseline model called Deep Blind Super-Resolution GAN (DBSR-GAN), an edge enhancement module is introduced to enhance the edge information of the images. To enlarge the receptive field of the algorithm, the Mask branch within the edge enhancement structure is further optimized. Moreover, the loss of image consistency is introduced to guide edge reconstruction, and subpixel convolution is employed for upsampling, thus resulting in sharper edge contours and more consistent stylized results. To tackle the low utilization of global information and the reconstruction of super-resolution artifacts in remote sensing images, an alternative algorithm named Nonlocal Module and Artifact Discrimination EGAN (END-GAN) is proposed. The END-GAN introduces a nonlocal module based on the EGAN in the feature extraction stage of the algorithm, enabling better utilization of the internal correlations of remote sensing images and enhancing the algorithm's capability to extract global target features. Additionally, a method discriminating artifacts is implemented to distinguish between artifacts and reals in reconstructed images. Then, the algorithm is optimized by introducing an artifact loss discrimination alongside the original loss function. Experimental comparisons on two datasets of remote sensing images, NWPUVHR-10 and UCAS-AOD, demonstrate significant improvements in the evaluation indexes when the proposed algorithm is under investigation.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Super-resolution reconstruction of remote sensing images based on convolutional neural network
    Tian, Yu
    Jia, Rui-Sheng
    Xu, Shao-Hua
    Hua, Rong
    Deng, Meng-Di
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2019, 13 (04)
  • [2] NARROW ROAD EXTRACTION FROM REMOTE SENSING IMAGES BASED ON SUPER-RESOLUTION CONVOLUTIONAL NEURAL NETWORK
    Zhou, Xinyu
    Chen, Xi
    Zhang, Ye
    [J]. IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 685 - 688
  • [3] Flow-based super-resolution reconstruction of remote sensing images
    Ren Shubo
    Meng Qian
    Wu Zuan
    [J]. CHINESE SPACE SCIENCE AND TECHNOLOGY, 2022, 42 (06) : 99 - 106
  • [4] Depth Map Super-Resolution Reconstruction Based on Convolutional Neural Networks
    [J]. Lei, Guoqing (lgq20051118@163.com), 2017, Chinese Optical Society (37):
  • [5] Super-resolution on Remote Sensing Images
    Yang, Yuting
    Lam, Kin-Man
    Dong, Junyu
    Sun, Xin
    Jian, Muwei
    [J]. INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2021, 2021, 11766
  • [6] Super-Resolution Reconstruction Algorithm To MODIS Remote Sensing Images
    Shen, Huanfeng
    Ng, Michael K.
    Li, Pingxiang
    Zhang, Liangpei
    [J]. COMPUTER JOURNAL, 2009, 52 (01): : 90 - 100
  • [7] A practical super-resolution method for multi-degradation remote sensing images with deep convolutional neural networks
    Zhao, Zhibo
    Ren, Chao
    Teng, Qizhi
    He, Xiaohai
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2022, 19 (06) : 1139 - 1154
  • [8] A practical super-resolution method for multi-degradation remote sensing images with deep convolutional neural networks
    Zhibo Zhao
    Chao Ren
    Qizhi Teng
    Xiaohai He
    [J]. Journal of Real-Time Image Processing, 2022, 19 : 1139 - 1154
  • [9] Water Identification from High-Resolution Remote Sensing Images Based on Multidimensional Densely Connected Convolutional Neural Networks
    Wang, Guojie
    Wu, Mengjuan
    Wei, Xikun
    Song, Huihui
    [J]. REMOTE SENSING, 2020, 12 (05)
  • [10] Remote sensing images super-resolution with deep convolution networks
    Qiong Ran
    Xiaodong Xu
    Shizhi Zhao
    Wei Li
    Qian Du
    [J]. Multimedia Tools and Applications, 2020, 79 : 8985 - 9001