MCWESRGAN: Improving Enhanced Super-Resolution Generative Adversarial Network for Satellite Images

被引:2
|
作者
Karwowska, Kinga [1 ]
Wierzbicki, Damian [1 ]
机构
[1] Mil Univ Technol, Fac Civil Engn & Geodesy, Dept Imagery Intelligence, PL-00908 Warsaw, Poland
关键词
Spatial resolution; Training; Generators; Superresolution; Generative adversarial networks; Satellite images; Computational modeling; Convolutional neural networks; deep learning; enhanced super-resolution generative adversarial network (ESRGAN); neural networks; power spectral density (PSD); single-image super-resolution (SISR); super resolution (SR); RESOLUTION;
D O I
10.1109/JSTARS.2023.3322642
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the dynamic technological development, we are witnessing a major progress in solutions that allow for the observation of Earth's surface. Small satellites have a significant drawback. Due to their limitations, the installed optic systems are not perfect. As a result, the quality of the obtained images is lower, including lower resolution, although the satellites move on the Low Earth Orbit. In the case of images lacking a high-resolution counterpart, the spatial resolution of the imagery can be improved using single-image super-resolution algorithms. In this article, we present an SISR solution based on a new network called MCWESRGAN, which is a modification of the popular ESRGAN network. We propose a novel strategy that introduces a multi-column discriminator model. The generator model is trained using Wasserstein loss. The introduced modifications enable a tenfold reduction in the training time of the network. The proposed algorithm is verified using images obtained from space, aerial imagery, and the Dataset for Object deTection in Aerial Images (DOTA) database. A set of evaluation methods for super-resolution (SR) images is proposed to verify the results. These evaluation methods indicate areas that are poorly estimated by the algorithm. Furthermore, as part of the conducted experiments, an absolute assessment method for interpretational potential based on the power spectral density of the image (PSD) is proposed, allowing for determining the magnitude of interpretational improvement after applying resolution enhancement algorithms. The conducted research demonstrates that we achieve better qualitative and quantitative results than classical ESRGAN methods and other state-of-the-art (SOTA) approaches.
引用
收藏
页码:9886 / 9906
页数:21
相关论文
共 50 条
  • [41] Generative adversarial image super-resolution network for multiple degradations
    Lin, Hong
    Fan, Jing
    Zhang, Yangyi
    Peng, Dewei
    IET IMAGE PROCESSING, 2020, 14 (17) : 4520 - 4527
  • [42] Image Super-Resolution using a Improved Generative Adversarial Network
    Wang, Han
    Wu, Wei
    Su, Yang
    Duan, Yongsheng
    Wang, Pengze
    PROCEEDINGS OF 2019 IEEE 9TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2019), 2019, : 312 - 315
  • [43] Super-Resolution Reconstruction of Cell Images Based on Generative Adversarial Networks
    Pan, Bin
    Du, Yifeng
    Guo, Xiaoming
    IEEE ACCESS, 2024, 12 : 72252 - 72263
  • [44] Super-resolution of magnetic resonance images using Generative Adversarial Networks
    Guerreiro, Joao
    Tomas, Pedro
    Garcia, Nuno
    Aidos, Helena
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 108
  • [45] MedSRGAN: medical images super-resolution using generative adversarial networks
    Yuchong Gu
    Zitao Zeng
    Haibin Chen
    Jun Wei
    Yaqin Zhang
    Binghui Chen
    Yingqin Li
    Yujuan Qin
    Qing Xie
    Zhuoren Jiang
    Yao Lu
    Multimedia Tools and Applications, 2020, 79 : 21815 - 21840
  • [46] Improving Image Super-Resolution Based on Multiscale Generative Adversarial Networks
    Yuan, Cao
    Deng, Kaidi
    Li, Chen
    Zhang, Xueting
    Li, Yaqin
    ENTROPY, 2022, 24 (08)
  • [47] TE-SAGAN: An Improved Generative Adversarial Network for Remote Sensing Super-Resolution Images
    Xu, Yongyang
    Luo, Wei
    Hu, Anna
    Xie, Zhong
    Xie, Xuejing
    Tao, Liufeng
    REMOTE SENSING, 2022, 14 (10)
  • [48] PathSRGAN: Multi-Supervised Super-Resolution for Cytopathological Images Using Generative Adversarial Network
    Ma, Jiabo
    Yu, Jingya
    Liu, Sibo
    Chen, Li
    Li, Xu
    Feng, Jie
    Chen, Zhixing
    Zeng, Shaoqun
    Liu, Xiuli
    Cheng, Shenghua
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (09) : 2920 - 2930
  • [49] Super-Resolution Reconstruction Method of Pavement Crack Images Based on an Improved Generative Adversarial Network
    Yuan, Bo
    Sun, Zhaoyun
    Pei, Lili
    Li, Wei
    Ding, Minghang
    Hao, Xueli
    SENSORS, 2022, 22 (23)
  • [50] Simultaneous denoising and super-resolution of optical coherence tomography images based on a generative adversarial network
    Huang, Yongqiang
    Lu, Zexin
    Shao, Zhimin
    Ran, Maosong
    Zhou, Jiliu
    Fang, Leyuan
    Zhang, Yi
    OPTICS EXPRESS, 2019, 27 (09): : 12289 - 12307