Remote sensing image denoising using residual encoder-decoder networks with edge enhancement

被引:0
|
作者
Wu C. [1 ]
Chen X. [1 ]
Zhan S. [1 ]
机构
[1] School of Computer and Information, Hefei University of Technology, Hefei
来源
Zhan, Shu (shu_zhan@hfut.edu.cn) | 1600年 / Science Press卷 / 24期
基金
中国国家自然科学基金;
关键词
Convolutional neural network; Edge enhancement; GF-2 remote sensing image; Perceptual loss; Remote sensing image denoising;
D O I
10.11834/jrs.20208169
中图分类号
学科分类号
摘要
Remote sensing images are often affected by noise in the process of digitization and transmission processes. Denoising is an indispensable way of improving image quality. Despite showing an excellent noise removal performance, the existing denoising algorithms however typically suffer from a common drawback. Specifically, in the learning process, some edge information is lost, thereby over-smoothing the denoising result. Given the importance of details-including sharp edges and texture information-in remote sensing images, we propose a residual encoder-decoder denoising network with joint loss (REDJ) for GF-2 satellite data. Inspired by U-net, we use a deep convolutional framework is used to learn the end-to-end mapping from noisy images to the original ones. The encoder acts as a feature extractor that captures semantic information of image contents while eliminating noise, whereas the decoder recovers the image details. The high-resolution features from the encoder are combined with the up-sampled output by skip connection. We also introduce high-frequency decomposition and residual mapping to simplify the training process by reducing the solution space. As for the loss function, we modify the traditional denoising per-pixel loss. Given a well-trained convolutional neural network for defining perceptual loss, we instead to learn the perceptual differences of the extracted features instead of merely matching the low-level pixel information. Unlike the loss of detail resulting from normal per-pixel MSE loss, we recommend a new joint loss that combines the advantages of both per-pixel reconstruction and feature reconstruction, preserves additional edge and texture information, and generates clear denoised results. We employ the GF-2 satellite images in the experiments. To obtain enough training and testing data, we divide the entire high-resolution image is divided into 1200 pictures of size 512 and then allocate 70% of these images for training and the other 30% for testing. We generate the noisy images by adding Gaussian noise. To verify the effectiveness of our proposed network, we compare our quantitative and qualitative results with those of other state-of-the-art methods, including wavelet threshold, total variation, and K-SVD. Our proposed method REDJ can obtain the best index values both of PSNR and average gradient. In the qualitative visual sense, REDJ obtains clear denoising results because of the joint of perceptual loss. Compared with other methods that produce blurred regions generated by other methods, REDJ preserves more edge information and texture details. We also compare the run times of different methods for denoising images and find that REDJ has a relatively high CPU speed and achieves an excellent computational efficiency on GPU time. This paper successfully applies deep learning theory for denoising remote sensing images. We use the proposed network is used to remove noise from high-resolution GF-2 remote sensing images and to preserve the edge contours and fine details, which is conducive to facilitate later detection, classification, and other remote sensing applications. In our future work, we will explore to handle other types of noises, especially the complex real-world noises, and consider a single comprehensive network for more image restoration tasks. © 2020, Science Press. All right reserved.
引用
收藏
页码:27 / 36
页数:9
相关论文
共 50 条
  • [31] Low-Light Image Enhancement Based on Deep Symmetric Encoder-Decoder Convolutional Networks
    Li, Qiming
    Wu, Haishen
    Xu, Lu
    Wang, Likai
    Lv, Yueqi
    Kang, Xinjie
    [J]. SYMMETRY-BASEL, 2020, 12 (03):
  • [32] Speckle denoising of optical coherence tomography image using residual encoder–decoder CycleGAN
    Kang Xie
    Mengting Luo
    Hu Chen
    Mingming Yang
    Yuhua He
    Peixi Liao
    Yi Zhang
    [J]. Signal, Image and Video Processing, 2023, 17 : 1521 - 1533
  • [33] Deep Residual Encoder-Decoder Networks for Desert Seismic Noise Suppression
    Ma, Haitao
    Yao, Haiyang
    Li, Yue
    Wang, Hongzhou
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (03) : 529 - 533
  • [34] Denoising Raman spectra using fully convolutional encoder-decoder network
    Loc, Irem
    Kecoglu, Ibrahim
    Unlu, Mehmet Burcin
    Parlatan, Ugur
    [J]. JOURNAL OF RAMAN SPECTROSCOPY, 2022, 53 (08) : 1445 - 1452
  • [35] Unsupervised Feature Selection using Encoder-Decoder Networks
    SharifiPour, Sasan
    Fayyazi, Hossein
    Sabokro, Mohammad
    [J]. 2020 6TH IRANIAN CONFERENCE ON SIGNAL PROCESSING AND INTELLIGENT SYSTEMS (ICSPIS), 2020,
  • [36] Detection of Building Change in Remote Sensing Image Based on Encoder-Decoder Network UNet3+
    Liang Y.
    Yi C.-X.
    Wang G.-Y.
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2023, 46 (08): : 1720 - 1732
  • [37] Semantic Segmentation of Remote Sensing Image Based on Multi-Scale Semantic Encoder-Decoder Network
    Liang Y.
    Yi C.-X.
    Wang G.-Y.
    Hu Y.-H.
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2023, 51 (11): : 3199 - 3214
  • [38] Semantic pixel labelling in remote sensing images using a deep convolutional encoder-decoder model
    Wei, Xin
    Fu, Kun
    Gao, Xin
    Yan, Menglong
    Sun, Xian
    Chen, Kaiqiang
    Sun, Hao
    [J]. REMOTE SENSING LETTERS, 2018, 9 (03) : 199 - 208
  • [39] Interpretable Transformations with Encoder-Decoder Networks
    Worrall, Daniel E.
    Garbin, Stephan J.
    Turmukhambetov, Daniyar
    Brostow, Gabriel J.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 5737 - 5746
  • [40] Building Precision: Efficient Encoder-Decoder Networks for Remote Sensing Based on Aerial RGB and LiDAR Data
    Sulaiman, Muhammad
    Finnesand, Erik
    Farmanbar, Mina
    Belbachir, Ahmed Nabil
    Rong, Chunming
    [J]. IEEE ACCESS, 2024, 12 : 60329 - 60346