A deep translation (GAN) based change detection network for optical and SAR remote sensing images

被引:220
|
作者
Li, Xinghua [1 ]
Du, Zhengshun [1 ]
Huang, Yanyuan [1 ]
Tan, Zhenyu [2 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Northwest Univ, Coll Urban & Environm Sci, Xian 710127, Peoples R China
基金
中国国家自然科学基金;
关键词
Change detection; Deep translation; Depthwise separable convolution; GAN; Multi-scale loss; Optical and SAR images; CLASSIFICATION;
D O I
10.1016/j.isprsjprs.2021.07.007
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
With the development of space-based imaging technology, a larger and larger number of images with different modalities and resolutions are available. The optical images reflect the abundant spectral information and geometric shape of ground objects, whose qualities are degraded easily in poor atmospheric conditions. Although synthetic aperture radar (SAR) images cannot provide the spectral features of the region of interest (ROI), they can capture all-weather and all-time polarization information. In nature, optical and SAR images encapsulate lots of complementary information, which is of great significance for change detection (CD) in poor weather situations. However, due to the difference in imaging mechanisms of optical and SAR images, it is difficult to conduct their CD directly using the traditional difference or ratio algorithms. Most recent CD methods bring image translation to reduce their difference, but the results are obtained by ordinary algebraic methods and threshold segmentation with limited accuracy. Towards this end, this work proposes a d eep translation based change detection network (DTCDN) for optical and SAR images. The deep translation firstly maps images from one domain (e.g., optical) to another domain (e.g., SAR) through a cyclic structure into the same feature space. With the similar characteristics after deep translation, they become comparable. Different from most previous researches, the translation results are imported to a supervised CD network that utilizes deep context features to separate the unchanged pixels and changed pixels. In the experiments, the proposed DTCDN was tested on four representative data sets from Gloucester, California, and Shuguang village. Compared with state-of-the-art methods, the effectiveness and robustness of the proposed method were confirmed.
引用
收藏
页码:14 / 34
页数:21
相关论文
共 50 条
  • [1] Optical and SAR images-based image translation for change detection using generative adversarial network (GAN)
    Ankush Manocha
    Yasir Afaq
    [J]. Multimedia Tools and Applications, 2023, 82 : 26289 - 26315
  • [2] Optical and SAR images-based image translation for change detection using generative adversarial network (GAN)
    Manocha, Ankush
    Afaq, Yasir
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (17) : 26289 - 26315
  • [3] A domain adaptation neural network for change detection with heterogeneous optical and SAR remote sensing images
    Zhang, Chenxiao
    Feng, Yukang
    Hu, Lei
    Tapete, Deodato
    Pan, Li
    Liang, Zheheng
    Cigna, Francesca
    Yue, Peng
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 109
  • [4] Change Detection in Heterogeneous Optical and SAR Remote Sensing Images Via Deep Homogeneous Feature Fusion
    Jiang, Xiao
    Li, Gang
    Liu, Yu
    Zhang, Xiao-Ping
    He, You
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 (13) : 1551 - 1566
  • [5] Change Detection in Remote Sensing Images Based on Image Mapping and a Deep Capsule Network
    Ma, Wenping
    Xiong, Yunta
    Wu, Yue
    Yang, Hui
    Zhang, Xiangrong
    Jiao, Licheng
    [J]. REMOTE SENSING, 2019, 11 (06)
  • [6] Multidomain Constrained Translation Network for Change Detection in Heterogeneous Remote Sensing Images
    Wu, Haoran
    Geng, Jie
    Jiang, Wen
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [7] CIBENet: A channel interaction and bridging-enhanced change detection network for optical and SAR remote sensing images
    Huang, Liang
    Wang, Min
    Tang, Bo -Hui
    Le, Weipeng
    Tian, Qiuyuan
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 131
  • [8] OPTICAL REMOTE SENSING CHANGE DETECTION THROUGH DEEP SIAMESE NETWORK
    Arabi, Mohammed El Amin
    Karoui, Moussa Sofiane
    Djerriri, Khelifa
    [J]. IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 5041 - 5044
  • [9] Deep Siamese Networks Based Change Detection with Remote Sensing Images
    Yang, Le
    Chen, Yiming
    Song, Shiji
    Li, Fan
    Huang, Gao
    [J]. REMOTE SENSING, 2021, 13 (17)
  • [10] DEEP ADAPTIVE PROPOSAL NETWORK IN OPTICAL REMOTE SENSING IMAGES OBJECTIVE DETECTION
    Li, Lingling
    Cheng, Lin
    Guo, Xiaohui
    Liu, Xu
    Jiao, Licheng
    Liu, Fang
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 2651 - 2654