Spatiotemporal Enhancement and Interlevel Fusion Network for Remote Sensing Images Change Detection

被引:16
|
作者
Huang, Yanyuan [1 ]
Li, Xinghua [1 ,2 ]
Du, Zhengshun [1 ]
Shen, Huanfeng [3 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Hubei Luojia Lab, Wuhan 430079, Peoples R China
[3] Wuhan Univ, Sch Resource & Environm Sci, Wuhan 430079, Peoples R China
关键词
Feature extraction; Spatiotemporal phenomena; Remote sensing; Decoding; Semantics; Location awareness; Deep learning; Change detection (CD); deep learning (DL); difference enhancement; feature fusion; remote sensing (RS); BUILDING CHANGE DETECTION; CONVOLUTIONAL NETWORK;
D O I
10.1109/TGRS.2024.3360516
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing (RS) image change detection (CD) plays a crucial role in monitoring surface dynamics; however, current deep learning (DL)-based CD methods still suffer from pseudo changes and scale variations due to inadequate exploration of temporal differences and under-use of multiscale features. Based on the aforementioned considerations, a spatiotemporal enhancement and interlevel fusion network (SEIFNet) is proposed to improve the ability of feature representation for changing objects. First, the multilevel feature maps are acquired from the Siamese hierarchical backbone. To highlight the disparity in the same location at different times, the spatiotemporal difference enhancement modules (ST-DEMs) are introduced to capture global and local information from bitemporal feature maps at each level. Coordinate attention (CA) and cascaded convolutions are adopted in subtraction and connection branches, respectively. Then, an adaptive context fusion module (ACFM) is designed to integrate interlevel features under the guidance of different semantic information, constituting a progressive decoder. Additionally, a plain refinement module and a concise summation-based prediction head are employed to enhance the boundary details and internal integrity of CD results. The experimental results validate the superiority of our lightweight network over eight state-of-the-art (SOTA) methods on LEVIR-CD, SYSU-CD, and WHU-CD datasets, both in accuracy and efficiency. Also, the effects of different types of backbones and differential enhancement modules are discussed in the ablation experiments in detail. The code will be available at https://github.com/lixinghua5540/SEIFNet.
引用
下载
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [41] Semantic Information Collaboration Network for Semantic Change Detection in Remote Sensing Images
    Ning, Xiaogang
    He, You
    Zhang, Hanchao
    Zhang, Ruiqian
    Chang, Dong
    Hao, Minghui
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 12893 - 12909
  • [42] Global-aware siamese network for change detection on remote sensing images
    Zhang, Ruiqian
    Zhang, Hanchao
    Ning, Xiaogang
    Huang, Xiao
    Wang, Jiaming
    Cui, Wei
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 199 : 61 - 72
  • [43] A Semisupervised Siamese Network for Efficient Change Detection in Heterogeneous Remote Sensing Images
    Jiang, Xiao
    Li, Gang
    Zhang, Xiao-Ping
    He, You
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [44] Multidomain Constrained Translation Network for Change Detection in Heterogeneous Remote Sensing Images
    Wu, Haoran
    Geng, Jie
    Jiang, Wen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [45] A Difference Enhanced Neural Network for Semantic Change Detection of Remote Sensing Images
    Wang, Renfang
    Wu, Hucheng
    Qiu, Hong
    Wang, Feng
    Liu, Xiufeng
    Cheng, Xu
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [46] Object-based change detection on multiscale fusion for VHR remote sensing images
    Zhang, Hansong
    Chen, Jianyu
    Liu, Xin
    MIPPR 2015: REMOTE SENSING IMAGE PROCESSING, GEOGRAPHIC INFORMATION SYSTEMS, AND OTHER APPLICATIONS, 2015, 9815
  • [47] Joint Variation Learning of Fusion and Difference Features for Change Detection in Remote Sensing Images
    Jiang, Kaixuan
    Zhang, Wenhua
    Liu, Jia
    Liu, Fang
    Xiao, Liang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [48] DMNet: A Network Architecture Using Dilated Convolution and Multiscale Mechanisms for Spatiotemporal Fusion of Remote Sensing Images
    Li, Weisheng
    Zhang, Xiayan
    Peng, Yidong
    Dong, Meilin
    IEEE SENSORS JOURNAL, 2020, 20 (20) : 12190 - 12202
  • [49] A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing images
    Zhang, Chenxiao
    Yue, Peng
    Tapete, Deodato
    Jiang, Liangcun
    Shangguan, Boyi
    Huang, Li
    Liu, Guangchao
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 166 : 183 - 200
  • [50] MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images
    Ma, Jinming
    Shi, Gang
    Li, Yanxiang
    Zhao, Ziyu
    SENSORS, 2022, 22 (03)