Spatiotemporal Enhancement and Interlevel Fusion Network for Remote Sensing Images Change Detection

被引:16
|
作者
Huang, Yanyuan [1 ]
Li, Xinghua [1 ,2 ]
Du, Zhengshun [1 ]
Shen, Huanfeng [3 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Hubei Luojia Lab, Wuhan 430079, Peoples R China
[3] Wuhan Univ, Sch Resource & Environm Sci, Wuhan 430079, Peoples R China
关键词
Feature extraction; Spatiotemporal phenomena; Remote sensing; Decoding; Semantics; Location awareness; Deep learning; Change detection (CD); deep learning (DL); difference enhancement; feature fusion; remote sensing (RS); BUILDING CHANGE DETECTION; CONVOLUTIONAL NETWORK;
D O I
10.1109/TGRS.2024.3360516
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing (RS) image change detection (CD) plays a crucial role in monitoring surface dynamics; however, current deep learning (DL)-based CD methods still suffer from pseudo changes and scale variations due to inadequate exploration of temporal differences and under-use of multiscale features. Based on the aforementioned considerations, a spatiotemporal enhancement and interlevel fusion network (SEIFNet) is proposed to improve the ability of feature representation for changing objects. First, the multilevel feature maps are acquired from the Siamese hierarchical backbone. To highlight the disparity in the same location at different times, the spatiotemporal difference enhancement modules (ST-DEMs) are introduced to capture global and local information from bitemporal feature maps at each level. Coordinate attention (CA) and cascaded convolutions are adopted in subtraction and connection branches, respectively. Then, an adaptive context fusion module (ACFM) is designed to integrate interlevel features under the guidance of different semantic information, constituting a progressive decoder. Additionally, a plain refinement module and a concise summation-based prediction head are employed to enhance the boundary details and internal integrity of CD results. The experimental results validate the superiority of our lightweight network over eight state-of-the-art (SOTA) methods on LEVIR-CD, SYSU-CD, and WHU-CD datasets, both in accuracy and efficiency. Also, the effects of different types of backbones and differential enhancement modules are discussed in the ablation experiments in detail. The code will be available at https://github.com/lixinghua5540/SEIFNet.
引用
下载
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [31] Change Detection in Multispectral Remote Sensing Images
    Vidya, Kolli Naga
    Parvathaneni, Sai Sanjana
    Haritha, Yamarthi
    Phaneendra Kumar, Boggavarapu L. N.
    Lecture Notes in Mechanical Engineering, 2023, : 405 - 414
  • [32] Scale-wised feature enhancement network for change captioning of remote sensing images
    Zhang, Fengwei
    Zhang, Wenjing
    Xia, Kai
    Feng, Hailin
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (17) : 5845 - 5869
  • [33] Multiscale Attention Fusion Graph Network for Remote Sensing Building Change Detection
    Yu, Shangguan
    Li, Jinjiang
    Chen, Zheng
    Ren, Lu
    Hua, Zhen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 18
  • [34] MDFENet: A Multiscale Difference Feature Enhancement Network for Remote Sensing Change Detection
    Li, Hao
    Liu, Xiaoyong
    Li, Huihui
    Dong, Ziyang
    Xiao, Xiangling
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 3104 - 3115
  • [35] StfMLP: Spatiotemporal Fusion Multilayer Perceptron for Remote-Sensing Images
    Chen, Guangsheng
    Lu, Hailiang
    Di, Donglin
    Li, Linhui
    Emam, Mahmoud
    Jing, Weipeng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [36] StfMLP: Spatiotemporal Fusion Multilayer Perceptron for Remote-Sensing Images
    Chen, Guangsheng
    Lu, Hailiang
    Di, Donglin
    Li, Linhui
    Emam, Mahmoud
    Jing, Weipeng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [37] A Two-Stage Spatiotemporal Fusion Method for Remote Sensing Images
    Sun, Yue
    Zhang, Hua
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2019, 85 (12): : 907 - 914
  • [38] An object-based spatiotemporal fusion model for remote sensing images
    Zhang, Hua
    Sun, Yue
    Shi, Wenzhong
    Guo, Dizhou
    Zheng, Nanshan
    EUROPEAN JOURNAL OF REMOTE SENSING, 2021, 54 (01) : 86 - 101
  • [39] Collaborative Learning Network for Change Detection and Semantic Segmentation of Remote Sensing Images
    Zhu, Jiahang
    Zhou, Yuan
    Xu, Nuo
    Huo, Chunlei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [40] Hyperboloid-Embedded Siamese Network for Change Detection in Remote Sensing Images
    Yang, Qian
    Zhang, Shujun
    Li, Jinsong
    Sun, Yukang
    Han, Qi
    Sun, Yuanyuan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 9240 - 9252