STENet: A Spatial Selection and Temporal Evolution Network for Change Detection in Remote Sensing Images

被引:0
|
作者
Pan, Xiang [1 ]
Lai, Jintao [1 ]
Jin, Yiting [1 ]
Zhou, Xiaolei [1 ]
Zheng, Jianwei [1 ]
机构
[1] Zhejiang Univ Technol, Coll Comp Sci & Technol, Hangzhou 310023, Peoples R China
基金
中国国家自然科学基金;
关键词
Correlation; Computational modeling; Semantics; Data augmentation; Feature extraction; Transformers; Rendering (computer graphics); Change detection (CD); convolutional neural network (CNN); remote sensing (RS); transformer;
D O I
10.1109/TGRS.2024.3428551
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Accompanied by the booming development of remote sensing (RS) imaging techniques, change detection (CD) has emerged as a conspicuous focal point in the realm of geoscience. Traditionally, extensive research has predominantly centered on extracting semantic features from individual images yet neglecting the interinput correlations latent in bitemporal imagery. This oversight gives rise to the occurrence of pseudovariant regions and the blurring of detection boundaries. To address these challenges, we propose a spatial selection and temporal evolution network, named STENet, which aims to unravel semantic correlations between bitemporal images from both spatial and temporal perspectives. Specifically, a dual pathway is crafted. The first one explores precisely the spatial localization of changes in bitemporal pairs, while the other complements the local details by generating a pseudovideo input via specific data augmentation. To boost the precision (Pre) of localizing sparsely changed targets, we further present a dynamic selective attention (DSA) mechanism, which strives for more focus on the positive regions while holding a mild computational demand. Moreover, by leveraging data augmentation to derive the temporal evolution of a set of progressively changed images, we then exploit a 3-D convolution-based encoder to mine the potential details therein, endeavoring to a refinement of target boundaries. Ultimately, STENet enforces the fusion of multiscale spatial and temporal features through a dedicated decoder and generates the final change map. Experiments on four popular datasets show that our proposal scores higher than most state-of-the-art approaches. In addition, the appealing performance is achieved with mild quantities of parameters and computations. The code is available at https://github.com/ZhengJianwei2/STENet.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Spatial-Temporal Evolution Guided Change Detection Network for Remote Sensing Images
    Wang, Qingwang
    Hong, Zheng
    Huang, Jiangbo
    Zhao, Xiaobin
    Song, Jian
    Zeng, Kai
    Shi, Jianwu
    Shen, Tao
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 14080 - 14092
  • [2] STNet: Spatial and Temporal feature fusion network for change detection in remote sensing images
    Ma, Xiaowen
    Yang, Jiawei
    Hong, Tingfeng
    Ma, Mengting
    Zhao, Ziyan
    Feng, Tian
    Zhang, Wei
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2195 - 2200
  • [3] A Divided Spatial and Temporal Context Network for Remote Sensing Change Detection
    Shi, Nian
    Chen, Keming
    Zhou, Guangyao
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 4897 - 4908
  • [4] Sample Selection Based Change Detection with Dilated Network Learning in Remote Sensing Images
    Venugopal, N.
    [J]. SENSING AND IMAGING, 2019, 20 (1):
  • [5] Sample Selection Based Change Detection with Dilated Network Learning in Remote Sensing Images
    N. Venugopal
    [J]. Sensing and Imaging, 2019, 20
  • [6] CHANGE DETECTION NETWORK OF NEARSHORE SHIPS FOR MULTI-TEMPORAL OPTICAL REMOTE SENSING IMAGES
    Cao, Jingyi
    You, Yanan
    Ning, Yuanyong
    Zhou, Wenli
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 2531 - 2534
  • [7] FTRNet: triplet fusion temporal relationship network for change detection in bitemporal remote sensing images
    Wu, Wei
    Li, Tong
    Xuan, Qi
    Wan, Qiming
    Chen, Zuohui
    [J]. GEOCARTO INTERNATIONAL, 2024, 39 (01)
  • [8] Ultralightweight Spatial-Spectral Feature Cooperation Network for Change Detection in Remote Sensing Images
    Lei, Tao
    Geng, Xinzhe
    Ning, Hailong
    Lv, Zhiyong
    Gong, Maoguo
    Jin, Yaochu
    Nandis, Asoke K. K.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [9] WAVELET SIAMESE NETWORK FOR CHANGE DETECTION IN REMOTE SENSING IMAGES
    Li, Tianhan
    Xiong, Fengchao
    Zheng, Wenbin
    Li, Zhuanfeng
    Zhou, Jun
    Qian, Yuntao
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5455 - 5458
  • [10] Spatial-Temporal Semantic Perception Network for Remote Sensing Image Semantic Change Detection
    He, You
    Zhang, Hanchao
    Ning, Xiaogang
    Zhang, Ruiqian
    Chang, Dong
    Hao, Minghui
    [J]. REMOTE SENSING, 2023, 15 (16)