Siamese Biattention Pooling Network for Change Detection in Remote Sensing

被引:0
|
作者
Chen, Hengzhi [1 ]
Hu, Kun [1 ]
Filippi, Patrick [2 ]
Xiang, Wei [3 ]
Bishop, Thomas [2 ]
Wang, Zhiyong [1 ]
机构
[1] Univ Sydney, Sch Comp Sci, Sydney, NSW 2006, Australia
[2] Univ Sydney, Sch Life & Environm Sci, Sydney, NSW 2006, Australia
[3] La Trobe Univ, Sch Comp Engn & Math Sci, Melbourne, Vic 3086, Australia
关键词
Deep learning; Decoding; Transformers; Remote sensing; Feature extraction; Vectors; Principal component analysis; Attention; change detection (CD); deep learning (DL); remote sensing; URBAN CHANGE DETECTION; IMAGES;
D O I
10.1109/JSTARS.2024.3373753
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Change detection (CD) in remote sensing aims to identify variations in image pairs captured at the same location but different times. While recent deep learning approaches, particularly those incorporating attention mechanisms, have achieved encouraging results on this task, they often fall short of comprehensively exploiting the change relevant patterns that are present in paired images. In this study, we propose a novel deep learning architecture, namely Siamese Bi-Attention Pooling Network (SBA-PN), to emphasize broad-scale change patterns by exploiting both intraimage and interimage contexts. The overall structure of SBA-PN aligns with the U-Net based encoder-decoder paradigm. A Siamese Transformer-like encoder formulates paired multiscale feature maps. To effectively emphasize change relevant patterns, a spatial optimal pooling module is devised, replacing the conventional self-attention mechanism. A contrastive pixel-wise supervision scheme is designed for shallow encoder layers in pursuit of change-aware feature maps. Next, the decoder mirrors the multiscale design, which formulates difference maps using a novel biattention mechanism from paired feature maps. During the decoding phase, a channel deviation pooling module is devised to further emphasize salient change regions. Comprehensive experimental results demonstrate the effectiveness of the proposed method with the state-of-the-art performance on two commonly used benchmark datasets, Sun Yat-Sen University (SYSU)-CD and LEarning VIsion Remote sensing (LEVIR)-CD.
引用
收藏
页码:7278 / 7291
页数:14
相关论文
共 50 条
  • [1] WAVELET SIAMESE NETWORK FOR CHANGE DETECTION IN REMOTE SENSING IMAGES
    Li, Tianhan
    Xiong, Fengchao
    Zheng, Wenbin
    Li, Zhuanfeng
    Zhou, Jun
    Qian, Yuntao
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5455 - 5458
  • [2] SRNET: SIAMESE RESIDUAL NETWORK FOR REMOTE SENSING CHANGE DETECTION
    Yang, Yue
    Chen, Tao
    Li, Jun
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6644 - 6647
  • [3] OPTICAL REMOTE SENSING CHANGE DETECTION THROUGH DEEP SIAMESE NETWORK
    Arabi, Mohammed El Amin
    Karoui, Moussa Sofiane
    Djerriri, Khelifa
    [J]. IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 5041 - 5044
  • [4] Boundary Extraction Constrained Siamese Network for Remote Sensing Image Change Detection
    Lei, Jie
    Gu, Yijie
    Xie, Weiying
    Li, Yunsong
    Du, Qian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] Siamese Attentive Convolutional Network for Effective Remote Sensing Image Change Detection
    Wan, Zifu
    Yan, Tianyu
    [J]. 2022 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY, HUMAN-COMPUTER INTERACTION AND ARTIFICIAL INTELLIGENCE, VRHCIAI, 2022, : 167 - 176
  • [6] Global-aware siamese network for change detection on remote sensing images
    Zhang, Ruiqian
    Zhang, Hanchao
    Ning, Xiaogang
    Huang, Xiao
    Wang, Jiaming
    Cui, Wei
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 199 : 61 - 72
  • [7] A Semisupervised Siamese Network for Efficient Change Detection in Heterogeneous Remote Sensing Images
    Jiang, Xiao
    Li, Gang
    Zhang, Xiao-Ping
    He, You
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Hyperboloid-Embedded Siamese Network for Change Detection in Remote Sensing Images
    Yang, Qian
    Zhang, Shujun
    Li, Jinsong
    Sun, Yukang
    Han, Qi
    Sun, Yuanyuan
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 9240 - 9252
  • [9] STransUNet: A Siamese TransUNet-Based Remote Sensing Image Change Detection Network
    Yuan, Jian
    Wang, Liejun
    Cheng, Shuli
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 9241 - 9253
  • [10] SASiamNet: Self-Adaptive Siamese Network for Change Detection of Remote Sensing Image
    Long, Xianxuan
    Zhuang, Wei
    Xia, Min
    Hu, Kai
    Lin, Haifeng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 1021 - 1034