SCAD: A Siamese Cross-Attention Discrimination Network for Bitemporal Building Change Detection

被引:6
|
作者
Xu, Chuan [1 ]
Ye, Zhaoyi [1 ]
Mei, Liye [1 ,2 ]
Shen, Sen [3 ]
Zhang, Qi [1 ]
Sui, Haigang [4 ]
Yang, Wei [5 ]
Sun, Shaohua [6 ]
机构
[1] Hubei Univ Technol, Sch Comp Sci, Wuhan 430068, Peoples R China
[2] Wuhan Univ, Inst Technol Sci, Wuhan 430072, Peoples R China
[3] Naval Engn Univ, Sch Weap Engn, Wuhan 430032, Peoples R China
[4] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430072, Peoples R China
[5] Wuchang Shouyi Univ, Sch Informat Sci & Engn, Wuhan 430064, Peoples R China
[6] Air Force Res Acad, Beijing 10085, Peoples R China
基金
中国国家自然科学基金;
关键词
building change detection; deep learning; Siamese cross-attention; feature fusion; differential context; COVER CHANGE DETECTION; IMAGE;
D O I
10.3390/rs14246213
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Building change detection (BCD) is crucial for urban construction and planning. The powerful discriminative ability of deep convolutions in deep learning-based BCD methods has considerably increased the accuracy and efficiency. However, dense and continuously distributed buildings contain a wide range of multi-scale features, which render current deep learning methods incapable of discriminating and incorporating multiple features effectively. In this work, we propose a Siamese cross-attention discrimination network (SCADNet) to identify complex information in bitemporal images and improve the change detection accuracy. Specifically, we first use the Siamese cross-attention (SCA) module to learn unchanged and changed feature information, combining multi-head cross-attention to improve the global validity of high-level semantic information. Second, we adapt a multi-scale feature fusion (MFF) module to integrate embedded tokens with context-rich channel transformer outputs. Then, upsampling is performed to fuse the extracted multi-scale information content to recover the original image information to the maximum extent. For information content with a large difference in contextual semantics, we perform filtering using a differential context discrimination (DCD) module, which can help the network to avoid pseudo-change occurrences. The experimental results show that the present SCADNet is able to achieve a significant change detection performance in terms of three public BCD datasets (LEVIR-CD, SYSU-CD, and WHU-CD). For these three datasets, we obtain F1 scores of 90.32%, 81.79%, and 88.62%, as well as OA values of 97.98%, 91.23%, and 98.88%, respectively.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] A Multiscale Cascaded Cross-Attention Hierarchical Network for Change Detection on Bitemporal Remote Sensing Images
    Zhang, Xiaofeng
    Wang, Liejun
    Cheng, Shuli
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [2] CASNet: A Cross-Attention Siamese Network for Video Salient Object Detection
    Ji, Yuzhu
    Zhang, Haijun
    Jie, Zequn
    Ma, Lin
    Wu, Q. M. Jonathan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (06) : 2676 - 2690
  • [3] Asymmetric Cross-Attention Hierarchical Network Based on CNN and Transformer for Bitemporal Remote Sensing Images Change Detection
    Zhang, Xiaofeng
    Cheng, Shuli
    Wang, Liejun
    Li, Haojin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [4] A cross-attention and Siamese network based model for off-topic detection
    Fan, Cong
    Guo, Shen
    Wumaier, Aishan
    Liu, Jiajun
    2023 IEEE 35TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2023, : 770 - 777
  • [5] An Improved Siamese Tracking Network Based On Self-Attention And Cross-Attention
    Lai Yijun
    Song Jianmei
    She Haoping
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 466 - 470
  • [6] Cross-Attention Guided Group Aggregation Network for Cropland Change Detection
    Xu, Chuan
    Ye, Zhaoyi
    Mei, Liye
    Shen, Sen
    Sun, Shaohua
    Wang, Ying
    Yang, Wei
    IEEE SENSORS JOURNAL, 2023, 23 (12) : 13680 - 13691
  • [7] Bitemporal Remote Sensing Image Change Detection Network Based on Siamese-Attention Feedback Architecture
    Yin, Hongyang
    Ma, Chong
    Weng, Liguo
    Xia, Min
    Lin, Haifeng
    REMOTE SENSING, 2023, 15 (17)
  • [8] Bitemporal Attention Transformer for Building Change Detection and Building Damage Assessment
    Lu, Wen
    Wei, Lu
    Nguyen, Minh
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 4917 - 4935
  • [9] Multi-level Cross-attention Siamese Network For Visual Object Tracking
    Zhang, Jianwei
    Wang, Jingchao
    Zhang, Huanlong
    Miao, Mengen
    Cai, Zengyu
    Chen, Fuguo
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (12): : 3976 - 3990
  • [10] CSCNet: A Cross-Scale Coordination Siamese Network for Building Change Detection
    Zhao, Yiyang
    Song, Xinyang
    Li, Jinjiang
    Liu, Yepeng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 1377 - 1389