A CBAM Based Multiscale Transformer Fusion Approach for Remote Sensing Image Change Detection

被引:85
|
作者
Wang, Wei [1 ]
Tan, Xinai [1 ]
Zhang, Peng [2 ]
Wang, Xin [1 ]
机构
[1] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Peoples R China
[2] Sun Yat Sen Univ, Sch Elect & Commun Engn, Shenzhen Campus, Shenzhen 518107, Peoples R China
关键词
Transformers; Feature extraction; Remote sensing; Context modeling; Data mining; Semantics; Decoding; Change detection; convolutional block attention module (CBAM); multiscale; remote sensing; transformer; NETWORK;
D O I
10.1109/JSTARS.2022.3198517
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Change detection methods play an indispensable role in remote sensing. Some change detection methods have obtained a fairly good performance by introducing attention mechanism on the basis of the convolutional neural network (CNN), but identifying intricate changes remains difficult. In response to these problems, this article proposes a new model for detecting changes in remote sensing, namely, MTCNet, which combines the advantages of multiscale transformer with the convolutional block attention module (CBAM) to improve the detection quality of different remote sensing images. On the basis of traditional convolutions, the transformer module is introduced to extract bitemporal image features by modeling contextual information. Based on the transformer module, a multiscale module is designed to form a multiscale transformer, which can obtain features at different scales in bitemporal images, thereby identifying the changes we are interested in. Based on the multiscale transformer module, the CBAM is introduced. The CBAM is split into a spatial attention module and a channel attention module, which are applied to the front and back ends of the multiscale transformer, respectively. Spatial information and channel information of feature maps are modeled separately. In this article, the validity and efficiency of the method are verified by a large number of experiments on the LEVIR-CD dataset and the WHU-CD dataset.
引用
收藏
页码:6817 / 6825
页数:9
相关论文
共 50 条
  • [21] SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection
    Zhang, Cui
    Wang, Liejun
    Cheng, Shuli
    Li, Yongming
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [22] A Novel Remote Sensing Image Change Detection Algorithm Based On Image Fusion And Wavelet Theory
    Yan, Xiangchen
    Liu, Haoming
    Wang, Chenxuan
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON COMMUNICATION AND ELECTRONICS SYSTEMS (ICCES), 2016, : 949 - 953
  • [23] A Transformer-Based Network for Change Detection in Remote Sensing Using Multiscale Difference-Enhancement
    Ailimujiang, Gulinazi
    Jiaermuhamaiti, Yiliyaer
    Jumahong, Huxidan
    Wang, Huiling
    Zhu, Shuangling
    Nurmamaiti, Pazilaiti
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [24] Multi-Scenario Remote Sensing Image Forgery Detection Based on Transformer and Model Fusion
    Zhao, Jinmiao
    Shi, Zelin
    Yu, Chuang
    Liu, Yunpeng
    REMOTE SENSING, 2024, 16 (22)
  • [25] Multiscale Remote Sensing Image Fusion Algorithm Based on Variational Segmentation
    Qin F.-Q.
    Wang L.-F.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (06): : 1084 - 1090
  • [26] CMTFNet: CNN and Multiscale Transformer Fusion Network for Remote-Sensing Image Semantic Segmentation
    Wu, Honglin
    Huang, Peng
    Zhang, Min
    Tang, Wenlong
    Yu, Xinyu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [27] Target detection based on remote sensing image fusion
    2001, Journal of Pattern Recognition and Artificial Intelligence (14):
  • [28] Multiscale Attention Fusion Graph Network for Remote Sensing Building Change Detection
    Yu, Shangguan
    Li, Jinjiang
    Chen, Zheng
    Ren, Lu
    Hua, Zhen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 18
  • [29] Remote Sensing Image Classification Method Based on Fusion of CNN and Transformer
    Jin Chuan
    Tong Changqing
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (20)
  • [30] Remote Sensing Image Fusion Method Based on Improved Swin Transformer
    Li Zitong
    Zhao Jiankang
    Xu Jingran
    Long Haihui
    Liu Chuanqi
    ACTA PHOTONICA SINICA, 2023, 52 (11)