TChange: A Hybrid Transformer-CNN Change Detection Network

被引:15
|
作者
Deng, Yupeng [1 ,2 ,3 ]
Meng, Yu [1 ]
Chen, Jingbo [1 ]
Yue, Anzhi [1 ]
Liu, Diyou [1 ]
Chen, Jing [1 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Univ Chinese Acad Sci, Elect Elect & Commun Engn, Beijing 100190, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
deep learning; change detection; convolutional neural network; multihead attention; transformer; IMAGES;
D O I
10.3390/rs15051219
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Change detection is employed to identify regions of change between two different time phases. Presently, the CNN-based change detection algorithm is the mainstream direction of change detection. However, there are two challenges in current change detection methods: (1) the intrascale problem: CNN-based change detection algorithms, due to the local receptive field limitation, can only fuse pairwise characteristics in a local range within a single scale, causing incomplete detection of large-scale targets. (2) The interscale problem: Current algorithms generally fuse layer by layer for interscale communication, with one-way flow of information and long propagation links, which are prone to information loss, making it difficult to take into account both large targets and small targets. To address the above issues, a hybrid transformer-CNN change detection network (TChange) for very-high-spatial-resolution (VHR) remote sensing images is proposed. (1) Change multihead self-attention (Change MSA) is built for global intrascale information exchange of spatial features and channel characteristics. (2) An interscale transformer module (ISTM) is proposed to perform direct interscale information exchange. To address the problem that the transformer tends to lose high-frequency features, the use of deep edge supervision is proposed to replace the commonly utilized depth supervision. TChange achieves state-of-the-art scores on the WUH-CD and LEVIR-CD open-source datasets. Furthermore, to validate the effectiveness of Change MSA and the ISTM proposed by TChange, we construct a change detection dataset, TZ-CD, that covers an area of 900 km2 and contains numerous large targets and weak change targets.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Land Cover Classification of UAV Remote Sensing Based on Transformer-CNN Hybrid Architecture
    Lu, Tingyu
    Wan, Luhe
    Qi, Shaoqun
    Gao, Meixiang
    SENSORS, 2023, 23 (11)
  • [42] Lost data reconstruction for structural health monitoring by parallel mixed Transformer-CNN network
    Yang, Fan
    Song, Xueli
    Yi, Wen
    Li, Rongpeng
    Wang, Yilin
    Xiao, Yuzhu
    Ma, Lingjuan
    Ma, Xiao
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2025, 224
  • [43] TCPCNet: a transformer-CNN parallel cooperative network for low-light image enhancement
    Zhang, Wanjun
    Ding, Yujie
    Zhang, Miaohui
    Zhang, Yonghua
    Cao, Lvchen
    Huang, Ziqing
    Wang, Jun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (17) : 52957 - 52972
  • [44] Parallel Transformer-CNN Model for Medical Image Segmentation
    Zhou, Mingkun
    Nie, Xueyun
    Liu, Yuhang
    Li, Doudou
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024, 2024, : 1048 - 1051
  • [45] Transformer-CNN: Swiss knife for QSAR modeling and interpretation
    Pavel Karpov
    Guillaume Godin
    Igor V. Tetko
    Journal of Cheminformatics, 12
  • [46] HCGNet: A Hybrid Change Detection Network Based on CNN and GNN
    Zhang, Cui
    Wang, Liejun
    Cheng, Shuli
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 12
  • [47] Learned Image Compression with Mixed Transformer-CNN Architectures
    Liu, Jinming
    Sun, Heming
    Katto, Jiro
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 14388 - 14397
  • [48] Transformer-CNN: Swiss knife for QSAR modeling and interpretation
    Karpov, Pavel
    Godin, Guillaume
    Tetko, Igor V.
    JOURNAL OF CHEMINFORMATICS, 2020, 12 (01)
  • [49] Hybrid CNN-Transformer Network for Electricity Theft Detection in Smart Grids
    Bai, Yu
    Sun, Haitong
    Zhang, Lili
    Wu, Haoqi
    SENSORS, 2023, 23 (20)
  • [50] SaltFormer: A hybrid CNN-Transformer network for automatic salt dome detection
    Li, Yang
    Peng, Suping
    He, Dengke
    COMPUTERS & GEOSCIENCES, 2025, 195