TChange: A Hybrid Transformer-CNN Change Detection Network

被引:15
|
作者
Deng, Yupeng [1 ,2 ,3 ]
Meng, Yu [1 ]
Chen, Jingbo [1 ]
Yue, Anzhi [1 ]
Liu, Diyou [1 ]
Chen, Jing [1 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Univ Chinese Acad Sci, Elect Elect & Commun Engn, Beijing 100190, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
deep learning; change detection; convolutional neural network; multihead attention; transformer; IMAGES;
D O I
10.3390/rs15051219
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Change detection is employed to identify regions of change between two different time phases. Presently, the CNN-based change detection algorithm is the mainstream direction of change detection. However, there are two challenges in current change detection methods: (1) the intrascale problem: CNN-based change detection algorithms, due to the local receptive field limitation, can only fuse pairwise characteristics in a local range within a single scale, causing incomplete detection of large-scale targets. (2) The interscale problem: Current algorithms generally fuse layer by layer for interscale communication, with one-way flow of information and long propagation links, which are prone to information loss, making it difficult to take into account both large targets and small targets. To address the above issues, a hybrid transformer-CNN change detection network (TChange) for very-high-spatial-resolution (VHR) remote sensing images is proposed. (1) Change multihead self-attention (Change MSA) is built for global intrascale information exchange of spatial features and channel characteristics. (2) An interscale transformer module (ISTM) is proposed to perform direct interscale information exchange. To address the problem that the transformer tends to lose high-frequency features, the use of deep edge supervision is proposed to replace the commonly utilized depth supervision. TChange achieves state-of-the-art scores on the WUH-CD and LEVIR-CD open-source datasets. Furthermore, to validate the effectiveness of Change MSA and the ISTM proposed by TChange, we construct a change detection dataset, TZ-CD, that covers an area of 900 km2 and contains numerous large targets and weak change targets.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] A transformer-CNN for deep image inpainting forensics
    Zhu, Xinshan
    Lu, Junyan
    Ren, Honghao
    Wang, Hongquan
    Sun, Biao
    VISUAL COMPUTER, 2023, 39 (10): : 4721 - 4735
  • [32] Hybrid Swin Transformer-CNN Model for Pore-Crack Structure Identification
    Li, Huaiyuan
    Li, Hui
    Li, Chuang
    Wu, Baohai
    Gao, Jinghuai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 13
  • [33] Hybrid transformer-CNN network-driven optical-scanning undersampling for photoacoustic remote sensing microscopy
    Pi, Yihan
    Chen, Jijing
    Ding, Kaixuan
    Zhang, Tongyan
    Zhang, Hao
    Zhang, Bingxue
    Guo, Junhao
    Tian, Zhen
    Li, Jiao
    PHOTOACOUSTICS, 2025, 42
  • [34] ASNet: Adaptive Semantic Network Based on Transformer-CNN for Salient Object Detection in Optical Remote Sensing Images
    Yan, Ruixiang
    Yan, Longquan
    Geng, Guohua
    Cao, Yufei
    Zhou, Pengbo
    Meng, Yongle
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [35] LHDACT: Lightweight Hybrid Dual Attention CNN and Transformer Network for Remote Sensing Image Change Detection
    Song, Xinyang
    Hua, Zhen
    Li, Jinjiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [36] TCPCNet: a transformer-CNN parallel cooperative network for low-light image enhancement
    Wanjun Zhang
    Yujie Ding
    Miaohui Zhang
    Yonghua Zhang
    Lvchen Cao
    Ziqing Huang
    Jun Wang
    Multimedia Tools and Applications, 2024, 83 : 52957 - 52972
  • [37] Deep learning for high-impedance fault detection and classification: transformer-CNN
    Rai, Khushwant
    Hojatpanah, Farnam
    Ajaei, Firouz Badrkhani
    Guerrero, Josep M.
    Grolinger, Katarina
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (16): : 14067 - 14084
  • [38] Enhancing Lung Tumor Segmentation: A Comparative Study of CNN-based Network with Multi-Scale Strategies and Attention Mechanisms and Hybrid Transformer-CNN Network
    Kim, Hye Ryun
    Lee, Jumin
    Hong, Helen
    Kim, Bong-Seog
    COMPUTER-AIDED DIAGNOSIS, MEDICAL IMAGING 2024, 2024, 12927
  • [39] SwinURNet: Hybrid Transformer-CNN Architecture for Real-Time Unstructured Road Segmentation
    Wang, Zhangyu
    Liao, Zhihao
    Zhou, Bin
    Yu, Guizhen
    Luo, Wenwen
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [40] scTCA: a hybrid Transformer-CNN architecture for imputation and denoising of scDNA-seq data
    Yu, Zhenhua
    Liu, Furui
    Li, Yang
    BRIEFINGS IN BIOINFORMATICS, 2024, 25 (06)