TChange: A Hybrid Transformer-CNN Change Detection Network

被引:15
|
作者
Deng, Yupeng [1 ,2 ,3 ]
Meng, Yu [1 ]
Chen, Jingbo [1 ]
Yue, Anzhi [1 ]
Liu, Diyou [1 ]
Chen, Jing [1 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Univ Chinese Acad Sci, Elect Elect & Commun Engn, Beijing 100190, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
deep learning; change detection; convolutional neural network; multihead attention; transformer; IMAGES;
D O I
10.3390/rs15051219
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Change detection is employed to identify regions of change between two different time phases. Presently, the CNN-based change detection algorithm is the mainstream direction of change detection. However, there are two challenges in current change detection methods: (1) the intrascale problem: CNN-based change detection algorithms, due to the local receptive field limitation, can only fuse pairwise characteristics in a local range within a single scale, causing incomplete detection of large-scale targets. (2) The interscale problem: Current algorithms generally fuse layer by layer for interscale communication, with one-way flow of information and long propagation links, which are prone to information loss, making it difficult to take into account both large targets and small targets. To address the above issues, a hybrid transformer-CNN change detection network (TChange) for very-high-spatial-resolution (VHR) remote sensing images is proposed. (1) Change multihead self-attention (Change MSA) is built for global intrascale information exchange of spatial features and channel characteristics. (2) An interscale transformer module (ISTM) is proposed to perform direct interscale information exchange. To address the problem that the transformer tends to lose high-frequency features, the use of deep edge supervision is proposed to replace the commonly utilized depth supervision. TChange achieves state-of-the-art scores on the WUH-CD and LEVIR-CD open-source datasets. Furthermore, to validate the effectiveness of Change MSA and the ISTM proposed by TChange, we construct a change detection dataset, TZ-CD, that covers an area of 900 km2 and contains numerous large targets and weak change targets.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] TTH-Net: Two-Stage Transformer-CNN Hybrid Network for Leaf Vein Segmentation
    Song, Peng
    Yu, Yonghong
    Zhang, Yang
    APPLIED SCIENCES-BASEL, 2023, 13 (19):
  • [22] Hybrid transformer-CNN with boundary-awareness network for 3D medical image segmentation
    Jianfei He
    Canhui Xu
    Applied Intelligence, 2023, 53 : 28542 - 28554
  • [23] Hybrid transformer-CNN model for accurate prediction of peptide hemolytic potential
    Almotairi, Sultan
    Badr, Elsayed
    Abdelbaky, Ibrahim
    Elhakeem, Mohamed
    Abdul Salam, Mustafa
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [24] Hybrid transformer-CNN with boundary-awareness network for 3D medical image segmentation
    He, Jianfei
    Xu, Canhui
    APPLIED INTELLIGENCE, 2023, 53 (23) : 28542 - 28554
  • [25] Dual encoder network with transformer-CNN for multi-organ segmentation
    Hong, Zhifang
    Chen, Mingzhi
    Hu, Weijie
    Yan, Shiyu
    Qu, Aiping
    Chen, Lingna
    Chen, Junxi
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2023, 61 (03) : 661 - 671
  • [26] CTRNet: An Automatic Modulation Recognition Based on Transformer-CNN Neural Network
    Zhang, Wenna
    Xue, Kailiang
    Yao, Aiqin
    Sun, Yunqiang
    ELECTRONICS, 2024, 13 (17)
  • [27] Dual encoder network with transformer-CNN for multi-organ segmentation
    Zhifang Hong
    Mingzhi Chen
    Weijie Hu
    Shiyu Yan
    Aiping Qu
    Lingna Chen
    Junxi Chen
    Medical & Biological Engineering & Computing, 2023, 61 : 661 - 671
  • [28] Deep learning for high-impedance fault detection and classification: transformer-CNN
    Khushwant Rai
    Farnam Hojatpanah
    Firouz Badrkhani Ajaei
    Josep M. Guerrero
    Katarina Grolinger
    Neural Computing and Applications, 2022, 34 : 14067 - 14084
  • [29] TransCNN-HAE: Transformer-CNN Hybrid AutoEncoder for Blind Image Inpainting
    Zhao, Haoru
    Gu, Zhaorui
    Zheng, Bing
    Zheng, Haiyong
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6813 - 6821
  • [30] Dual branch Transformer-CNN parametric filtering network for underwater image enhancement
    Chang, Baocai
    Li, Jinjiang
    Ren, Lu
    Chen, Zheng
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100