ConMamba: CNN and SSM High-Performance Hybrid Network for Remote Sensing Change Detection

被引:2
|
作者
Dong, Zhiwei [1 ]
Yuan, Genji [2 ]
Hua, Zhen [1 ]
Li, Jinjiang [2 ]
机构
[1] Shandong Technol & Business Univ, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Feature extraction; Transformers; Computer architecture; Convolutional neural networks; Computational modeling; Adaptation models; Data models; Context modeling; Faces; Mamba; remote sensing change detection (RSCD); state space models (SSMs);
D O I
10.1109/TGRS.2024.3495216
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Accurate remote sensing change detection (RSCD) tasks rely on comprehensively processing multiscale information from local details to effectively integrate global dependencies. Hybrid models based on convolutional neural networks (CNNs) and Transformers have become mainstream approaches in RSCD due to their complementary advantages in local feature extraction and long-term dependency modeling. However, the Transformer faces application bottlenecks due to the high secondary complexity of its attention mechanism. In recent years, state-space models (SSMs) with efficient hardware-aware design, represented by Mamba, have gained widespread attention for their excellent performance in long-series modeling and have demonstrated significant advantages in terms of improved accuracy, reduced memory consumption, and reduced computational cost. Based on the high match between the efficiency of SSM in long sequence data processing and the requirements of the RSCD task, this study explores the potential of its application in the RSCD task. However, relying on SSM alone is insufficient in recognizing fine-grained features in remote sensing images. To this end, we propose a novel hybrid architecture, ConMamba, which constructs a high-performance hybrid encoder (CS-Hybridizer) by realizing the deep integration of the CNN and SSM through the feature interaction module (FIM). In addition, we introduce the spatial integration module (SIM) in the feature reconstruction stage to further enhance the model's ability to integrate complex contextual information. Extensive experimental results on three publicly available RSCD datasets show that ConMamba significantly outperforms existing techniques in several performance metrics, validating the effectiveness and foresight of the hybrid architecture based on the CNN and SSM in RSCD.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] LFHNet: Lightweight Full-Scale Hybrid Network for Remote Sensing Change Detection
    Jiang, Xintao
    Zhang, Shubin
    Gan, Jun
    Wei, Jujie
    Luo, Qingli
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 10266 - 10278
  • [22] Gradient-Guided Temporal Cross-Attention Transformer for High-Performance Remote Sensing Change Detection
    Zhang, Hao
    Wu, Yang
    Song, Huihui
    Zhang, Kaihua
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [23] Multistage Interaction Network for Remote Sensing Change Detection
    Zhou, Meng
    Qian, Weixian
    Ren, Kan
    REMOTE SENSING, 2024, 16 (06)
  • [24] Hybrid CNN and Transformer Network for Semantic Segmentation of UAV Remote Sensing Images
    Zhou X.
    Zhou L.
    Gong S.
    Zhang H.
    Zhong S.
    Xia Y.
    Huang Y.
    IEEE Journal on Miniaturization for Air and Space Systems, 2024, 5 (01): : 33 - 41
  • [25] SSNet: A Novel Transformer and CNN Hybrid Network for Remote Sensing Semantic Segmentation
    Yao, Min
    Zhang, Yaozu
    Liu, Guofeng
    Pang, Dongdong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 3023 - 3037
  • [26] Change detection based on Faster R-CNN for high-resolution remote sensing images
    Wang, Qing
    Zhang, Xiaodong
    Chen, Guanzhou
    Dai, Fan
    Gong, Yuanfu
    Zhu, Kun
    REMOTE SENSING LETTERS, 2018, 9 (10) : 923 - 932
  • [27] TChange: A Hybrid Transformer-CNN Change Detection Network
    Deng, Yupeng
    Meng, Yu
    Chen, Jingbo
    Yue, Anzhi
    Liu, Diyou
    Chen, Jing
    REMOTE SENSING, 2023, 15 (05)
  • [28] HCGNet: A Hybrid Change Detection Network Based on CNN and GNN
    Zhang, Cui
    Wang, Liejun
    Cheng, Shuli
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 12
  • [29] A hybrid change detection analysis using high-resolution remote sensing image
    Xu, Q. Q.
    Liu, Z. J.
    Yang, M. Z.
    Ren, H. C.
    Song, C.
    Li, F. F.
    6TH DIGITAL EARTH SUMMIT, 2016, 46
  • [30] CTST: CNN and Transformer-Based Spatio-Temporally Synchronized Network for Remote Sensing Change Detection
    Wang, Shuo
    Wu, Wenbin
    Zheng, Zhiqing
    Li, Jinjiang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 16272 - 16288