ConMamba: CNN and SSM High-Performance Hybrid Network for Remote Sensing Change Detection

被引:2
|
作者
Dong, Zhiwei [1 ]
Yuan, Genji [2 ]
Hua, Zhen [1 ]
Li, Jinjiang [2 ]
机构
[1] Shandong Technol & Business Univ, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Feature extraction; Transformers; Computer architecture; Convolutional neural networks; Computational modeling; Adaptation models; Data models; Context modeling; Faces; Mamba; remote sensing change detection (RSCD); state space models (SSMs);
D O I
10.1109/TGRS.2024.3495216
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Accurate remote sensing change detection (RSCD) tasks rely on comprehensively processing multiscale information from local details to effectively integrate global dependencies. Hybrid models based on convolutional neural networks (CNNs) and Transformers have become mainstream approaches in RSCD due to their complementary advantages in local feature extraction and long-term dependency modeling. However, the Transformer faces application bottlenecks due to the high secondary complexity of its attention mechanism. In recent years, state-space models (SSMs) with efficient hardware-aware design, represented by Mamba, have gained widespread attention for their excellent performance in long-series modeling and have demonstrated significant advantages in terms of improved accuracy, reduced memory consumption, and reduced computational cost. Based on the high match between the efficiency of SSM in long sequence data processing and the requirements of the RSCD task, this study explores the potential of its application in the RSCD task. However, relying on SSM alone is insufficient in recognizing fine-grained features in remote sensing images. To this end, we propose a novel hybrid architecture, ConMamba, which constructs a high-performance hybrid encoder (CS-Hybridizer) by realizing the deep integration of the CNN and SSM through the feature interaction module (FIM). In addition, we introduce the spatial integration module (SIM) in the feature reconstruction stage to further enhance the model's ability to integrate complex contextual information. Extensive experimental results on three publicly available RSCD datasets show that ConMamba significantly outperforms existing techniques in several performance metrics, validating the effectiveness and foresight of the hybrid architecture based on the CNN and SSM in RSCD.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] CGA-Net: A CNN-GAT Aggregation Network Based on Metric for Change Detection in Remote Sensing
    Lin, Huilan
    Zhao, Chunlei
    He, Rong
    Zhu, Ming
    Jiang, Xin
    Qin, Yi
    Gao, Wen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 8360 - 8376
  • [32] Change Capsule Network for Optical Remote Sensing Image Change Detection
    Xu, Quanfu
    Chen, Keming
    Zhou, Guangyao
    Sun, Xian
    REMOTE SENSING, 2021, 13 (14)
  • [33] Hybrid-TransCD: A Hybrid Transformer Remote Sensing Image Change Detection Network via Token Aggregation
    Ke, Qingtian
    Zhang, Peng
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2022, 11 (04)
  • [34] Remote sensing image change detection based on CNN-Transformer structure
    Pan, Mengyang
    Yang, Hang
    Fan, Xianghui
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (10) : 1361 - 1379
  • [35] Change Detection in Unlabeled Optical Remote Sensing Data Using Siamese CNN
    Hedjam, Rachid
    Abdesselam, Abdelhamid
    Melgani, Farid
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 4178 - 4187
  • [36] Practical framework and methodology for high-performance intelligent invariant detection in remote sensing imagery
    Ning, Xiaogang
    Zhang, Hanchao
    Zhang, Ruiqian
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2024, 53 (06): : 1098 - 1112
  • [37] Titan: A high-performance remote-sensing database
    Chang, CL
    Moon, B
    Acharya, A
    Shock, C
    Sussman, A
    Saltz, J
    13TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING - PROCEEDINGS, 1997, : 375 - 384
  • [38] High-performance computing in remote sensing image compression
    Lin, Albert
    Chang, C. F.
    Lin, M. C.
    Jan, L. J.
    HIGH-PERFORMANCE COMPUTING IN REMOTE SENSING, 2011, 8183
  • [39] Progressive Refinement Network for Remote Sensing Image Change Detection
    Xu, Xinghan
    Liang, Yi
    Liu, Jianwei
    Zhang, Chengkun
    Wang, Deyi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [40] WAVELET SIAMESE NETWORK FOR CHANGE DETECTION IN REMOTE SENSING IMAGES
    Li, Tianhan
    Xiong, Fengchao
    Zheng, Wenbin
    Li, Zhuanfeng
    Zhou, Jun
    Qian, Yuntao
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5455 - 5458