Cross-Level Attentive Feature Aggregation for Change Detection

被引:3
|
作者
Wang, Guangxing [1 ]
Cheng, Gong [1 ]
Zhou, Peicheng [2 ]
Han, Junwei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710129, Peoples R China
[2] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Head; Modulation; Logic gates; Task analysis; Fuses; Transformers; Change detection; feature aggregation; feature pyramid network; attention mechanism;
D O I
10.1109/TCSVT.2023.3344092
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This article studies change detection within pairs of optical images remotely sensed from overhead views. We consider that a high-performance solution to this task entails highly effective multi-level feature interaction. With that in mind, we propose a novel approach characterized by two attentive feature aggregation schemes that handle cross-level features in different processes. For the Siamese-based feature extraction of the bi-temporal image pair, we attach emphasis on constructing semantically strong and contextually rich pyramidal feature representations to enable comprehensive matching and differencing. To this end, we leverage a feature pyramid network and re-formulate its cross-level feature merging procedure as top-down modulation with multiplicative channel attention and additive gated attention. For the multi-level difference feature fusion, we progressively fuse the derived difference feature pyramid in an attend-then-filter manner. This makes the high-level fused features and the adjacent lower-level difference features constrain each other, and thus allows steady feature fusion for specifying change regions. In addition, we build an upsampling head as a replacement for the normal heads followed by static upsampling. Our implementation contains a stack of upsampling modules that allocate features for each pixel. Each has a learnable branch that produces attentive residuals for refining the statically upsampled results. We conduct extensive experiments on four public datasets and results show that our approach achieves state-of-the-art performance. Code is available at https://github.com/xingronaldo/CLAFA.
引用
收藏
页码:6051 / 6062
页数:12
相关论文
共 50 条
  • [1] Cross-level Feature Aggregation Network for Polyp Segmentation
    Zhou, Tao
    Zhou, Yi
    He, Kelei
    Gong, Chen
    Yang, Jian
    Fu, Huazhu
    Shen, Dinggang
    [J]. PATTERN RECOGNITION, 2023, 140
  • [2] Cross-level feature aggregation image enhancement with dual-path hybrid attention
    Yuan, Heng
    Wang, Xiaoxue
    Yan, Tinghao
    Zhang, Shengchong
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2024, 32 (10): : 1538 - 1551
  • [3] Defocus blur detection via adaptive cross-level feature fusion and refinement
    Zhao, Zijian
    Yang, Hang
    Liu, Peiyu
    Nie, Haitao
    Zhang, Zhongbo
    Li, Chunyu
    [J]. VISUAL COMPUTER, 2024, 40 (11): : 8141 - 8153
  • [4] Exploring Feature Compensation and Cross-level Correlation for Infrared Small Target Detection
    Zhang, Mingjin
    Yue, Ke
    Zhang, Jing
    Li, Yunsong
    Gao, Xinbo
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1857 - 1865
  • [5] Face forgery detection with cross-level attention
    Liu, Yaju
    Fei, Jianwei
    Yu, Peipeng
    Yuan, Chengsheng
    Liang, Haopeng
    [J]. INTERNATIONAL JOURNAL OF AUTONOMOUS AND ADAPTIVE COMMUNICATIONS SYSTEMS, 2024, 17 (03) : 233 - 246
  • [6] Hybridizing Cross-Level Contextual and Attentive Representations for Remote Sensing Imagery Semantic Segmentation
    Li, Xin
    Xu, Feng
    Xia, Runliang
    Lyu, Xin
    Gao, Hongmin
    Tong, Yao
    [J]. REMOTE SENSING, 2021, 13 (15)
  • [7] RGB-D Salient Object Detection Based on Cross-Modal and Cross-Level Feature Fusion
    Peng, Yanbin
    Zhai, Zhinian
    Feng, Mingkun
    [J]. IEEE Access, 2024, 12 : 45134 - 45146
  • [8] RGB-D Salient Object Detection Based on Cross-Modal and Cross-Level Feature Fusion
    Peng, Yanbin
    Zhai, Zhinian
    Feng, Mingkun
    [J]. IEEE ACCESS, 2024, 12 : 45134 - 45146
  • [9] Dense Prediction with Attentive Feature Aggregation
    Yang, Yung-Hsu
    Huang, Thomas E.
    Sun, Min
    Bulo, Samuel Rota
    Kontschieder, Peter
    Yu, Fisher
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 97 - 106
  • [10] COHORTS, AGGREGATION PROBLEMS AND CROSS-LEVEL THEORIZING - CASE OF PARTISAN STABILITY
    VANDERBOK, WG
    [J]. WESTERN POLITICAL QUARTERLY, 1977, 30 (01): : 104 - 111