Hierarchical Attention Feature Fusion-Based Network for Land Cover Change Detection With Homogeneous and Heterogeneous Remote Sensing Images

被引:19
|
作者
Lv, ZhiYong [1 ,2 ,3 ]
Liu, Jie [1 ,2 ]
Sun, Weiwei [4 ]
Lei, Tao [5 ]
Benediktsson, Jon Atli [6 ]
Jia, Xiuping [7 ]
机构
[1] Xian Univ Technol, Sch Comp Sci & Engn, Xian 710048, Shaanxi, Peoples R China
[2] Xian Univ Technol, Shaanxi Key Lab Network Comp & Secur Technol, Xian 710048, Shaanxi, Peoples R China
[3] Shenzhen Land & Real Estate Exchange Bldg, Shenzhen 518040, Peoples R China
[4] Ningbo Univ, Dept Geog & Spatial Informat Tech, Ningbo 315211, Zhejiang, Peoples R China
[5] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710021, Peoples R China
[6] Univ Iceland, Fac Elect & Comp Engn, IS-107 Reykjavik, Iceland
[7] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2612, Australia
关键词
Feature extraction; Convolution; Kernel; Deep learning; Decoding; Task analysis; Semantics; Change detection; deep learning; remote sensing images (RSIs); UNet; FRAMEWORK;
D O I
10.1109/TGRS.2023.3334521
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep learning techniques have become popular in land cover change detection (LCCD) with remote sensing images (RSIs). However, many existing networks mostly concentrate on learning deep features but without considering the effect of different features' attention and fusion strategy on detection performance. In this article, a novel hierarchical attention feature fusion (HAFF)-based network for LCCD with RSIs is proposed. In the proposed HAFF-based network, novel multiscale convolution fusion filters (MCFFs) explore the global semantic feature of the interested targets from multiperspective ways. To achieve that objective, the proposed MCFFs are composed by a well-known position attention module (PAM) and a novel multiperspectives feature filter block (MFFB) with different kernel sizes. In addition, a compound loss function was proposed for balancing the impact from the features at different levels in terms of backpropagation error. Experiments conducted on six pairs of real RSIs, including three pairs of homogeneous images and three pairs of heterogeneous images, confirmed the superiority of the proposed HAFF network over other cognate methods. Moreover, the ablation experiments further confirmed the feasibility and superiority of the proposed MCFFs, whereas quantitative observations indicated that competitive improvements are achieved by the proposed MCFFs in terms of all the evaluation indicators. The code for the proposed approach will be available at https://github.com/ImgSciGroup/HAFF.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] LCDNet: Lightweight Change Detection Network With Dual-Attention Guidance and Multiscale Feature Fusion for Remote-Sensing Images
    Li, Junwei
    Li, Shijie
    Wang, Feng
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [22] A Feature Fusion-Based Visual Attention Method for Target Detection in SAR Images
    Zhang, Qiang
    Cao, Zongjie
    [J]. PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2015, 322 : 159 - 166
  • [23] Harbor Detection in Remote Sensing Images Based on Feature Fusion
    Zhao, Huibin
    Li, Weihai
    Yu, Nenghai
    Ao, Huanhuan
    [J]. 2012 5TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), 2012, : 1053 - 1057
  • [24] Attention and feature fusion for aircraft target detection in optical remote sensing images
    Lan Xu-ting
    Guo Zhong-hua
    Li Chang-hao
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2021, 36 (11) : 1506 - 1515
  • [25] Asymmetric Cross-Attention Hierarchical Network Based on CNN and Transformer for Bitemporal Remote Sensing Images Change Detection
    Zhang, Xiaofeng
    Cheng, Shuli
    Wang, Liejun
    Li, Haojin
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [26] A Multiscale Cascaded Cross-Attention Hierarchical Network for Change Detection on Bitemporal Remote Sensing Images
    Zhang, Xiaofeng
    Wang, Liejun
    Cheng, Shuli
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [27] Attention Filtering Network Based on Branch Transformer for Change Detection in Remote Sensing Images
    Yu, Shangguan
    Li, Jinjiang
    Liu, Yepeng
    Fan, Zhang
    Zhang, Caiming
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 19
  • [28] Change Detection of Remote Sensing Images Based on Attention Mechanism
    Chen, Long
    Zhang, Dezheng
    Li, Peng
    Lv, Peng
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2020, 2020
  • [29] Neighborhood fusion-based hierarchical parallel feature pyramid network for object detection
    Mo, Lingfei
    Hu, Shuming
    [J]. Journal of Southeast University (English Edition), 2020, 36 (03) : 252 - 263
  • [30] FRCD: Feature Refine Change Detection Network for Remote Sensing Images
    Wang, Zhewei
    Pan, Zongxu
    Hu, Yuxin
    Lei, Bin
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20