Hierarchical Attention Feature Fusion-Based Network for Land Cover Change Detection With Homogeneous and Heterogeneous Remote Sensing Images

被引:19
|
作者
Lv, ZhiYong [1 ,2 ,3 ]
Liu, Jie [1 ,2 ]
Sun, Weiwei [4 ]
Lei, Tao [5 ]
Benediktsson, Jon Atli [6 ]
Jia, Xiuping [7 ]
机构
[1] Xian Univ Technol, Sch Comp Sci & Engn, Xian 710048, Shaanxi, Peoples R China
[2] Xian Univ Technol, Shaanxi Key Lab Network Comp & Secur Technol, Xian 710048, Shaanxi, Peoples R China
[3] Shenzhen Land & Real Estate Exchange Bldg, Shenzhen 518040, Peoples R China
[4] Ningbo Univ, Dept Geog & Spatial Informat Tech, Ningbo 315211, Zhejiang, Peoples R China
[5] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710021, Peoples R China
[6] Univ Iceland, Fac Elect & Comp Engn, IS-107 Reykjavik, Iceland
[7] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2612, Australia
关键词
Feature extraction; Convolution; Kernel; Deep learning; Decoding; Task analysis; Semantics; Change detection; deep learning; remote sensing images (RSIs); UNet; FRAMEWORK;
D O I
10.1109/TGRS.2023.3334521
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep learning techniques have become popular in land cover change detection (LCCD) with remote sensing images (RSIs). However, many existing networks mostly concentrate on learning deep features but without considering the effect of different features' attention and fusion strategy on detection performance. In this article, a novel hierarchical attention feature fusion (HAFF)-based network for LCCD with RSIs is proposed. In the proposed HAFF-based network, novel multiscale convolution fusion filters (MCFFs) explore the global semantic feature of the interested targets from multiperspective ways. To achieve that objective, the proposed MCFFs are composed by a well-known position attention module (PAM) and a novel multiperspectives feature filter block (MFFB) with different kernel sizes. In addition, a compound loss function was proposed for balancing the impact from the features at different levels in terms of backpropagation error. Experiments conducted on six pairs of real RSIs, including three pairs of homogeneous images and three pairs of heterogeneous images, confirmed the superiority of the proposed HAFF network over other cognate methods. Moreover, the ablation experiments further confirmed the feasibility and superiority of the proposed MCFFs, whereas quantitative observations indicated that competitive improvements are achieved by the proposed MCFFs in terms of all the evaluation indicators. The code for the proposed approach will be available at https://github.com/ImgSciGroup/HAFF.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] A Multi-Feature Fusion-Based Change Detection Method for Remote Sensing Images
    Liping Cai
    Wenzhong Shi
    Ming Hao
    Hua Zhang
    Lipeng Gao
    [J]. Journal of the Indian Society of Remote Sensing, 2018, 46 : 2015 - 2022
  • [2] A Multi-Feature Fusion-Based Change Detection Method for Remote Sensing Images
    Cai, Liping
    Shi, Wenzhong
    Hao, Ming
    Zhang, Hua
    Gao, Lipeng
    [J]. JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2018, 46 (12) : 2015 - 2022
  • [3] Cross-attention neural network for land cover change detection with remote sensing images
    Lv, Zhiyong
    Zhong, Pingdong
    Wang, Wei
    Sun, Weiwei
    Lei, Tao
    Nicola, Falco
    [J]. PHOTOGRAMMETRIC RECORD, 2024, 39 (186): : 412 - 434
  • [4] Change Detection in Heterogeneous Optical and SAR Remote Sensing Images Via Deep Homogeneous Feature Fusion
    Jiang, Xiao
    Li, Gang
    Liu, Yu
    Zhang, Xiao-Ping
    He, You
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 1551 - 1566
  • [5] Multiscale Attention Network Guided With Change Gradient Image for Land Cover Change Detection Using Remote Sensing Images
    Lv, Zhiyong
    Zhong, Pingdong
    Wang, Wei
    You, Zhenzhen
    Falco, Nicola
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [6] Land Cover Change Detection With Heterogeneous Remote Sensing Images: Review, Progress, and Perspective
    Lv, ZhiYong
    Huang, HaiTao
    Li, Xinghua
    Zhao, MingHua
    Benediktsson, Jon Atli
    Sun, WeiWei
    Falco, Nicola
    [J]. PROCEEDINGS OF THE IEEE, 2022, 110 (12) : 1976 - 1991
  • [7] Small Object Detection in Remote Sensing Images Based on Feature Fusion and Attention
    Zhang Yin
    Zhu Guiyi
    Shi Tianjun
    Zhang Kun
    Yan Junhua
    [J]. ACTA OPTICA SINICA, 2022, 42 (24)
  • [8] AMFFNet: attention-guided multi-level feature fusion network for land cover classification of remote sensing images
    Tang, Bochuan
    Tuerxun, Palidan
    Qi, Ranran
    Yang, Guangqi
    Qian, Yurong
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2023, 17 (02)
  • [9] A multiscale graph convolutional network for change detection in homogeneous and heterogeneous remote sensing images
    Wu, Junzheng
    Li, Biao
    Qin, Yao
    Ni, Weiping
    Zhang, Han
    Fu, Ruigang
    Sun, Yuli
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 105
  • [10] A Hierarchical Consensus Attention Network for Feature Matching of Remote Sensing Images
    Chen, Shuang
    Chen, Jiaxuan
    Rao, Yujing
    Chen, Xiaoxian
    Fan, Xiaoyan
    Bai, Haicheng
    Xing, Lin
    Zhou, Chengjiang
    Yang, Yang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60