MsFNet: Multi-Scale Fusion Network Based on Dynamic Spectral Features for Multi-Temporal Hyperspectral Image Change Detection

被引:0
|
作者
Feng, Yining [1 ]
Ni, Weihan [2 ]
Song, Liyang [2 ]
Wang, Xianghai [1 ,2 ]
机构
[1] Liaoning Normal Univ, Sch Geog, Dalian 116029, Peoples R China
[2] Liaoning Normal Univ, Sch Comp Sci & Artificial Intelligence, Dalian 116029, Peoples R China
基金
中国国家自然科学基金;
关键词
change detection; deep learning; hyperspectral image; multi-scale feature; multi-temporal analysis; LAND-COVER;
D O I
10.3390/rs16163037
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the development of satellite technology, the importance of multi-temporal remote sensing (RS) image change detection (CD) in urban planning, environmental monitoring, and other fields is increasingly prominent. Deep learning techniques enable a profound exploration of the intrinsic features within hyperspectral (HS) data, leading to substantial enhancements in CD accuracy while addressing several challenges posed by traditional methodologies. However, existing convolutional neural network (CNN)-based CD approaches frequently encounter issues during the feature extraction process, such as the loss of detailed information due to downsampling, which hampers a model's ability to accurately capture complex spectral features. Additionally, these methods often neglect the integration of multi-scale information, resulting in suboptimal local feature extraction and, consequently, diminished model performance. To address these limitations, we propose a multi-scale fusion network (MsFNet) which leverages dynamic spectral features for effective multi-temporal HS-CD. Our approach incorporates a dynamic convolution module with spectral attention, which adaptively modulates the receptive field size according to the spectral characteristics of different bands. This flexibility enhances the model's capacity to focus on critical bands, thereby improving its ability to identify and differentiate changes across spectral dimensions. Furthermore, we develop a multi-scale feature fusion module which extracts and integrates features from deep feature maps, enriching local information and augmenting the model's sensitivity to local variations. Experimental evaluations conducted on three real-world HS-CD datasets demonstrate that the proposed MsFNet significantly outperforms contemporary advanced CD methods in terms of both efficacy and performance.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Multi-Spectral and Multi-Temporal Features Fusion With SE Network for Anomalous Sound Detection
    Kong, Dewei
    Yu, Hongjiang
    Yuan, Guoshun
    [J]. IEEE Access, 2024, 12 : 167262 - 167277
  • [2] TARGETED CHANGE DETECTION FOR STACKED MULTI-TEMPORAL HYPERSPECTRAL IMAGE
    Wu, Chen
    Zhang, Liangpei
    Du, Bo
    [J]. 2012 4TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING (WHISPERS), 2012,
  • [3] Multi-Temporal Spatial-Spectral Comparison Network for Hyperspectral Anomalous Change Detection
    Hu, Meiqi
    Wu, Chen
    Du, Bo
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1432 - 1435
  • [4] Deep Siamese Multi-scale Convolutional Network for Change Detection in Multi-temporal VHR Images
    Chen, Hongruixuan
    Wu, Chen
    Du, Bo
    Zhang, Liangpei
    [J]. 2019 10TH INTERNATIONAL WORKSHOP ON THE ANALYSIS OF MULTITEMPORAL REMOTE SENSING IMAGES (MULTITEMP), 2019,
  • [5] Hyperspectral image change detection based on an improved multi-scale and spectral-wise transformer
    Zou, Changzhong
    Liang, Wenfeng
    Liu, Lei
    Zou, Changwu
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (06) : 1903 - 1924
  • [6] Auto-MSFNet: Search Multi-scale Fusion Network for Salient Object Detection
    Zhang, Miao
    Liu, Tingwei
    Piao, Yongri
    Yao, Shunyu
    Lu, Huchuan
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 667 - 676
  • [7] ROBUST VHR IMAGE CHANGE DETECTION BASED ON LOCAL FEATURES AND MULTI-SCALE FUSION
    Xu, Yuan
    Huo, Chunlei
    Xiang, Shiming
    Pan, Chunhong
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 1991 - 1995
  • [8] MsfNet: a novel small object detection based on multi-scale feature fusion
    Song, Ziying
    Wu, Peiliang
    Yang, Kuihe
    Zhang, Yu
    Liu, Yi
    [J]. 2021 17TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2021), 2021, : 700 - 704
  • [9] Hyperspectral Image Classification Based on Multi-Scale Feature Fusion Residual Network
    Deng Ziqing
    Wang Yang
    Zhang Bing
    Ding Zhao
    Bian Lifeng
    Yang Chen
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (18)
  • [10] A Multi-Scale and Multi-Level Spectral-Spatial Feature Fusion Network for Hyperspectral Image Classification
    Mu, Caihong
    Guo, Zhen
    Liu, Yi
    [J]. REMOTE SENSING, 2020, 12 (01)