MsFNet: Multi-Scale Fusion Network Based on Dynamic Spectral Features for Multi-Temporal Hyperspectral Image Change Detection

被引:0
|
作者
Feng, Yining [1 ]
Ni, Weihan [2 ]
Song, Liyang [2 ]
Wang, Xianghai [1 ,2 ]
机构
[1] Liaoning Normal Univ, Sch Geog, Dalian 116029, Peoples R China
[2] Liaoning Normal Univ, Sch Comp Sci & Artificial Intelligence, Dalian 116029, Peoples R China
基金
中国国家自然科学基金;
关键词
change detection; deep learning; hyperspectral image; multi-scale feature; multi-temporal analysis; LAND-COVER;
D O I
10.3390/rs16163037
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the development of satellite technology, the importance of multi-temporal remote sensing (RS) image change detection (CD) in urban planning, environmental monitoring, and other fields is increasingly prominent. Deep learning techniques enable a profound exploration of the intrinsic features within hyperspectral (HS) data, leading to substantial enhancements in CD accuracy while addressing several challenges posed by traditional methodologies. However, existing convolutional neural network (CNN)-based CD approaches frequently encounter issues during the feature extraction process, such as the loss of detailed information due to downsampling, which hampers a model's ability to accurately capture complex spectral features. Additionally, these methods often neglect the integration of multi-scale information, resulting in suboptimal local feature extraction and, consequently, diminished model performance. To address these limitations, we propose a multi-scale fusion network (MsFNet) which leverages dynamic spectral features for effective multi-temporal HS-CD. Our approach incorporates a dynamic convolution module with spectral attention, which adaptively modulates the receptive field size according to the spectral characteristics of different bands. This flexibility enhances the model's capacity to focus on critical bands, thereby improving its ability to identify and differentiate changes across spectral dimensions. Furthermore, we develop a multi-scale feature fusion module which extracts and integrates features from deep feature maps, enriching local information and augmenting the model's sensitivity to local variations. Experimental evaluations conducted on three real-world HS-CD datasets demonstrate that the proposed MsFNet significantly outperforms contemporary advanced CD methods in terms of both efficacy and performance.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Multi-Spectral and Multi-Temporal Features Fusion With SE Network for Anomalous Sound Detection
    Kong, Dewei
    Yu, Hongjiang
    Yuan, Guoshun
    IEEE ACCESS, 2024, 12 : 167262 - 167277
  • [2] TARGETED CHANGE DETECTION FOR STACKED MULTI-TEMPORAL HYPERSPECTRAL IMAGE
    Wu, Chen
    Zhang, Liangpei
    Du, Bo
    2012 4TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING (WHISPERS), 2012,
  • [3] Multi-Temporal Spatial-Spectral Comparison Network for Hyperspectral Anomalous Change Detection
    Hu, Meiqi
    Wu, Chen
    Du, Bo
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1432 - 1435
  • [4] Deep Siamese Multi-scale Convolutional Network for Change Detection in Multi-temporal VHR Images
    Chen, Hongruixuan
    Wu, Chen
    Du, Bo
    Zhang, Liangpei
    2019 10TH INTERNATIONAL WORKSHOP ON THE ANALYSIS OF MULTITEMPORAL REMOTE SENSING IMAGES (MULTITEMP), 2019,
  • [5] Hyperspectral image change detection based on an improved multi-scale and spectral-wise transformer
    Zou, Changzhong
    Liang, Wenfeng
    Liu, Lei
    Zou, Changwu
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (06) : 1903 - 1924
  • [6] ROBUST VHR IMAGE CHANGE DETECTION BASED ON LOCAL FEATURES AND MULTI-SCALE FUSION
    Xu, Yuan
    Huo, Chunlei
    Xiang, Shiming
    Pan, Chunhong
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 1991 - 1995
  • [7] Auto-MSFNet: Search Multi-scale Fusion Network for Salient Object Detection
    Zhang, Miao
    Liu, Tingwei
    Piao, Yongri
    Yao, Shunyu
    Lu, Huchuan
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 667 - 676
  • [8] MsfNet: a novel small object detection based on multi-scale feature fusion
    Song, Ziying
    Wu, Peiliang
    Yang, Kuihe
    Zhang, Yu
    Liu, Yi
    2021 17TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2021), 2021, : 700 - 704
  • [9] A Novel Multi-scale Feature Fusion Based Network for Hyperspectral and Multispectral Image Fusion
    Dong, Shuai
    Huang, Shaoguang
    Zhang, Jinhan
    Zhang, Hongyan
    PATTERN RECOGNITION AND COMPUTER VISION, PT XIII, PRCV 2024, 2025, 15043 : 530 - 544
  • [10] Hyperspectral Image Classification Based on Multi-Scale Feature Fusion Residual Network
    Deng Ziqing
    Wang Yang
    Zhang Bing
    Ding Zhao
    Bian Lifeng
    Yang Chen
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (18)