MsFNet: Multi-Scale Fusion Network Based on Dynamic Spectral Features for Multi-Temporal Hyperspectral Image Change Detection

被引:0
|
作者
Feng, Yining [1 ]
Ni, Weihan [2 ]
Song, Liyang [2 ]
Wang, Xianghai [1 ,2 ]
机构
[1] Liaoning Normal Univ, Sch Geog, Dalian 116029, Peoples R China
[2] Liaoning Normal Univ, Sch Comp Sci & Artificial Intelligence, Dalian 116029, Peoples R China
基金
中国国家自然科学基金;
关键词
change detection; deep learning; hyperspectral image; multi-scale feature; multi-temporal analysis; LAND-COVER;
D O I
10.3390/rs16163037
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the development of satellite technology, the importance of multi-temporal remote sensing (RS) image change detection (CD) in urban planning, environmental monitoring, and other fields is increasingly prominent. Deep learning techniques enable a profound exploration of the intrinsic features within hyperspectral (HS) data, leading to substantial enhancements in CD accuracy while addressing several challenges posed by traditional methodologies. However, existing convolutional neural network (CNN)-based CD approaches frequently encounter issues during the feature extraction process, such as the loss of detailed information due to downsampling, which hampers a model's ability to accurately capture complex spectral features. Additionally, these methods often neglect the integration of multi-scale information, resulting in suboptimal local feature extraction and, consequently, diminished model performance. To address these limitations, we propose a multi-scale fusion network (MsFNet) which leverages dynamic spectral features for effective multi-temporal HS-CD. Our approach incorporates a dynamic convolution module with spectral attention, which adaptively modulates the receptive field size according to the spectral characteristics of different bands. This flexibility enhances the model's capacity to focus on critical bands, thereby improving its ability to identify and differentiate changes across spectral dimensions. Furthermore, we develop a multi-scale feature fusion module which extracts and integrates features from deep feature maps, enriching local information and augmenting the model's sensitivity to local variations. Experimental evaluations conducted on three real-world HS-CD datasets demonstrate that the proposed MsFNet significantly outperforms contemporary advanced CD methods in terms of both efficacy and performance.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Multi-scale feature progressive fusion network for remote sensing image change detection
    Lu, Di
    Cheng, Shuli
    Wang, Liejun
    Song, Shiji
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [23] Spectral image fusion based on multi-scale wavelet analysis
    Machikhin, Alexander S.
    [J]. 21ST INTERNATIONAL SYMPOSIUM ON ATMOSPHERIC AND OCEAN OPTICS: ATMOSPHERIC PHYSICS, 2015, 9680
  • [24] Saliency Detection Based on Multi-Scale Image Features
    Zheng, Chaoqun
    Zheng, Xiaozhi
    Wang, Guizhong
    Tian, Shuo
    Guo, Qiang
    [J]. 2016 IEEE 14TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 14TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 2ND INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/DATACOM/CYBERSC, 2016, : 223 - 227
  • [25] Multi-scale spatial-spectral fusion based on multi-input fusion calculation and coordinate attention for hyperspectral image classification
    Yang, Lina
    Zhang, Fengqi
    Wang, Patrick Shen-Pei
    Li, Xichun
    Meng, Zuqiang
    [J]. PATTERN RECOGNITION, 2022, 122
  • [26] Change Detection of Multi-temporal Remote Sensing Data Based on Image Fusion and Fuzzy Clustering
    Liu, Xiaoyan
    Qin, Yali
    Li, Ruchun
    Li, Jia
    Ren, Hongliang
    [J]. 2013 6TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), VOLS 1-3, 2013, : 819 - 823
  • [27] A Change Detection Method Based on Multi-Scale Adaptive Convolution Kernel Network and Multimodal Conditional Random Field for Multi-Temporal Multispectral Images
    Feng, Shou
    Fan, Yuanze
    Tang, Yingjie
    Cheng, Hao
    Zhao, Chunhui
    Zhu, Yaoxuan
    Cheng, Chunhua
    [J]. REMOTE SENSING, 2022, 14 (21)
  • [28] Multi-Scale Transformer Network for Hyperspectral Image Denoising
    Hu, Shuai
    Hu, Yikun
    Lin, Junyan
    Gao, Feng
    Dong, Junyu
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7328 - 7331
  • [29] Hyperspectral image quality based on convolutional network of multi-scale depth
    Liu, Lei
    Sun, Min
    Ren, Xiang
    Li, Xiuxian
    Zhang, Qiaoru
    Ma, Li
    Li, Yongning
    Song, Mo
    [J]. Journal of Visual Communication and Image Representation, 2020, 71
  • [30] Hyperspectral image quality based on convolutional network of multi-scale depth
    Liu, Lei
    Sun, Min
    Ren, Xiang
    Li, Xiuxian
    Zhang, Qiaoru
    Ma, Li
    Li, Yongning
    Song, Mo
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2020, 71