Spectral Correlation and Spatial High-Low Frequency Information of Hyperspectral Image Super-Resolution Network

被引:3
|
作者
Zhang, Jing [1 ,2 ,3 ,4 ]
Zheng, Renjie [4 ]
Chen, Xu [4 ]
Hong, Zhaolong [4 ]
Li, Yunsong [1 ,2 ]
Lu, Ruitao [5 ]
机构
[1] Xidian Univ, State Key Lab Lntegrated Serv Network, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
[3] Xidian Univ, Guangzhou Inst Technol, Guangzhou 510700, Peoples R China
[4] Xidian Univ, Hangzhou Inst Technol, Hangzhou 311231, Peoples R China
[5] Rocket Force Univ Engn, Dept Control Engn, Xian 710025, Peoples R China
关键词
frequency separation; spectrum adaptive attention; hyperspectral images; super-resolution; RESOLUTION; INTERPOLATION;
D O I
10.3390/rs15092472
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Hyperspectral images (HSIs) generally contain tens or even hundreds of spectral segments within a specific frequency range. Due to the limitations and cost of imaging sensors, HSIs often trade spatial resolution for finer band resolution. To compensate for the loss of spatial resolution and maintain a balance between space and spectrum, existing algorithms were used to obtain excellent results. However, these algorithms could not fully mine the coupling relationship between the spectral domain and spatial domain of HSIs. In this study, we presented a spectral correlation and spatial high-low frequency information of a hyperspectral image super-resolution network (SCSFINet) based on the spectrum-guided attention for analyzing the information already obtained from HSIs. The core of our algorithms was the spectral and spatial feature extraction module (SSFM), consisting of two key elements: (a) spectrum-guided attention fusion (SGAF) using SGSA/SGCA and CFJSF to extract spectral-spatial and spectral-channel joint feature attention, and (b) high- and low-frequency separated multi-level feature fusion (FSMFF) for fusing the multi-level information. In the final stage of upsampling, we proposed the channel grouping and fusion (CGF) module, which can group feature channels and extract and merge features within and between groups to further refine the features and provide finer feature details for sub-pixel convolution. The test on the three general hyperspectral datasets, compared to the existing hyperspectral super-resolution algorithms, suggested the advantage of our method.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] Hyperspectral image super-resolution with spectral-spatial network
    Jia, Jinrang
    Ji, Luyan
    Zhao, Yongchao
    Geng, Xiurui
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2018, 39 (22) : 7806 - 7829
  • [2] Hyperspectral Image Super-Resolution Based on Spatial and Spectral Correlation Fusion
    Yi, Chen
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (07): : 4165 - 4177
  • [3] A novel spatial and spectral transformer network for hyperspectral image super-resolution
    Wu, Huapeng
    Xu, Hui
    Zhan, Tianming
    [J]. MULTIMEDIA SYSTEMS, 2024, 30 (03)
  • [4] Spectral-Spatial MLP Network for Hyperspectral Image Super-Resolution
    Yao, Yunze
    Hu, Jianwen
    Liu, Yaoting
    Zhao, Yushan
    [J]. REMOTE SENSING, 2023, 15 (12)
  • [5] DEEP RESIDUAL NETWORK OF SPECTRAL AND SPATIAL FUSION FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Han, Xian-Hua
    Chen, Yen-Wei
    [J]. 2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), 2019, : 266 - 270
  • [6] Spatial-Spectral Deep Residual Network for Hyperspectral Image Super-Resolution
    Zheng W.F.
    Xie Z.X.
    [J]. SN Computer Science, 4 (4)
  • [7] Deep Spatial-Spectral Information Exploitation for Rapid Hyperspectral Image Super-Resolution
    Hu, Jing
    Li, Yunsong
    Zhao, Minghua
    Zhang, Yaling
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3109 - 3112
  • [8] Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network
    Li Yanshan
    Chen Shifu
    Luo Wenhan
    Zhou Li
    Xie Weixin
    [J]. CHINESE JOURNAL OF ELECTRONICS, 2023, 32 (03) : 415 - 428
  • [9] Thangka Hyperspectral Image Super-Resolution Based on a Spatial-Spectral Integration Network
    Wang, Sai
    Fan, Fenglei
    [J]. REMOTE SENSING, 2023, 15 (14)
  • [10] Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network
    LI Yanshan
    CHEN Shifu
    LUO Wenhan
    ZHOU Li
    XIE Weixin
    [J]. Chinese Journal of Electronics, 2023, 32 (03) : 415 - 428