Spatial-spectral dual path hyperspectral image super-resolution reconstruction network based on spectral response functions

被引:2
|
作者
Xu, Yinghao [1 ]
Jiang, Xi [1 ]
Hou, Junyi [1 ]
Sun, Yuanyuan [1 ,2 ]
Zhu, Xijun [1 ]
机构
[1] Qingdao Univ Sci & Technol, Coll Informat Sci & Technol, Qingdao, Peoples R China
[2] Qingdao Univ Sci & Technol, Coll Big Data, Qingdao, Peoples R China
关键词
Super-resolution; spectral response function; hyperspectral images; spectral dimensional attention; group convolution; CONVOLUTIONAL NEURAL-NETWORK;
D O I
10.1080/10106049.2022.2157497
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Recently, hyperspectral image (HSI) super-resolution (SR) techniques based on deep learning have been actively developed. However, most hyperspectral image super-resolution reconstruction methods usually use all spectral bands simultaneously, leading to a mismatch of spectral properties between reconstructed HSI bands. Therefore, we proposed a new method of spatial-spectral dual path residual network (SGDPRN) based on spectral response function (SRF) to address the above problem. The SGDPRN is composed of the SRF guided grouping part, the spatial-spectral feature extraction part, and the final reconstruction part. Firstly, the reconstructed features for different spectral ranges are identified separately using SRF as a guide. Then, based on the grouping results, a spatial-spectral dual-path residual block is used to explore the spatial and spectral features by the designed parallel structure simultaneously. The spatial path is designed to extract sharp edges and realistic textures, and the spectral path is designed to model inter-spectral correlations to refine spectral features. At last, the third block of SGDPRN concatenates features of all groups and finishes the reconstruction of HSISR. QUST-1 satellite images have been applied in experiments, and the results showed that SGDPRN produced a higher peak signal to noise ratio, structural similarity metric, correlation coefficient, and lower spectral angle mapper, root mean square error than the other methods. This demonstrates that our method can effectively maintain the correlation of spectral bands while improving the spatial resolution.
引用
收藏
页数:24
相关论文
共 50 条
  • [21] Super-Resolution Mapping Based on Spatial-Spectral Correlation for Spectral Imagery
    Wang, Peng
    Wang, Liguo
    Leung, Henry
    Zhang, Gong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (03): : 2256 - 2268
  • [22] Hyperspectral Imagery Super-Resolution by Spatial-Spectral Joint Nonlocal Similarity
    Zhao, Yongqiang
    Yang, Jingxiang
    Chan, Jonathan Cheung-Wai
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (06) : 2671 - 2679
  • [23] Hyperspectral Image Super-Resolution Based on Spatial and Spectral Correlation Fusion
    Yi, Chen
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (07): : 4165 - 4177
  • [24] Spatial-Spectral Interaction Super-Resolution CNN-Mamba Network for Fusion of Satellite Hyperspectral and Multispectral Image
    Zhao, Guangwei
    Wu, Haitao
    Luo, Dexiang
    Ou, Xu
    Zhang, Yu
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 18489 - 18501
  • [25] Progressive Spatial-Spectral Joint Network for Hyperspectral Image Reconstruction
    Li, Tianshuai
    Gu, Yanfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [26] DEEP RESIDUAL NETWORK OF SPECTRAL AND SPATIAL FUSION FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Han, Xian-Hua
    Chen, Yen-Wei
    2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), 2019, : 266 - 270
  • [27] Spatial Spectral VAFormer Graph Convolution Hyperspectral Image Super-Resolution Network
    Fan, Jiale
    Li, Qiang
    Zhang, Ruifeng
    Guan, Xin
    LASER & OPTOELECTRONICS PROGRESS, 2025, 62 (02)
  • [28] Hyperspectral Image Joint Super-Resolution via Local Implicit Spatial-Spectral Function Learning
    Zhang, Yanan
    Zhang, Jizhou
    Han, Sijia
    IEEE PHOTONICS JOURNAL, 2024, 16 (03): : 1 - 12
  • [29] Joint Spatial-Spectral Smoothing in a Minimum-Volume Simplex for Hyperspectral Image Super-Resolution
    Ma, Fei
    Yang, Feixia
    Ping, Ziliang
    Wang, Wenqin
    APPLIED SCIENCES-BASEL, 2020, 10 (01):
  • [30] Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution
    Xue, Jize
    Zhao, Yong-Qiang
    Bu, Yuanyang
    Liao, Wenzhi
    Chan, Jonathan Cheung-Wai
    Philips, Wilfried
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3084 - 3097