SSAformer: Spatial-Spectral Aggregation Transformer for Hyperspectral Image Super-Resolution

被引:0
|
作者
Wang, Haoqian [1 ,2 ,3 ]
Zhang, Qi [4 ]
Peng, Tao [1 ]
Xu, Zhongjie [1 ,2 ,3 ]
Cheng, Xiangai [1 ,2 ,3 ]
Xing, Zhongyang [1 ,2 ,3 ]
Li, Teng [1 ]
机构
[1] Natl Univ Def Technol, Coll Adv Interdisciplinary Studies, Changsha 410073, Peoples R China
[2] State Key Lab Pulsed Power Laser Technol, Changsha 410073, Peoples R China
[3] Hunan Prov Key Lab High Energy Laser Technol, Changsha 410073, Peoples R China
[4] Natl Univ Def Technol, Coll Comp Sci & Technol, State Key Lab High Performance Comp, Changsha 410073, Peoples R China
关键词
hyperspectral image; super-resolution; deep learning; transformer; FUSION; CLASSIFICATION;
D O I
10.3390/rs16101766
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The hyperspectral image (HSI) distinguishes itself in material identification through its exceptional spectral resolution. However, its spatial resolution is constrained by hardware limitations, prompting the evolution of HSI super-resolution (SR) techniques. Single HSI SR endeavors to reconstruct high-spatial-resolution HSI from low-spatial-resolution inputs, and recent progress in deep learning-based algorithms has significantly advanced the quality of reconstructed images. However, convolutional methods struggle to extract comprehensive spatial and spectral features. Transformer-based models have yet to harness long-range dependencies across both dimensions fully, thus inadequately integrating spatial and spectral data. To solve the above problem, in this paper, we propose a new HSI SR method, SSAformer, which merges the strengths of CNNs and Transformers. It introduces specially designed attention mechanisms for HSI, including spatial and spectral attention modules, and overcomes the previous challenges in extracting and amalgamating spatial and spectral information. Evaluations on benchmark datasets show that SSAformer surpasses contemporary methods in enhancing spatial details and preserving spectral accuracy, underscoring its potential to expand HSI's utility in various domains, such as environmental monitoring and remote sensing.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Cross-Scope Spatial-Spectral Information Aggregation for Hyperspectral Image Super-Resolution
    Chen, Shi
    Zhang, Lefei
    Zhang, Liangpei
    [J]. IEEE Transactions on Image Processing, 2024, 33 : 5878 - 5891
  • [2] Hyperspectral Image Super-Resolution by Deep Spatial-Spectral Exploitation
    Hu, Jing
    Zhao, Minghua
    Li, Yunsong
    [J]. REMOTE SENSING, 2019, 11 (10)
  • [3] Spatial-Spectral Deep Residual Network for Hyperspectral Image Super-Resolution
    Zheng W.F.
    Xie Z.X.
    [J]. SN Computer Science, 4 (4)
  • [4] A spectral and spatial transformer for hyperspectral remote sensing image super-resolution
    Wang, Bingqian
    Chen, Jianhua
    Wang, Huajun
    Tang, Yipeng
    Chen, Jiongling
    Jiang, Ye
    [J]. INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2024, 17 (01)
  • [5] A novel spatial and spectral transformer network for hyperspectral image super-resolution
    Wu, Huapeng
    Xu, Hui
    Zhan, Tianming
    [J]. MULTIMEDIA SYSTEMS, 2024, 30 (03)
  • [6] Hyperspectral Image Super-Resolution by Spectral Mixture Analysis and Spatial-Spectral Group Sparsity
    Li, Jie
    Yuan, Qiangqiang
    Shen, Huanfeng
    Meng, Xiangchao
    Zhang, Liangpei
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (09) : 1250 - 1254
  • [7] Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network
    Li Yanshan
    Chen Shifu
    Luo Wenhan
    Zhou Li
    Xie Weixin
    [J]. CHINESE JOURNAL OF ELECTRONICS, 2023, 32 (03) : 415 - 428
  • [8] Thangka Hyperspectral Image Super-Resolution Based on a Spatial-Spectral Integration Network
    Wang, Sai
    Fan, Fenglei
    [J]. REMOTE SENSING, 2023, 15 (14)
  • [9] Deep Spatial-Spectral Information Exploitation for Rapid Hyperspectral Image Super-Resolution
    Hu, Jing
    Li, Yunsong
    Zhao, Minghua
    Zhang, Yaling
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3109 - 3112
  • [10] Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network
    LI Yanshan
    CHEN Shifu
    LUO Wenhan
    ZHOU Li
    XIE Weixin
    [J]. Chinese Journal of Electronics, 2023, 32 (03) : 415 - 428