SSAformer: Spatial-Spectral Aggregation Transformer for Hyperspectral Image Super-Resolution

被引:0
|
作者
Wang, Haoqian [1 ,2 ,3 ]
Zhang, Qi [4 ]
Peng, Tao [1 ]
Xu, Zhongjie [1 ,2 ,3 ]
Cheng, Xiangai [1 ,2 ,3 ]
Xing, Zhongyang [1 ,2 ,3 ]
Li, Teng [1 ]
机构
[1] Natl Univ Def Technol, Coll Adv Interdisciplinary Studies, Changsha 410073, Peoples R China
[2] State Key Lab Pulsed Power Laser Technol, Changsha 410073, Peoples R China
[3] Hunan Prov Key Lab High Energy Laser Technol, Changsha 410073, Peoples R China
[4] Natl Univ Def Technol, Coll Comp Sci & Technol, State Key Lab High Performance Comp, Changsha 410073, Peoples R China
关键词
hyperspectral image; super-resolution; deep learning; transformer; FUSION; CLASSIFICATION;
D O I
10.3390/rs16101766
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The hyperspectral image (HSI) distinguishes itself in material identification through its exceptional spectral resolution. However, its spatial resolution is constrained by hardware limitations, prompting the evolution of HSI super-resolution (SR) techniques. Single HSI SR endeavors to reconstruct high-spatial-resolution HSI from low-spatial-resolution inputs, and recent progress in deep learning-based algorithms has significantly advanced the quality of reconstructed images. However, convolutional methods struggle to extract comprehensive spatial and spectral features. Transformer-based models have yet to harness long-range dependencies across both dimensions fully, thus inadequately integrating spatial and spectral data. To solve the above problem, in this paper, we propose a new HSI SR method, SSAformer, which merges the strengths of CNNs and Transformers. It introduces specially designed attention mechanisms for HSI, including spatial and spectral attention modules, and overcomes the previous challenges in extracting and amalgamating spatial and spectral information. Evaluations on benchmark datasets show that SSAformer surpasses contemporary methods in enhancing spatial details and preserving spectral accuracy, underscoring its potential to expand HSI's utility in various domains, such as environmental monitoring and remote sensing.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] AS3ITransUNet: Spatial-Spectral Interactive Transformer U-Net With Alternating Sampling for Hyperspectral Image Super-Resolution
    Xu, Qin
    Liu, Shiji
    Wang, Jiahui
    Jiang, Bo
    Tang, Jin
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [22] Spatial-Spectral Transformer for Hyperspectral Image Classification
    He, Xin
    Chen, Yushi
    Lin, Zhouhan
    [J]. REMOTE SENSING, 2021, 13 (03) : 1 - 22
  • [23] Spatial-spectral dual path hyperspectral image super-resolution reconstruction network based on spectral response functions
    Xu, Yinghao
    Jiang, Xi
    Hou, Junyi
    Sun, Yuanyuan
    Zhu, Xijun
    [J]. GEOCARTO INTERNATIONAL, 2023, 38 (01)
  • [24] Hyperspectral image super-resolution with spectral-spatial network
    Jia, Jinrang
    Ji, Luyan
    Zhao, Yongchao
    Geng, Xiurui
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2018, 39 (22) : 7806 - 7829
  • [25] DUAL 1D-2D SPATIAL-SPECTRAL CNN FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Li, Jiaojiao
    Cui, Ruxing
    Li, Bo
    Li, Yunsong
    Mei, Shaohui
    Du, Qian
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3113 - 3116
  • [26] Dual Aggregation Transformer for Image Super-Resolution
    Chen, Zheng
    Zhang, Yulun
    Gu, Jinjin
    Kong, Linghe
    Yang, Xiaokang
    Yu, Fisher
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12278 - 12287
  • [27] SPATIAL-SPECTRAL COMPRESSIVE SENSING FOR HYPERSPECTRAL IMAGES SUPER-RESOLUTION OVER LEARNED DICTIONARY
    Huang, Wei
    Wu, Zebin
    Liu, Hongyi
    Xiao, Liang
    Wei, Zhihui
    [J]. 2014 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2014, : 4930 - 4933
  • [28] Hyperspectral Image Super-Resolution via Sparsity Regularization-Based Spatial-Spectral Tensor Subspace Representation
    Peng, Yidong
    Li, Weisheng
    Luo, Xiaobo
    Du, Jiao
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 11707 - 11722
  • [29] Hyperspectral Image Super-Resolution Based on Spatial and Spectral Correlation Fusion
    Yi, Chen
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (07): : 4165 - 4177
  • [30] Spectral-Spatial MLP Network for Hyperspectral Image Super-Resolution
    Yao, Yunze
    Hu, Jianwen
    Liu, Yaoting
    Zhao, Yushan
    [J]. REMOTE SENSING, 2023, 15 (12)