Hybrid-Scale Hierarchical Transformer for Remote Sensing Image Super-Resolution

被引:6
|
作者
Shang, Jianrun [1 ]
Gao, Mingliang [1 ]
Li, Qilei [2 ]
Pan, Jinfeng [1 ]
Zou, Guofeng [1 ]
Jeon, Gwanggil [1 ,3 ]
机构
[1] Shandong Univ Technol, Sch Elect & Elect Engn, Zibo 255000, Peoples R China
[2] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
[3] Incheon Natl Univ, Dept Embedded Syst Engn, Incheon 22012, South Korea
基金
中国国家自然科学基金;
关键词
super-resolution; remote sensing image; convolutional neural network; transformer; self-similarity; ALGORITHM;
D O I
10.3390/rs15133442
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Super-resolution (SR) technology plays a crucial role in improving the spatial resolution of remote sensing images so as to overcome the physical limitations of spaceborne imaging systems. Although deep convolutional neural networks have achieved promising results, most of them overlook the advantage of self-similarity information across different scales and high-dimensional features after the upsampling layers. To address the problem, we propose a hybrid-scale hierarchical transformer network (HSTNet) to achieve faithful remote sensing image SR. Specifically, we propose a hybrid-scale feature exploitation module to leverage the internal recursive information in single and cross scales within the images. To fully leverage the high-dimensional features and enhance discrimination, we designed a cross-scale enhancement transformer to capture long-range dependencies and efficiently calculate the relevance between high-dimension and low-dimension features. The proposed HSTNet achieves the best result in PSNR and SSIM with the UCMecred dataset and AID dataset. Comparative experiments demonstrate the effectiveness of the proposed methods and prove that the HSTNet outperforms the state-of-the-art competitors both in quantitative and qualitative evaluations.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Hybrid-Scale Self-Similarity Exploitation for Remote Sensing Image Super-Resolution
    Lei, Sen
    Shi, Zhenwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Remote sensing image super-resolution via cross-scale hierarchical transformer
    Xiao, Yi
    Yuan, Qiangqiang
    He, Jiang
    Zhang, Liangpei
    GEO-SPATIAL INFORMATION SCIENCE, 2023, 27 (06): : 1914 - 1930
  • [3] Efficient Swin Transformer for Remote Sensing Image Super-Resolution
    Kang, Xudong
    Duan, Puhong
    Li, Jier
    Li, Shutao
    IEEE Transactions on Image Processing, 2024, 33 : 6367 - 6379
  • [4] Remote sensing image Super-resolution reconstruction by fusing multi-scale receptive fields and hybrid transformer
    Denghui Liu
    Lin Zhong
    Haiyang Wu
    Songyang Li
    Yida Li
    Scientific Reports, 15 (1)
  • [5] A spectral and spatial transformer for hyperspectral remote sensing image super-resolution
    Wang, Bingqian
    Chen, Jianhua
    Wang, Huajun
    Tang, Yipeng
    Chen, Jiongling
    Jiang, Ye
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2024, 17 (01)
  • [6] Super-resolution Reconstruction of Remote Sensing Image Based on Transformer of Multi-scale Feature Fusion
    Wang, Zhi
    Wang, Kun
    Wang, Meng-Qing
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2024, 45 (08): : 1178 - 1184
  • [7] DTCNet: Transformer-CNN Distillation for Super-Resolution of Remote Sensing Image
    Lin, Cong
    Mao, Xin
    Qiu, Chenghao
    Zou, Lilan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 11117 - 11133
  • [8] Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution
    Lei, Sen
    Shi, Zhenwei
    Mo, Wenjing
    IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [9] An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution
    Zhang, Wenjian
    Tan, Zheng
    Lv, Qunbo
    Li, Jiaao
    Zhu, Baoyu
    Liu, Yangyang
    REMOTE SENSING, 2024, 16 (05)
  • [10] Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution
    Lei, Sen
    Shi, Zhenwei
    Mo, Wenjing
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60