Hybrid-Scale Hierarchical Transformer for Remote Sensing Image Super-Resolution

被引:6
|
作者
Shang, Jianrun [1 ]
Gao, Mingliang [1 ]
Li, Qilei [2 ]
Pan, Jinfeng [1 ]
Zou, Guofeng [1 ]
Jeon, Gwanggil [1 ,3 ]
机构
[1] Shandong Univ Technol, Sch Elect & Elect Engn, Zibo 255000, Peoples R China
[2] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
[3] Incheon Natl Univ, Dept Embedded Syst Engn, Incheon 22012, South Korea
基金
中国国家自然科学基金;
关键词
super-resolution; remote sensing image; convolutional neural network; transformer; self-similarity; ALGORITHM;
D O I
10.3390/rs15133442
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Super-resolution (SR) technology plays a crucial role in improving the spatial resolution of remote sensing images so as to overcome the physical limitations of spaceborne imaging systems. Although deep convolutional neural networks have achieved promising results, most of them overlook the advantage of self-similarity information across different scales and high-dimensional features after the upsampling layers. To address the problem, we propose a hybrid-scale hierarchical transformer network (HSTNet) to achieve faithful remote sensing image SR. Specifically, we propose a hybrid-scale feature exploitation module to leverage the internal recursive information in single and cross scales within the images. To fully leverage the high-dimensional features and enhance discrimination, we designed a cross-scale enhancement transformer to capture long-range dependencies and efficiently calculate the relevance between high-dimension and low-dimension features. The proposed HSTNet achieves the best result in PSNR and SSIM with the UCMecred dataset and AID dataset. Comparative experiments demonstrate the effectiveness of the proposed methods and prove that the HSTNet outperforms the state-of-the-art competitors both in quantitative and qualitative evaluations.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] MAP super-resolution reconstruction of remote sensing image
    Liu Tao
    Qian Feng
    Zhang Bao
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2018, 33 (10) : 884 - 892
  • [22] Multi-Attention Multi-Image Super-Resolution Transformer (MAST) for Remote Sensing
    Li, Jiaao
    Lv, Qunbo
    Zhang, Wenjian
    Zhu, Baoyu
    Zhang, Guiyu
    Tan, Zheng
    REMOTE SENSING, 2023, 15 (17)
  • [23] MSWAGAN: Multispectral Remote Sensing Image Super-Resolution Based on Multiscale Window Attention Transformer
    Wang, Chunyang
    Zhang, Xian
    Yang, Wei
    Wang, Gaige
    Li, Xingwang
    Wang, Jianlong
    Lu, Bibo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [24] TTST: A Top-k Token Selective Transformer for Remote Sensing Image Super-Resolution
    Xiao, Yi
    Yuan, Qiangqiang
    Jiang, Kui
    He, Jiang
    Lin, Chia-Wen
    Zhang, Liangpei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 738 - 752
  • [25] Uncertainty-driven mixture convolution and transformer network for remote sensing image super-resolution
    Zhang, Xiaomin
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [26] Hierarchical Feature Aggregation and Self-Learning Network for Remote Sensing Image Continuous-Scale Super-Resolution
    Ni, Ning
    Wu, Hanlin
    Zhang, Libao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [27] Enhancing Remote Sensing Image Super-Resolution with Efficient Hybrid Conditional Diffusion Model
    Han, Lintao
    Zhao, Yuchen
    Lv, Hengyi
    Zhang, Yisa
    Liu, Hailong
    Bi, Guoling
    Han, Qing
    REMOTE SENSING, 2023, 15 (13)
  • [28] A Hybrid Network of CNN and Transformer for Lightweight Image Super-Resolution
    Fang, Jinsheng
    Lin, Hanjiang
    Chen, Xinyu
    Zeng, Kun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1102 - 1111
  • [29] DsTer: A dense spectral transformer for remote sensing spectral super-resolution
    He, Jiang
    Yuan, Qiangqiang
    Li, Jie
    Xiao, Yi
    Liu, Xinxin
    Zou, Yun
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 109
  • [30] DTRN: DUAL TRANSFORMER RESIDUAL NETWORK FOR REMOTE SENSING SUPER-RESOLUTION
    Sui, Jialu
    Ma, Xianping
    Zhang, Xiaokang
    Pun, Man-On
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6041 - 6044