RSTSRN: Recursive Swin Transformer Super-Resolution Network for Mars Images

被引:0
|
作者
Wu, Fanlu [1 ,2 ]
Jiang, Xiaonan [1 ]
Fu, Tianjiao [1 ]
Fu, Yao [1 ]
Xu, Dongdong [1 ]
Zhao, Chunlei [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Chinese Acad Sci, Key Lab Lunar & Deep Space Explorat, Beijing 100101, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 20期
基金
中国国家自然科学基金;
关键词
super-resolution reconstruction; Swin Transformer; Laplacian Pyramid; BACK-PROJECTION NETWORKS; SUPER RESOLUTION; RECONSTRUCTION; ROVER; MRI;
D O I
10.3390/app14209286
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
High-resolution optical images will provide planetary geology researchers with finer and more microscopic image data information. In order to maximize scientific output, it is necessary to further increase the resolution of acquired images, so image super-resolution (SR) reconstruction techniques have become the best choice. Aiming at the problems of large parameter quantity and high computational complexity in current deep learning-based image SR reconstruction methods, we propose a novel Recursive Swin Transformer Super-Resolution Network (RSTSRN) for SR applied to images. The RSTSRN improves upon the LapSRN, which we use as our backbone architecture. A Residual Swin Transformer Block (RSTB) is used for more efficient residual learning, which consists of stacked Swin Transformer Blocks (STBs) with a residual connection. Moreover, the idea of parameter sharing was introduced to reduce the number of parameters, and a multi-scale training strategy was designed to accelerate convergence speed. Experimental results show that the proposed RSTSRN achieves superior performance on 2x, 4x and 8xSR tasks to state-of-the-art methods with similar parameters. Especially on high-magnification SR tasks, the RSTSRN has great performance superiority. Compared to the LapSRN network, for 2x, 4x and 8x Mars image SR tasks, the RSTSRN network has increased PSNR values by 0.35 dB, 0.88 dB and 1.22 dB, and SSIM values by 0.0048, 0.0114 and 0.0311, respectively.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Mars Image Super-Resolution Based on Generative Adversarial Network
    Wang, Cong
    Zhang, Yin
    Zhang, Yongqiang
    Tian, Rui
    Ding, Mingli
    IEEE ACCESS, 2021, 9 : 108889 - 108898
  • [42] Super-Resolution by Predicting Offsets: An Ultra-Efficient Super-Resolution Network for Rasterized Images
    Gu, Jinjin
    Cai, Haoming
    Dong, Chenyu
    Zhang, Ruofan
    Zhang, Yulun
    Yang, Wenming
    Yuan, Chun
    COMPUTER VISION, ECCV 2022, PT XIX, 2022, 13679 : 583 - 598
  • [43] BSRT: Improving Burst Super-Resolution with Swin Transformer and Flow-Guided Deformable Alignment
    Luo, Ziwei
    Li, Youwei
    Cheng, Shen
    Yu, Lei
    Wu, Qi
    Wen, Zhihong
    Fan, Haoqiang
    Sun, Jian
    Liu, Shuaicheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 997 - 1007
  • [44] Super-resolution reconstruction of wind fields with a swin-transformer-based deep learning framework
    Tang, Lingxiao
    Li, Chao
    Zhao, Zihan
    Xiao, Yiqing
    Chen, Shenpeng
    PHYSICS OF FLUIDS, 2024, 36 (12)
  • [45] Evaluation of Swin Transformer and knowledge transfer for denoising of super-resolution structured illumination microscopy data
    Shah, Zafran Hussain
    Mueller, Marcel
    Huebner, Wolfgang
    Wang, Tung-Cheng
    Telman, Daniel
    Huser, Thomas
    Schenck, Wolfram
    GIGASCIENCE, 2024, 13
  • [46] A Hybrid Network of CNN and Transformer for Lightweight Image Super-Resolution
    Fang, Jinsheng
    Lin, Hanjiang
    Chen, Xinyu
    Zeng, Kun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1102 - 1111
  • [47] Structured image super-resolution network based on improved Transformer
    Lv X.-D.
    Li J.
    Deng Z.-N.
    Feng H.
    Cui X.-T.
    Deng H.-X.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (05): : 865 - 874+910
  • [48] A Residual Network with Efficient Transformer for Lightweight Image Super-Resolution
    Yan, Fengqi
    Li, Shaokun
    Zhou, Zhiguo
    Shi, Yonggang
    ELECTRONICS, 2024, 13 (01)
  • [49] Spatial Transformer Generative Adversarial Network for Image Super-Resolution
    Rempakos, Pantelis
    Vrigkas, Michalis
    Plissiti, Marina E.
    Nikou, Christophoros
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2023, PT I, 2023, 14233 : 399 - 411
  • [50] Task Transformer Network for Joint MRI Reconstruction and Super-Resolution
    Feng, Chun-Mei
    Yan, Yunlu
    Fu, Huazhu
    Chen, Li
    Xu, Yong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI, 2021, 12906 : 307 - 317