LSwinSR: UAV Imagery Super-Resolution Based on Linear Swin Transformer

被引:0
|
作者
Li, Rui [1 ]
Zhao, Xiaowei [1 ]
机构
[1] Univ Warwick, Sch Engn, Intelligent Control & Smart Energy ICSE Res Grp, Coventry CV4 7AL, England
基金
英国工程与自然科学研究理事会;
关键词
Superresolution; Transformers; Autonomous aerial vehicles; Convolutional neural networks; Degradation; Complexity theory; Kernel; Deep learning; semantic segmentation; super-resolution; Transformer; unmanned aerial vehicle (UAV); SEMANTIC SEGMENTATION;
D O I
10.1109/TGRS.2024.3463204
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Super-resolution, which aims to reconstruct high-resolution (HR) images from low-resolution (LR) images, has drawn considerable attention and has been intensively studied in computer vision and remote sensing communities. Super-resolution technology is especially beneficial for unmanned aerial vehicles (UAVs), as the number and resolution of images captured by UAVs are highly limited by physical constraints such as flight altitude and load capacity. In the wake of the successful application of deep learning methods in the super-resolution task, in recent years, a series of super-resolution algorithms have been developed. In this article, for the super-resolution of UAV images, a novel network based on the state-of-the-art Swin Transformer is proposed with better efficiency and competitive accuracy. Meanwhile, as one of the essential applications of the UAV is land cover and land use monitoring, simple image quality assessments such as the peak-signal-to-noise ratio (PSNR) and the structural similarity index measure (SSIM) are not enough to comprehensively measure the performance of an algorithm. Therefore, we further investigate the effectiveness of super-resolution methods using the accuracy of semantic segmentation. The code is available at https://github.com/lironui/GeoSR.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] A SWIN TRANSFORMER- BASED FUSION APPROACH FOR HYPERSPECTRAL IMAGE SUPER-RESOLUTION
    Yang, Yuchao
    Wang, Yulei
    Zhao, Enyu
    Song, Meiping
    Zhang, Qiang
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7372 - 7375
  • [2] Efficient Swin Transformer for Remote Sensing Image Super-Resolution
    Kang, Xudong
    Duan, Puhong
    Li, Jier
    Li, Shutao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6367 - 6379
  • [3] Asymmetric convolution Swin transformer for medical image super-resolution
    Lu, Weijia
    Jiang, Jiehui
    Tian, Hao
    Gu, Jun
    Lu, Yuhong
    Yang, Wanli
    Gong, Ming
    Han, Tianyi
    Jiang, Xiaojuan
    Zhang, Tingting
    ALEXANDRIA ENGINEERING JOURNAL, 2023, 85 : 177 - 184
  • [4] An Iris Image Super-Resolution Model Based on Swin Transformer and Generative Adversarial Network
    Lu, Hexin
    Zhu, Xiaodong
    Cui, Jingwei
    Jiang, Haifeng
    ALGORITHMS, 2024, 17 (03)
  • [5] SwiniPASSR: Swin Transformer based Parallax Attention Network for Stereo Image Super-Resolution
    Jin, Kai
    Wei, Zeqiang
    Yang, Angulia
    Guo, Sha
    Gao, Mingzhi
    Zhou, Xiuzhuang
    Guo, Guodong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 919 - 928
  • [6] Super-Resolution Swin Transformer and Attention Network for Medical CT Imaging
    Hu, Jianhua
    Zheng, Shuzhao
    Wang, Bo
    Luo, Guixiang
    Huang, WoQing
    Zhang, Jun
    BIOMED RESEARCH INTERNATIONAL, 2022, 2022
  • [7] RSTSRN: Recursive Swin Transformer Super-Resolution Network for Mars Images
    Wu, Fanlu
    Jiang, Xiaonan
    Fu, Tianjiao
    Fu, Yao
    Xu, Dongdong
    Zhao, Chunlei
    APPLIED SCIENCES-BASEL, 2024, 14 (20):
  • [8] INFORMATION-GROWTH SWIN TRANSFORMER NETWORK FOR IMAGE SUPER-RESOLUTION
    Ji, Yantao
    Jiang, Peilin
    Shi, Jingang
    Guo, Yu
    Zhang, Ruiteng
    Wang, Fei
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3993 - 3997
  • [9] Super-resolution reconstruction of wind fields with a swin-transformer-based deep learning framework
    Tang, Lingxiao
    Li, Chao
    Zhao, Zihan
    Xiao, Yiqing
    Chen, Shenpeng
    PHYSICS OF FLUIDS, 2024, 36 (12)
  • [10] Spstnet: image super-resolution using spatial pyramid swin transformer network
    Sun, Yemei
    Wang, Jiao
    Yang, Yue
    Zhang, Yan
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (04)