LSwinSR: UAV Imagery Super-Resolution Based on Linear Swin Transformer

被引:0
|
作者
Li, Rui [1 ]
Zhao, Xiaowei [1 ]
机构
[1] Univ Warwick, Sch Engn, Intelligent Control & Smart Energy ICSE Res Grp, Coventry CV4 7AL, England
基金
英国工程与自然科学研究理事会;
关键词
Superresolution; Transformers; Autonomous aerial vehicles; Convolutional neural networks; Degradation; Complexity theory; Kernel; Deep learning; semantic segmentation; super-resolution; Transformer; unmanned aerial vehicle (UAV); SEMANTIC SEGMENTATION;
D O I
10.1109/TGRS.2024.3463204
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Super-resolution, which aims to reconstruct high-resolution (HR) images from low-resolution (LR) images, has drawn considerable attention and has been intensively studied in computer vision and remote sensing communities. Super-resolution technology is especially beneficial for unmanned aerial vehicles (UAVs), as the number and resolution of images captured by UAVs are highly limited by physical constraints such as flight altitude and load capacity. In the wake of the successful application of deep learning methods in the super-resolution task, in recent years, a series of super-resolution algorithms have been developed. In this article, for the super-resolution of UAV images, a novel network based on the state-of-the-art Swin Transformer is proposed with better efficiency and competitive accuracy. Meanwhile, as one of the essential applications of the UAV is land cover and land use monitoring, simple image quality assessments such as the peak-signal-to-noise ratio (PSNR) and the structural similarity index measure (SSIM) are not enough to comprehensively measure the performance of an algorithm. Therefore, we further investigate the effectiveness of super-resolution methods using the accuracy of semantic segmentation. The code is available at https://github.com/lironui/GeoSR.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] The Method of Industrial Internet Image Super-resolution Based on Transformer
    Liu, Lin
    Yu, Yingjie
    Wang, Juncheng
    Jin, Yi
    Zeng, Yuqiao
    2022 16TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP2022), VOL 1, 2022, : 260 - 265
  • [42] A Transformer-Based Model for Super-Resolution of Anime Image
    Xu, Shizhuo
    Dutta, Vibekananda
    He, Xin
    Matsumaru, Takafumi
    SENSORS, 2022, 22 (21)
  • [43] Structured image super-resolution network based on improved Transformer
    Lv X.-D.
    Li J.
    Deng Z.-N.
    Feng H.
    Cui X.-T.
    Deng H.-X.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (05): : 865 - 874+910
  • [44] Lightweight network with masks for light field image super-resolution based on swin attention
    Wang, Xingzheng
    Wu, Shaoyong
    Li, Jiahui
    Wu, Jianbin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (33) : 79785 - 79804
  • [45] Super-Resolution Mosaicking of UAV Surveillance Video
    Wang, Yi
    Fevig, Ronald
    Schultz, Richard R.
    2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, : 345 - 348
  • [46] SUPER-RESOLUTION BASED ON FAST LINEAR KERNEL REGRESSION
    Li, Jian-Min
    Qu, Yan-Yun
    Gu, Ying
    Fang, Tian-Zhu
    Li, Cui-Hua
    PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOLS 1-4, 2013, : 333 - 339
  • [47] A Deep Learning Approach Combining Super-resolution and Segmentation to Identify Weed and Tobacco in UAV Imagery
    Zhao, Fan
    Huang, Jirui
    Liu, Yongying
    Wang, Jiaqi
    Chen, Yijia
    Shao, Xinlei
    Ma, Bangzhang
    Xi, Dianhan
    Zhang, Mowen
    Tu, Zhengyue
    Wu, Mengya
    Wu, Qingyang
    Chen, Yulun
    He, Yinyin
    2024 9TH INTERNATIONAL CONFERENCE ON ELECTRONIC TECHNOLOGY AND INFORMATION SCIENCE, ICETIS 2024, 2024, : 594 - 597
  • [48] Reconstruction and super-resolution of dilute aperture imagery
    Miller, C
    Hunt, BR
    Kendrick, RL
    Duncan, AL
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, PROCEEDINGS - VOL I, 1996, : 697 - 699
  • [49] ROBUST DEEP HYPERSPECTRAL IMAGERY SUPER-RESOLUTION
    Nie, Jiangtao
    Zhang, Lei
    Wang, Cong
    Wei, Wei
    Zhang, Yanning
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 847 - 850
  • [50] Spatial relaxation transformer for image super-resolution
    Li, Yinghua
    Zhang, Ying
    Zeng, Hao
    He, Jinglu
    Guo, Jie
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (07)