LSwinSR: UAV Imagery Super-Resolution Based on Linear Swin Transformer

被引:0
|
作者
Li, Rui [1 ]
Zhao, Xiaowei [1 ]
机构
[1] Univ Warwick, Sch Engn, Intelligent Control & Smart Energy ICSE Res Grp, Coventry CV4 7AL, England
基金
英国工程与自然科学研究理事会;
关键词
Superresolution; Transformers; Autonomous aerial vehicles; Convolutional neural networks; Degradation; Complexity theory; Kernel; Deep learning; semantic segmentation; super-resolution; Transformer; unmanned aerial vehicle (UAV); SEMANTIC SEGMENTATION;
D O I
10.1109/TGRS.2024.3463204
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Super-resolution, which aims to reconstruct high-resolution (HR) images from low-resolution (LR) images, has drawn considerable attention and has been intensively studied in computer vision and remote sensing communities. Super-resolution technology is especially beneficial for unmanned aerial vehicles (UAVs), as the number and resolution of images captured by UAVs are highly limited by physical constraints such as flight altitude and load capacity. In the wake of the successful application of deep learning methods in the super-resolution task, in recent years, a series of super-resolution algorithms have been developed. In this article, for the super-resolution of UAV images, a novel network based on the state-of-the-art Swin Transformer is proposed with better efficiency and competitive accuracy. Meanwhile, as one of the essential applications of the UAV is land cover and land use monitoring, simple image quality assessments such as the peak-signal-to-noise ratio (PSNR) and the structural similarity index measure (SSIM) are not enough to comprehensively measure the performance of an algorithm. Therefore, we further investigate the effectiveness of super-resolution methods using the accuracy of semantic segmentation. The code is available at https://github.com/lironui/GeoSR.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] SWCGAN: Generative Adversarial Network Combining Swin Transformer and CNN for Remote Sensing Image Super-Resolution
    Tu, Jingzhi
    Mei, Gang
    Ma, Zhengjing
    Piccialli, Francesco
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 5662 - 5673
  • [32] Super-resolution of atmospheric degraded imagery
    Green, JJ
    Hunt, BR
    PROPAGATION AND IMAGING THROUGH THE ATMOSPHERE III, 1999, 3763 : 94 - 101
  • [33] Super-resolution for flash ladar imagery
    Hu, Shuowen
    Young, S. Susan
    Hong, Tsai
    Reynolds, Joseph P.
    Krapels, Keith
    Miller, Brian
    Thomas, Jim
    Nguyen, Oanh
    APPLIED OPTICS, 2010, 49 (05) : 772 - 780
  • [34] Transformer for Single Image Super-Resolution
    Lu, Zhisheng
    Li, Juncheng
    Liu, Hong
    Huang, Chaoyan
    Zhang, Linlin
    Zeng, Tieyong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 456 - 465
  • [35] TRANSFORMER AND CNN HYBRID NETWORK FOR SUPER-RESOLUTION SEMANTIC SEGMENTATION OF REMOTE SENSING IMAGERY
    Liu, Yutong
    Gao, Kun
    Wang, Hong
    Wang, Junwei
    Zhang, Xiaodian
    Wang, Pengyu
    Li, Shuzhong
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6940 - 6943
  • [36] A MAP-Based Approach for Hyperspectral Imagery Super-Resolution
    Irmak, Hasan
    Akar, Gozde Bozdagi
    Yuksel, Seniha Esen
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (06) : 2942 - 2951
  • [37] Small Object Detection Networks Based on Classification-Oriented Super-Resolution GAN for UAV Aerial Imagery
    Chen, Yiting
    Li, Jie
    Niu, Yifeng
    He, Jingbo
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 4610 - 4615
  • [38] Transformer-based image super-resolution and its lightweight
    Zhang, Dongxiao
    Qi, Tangyao
    Gao, Juhao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (26) : 68625 - 68649
  • [39] Lightweight Wavelet-Based Transformer for Image Super-Resolution
    Ran, Jinye
    Zhang, Zili
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2022, 13631 : 368 - 382
  • [40] Efficient image super-resolution based on transformer with bidirectional interaction
    Gendy, Garas
    He, Guanghui
    Sabor, Nabil
    APPLIED SOFT COMPUTING, 2024, 165