Super Resolution Reconstruction Algorithm of UAV Image Based on Residual Neural Network

被引:1
|
作者
Wan, Fang [1 ]
Zhang, Xiaorong [2 ]
机构
[1] Hainan Vocat Univ Sci & Technol, Coll Informat Engn, Haikou 571126, Hainan, Peoples R China
[2] Beihai Univ, Sch Elect Engn, Beijing 100191, Peoples R China
关键词
Superresolution; Feature extraction; Optical flow; Image resolution; Image reconstruction; Convolution; Convolutional neural networks; Super resolution; optical flow estimation; dense residual block;
D O I
10.1109/ACCESS.2021.3114437
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of convolutional neural network, video super-resolution algorithm has achieved remarkable success. Because the dependence between frames is complex, traditional methods lack the ability to model the complex dependence, and it is difficult to estimate and compensate the motion accurately in the process of video super-resolution reconstruction. Therefore, a reconstruction network based on optical flow residuals is proposed. In low resolution space, the dense residual network is used to obtain the complementary information of adjacent video frames, and then the optical flow of high-resolution video frames is predicted through the pyramid structure, and then the low resolution video frames are transformed into high-resolution video frames through the sub-pixel convolution layer, The high-resolution video frame is compensated with the predicted high-resolution optical flow. Finally, it is input into the super-resolution fusion network to get better effect. A new loss function training network is proposed to better constrain the network. Experimental results on public data sets show that the reconstruction effect is improved in PSNR, structural similarity and subjective visual effect.
引用
收藏
页码:140372 / 140382
页数:11
相关论文
共 50 条
  • [1] Image Super-resolution Reconstruction Algorithm Based on Convolutional Neural Network
    He Jingxuan
    Zhang Jian
    Zhang Yonghui
    Wang Rong
    [J]. PROCEEDINGS OF 2018 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION, ELECTRONICS AND ELECTRICAL ENGINEERING (AUTEEE), 2018, : 267 - 271
  • [2] Image super-resolution reconstruction based on residual connection convolutional neural network
    Guo, Ji-Chang
    Wu, Jie
    Guo, Chun-Le
    Zhu, Ming-Hui
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2019, 49 (05): : 1726 - 1734
  • [3] Optimization of Single Image Super-Resolution Reconstruction Algorithm Based on Residual Dense Network
    Zhang, Rui
    Wang, Siqi
    Wu, Zi'ang
    [J]. PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 2497 - 2501
  • [4] A terahertz image super-resolution reconstruction algorithm based on the deep convolutional neural network
    Li, Zeng
    Cen, Zhaofeng
    Li, Xiaotong
    [J]. AOPC 2017: OPTICAL SENSING AND IMAGING TECHNOLOGY AND APPLICATIONS, 2017, 10462
  • [5] Image Super-Resolution Reconstruction Algorithm Based on Enhanced Multi-Scale Residual Network
    Xu Jiao
    Yuan Sannan
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (04)
  • [6] Super-resolution reconstruction of MR image with a novel residual learning network algorithm
    Shi, Jun
    Liu, Qingping
    Wang, Chaofeng
    Zhang, Qi
    Ying, Shihui
    Xu, Haoyu
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2018, 63 (08):
  • [7] Super-resolution image reconstruction based on RBF neural network
    Zhu, Fu-Zhen
    Li, Jin-Zong
    Zhu, Bing
    Li, Dong-Dong
    Yang, Xue-Feng
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2010, 18 (06): : 1444 - 1451
  • [8] Image super resolution reconstruction algorithm based on generative countermeasure network
    Liu Guo-qi
    Liu Jin-feng
    Zhu Dong-hui
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2021, 36 (12) : 1720 - 1727
  • [9] Image super-resolution reconstruction based on improved Dirac residual network
    Yang, Xin
    Xie, Tangxin
    Liu, Li
    Zhou, Dake
    [J]. MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2021, 32 (04) : 1065 - 1082
  • [10] Image Super-Resolution Reconstruction Based on Improved Dense Residual Network
    Yao TianShun
    Ma XiaoXuan
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 861 - 866