Fast Video Super-Resolution Reconstruction Method Based on Motion Feature Fusion

被引:0
|
作者
Fu, Lihua [1 ]
Sun, Xiaowei [1 ]
Zhao, Yu [1 ]
Li, Zonggang [1 ]
Huang, Jialiang [1 ]
Wang, Luyuan [1 ]
机构
[1] Faculty of Information Technology, Beijing University of Technology, Beijing,100124, China
基金
北京市自然科学基金;
关键词
Feature fusion - Key frames - Low resolution video - Motion features - Real time requirement - Super resolution reconstruction - Time consumption - Video super-resolution;
D O I
10.16451/j.cnki.issn1003-6059.201911007
中图分类号
学科分类号
摘要
Video super-resolution reconstruction methods based on deep learning are often faced with the problems of long time consumption or low accuracy. A video super-resolution reconstruction method based on deep residual network is proposed. It reconstructs videos with high accuracy quickly and meets the real-time requirements for low-resolution videos. Firstly, the adaptive key frame discrimination subnet is utilized to adaptively identify key frames from the video. Then, the reconstruction results of the key frames are obtained by the high precision reconstruction subnet. For non-key frames, the reconstruction results are directly gained based on the features obtained by fusing the features of the corresponding key frame and the motion estimation features between the non-key frame and the adjacent key frame. Experiments on open datasets show that videos are fast reconstructed by the proposed method with high accuracy and robustness.
引用
收藏
页码:1022 / 1031
相关论文
共 50 条
  • [1] Video super-resolution reconstruction method based on deep Back projection and motion feature fusion
    Li-hua Fu
    Xiao-wei Sun
    Yu Zhao
    Ren-jie Chen
    Hui Chen
    Ru Zhao
    [J]. Multimedia Tools and Applications, 2021, 80 : 11423 - 11441
  • [2] Video super-resolution reconstruction method based on deep Back projection and motion feature fusion
    Fu, Li-hua
    Sun, Xiao-wei
    Zhao, Yu
    Chen, Ren-jie
    Chen, Hui
    Zhao, Ru
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (08) : 11423 - 11441
  • [3] A super-resolution reconstruction algorithm based on feature fusion
    Wang, Lin
    Yang, Siqi
    Jia, Jingqian
    [J]. PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 3060 - 3065
  • [4] PSO-based Fusion Method for Video Super-Resolution
    Cheng, Ming-Hui
    Hwang, Kao-Shing
    Jeng, Jyh-Horng
    Lin, Nai-Wei
    [J]. JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2013, 73 (01): : 25 - 42
  • [5] PSO-based Fusion Method for Video Super-Resolution
    Ming-Hui Cheng
    Kao-Shing Hwang
    Jyh-Horng Jeng
    Nai-Wei Lin
    [J]. Journal of Signal Processing Systems, 2013, 73 : 25 - 42
  • [6] Fast Super-resolution Reconstruction for Video-based Pattern Recognition
    Shi, Fei
    Yuan, Jie
    Zhu, Xiang
    [J]. ICNC 2008: FOURTH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, VOL 4, PROCEEDINGS, 2008, : 135 - 139
  • [7] Super-Resolution Reconstruction Method of Remote Sensing Image Based on Multi-Feature Fusion
    Huang, Zhi-Xing
    Jing, Chang-Wei
    [J]. IEEE ACCESS, 2020, 8 : 18764 - 18771
  • [8] Deep Feature Fusion Network for Compressed Video Super-Resolution
    Yue Wang
    Xiaohong Wu
    Xiaohai He
    Chao Ren
    Tingrong Zhang
    [J]. Neural Processing Letters, 2022, 54 : 4427 - 4441
  • [9] Deep Feature Fusion Network for Compressed Video Super-Resolution
    Wang, Yue
    Wu, Xiaohong
    He, Xiaohai
    Ren, Chao
    Zhang, Tingrong
    [J]. NEURAL PROCESSING LETTERS, 2022, 54 (05) : 4427 - 4441
  • [10] Super-Resolution Reconstruction of Satellite Video Images Based on Interpolation Method
    Xie Qifang
    Yao Guoqing
    Liu Pin
    [J]. ADVANCES IN INFORMATION AND COMMUNICATION TECHNOLOGY, 2017, 107 : 454 - 459