Deep Feature Fusion Network for Compressed Video Super-Resolution

被引:0
|
作者
Yue Wang
Xiaohong Wu
Xiaohai He
Chao Ren
Tingrong Zhang
机构
[1] Sichuan University,College of Electronics and Information Engineering
来源
Neural Processing Letters | 2022年 / 54卷
关键词
Compression artifacts reduction; Super-resolution; Feature fusion; Ordinary differential equation; Dual attention mechanism;
D O I
暂无
中图分类号
学科分类号
摘要
The majority of conventional video super-resolution algorithms aim at reconstructing low-resolution videos after down-sampling. However, numerous low-resolution videos will be further compressed to adapt to the limited storage size and transmission bandwidth, leading to further video quality degradation. Significantly, the noise brought by compression often has a strong correlation with the content of the video frame itself. If we super-resolve compressed video frames directly, the noise may be amplified, leading to loss of important information or lower super-resolution performance. To ease those problems, we present an end-to-end deep feature fusion network with ordinary differential equation and dual attention mechanism for joint video compression artifacts reduction and super-resolution. The proposed network commendably enhances the spatial-temporal features fusion of different depths, improves the acquisition of meaningful information ability, and perfects reconstruction quality. In addition, we leverage several skip connections to fuse the captured in-depth feature information and the shallow to prevent information loss. The experimental results show that our proposed method is competent to reduce bit-rate and have excellent quality improvement effectively.
引用
收藏
页码:4427 / 4441
页数:14
相关论文
共 50 条
  • [1] Deep Feature Fusion Network for Compressed Video Super-Resolution
    Wang, Yue
    Wu, Xiaohong
    He, Xiaohai
    Ren, Chao
    Zhang, Tingrong
    NEURAL PROCESSING LETTERS, 2022, 54 (05) : 4427 - 4441
  • [2] Compressed Domain Deep Video Super-Resolution
    Chen, Peilin
    Yang, Wenhan
    Wang, Meng
    Sun, Long
    Hu, Kangkang
    Wang, Shiqi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 (30) : 7156 - 7169
  • [3] Multi-Stage Feature Fusion Network for Video Super-Resolution
    Song, Huihui
    Xu, Wenjie
    Liu, Dong
    Liu, Bo
    Liu, Qingshan
    Metaxas, Dimitris N.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2923 - 2934
  • [4] Compressed multi-scale feature fusion network for single image super-resolution
    Fan, Xinxia
    Yang, Yanhua
    Deng, Cheng
    Xu, Jie
    Gao, Xinbo
    SIGNAL PROCESSING, 2018, 146 : 50 - 60
  • [5] Deep Unrolled Network for Video Super-Resolution
    Chiche, Benjamin Naoto
    Woiselle, Arnaud
    Frontera-Pons, Joana
    Starck, Jean-Luc
    2020 TENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2020,
  • [6] FM-VSR: Feature Multiplexing Video Super-Resolution for Compressed Video
    He, Gang
    Wu, Shan
    Pei, Simin
    Xu, Li
    Wu, Chang
    Xu, Kepeng
    Li, Yunsong
    IEEE ACCESS, 2021, 9 : 88060 - 88068
  • [7] Deep Compressed Video Super-Resolution With Guidance of Coding Priors
    Zhu, Qiang
    Chen, Feiyu
    Liu, Yu
    Zhu, Shuyuan
    Zeng, Bing
    IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (02) : 505 - 515
  • [8] Lightweight Video Super-Resolution for Compressed Video
    Kwon, Ilhwan
    Li, Jun
    Prasad, Mukesh
    ELECTRONICS, 2023, 12 (03)
  • [9] Deeply Feature Fused Video Super-resolution Network
    Yang, Jingmin
    Chen, Zhensen
    Xu, Li
    PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC), 2021, : 161 - 164
  • [10] Recurrent feature supplementation network for video super-resolution
    Li, Guo-Fang
    Zhu, Yong-Gui
    JOURNAL OF THE CHINESE INSTITUTE OF ENGINEERS, 2024, 47 (07) : 888 - 900