Deep Feature Fusion Network for Compressed Video Super-Resolution

被引:0
|
作者
Yue Wang
Xiaohong Wu
Xiaohai He
Chao Ren
Tingrong Zhang
机构
[1] Sichuan University,College of Electronics and Information Engineering
来源
Neural Processing Letters | 2022年 / 54卷
关键词
Compression artifacts reduction; Super-resolution; Feature fusion; Ordinary differential equation; Dual attention mechanism;
D O I
暂无
中图分类号
学科分类号
摘要
The majority of conventional video super-resolution algorithms aim at reconstructing low-resolution videos after down-sampling. However, numerous low-resolution videos will be further compressed to adapt to the limited storage size and transmission bandwidth, leading to further video quality degradation. Significantly, the noise brought by compression often has a strong correlation with the content of the video frame itself. If we super-resolve compressed video frames directly, the noise may be amplified, leading to loss of important information or lower super-resolution performance. To ease those problems, we present an end-to-end deep feature fusion network with ordinary differential equation and dual attention mechanism for joint video compression artifacts reduction and super-resolution. The proposed network commendably enhances the spatial-temporal features fusion of different depths, improves the acquisition of meaningful information ability, and perfects reconstruction quality. In addition, we leverage several skip connections to fuse the captured in-depth feature information and the shallow to prevent information loss. The experimental results show that our proposed method is competent to reduce bit-rate and have excellent quality improvement effectively.
引用
收藏
页码:4427 / 4441
页数:14
相关论文
共 50 条
  • [21] Image Super-Resolution Network Based on Feature Fusion Attention
    Zou, Changjun
    Ye, Lintao
    JOURNAL OF SENSORS, 2022, 2022
  • [22] Enhanced Spatial Adaptive Fusion Network For Video Super-Resolution
    Li, Boyue
    Zhao, Xin
    Yuan, Shiqian
    Lan, Rushi
    Luo, Xiaonan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VI, 2025, 15036 : 491 - 505
  • [23] Spatio-Temporal Fusion Network for Video Super-Resolution
    Li, Huabin
    Zhang, Pingjian
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [24] Local-Global Fusion Network for Video Super-Resolution
    Su, Dewei
    Wang, Hua
    Jin, Longcun
    Sun, Xianfang
    Peng, Xinyi
    IEEE ACCESS, 2020, 8 : 172443 - 172456
  • [25] Image Super-Resolution via Deep Feature Recalibration Network
    Xin, Jingwei
    Jiang, Xinrui
    Wang, Nannan
    Li, Jie
    Gao, Xinbo
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2020, 2020, 12305 : 256 - 267
  • [26] Robust super-resolution depth imaging via a multi-feature fusion deep network
    Ruget, Alice
    McLaughlin, Stephen
    Henderson, Robert K.
    Gyongy, Istvan
    Halimi, Abderrahim
    Leach, Jonathan
    OPTICS EXPRESS, 2021, 29 (08) : 11917 - 11937
  • [27] Learning a Deep Dual Attention Network for Video Super-Resolution
    Li, Feng
    Bai, Huihui
    Zhao, Yao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 4474 - 4488
  • [28] Towards Efficient Video Detection Object Super-Resolution with Deep Fusion Network for Public Safety
    Ren, Sheng
    Li, Jianqi
    Tu, Tianyi
    Peng, Yibo
    Jiang, Jian
    SECURITY AND COMMUNICATION NETWORKS, 2021, 2021
  • [29] DDAN: A DEEP DUAL ATTENTION NETWORK FOR VIDEO SUPER-RESOLUTION
    Sun, Xiyue
    Li, Feng
    Bai, Huihui
    Zhao, Yao
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [30] Deep Blind Video Super-resolution
    Pan, Jinshan
    Bai, Haoran
    Dong, Jiangxin
    Zhang, Jiawei
    Tang, Jinhui
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4791 - 4800