FDDCC-VSR: a lightweight video super-resolution network based on deformable 3D convolution and cheap convolution

被引:1
|
作者
Wang, Xiaohu [1 ]
Yang, Xin [1 ]
Li, Hengrui [1 ]
Li, Tao [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 210016, Peoples R China
来源
VISUAL COMPUTER | 2025年 / 41卷 / 05期
基金
中国国家自然科学基金;
关键词
Video super-resolution reconstruction; Deformable 3D convolution; Cheap convolution; Spatial attention; Bicubic interpolation;
D O I
10.1007/s00371-024-03621-x
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Currently, the mainstream deep video super-resolution (VSR) models typically employ deeper neural network layers or larger receptive fields. This approach increases computational requirements, making network training difficult and inefficient. Therefore, this paper proposes a VSR model called fusion of deformable 3D convolution and cheap convolution (FDDCC-VSR).In FDDCC-VSR, we first divide the detailed features of each frame in VSR into dynamic features of visual moving objects and details of static backgrounds. This division allows for the use of fewer specialized convolutions in feature extraction, resulting in a lightweight network that is easier to train. Furthermore, FDDCC-VSR incorporates multiple D-C CRBs (Convolutional Residual Blocks), which establish a lightweight spatial attention mechanism to aid deformable 3D convolution. This enables the model to focus on learning the corresponding feature details. Finally, we employ an improved bicubic interpolation combined with subpixel techniques to enhance the PSNR (Peak Signal-to-Noise Ratio) value of the original image. Detailed experiments demonstrate that FDDCC-VSR outperforms the most advanced algorithms in terms of both subjective visual effects and objective evaluation criteria. Additionally, our model exhibits a small parameter and calculation overhead.
引用
收藏
页码:3581 / 3593
页数:13
相关论文
共 50 条
  • [1] Deformable 3D Convolution for Video Super-Resolution
    Ying, Xinyi
    Wang, Longguang
    Wang, Yingqian
    Sheng, Weidong
    An, Wei
    Guo, Yulan
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 1500 - 1504
  • [2] Multi-Kernel Deformable 3D Convolution for Video Super-Resolution
    Dou, Tianyu
    Yu, Xiafei
    Zhao, Jiying
    2021 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2021,
  • [3] Lightweight Reference-Based Video Super-Resolution Using Deformable Convolution
    Miyazaki, Tomo
    Guo, Zirui
    Omachi, Shinichiro
    INFORMATION, 2024, 15 (11)
  • [4] Video super-resolution with 3D adaptive normalized convolution
    Zhang, Kaibing
    Mu, Guangwu
    Yuan, Yuan
    Gao, Xinbo
    Tao, Dacheng
    NEUROCOMPUTING, 2012, 94 : 140 - 151
  • [5] Video super-resolution based on multi-scale 3D convolution
    Zhan K.
    Sun Y.
    Li Y.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2021, 48 (05): : 8 - 14
  • [6] Video Super-Resolution Method Using Deformable Convolution-Based Alignment Network
    Lee, Yooho
    Cho, Sukhee
    Jun, Dongsan
    SENSORS, 2022, 22 (21)
  • [7] Lightweight image super-resolution with feature cheap convolution and attention mechanism
    Yang, Xin
    Li, Hengrui
    Li, Xiaochuan
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (06): : 3977 - 3992
  • [8] Lightweight brain MR image super-resolution using 3D convolution
    Kim, Young Beom
    Van Le, The
    Lee, Jin Young
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) : 8785 - 8795
  • [9] Lightweight brain MR image super-resolution using 3D convolution
    Young Beom Kim
    The Van Le
    Jin Young Lee
    Multimedia Tools and Applications, 2024, 83 : 8785 - 8795
  • [10] Lightweight image super-resolution with feature cheap convolution and attention mechanism
    Xin Yang
    Hengrui Li
    Xiaochuan Li
    Cluster Computing, 2022, 25 : 3977 - 3992