FDDCC-VSR: a lightweight video super-resolution network based on deformable 3D convolution and cheap convolution

被引:1
|
作者
Wang, Xiaohu [1 ]
Yang, Xin [1 ]
Li, Hengrui [1 ]
Li, Tao [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 210016, Peoples R China
来源
VISUAL COMPUTER | 2025年 / 41卷 / 05期
基金
中国国家自然科学基金;
关键词
Video super-resolution reconstruction; Deformable 3D convolution; Cheap convolution; Spatial attention; Bicubic interpolation;
D O I
10.1007/s00371-024-03621-x
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Currently, the mainstream deep video super-resolution (VSR) models typically employ deeper neural network layers or larger receptive fields. This approach increases computational requirements, making network training difficult and inefficient. Therefore, this paper proposes a VSR model called fusion of deformable 3D convolution and cheap convolution (FDDCC-VSR).In FDDCC-VSR, we first divide the detailed features of each frame in VSR into dynamic features of visual moving objects and details of static backgrounds. This division allows for the use of fewer specialized convolutions in feature extraction, resulting in a lightweight network that is easier to train. Furthermore, FDDCC-VSR incorporates multiple D-C CRBs (Convolutional Residual Blocks), which establish a lightweight spatial attention mechanism to aid deformable 3D convolution. This enables the model to focus on learning the corresponding feature details. Finally, we employ an improved bicubic interpolation combined with subpixel techniques to enhance the PSNR (Peak Signal-to-Noise Ratio) value of the original image. Detailed experiments demonstrate that FDDCC-VSR outperforms the most advanced algorithms in terms of both subjective visual effects and objective evaluation criteria. Additionally, our model exhibits a small parameter and calculation overhead.
引用
收藏
页码:3581 / 3593
页数:13
相关论文
共 50 条
  • [31] EGARNet: adjacent residual lightweight super-resolution network based on extended group-enhanced convolution
    Shen, Longfeng
    Qin, Fenglan
    Zhu, Hongying
    Sun, Dengdi
    Min, Hai
    MULTIMEDIA SYSTEMS, 2023, 29 (05) : 2651 - 2668
  • [32] EGARNet: adjacent residual lightweight super-resolution network based on extended group-enhanced convolution
    Longfeng Shen
    Fenglan Qin
    Hongying Zhu
    Dengdi Sun
    Hai Min
    Multimedia Systems, 2023, 29 : 2651 - 2668
  • [33] Conditional Convolution Residual Network for Efficient Super-Resolution
    Guo, Yunsheng
    Huang, Jinyang
    Zhang, Xiang
    Sun, Xiao
    Gu, Yu
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PART X, 2023, 14263 : 86 - 97
  • [34] Image super-resolution with parallel convolution attention network
    Zhang, Qiao
    Yang, Xiaomin
    Xiao, Long
    Yang, Feng
    Hussain, Farhan
    Won Kim, Pyoung
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (22):
  • [35] Deep convolution network for surveillance records super-resolution
    Shamsolmoali, Pourya
    Zareapoor, Masoumeh
    Jain, Deepak Kumar
    Jain, Vinay Kumar
    Yang, Jie
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (17) : 23815 - 23829
  • [36] Deep convolution network for surveillance records super-resolution
    Pourya Shamsolmoali
    Masoumeh Zareapoor
    Deepak Kumar Jain
    Vinay Kumar Jain
    Jie Yang
    Multimedia Tools and Applications, 2019, 78 : 23815 - 23829
  • [37] Depth Map Super-Resolution Based on Semi-Couple Deformable Convolution Networks
    Liu, Botao
    Chen, Kai
    Peng, Sheng-Lung
    Zhao, Ming
    MATHEMATICS, 2023, 11 (21)
  • [38] Efficient lightweight network for video super-resolution
    Laigan Luo
    Benshun Yi
    Zhongyuan Wang
    Peng Yi
    Zheng He
    Neural Computing and Applications, 2024, 36 : 883 - 896
  • [39] Efficient lightweight network for video super-resolution
    Luo, Laigan
    Yi, Benshun
    Wang, Zhongyuan
    Yi, Peng
    He, Zheng
    NEURAL COMPUTING & APPLICATIONS, 2023, 36 (2): : 883 - 896
  • [40] HYBRID CONVOLUTION-TRANSFORMER FOR LIGHTWEIGHT SINGLE IMAGE SUPER-RESOLUTION
    Li, Jiuqiang
    Ke, Yutong
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 2395 - 2399