FDDCC-VSR: a lightweight video super-resolution network based on deformable 3D convolution and cheap convolution

被引:1
|
作者
Wang, Xiaohu [1 ]
Yang, Xin [1 ]
Li, Hengrui [1 ]
Li, Tao [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 210016, Peoples R China
来源
VISUAL COMPUTER | 2025年 / 41卷 / 05期
基金
中国国家自然科学基金;
关键词
Video super-resolution reconstruction; Deformable 3D convolution; Cheap convolution; Spatial attention; Bicubic interpolation;
D O I
10.1007/s00371-024-03621-x
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Currently, the mainstream deep video super-resolution (VSR) models typically employ deeper neural network layers or larger receptive fields. This approach increases computational requirements, making network training difficult and inefficient. Therefore, this paper proposes a VSR model called fusion of deformable 3D convolution and cheap convolution (FDDCC-VSR).In FDDCC-VSR, we first divide the detailed features of each frame in VSR into dynamic features of visual moving objects and details of static backgrounds. This division allows for the use of fewer specialized convolutions in feature extraction, resulting in a lightweight network that is easier to train. Furthermore, FDDCC-VSR incorporates multiple D-C CRBs (Convolutional Residual Blocks), which establish a lightweight spatial attention mechanism to aid deformable 3D convolution. This enables the model to focus on learning the corresponding feature details. Finally, we employ an improved bicubic interpolation combined with subpixel techniques to enhance the PSNR (Peak Signal-to-Noise Ratio) value of the original image. Detailed experiments demonstrate that FDDCC-VSR outperforms the most advanced algorithms in terms of both subjective visual effects and objective evaluation criteria. Additionally, our model exhibits a small parameter and calculation overhead.
引用
收藏
页码:3581 / 3593
页数:13
相关论文
共 50 条
  • [21] An Efficient Accelerator Based on Lightweight Deformable 3D-CNN for Video Super-Resolution
    Zhang, Siyu
    Mao, Wendong
    Wang, Zhongfeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2023, 70 (06) : 2384 - 2397
  • [22] Lightweight Feedback Convolution Neural Network for Remote Sensing Images Super-Resolution
    Wang, Jin
    Wu, Yiming
    Wang, Liu
    Wang, Lei
    Alfarraj, Osama
    Tolba, Amr
    IEEE ACCESS, 2021, 9 : 15992 - 16003
  • [23] Enhanced Feature Refinement Network Based on Depthwise Separable Convolution for Lightweight Image Super-Resolution
    Sun, Weizhe
    Ke, Ran
    Liu, Zhen
    Lu, Haoran
    Li, Dong
    Yang, Fei
    Zhang, Lei
    SYMMETRY-BASEL, 2024, 16 (11):
  • [24] Lightweight image super-resolution network based on dynamic graph message passing and convolution mixer
    Gendy, Garas
    Hou, Jingchao
    Sabor, Nabil
    He, Guanghui
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 263
  • [25] Light Field Image Super-Resolution Using Deformable Convolution
    Wang, Yingqian
    Yang, Jungang
    Wang, Longguang
    Ying, Xinyi
    Wu, Tianhao
    An, Wei
    Guo, Yulan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1057 - 1071
  • [26] Depth Map Super-Resolution Using Guided Deformable Convolution
    Kim, Joon-Yeon
    Ji, Seowon
    Baek, Seung-Jin
    Jung, Seung-Won
    Ko, Sung-Jea
    IEEE ACCESS, 2021, 9 : 66626 - 66635
  • [27] GlobalSR: Global context network for single image super-resolution via deformable convolution attention and fast Fourier convolution
    Chen, Qiangpu
    Wen, Wushao
    Qin, Jinghui
    NEURAL NETWORKS, 2024, 180
  • [28] Satellite Video Super-Resolution via Multiscale Deformable Convolution Alignment and Temporal Grouping Projection
    Xiao, Yi
    Su, Xin
    Yuan, Qiangqiang
    Liu, Denghong
    Shen, Huanfeng
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [29] Iterative Back Projection Network Based on Deformable 3D Convolution
    Luo, Chengzhi
    Li, Bing
    Liu, Feng
    IEEE ACCESS, 2023, 11 : 122586 - 122597
  • [30] Deformable Convolution Alignment and Dynamic Scale-Aware Network for Continuous-Scale Satellite Video Super-Resolution
    Ni, Ning
    Zhang, Libao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 17