FDDCC-VSR: a lightweight video super-resolution network based on deformable 3D convolution and cheap convolution

被引:1
|
作者
Wang, Xiaohu [1 ]
Yang, Xin [1 ]
Li, Hengrui [1 ]
Li, Tao [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 210016, Peoples R China
来源
VISUAL COMPUTER | 2025年 / 41卷 / 05期
基金
中国国家自然科学基金;
关键词
Video super-resolution reconstruction; Deformable 3D convolution; Cheap convolution; Spatial attention; Bicubic interpolation;
D O I
10.1007/s00371-024-03621-x
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Currently, the mainstream deep video super-resolution (VSR) models typically employ deeper neural network layers or larger receptive fields. This approach increases computational requirements, making network training difficult and inefficient. Therefore, this paper proposes a VSR model called fusion of deformable 3D convolution and cheap convolution (FDDCC-VSR).In FDDCC-VSR, we first divide the detailed features of each frame in VSR into dynamic features of visual moving objects and details of static backgrounds. This division allows for the use of fewer specialized convolutions in feature extraction, resulting in a lightweight network that is easier to train. Furthermore, FDDCC-VSR incorporates multiple D-C CRBs (Convolutional Residual Blocks), which establish a lightweight spatial attention mechanism to aid deformable 3D convolution. This enables the model to focus on learning the corresponding feature details. Finally, we employ an improved bicubic interpolation combined with subpixel techniques to enhance the PSNR (Peak Signal-to-Noise Ratio) value of the original image. Detailed experiments demonstrate that FDDCC-VSR outperforms the most advanced algorithms in terms of both subjective visual effects and objective evaluation criteria. Additionally, our model exhibits a small parameter and calculation overhead.
引用
收藏
页码:3581 / 3593
页数:13
相关论文
共 50 条
  • [41] Lightweight Super-Resolution with Self-Calibrated Convolution for Panoramic Videos
    Shang, Fanjie
    Liu, Hongying
    Ma, Wanhao
    Liu, Yuanyuan
    Jiao, Licheng
    Shang, Fanhua
    Wang, Lijun
    Zhou, Zhenyu
    SENSORS, 2023, 23 (01)
  • [42] Lightweight Single Image Super-Resolution by Channel Split Residual Convolution
    Liu, Buzhong
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2022, 18 (01): : 12 - 25
  • [43] Lightweight Image Super-Resolution Based on Shuffle Group Convolution and Sparse Global Attention
    Li Xiang
    Zhang Juan
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (04)
  • [44] Video Object Segmentation with 3D Convolution Network
    Tang, Huiyun
    Tao, Pin
    Ma, Rui
    Shi, Yuanchun
    ICCCV 2019: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON CONTROL AND COMPUTER VISION, 2019, : 28 - 32
  • [45] A Joint Super-Resolution and Deformable Registration Network for 3D Brain Images
    Lan, Sheng
    Guo, Zhenhua
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 173 - 179
  • [46] Single Image Super-Resolution: Depthwise Separable Convolution Super-Resolution Generative Adversarial Network
    Jiang, Zetao
    Huang, Yongsong
    Hu, Lirui
    APPLIED SCIENCES-BASEL, 2020, 10 (01):
  • [47] Exploring the Relationship Between 2D/3D Convolution for Hyperspectral Image Super-Resolution
    Li, Qiang
    Wang, Qi
    Li, Xuelong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (10): : 8693 - 8703
  • [48] IMAGE SUPER-RESOLUTION USING DEFORMABLE CONVOLUTION GROUP FUSION FOR CANCER DIAGNOSIS
    Chen, Xiao
    Gao, Yang
    Jing, Ruyun
    JOURNAL OF INVESTIGATIVE MEDICINE, 2023, 71 : 19 - 19
  • [49] An image super-resolution network based on multi-scale convolution fusion
    Yang, Xin
    Zhu, Yitian
    Guo, Yingqing
    Zhou, Dake
    VISUAL COMPUTER, 2022, 38 (12): : 4307 - 4317
  • [50] NoUCSR: Efficient Super-Resolution Network without Upsampling Convolution
    Xiong, Dongliang
    Huang, Kai
    Chen, Siang
    Li, Bowen
    Jiang, Haitian
    Xu, Wenyuan
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3378 - 3387