Multi-scale Deformable Deblurring Kernel Prediction for Dynamic Scene Deblurring

被引:0
|
作者
Zhu, Kai [1 ]
Sang, Nong [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Key Lab Image Proc & Intelligent Control, Wuhan, Peoples R China
来源
关键词
Dynamic scene deblurring; Deformable convolution; Dynamic convolution;
D O I
10.1007/978-3-030-87361-5_21
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deblurring aims to restore clear images from blurred ones. Recently deep learning are widely used. Previous methods regard deblurring as dense prediction problems and rarely consider the inverse operation of blur. In this paper, we propose a multi-scale deformable deblurring kernel prediction network for dynamic scene deblurring which uses a coarse-to-fine method to predict the per-pixel deformable deblurring kernel and uses the fusion weight to integrate the latent images in different scales. Since the spatially variable blur scatters pixel information to surrounding sub-pixels and leads to the spatially and quantitively uneven distribution of latent pixel information, the per-pixel deformable deblurring kernel can adaptively select the sub-pixels and linearly combine them into the clean pixel for information aggregation. The multi-scale architecture helps the deformable deblurring kernel enlarge the reception field. The residual image is added to convolution result in each scale to supply refined edges when the kernel cannot cover the areas existing latent pixel information. Besides, we add local similarity loss to constrain deformable deblurring kernel's weight and offset which boosts the deblurring performance. Qualitative and quantitative experiments show that our method can produce competitive deblurring performance.
引用
收藏
页码:253 / 264
页数:12
相关论文
共 50 条
  • [31] Multi-Scale Cyclic Image Deblurring Based on PVC-Resnet
    Zhang, Kai
    Chen, Minhui
    Zhu, Dequan
    Liu, Kaixuan
    Zhao, Haonan
    Liao, Juan
    PHOTONICS, 2023, 10 (08)
  • [32] UNet Based Multi-Scale Recurrent Network for Lightweight Video Deblurring
    Yae, Shunsuke
    Ikehara, Masaaki
    IEEE ACCESS, 2023, 11 : 117520 - 117527
  • [33] SELF-SUPERVISED MULTI-SCALE NEURAL NETWORK FOR BLIND DEBLURRING
    Zhang, Meina
    Yang, Ying
    Ni, Guoxi
    Wu, Tingting
    Zeng, Tieyong
    INVERSE PROBLEMS AND IMAGING, 2024, 18 (03) : 623 - 641
  • [34] Supersonic combustion field evolution prediction in scramjet engine using a deblurring multi-scale attention network
    Chen, Erda
    Guo, Mingming
    Deng, Jiawen
    Tian, Ye
    Deng, Xue
    Le, Jialing
    Zhang, Hua
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [35] Multi-Task Learning Framework for Motion Estimation and Dynamic Scene Deblurring
    Jung, Hyungjoo
    Kim, Youngjung
    Jang, Hyunsung
    Ha, Namkoo
    Sohn, Kwanghoon
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 (30) : 8170 - 8183
  • [36] Multi-stream attentive generative adversarial network for dynamic scene deblurring
    Cui, Jinkai
    Li, Weihong
    Gong, Weiguo
    NEUROCOMPUTING, 2020, 383 (39-56) : 39 - 56
  • [37] Progressive edge-sensing dynamic scene deblurring
    Tianlin Zhang
    Jinjiang Li
    Hui Fan
    ComputationalVisualMedia, 2022, 8 (03) : 495 - 508
  • [38] Deep Supervised Attention Network for Dynamic Scene Deblurring
    Jang, Seok-Woo
    Yan, Limin
    Kim, Gye-Young
    SENSORS, 2025, 25 (06)
  • [39] Bi-branch network for dynamic scene deblurring
    Luo, Yao
    Duan, Zhong-Hui
    Tang, Jinhui
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 202
  • [40] Total variation constraint GAN for dynamic scene deblurring
    Ouyang, Yi
    IMAGE AND VISION COMPUTING, 2019, 88 : 113 - 119