Deep Reference-based Dynamic Scene Deblurring

被引:0
|
作者
Liu, Cunzhe [1 ]
Hua, Zhen [1 ]
Li, Jinjiang [2 ]
机构
[1] Shandong Technol & Business Univ, Sch Informat & Elect Engn, Yantai 264005, Shandong, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Shandong, Peoples R China
关键词
Image deblurring; reference image; convolutional neural network; encoder-; decoder; deep learning;
D O I
10.3837/tiis.2024.03.007
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Dynamic scene deblurring is a complex computer vision problem owing to its difficulty to model mathematically. In this paper, we present a novel approach for image deblurring with the help of the sharp reference image, which utilizes the reference image for high-quality and high-frequency detail results. To better utilize the clear reference image, we develop an encoder-decoder network and two novel modules are designed to guide the network for better image restoration. The proposed Reference Extraction and Aggregation Module can effectively establish the correspondence between blurry image and reference image and explore the most relevant features for better blur removal and the proposed Spatial Feature Fusion Module enables the encoder to perceive blur information at different spatial scales. In the final, the multi-scale feature maps from the encoder and cascaded Reference Extraction and Aggregation Modules are integrated into the decoder for a global fusion and representation. Extensive quantitative and qualitative experimental results from the different benchmarks show the effectiveness of our proposed method.
引用
收藏
页码:653 / 669
页数:17
相关论文
共 50 条
  • [21] Decoupled Frequency Learning for Dynamic Scene Deblurring
    Liu, Tao
    Tan, Shan
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 89 - 96
  • [22] Dynamic Scene Deblurring by Depth Guided Model
    Li, Lerenhan
    Pan, Jinshan
    Lai, Wei-Sheng
    Gao, Changxin
    Sang, Nong
    Yang, Ming-Hsuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 5273 - 5288
  • [23] Segmentation-Free Dynamic Scene Deblurring
    Kim, Tae Hyun
    Lee, Kyoung Mu
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 2766 - 2773
  • [24] Structures Guided Dynamic Scene Deblurring Method
    Qi, Qing
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [25] Reference-Based Multi-Level Features Fusion Deblurring Network for Optical Remote Sensing Images
    Li, Zhiyuan
    Guo, Jiayi
    Zhang, Yueting
    Li, Jie
    Wu, Yirong
    REMOTE SENSING, 2022, 14 (11)
  • [26] SAR Image Despeckling by Noisy Reference-Based Deep Learning Method
    Ma, Xiaoshuang
    Wang, Chen
    Yin, Zhixiang
    Wu, Penghai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (12): : 8807 - 8818
  • [27] Multi-scale Deformable Deblurring Kernel Prediction for Dynamic Scene Deblurring
    Zhu, Kai
    Sang, Nong
    IMAGE AND GRAPHICS (ICIG 2021), PT III, 2021, 12890 : 253 - 264
  • [28] Toward a Dynamic Threshold for Quality Score Distortion in Reference-Based Alignment
    Hernandez-Lopez, Ana A.
    Alberti, Claudio
    Mattavelli, Marco
    JOURNAL OF COMPUTATIONAL BIOLOGY, 2020, 27 (02) : 288 - 300
  • [29] Reference-based refinements - Response
    Schneeweiss, S
    Dormuth, C
    CANADIAN MEDICAL ASSOCIATION JOURNAL, 2003, 168 (09) : 1115 - 1115
  • [30] Improved Deep Multi-Patch Hierarchical Network With Nested Module for Dynamic Scene Deblurring
    Zhao, Zunjin
    Xiong, Bangshu
    Gai, Shan
    Wang, Lei
    IEEE ACCESS, 2020, 8 : 62116 - 62126