Deep Reference-based Dynamic Scene Deblurring

被引:0
|
作者
Liu, Cunzhe [1 ]
Hua, Zhen [1 ]
Li, Jinjiang [2 ]
机构
[1] Shandong Technol & Business Univ, Sch Informat & Elect Engn, Yantai 264005, Shandong, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Shandong, Peoples R China
关键词
Image deblurring; reference image; convolutional neural network; encoder-; decoder; deep learning;
D O I
10.3837/tiis.2024.03.007
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Dynamic scene deblurring is a complex computer vision problem owing to its difficulty to model mathematically. In this paper, we present a novel approach for image deblurring with the help of the sharp reference image, which utilizes the reference image for high-quality and high-frequency detail results. To better utilize the clear reference image, we develop an encoder-decoder network and two novel modules are designed to guide the network for better image restoration. The proposed Reference Extraction and Aggregation Module can effectively establish the correspondence between blurry image and reference image and explore the most relevant features for better blur removal and the proposed Spatial Feature Fusion Module enables the encoder to perceive blur information at different spatial scales. In the final, the multi-scale feature maps from the encoder and cascaded Reference Extraction and Aggregation Modules are integrated into the decoder for a global fusion and representation. Extensive quantitative and qualitative experimental results from the different benchmarks show the effectiveness of our proposed method.
引用
收藏
页码:653 / 669
页数:17
相关论文
共 50 条
  • [1] Deep Ranking Exemplar-Based Dynamic Scene Deblurring
    Li, Yaowei
    Pan, Jinshan
    Luo, Ye
    Lu, Jianwei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2245 - 2256
  • [2] Discriminative Reference-Based Scene Image Categorization
    Li, Qun
    Xu, Ding
    An, Le
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2014, E97D (10): : 2823 - 2826
  • [3] Reference-based dual-task framework for motion deblurring
    Liu, Cunzhe
    Hua, Zhen
    Li, Jinjiang
    VISUAL COMPUTER, 2024, 40 (01): : 137 - 151
  • [4] Reference-based dual-task framework for motion deblurring
    Cunzhe Liu
    Zhen Hua
    Jinjiang Li
    The Visual Computer, 2024, 40 : 137 - 151
  • [5] Deep Supervised Attention Network for Dynamic Scene Deblurring
    Jang, Seok-Woo
    Yan, Limin
    Kim, Gye-Young
    SENSORS, 2025, 25 (06)
  • [6] Deep Dynamic Scene Deblurring From Optical Flow
    Zhang, Jiawei
    Pan, Jinshan
    Wang, Daoye
    Zhou, Shangchen
    Wei, Xing
    Zhao, Furong
    Liu, Jianbo
    Ren, Jimmy
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (12) : 8250 - 8260
  • [7] Dynamic Scene Deblurring
    Kim, Tae Hyun
    Ahn, Byeongjoo
    Lee, Kyoung Mu
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 3160 - 3167
  • [8] Dynamic Scene Deblurring Based on Semantic Information Supplement
    Liu, Yiming
    Li, Junhui
    Huang, Wenzhuo
    Tang, Kang
    Xu, Dahong
    2020 4TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2020), 2020, 1518
  • [9] Deep Dynamic Scene Deblurring for Unconstrained Dual-Lens Cameras
    Mohan, M. R. Mahesh
    Nithin, G. K.
    Rajagopalan, A. N.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 (30) : 4479 - 4491
  • [10] Reference-Based Deep Line Art Video Colorization
    Shi, Min
    Zhang, Jia-Qi
    Chen, Shu-Yu
    Gao, Lin
    Lai, Yu-Kun
    Zhang, Fang-Lue
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (06) : 2965 - 2979