Deep Reference-based Dynamic Scene Deblurring

被引:0
|
作者
Liu, Cunzhe [1 ]
Hua, Zhen [1 ]
Li, Jinjiang [2 ]
机构
[1] Shandong Technol & Business Univ, Sch Informat & Elect Engn, Yantai 264005, Shandong, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Shandong, Peoples R China
关键词
Image deblurring; reference image; convolutional neural network; encoder-; decoder; deep learning;
D O I
10.3837/tiis.2024.03.007
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Dynamic scene deblurring is a complex computer vision problem owing to its difficulty to model mathematically. In this paper, we present a novel approach for image deblurring with the help of the sharp reference image, which utilizes the reference image for high-quality and high-frequency detail results. To better utilize the clear reference image, we develop an encoder-decoder network and two novel modules are designed to guide the network for better image restoration. The proposed Reference Extraction and Aggregation Module can effectively establish the correspondence between blurry image and reference image and explore the most relevant features for better blur removal and the proposed Spatial Feature Fusion Module enables the encoder to perceive blur information at different spatial scales. In the final, the multi-scale feature maps from the encoder and cascaded Reference Extraction and Aggregation Modules are integrated into the decoder for a global fusion and representation. Extensive quantitative and qualitative experimental results from the different benchmarks show the effectiveness of our proposed method.
引用
收藏
页码:653 / 669
页数:17
相关论文
共 50 条
  • [31] Reference-Based Sequence Classification
    He, Zengyou
    Xu, Guangyao
    Sheng, Chaohua
    Xu, Bo
    Zou, Quan
    IEEE ACCESS, 2020, 8 : 218199 - 218214
  • [32] Progressive edge-sensing dynamic scene deblurring
    Tianlin Zhang
    Jinjiang Li
    Hui Fan
    ComputationalVisualMedia, 2022, 8 (03) : 495 - 508
  • [33] Bi-branch network for dynamic scene deblurring
    Luo, Yao
    Duan, Zhong-Hui
    Tang, Jinhui
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 202
  • [34] Total variation constraint GAN for dynamic scene deblurring
    Ouyang, Yi
    IMAGE AND VISION COMPUTING, 2019, 88 : 113 - 119
  • [35] Progressive edge-sensing dynamic scene deblurring
    Tianlin Zhang
    Jinjiang Li
    Hui Fan
    Computational Visual Media, 2022, 8 : 495 - 508
  • [36] Progressive edge-sensing dynamic scene deblurring
    Zhang, Tianlin
    Li, Jinjiang
    Fan, Hui
    COMPUTATIONAL VISUAL MEDIA, 2022, 8 (03) : 495 - 508
  • [37] Reference-Based Encoding for Dynamic Data: Enabling Direct Modification in Compressed Format
    Wang, Biao
    Xu, Yun
    2024 DATA COMPRESSION CONFERENCE, DCC, 2024, : 589 - 589
  • [38] Dynamic Reference-based Voltage Droop Control for VSC-MTDC System
    Kim, Nam-Dae
    Kim, Hak-Man
    Park, Jae-Sae
    JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2015, 10 (06) : 2249 - 2255
  • [39] S-DyRF: Reference-Based Stylized Radiance Fields for Dynamic Scenes
    Li, Xingyi
    Cao, Zhiguo
    Wu, Yizheng
    Wang, Kewei
    Xian, Ke
    Wang, Zhe
    Lin, Guosheng
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 20102 - 20112
  • [40] Dynamic scene blind image deblurring based on local and non-local features
    Qing Qi
    Machine Vision and Applications, 2023, 34