Non-uniform motion deblurring with blurry component divided guidance

被引:12
|
作者
Wang, Pei [1 ,5 ]
Sun, Wei [2 ]
Yan, Qingsen [3 ]
Niu, Axi [1 ,5 ]
Li, Rui [1 ,5 ]
Zhu, Yu [1 ,5 ]
Sun, Jinqiu [4 ,5 ]
Zhang, Yanning [1 ,5 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710072, Peoples R China
[3] Univ Adelaide, Sch Comp Sci, Adelaide, SA 5005, Australia
[4] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[5] Natl Engn Lab Integrated Aero Space Ground Ocean, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Non-uiniform deblurring; Component divided; Attention mechanism; INTENSITY; IMAGES;
D O I
10.1016/j.patcog.2021.108082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Blind image deblurring is a fundamental and challenging computer vision problem, which aims to recover both the blur kernel and the latent sharp image from only a blurry observation. Despite the superiority of deep learning methods in image deblurring have displayed, there still exists a major challenge with various non-uniform motion blur. Previous methods simply take all the image features as the input to the decoder, which handles different degrees (e.g. large blur, small blur) simultaneously, leading to challenges for sharp image generation. To tackle the above problems, we present a deep two-branch network to deal with blurry images via a component divided module, which divides an image into two components based on the representation of blurry degree. Specifically, two component attentive blocks are employed to learn attention maps to exploit useful deblurring feature representations on both large and small blurry regions. Then, the blur-aware features are fed into two-branch reconstruction decoders respectively. In addition, a new feature fusion mechanism, orientation-based feature fusion, is proposed to merge sharp features of the two branches. Both qualitative and quantitative experimental results show that our method performs favorably against the state-of-the-art approaches. (c) 2021 Elsevier Ltd. All rights reserved.
引用
下载
收藏
页数:16
相关论文
共 50 条
  • [1] Registration Based Non-uniform Motion Deblurring
    Cho, Sunghyun
    Cho, Hojin
    Tai, Yu-Wing
    Lee, Seungyong
    COMPUTER GRAPHICS FORUM, 2012, 31 (07) : 2183 - 2192
  • [2] Non-uniform Motion Deblurring for Bilayer Scenes
    Paramanand, C.
    Rajagopalan, A. N.
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 1115 - 1122
  • [3] Non-uniform motion deblurring with Kernel grid regularization
    Shen, Ziyi
    Xu, Tingfa
    Pan, Jinshan
    Guo, Jie
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 62 : 1 - 15
  • [4] Non-uniform Motion Deblurring Using Normalized Hyper Laplacian Prior
    Wang, Guodong
    Wei, Bin
    Pan, Zhenkuan
    Lu, Jingge
    Diao, Zhaojing
    COMPUTER VISION, CCCV 2015, PT I, 2015, 546 : 103 - 113
  • [5] Deep Convolutional Neural Networks for Dense Non-Uniform Motion Deblurring
    Cronje, Jaco
    2015 INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2015,
  • [6] Removing Non-uniform Camera Shake Using Blind Motion Deblurring
    Kim, Jinok
    Oh, Jongsuk
    Park, Rae-Hong
    2016 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2016,
  • [7] Non-Uniform Blind Deblurring by Reblurring
    Bahat, Yuval
    Efrat, Netalee
    Irani, Michal
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 3306 - 3314
  • [8] Non-uniform Deblurring for Shaken Images
    Oliver Whyte
    Josef Sivic
    Andrew Zisserman
    Jean Ponce
    International Journal of Computer Vision, 2012, 98 : 168 - 186
  • [9] Non-uniform Deblurring for Shaken Images
    Whyte, Oliver
    Sivic, Josef
    Zisserman, Andrew
    Ponce, Jean
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2012, 98 (02) : 168 - 186
  • [10] Attention Network for Non-Uniform Deblurring
    Qi, Qing
    Guo, Jichang
    Jin, Weipei
    IEEE ACCESS, 2020, 8 (08): : 100044 - 100057