Efficient multi-stage network with pixel-wise degradation prediction for real-time motion deblurring

被引:2
|
作者
Hao, Zeyu [1 ]
Wang, Hang [2 ]
Zhang, Xuchong [1 ]
Li, Yuhai [3 ]
Sun, Hongbin [1 ]
机构
[1] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Shaanxi, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Microelect, Xian 710049, Shaanxi, Peoples R China
[3] Natl Key Lab Electromagnet Space Secur, Tianjin 300308, Peoples R China
基金
中国国家自然科学基金;
关键词
Motion blur; Degradation; Lightweight module; Attention mechanism; Multi-scale; Pixel-wise degradation prediction; Compensation;
D O I
10.1016/j.cviu.2023.103693
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Motion deblurring is an indispensable task in perceptual systems because motion blur can seriously influence the visual effect and the quality of subsequent perception tasks. In practical application, efficiency and effect of motion deblurring are both important. However, among the existing methods, there is no design that can meet the real-time and visual quality requirements at the same time. Thus, an efficient motion deblurring network is proposed by leveraging multi-stage pixel-wise degradation prediction. Specifically, some lightweight modules are designed to accelerate processing while attention and multi-scale mechanism are introduced to maintain quality. In addition, a pixel-wise degradation prediction module and a spatial-channel compensation module are further employed to improve the deblurring quality, such as the distortion of moving objects in the restoration images. Extensive experimental results show that the proposed network can achieve the same PSNR level as the SOTA lightweight deblurring methods and is far faster (5.3 times for DMPHN, 6.7 times for IFI-RNN). Therefore, the proposed design achieves a balance between quality and speed compared with the existing methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Blind Motion Deblurring With Pixel-Wise Kernel Estimation via Kernel Prediction Networks
    Carbajal, Guillermo
    Vitoria, Patricia
    Lezama, Jose
    Muse, Pablo
    [J]. IEEE Transactions on Computational Imaging, 2023, 9 : 928 - 943
  • [2] Real-time pixel-wise grasp affordance prediction based on multi-scale context information fusion
    Wu, Yongxiang
    Fu, Yili
    Wang, Shuguo
    [J]. INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2022, 49 (02): : 368 - 381
  • [3] Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors
    Bibby, Charles
    Reid, Ian
    [J]. COMPUTER VISION - ECCV 2008, PT II, PROCEEDINGS, 2008, 5303 : 831 - 844
  • [4] Pixel-wise real-time advanced calibration method for thermal infrared cameras
    Tremblay, Pierre
    Belhumeur, Louis
    Chamberland, Martin
    Villemaire, Andre
    Dubois, Patrick
    Marcotte, Frederic
    Belzile, Charles
    Farley, Vincent
    Lagueux, Philippe
    [J]. INFRARED IMAGING SYSTEMS: DESIGN, ANALYSIS, MODELING, AND TESTING XXI, 2010, 7662
  • [5] Multi-stage feature-fusion dense network for motion deblurring
    Guo, Cai
    Wang, Qian
    Dai, Hong-Ning
    Li, Ping
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90
  • [6] Complex sinusoidally modulated imaging for real-time pixel-wise optical flow detection
    Wei, D.
    Masurel, P.
    Kurihara, T.
    Ando, S.
    [J]. IMAGE PROCESSING: ALGORITHMS AND SYSTEMS V, 2007, 6497
  • [7] Pixel-wise body composition prediction with a multi-task conditional generative adversarial network
    Wang, Qiyue
    Xue, Wu
    Zhang, Xiaoke
    Jin, Fang
    Hahn, James
    [J]. JOURNAL OF BIOMEDICAL INFORMATICS, 2021, 120
  • [8] DENSELY CONNECTED MULTI-STAGE MODEL WITH CHANNEL WISE SUBBAND FEATURE FOR REAL-TIME SPEECH ENHANCEMENT
    Li, Jingdong
    Luo, Dawei
    Liu, Yun
    Zhu, Yuanyuan
    Li, Zhaoxia
    Cui, Guohui
    Tang, Wenqi
    Chen, Wei
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6638 - 6642
  • [9] Real-Time Pixel-Wise Grasp Detection Based on RGB-D Feature Dense Fusion
    Wu, Yongxiang
    Fu, Yili
    Wang, Shuguo
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (IEEE ICMA 2021), 2021, : 970 - 975
  • [10] Multi-Stage Attentive Network for Motion Deblurring via Binary Cross-Entropy Loss
    Guo, Cai
    Chen, Xinan
    Chen, Yanhua
    Yu, Chuying
    [J]. ENTROPY, 2022, 24 (10)