Uncertainty-Aware Variate Decomposition for Self-supervised Blind Image Deblurring

被引:0
|
作者
Jiang, Runhua [1 ]
Han, Yahong [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
基金
中国国家自然科学基金;
关键词
Self-supervised image deblirrung; residual image; multi-variate decomposition;
D O I
10.1145/3581783.3612535
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Blind image deblurring remains challenging due to the ill-posed nature of the traditional blurring function. Although previous supervised methods have achieved great breakthrough with synthetic blurry-sharp image pairs, their generalization ability to real-world blurs is limited by the discrepancy between synthetic and real blurs. To overcome this limitation, unsupervised deblurring methods have been proposed by using natural priors or generative adversarial networks. However, natural priors are vulnerable to random blur artifacts, while generators of generative adversarial networks always produce inaccurate details and unrealistic colors. Consequently, previous methods easily suffer from slow convergence and poor performance. In this work, we propose to formulate the traditional blurring function as the composition of multiple variates, thus allowing us explicitly define characteristics of residual images between blurry and sharp images. We also propose a multi-step self-supervised deblurring framework to address the slow convergence issue. Our framework continuously decomposes and composes input images, thus utilizing the uncertainty of blur artifacts to obtain diverse pseudo blurry-sharp image pairs for self-supervised learning. This framework is more efficient than previous methods, as it does not rely on natural priors or GANs. Extensive comparisons demonstrate that the proposed framework outperforms state-of-the-art unsupervised methods on both dynamic scene, human-aware centric motion, real-world and out-of-focus deblurring datasets. The codes are available at https://github.com/ddghjikle/MM-2023-USDF.
引用
收藏
页码:252 / 260
页数:9
相关论文
共 50 条
  • [1] Uncertainty-Aware Graph Self-Supervised Learning for Hyperspectral Image Change Detection
    Jian, Ping
    Ou, Yimin
    Chen, Keming
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 19
  • [2] Uncertainty-Aware Self-Supervised Learning of Spatial Perception Tasks
    Nava, Mirko
    Paolillo, Antonio
    Guzzi, Jerome
    Gambardella, Luca Maria
    Giusti, Alessandro
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 6693 - 6700
  • [3] Uncertainty-aware Self-supervised 3D Data Association
    Wang, Jianren
    Ancha, Siddharth
    Chen, Yi-Ting
    Held, David
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 8125 - 8132
  • [4] Self-supervised image blind deblurring using deep generator prior
    LI Yuan
    WANG Shasha
    CHEN Lei
    Optoelectronics Letters, 2022, (03) : 187 - 192
  • [5] Self-supervised image blind deblurring using deep generator prior
    Li Yuan
    Wang Shasha
    Chen Lei
    OPTOELECTRONICS LETTERS, 2022, 18 (03) : 187 - 192
  • [6] Self-supervised image blind deblurring using deep generator prior
    Yuan Li
    Shasha Wang
    Lei Chen
    Optoelectronics Letters, 2022, 18 : 187 - 192
  • [7] Uncertainty-aware Self-supervised Target-mass Grasping of Granular Foods
    Takahashi, Kuniyuki
    Ko, Wilson
    Ummadisingu, Avinash
    Maeda, Shin-ichi
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 2620 - 2626
  • [8] Self-Supervised 3D Human Mesh Recovery from a Single Image with Uncertainty-Aware Learning
    Yan, Guoli
    Zhong, Zichun
    Hua, Jing
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 6422 - 6430
  • [9] Uncertainty-Aware Unsupervised Image Deblurring with Deep Residual Prior
    Tang, Xiaole
    Zhao, Xile
    Liu, Jun
    Wang, Jianli
    Miao, Yuchun
    Zeng, Tieyong
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 9883 - 9892
  • [10] Self-Supervised Learning of Monocular Visual Odometry and Depth with Uncertainty-Aware Scale Consistency
    Zhang, Guanwen (guanwen.zh@nwpu.edu.cn), 1600, Institute of Electrical and Electronics Engineers Inc.