INDigo: An INN-Guided Probabilistic Diffusion Algorithm for Inverse Problems

被引:0
|
作者
You, Di [1 ]
Floros, Andreas [1 ]
Dragotti, Pier Luigi [1 ]
机构
[1] Imperial Coll London, EEE Dept, London, England
关键词
inverse problems; diffusion models; invertible neural networks;
D O I
10.1109/MMSP59012.2023.10337733
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recently it has been shown that using diffusion models for inverse problems can lead to remarkable results. However, these approaches require a closed-form expression of the degradation model and can not support complex degradations. To overcome this limitation, we propose a method (INDigo) that combines invertible neural networks (INN) and diffusion models for general inverse problems. Specifically, we train the forward process of INN to simulate an arbitrary degradation process and use the inverse as a reconstruction process. During the diffusion sampling process, we impose an additional data-consistency step that minimizes the distance between the intermediate result and the INN-optimized result at every iteration, where the INN-optimized image is composed of the coarse information given by the observed degraded image and the details generated by the diffusion process. With the help of INN, our algorithm effectively estimates the details lost in the degradation process and is no longer limited by the requirement of knowing the closed-form expression of the degradation model. Experiments demonstrate that our algorithm obtains competitive results compared with recently leading methods both quantitatively and visually. Moreover, our algorithm performs well on more complex degradation models and real-world low-quality images.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] INDIGO+: A Unified INN-Guided Probabilistic Diffusion Algorithm for Blind and Non-Blind Image Restoration
    You, Di
    Dragotti, Pier Luigi
    IEEE Journal on Selected Topics in Signal Processing, 2024, 18 (06): : 1108 - 1122
  • [2] Guided Genetic Algorithm for Information Diffusion Problems
    Kromer, Pavel
    Nowakova, Jana
    2018 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2018, : 1722 - 1729
  • [3] Probabilistic constraints for inverse problems
    Carvalho, Elsa
    Cruz, Jorge
    Barahona, Pedro
    INTERVAL / PROBABILISTIC UNCERTAINTY AND NON-CLASSICAL LOGICS, 2008, 46 : 115 - 128
  • [4] Probabilistic Constraints for Nonlinear Inverse Problems
    Carvalho, Elsa
    Cruz, Jorge
    Barahona, Pedro
    PRINCIPLES AND PRACTICE OF CONSTRAINT PROGRAMMING, CP 2014, 2014, 8656 : 913 - 917
  • [5] Probabilistic analysis of implicit inverse problems
    Mosegaard, K
    Rygaard-Hjalsted, C
    INVERSE PROBLEMS, 1999, 15 (02) : 573 - 583
  • [6] PROBABILISTIC APPROACH TO INVERSE PROBLEMS IN ULTRASONICS
    RICHARDSON, JM
    MARSH, KA
    IEEE TRANSACTIONS ON SONICS AND ULTRASONICS, 1985, 32 (01): : 83 - 83
  • [7] Probabilistic constraints for nonlinear inverse problems
    Carvalho, Elsa
    Cruz, Jorge
    Barahona, Pedro
    CONSTRAINTS, 2013, 18 (03) : 344 - 376
  • [8] Guided diffusion for inverse molecular design
    Weiss, Tomer
    Yanes, Eduardo Mayo
    Chakraborty, Sabyasachi
    Cosmo, Luca
    Bronstein, Alex M.
    Gershoni-Poranne, Renana
    NATURE COMPUTATIONAL SCIENCE, 2023, 3 (10): : 873 - 882
  • [9] Guided diffusion for inverse molecular design
    Tomer Weiss
    Eduardo Mayo Yanes
    Sabyasachi Chakraborty
    Luca Cosmo
    Alex M. Bronstein
    Renana Gershoni-Poranne
    Nature Computational Science, 2023, 3 : 873 - 882
  • [10] A GUIDED MEMETIC ALGORITHM WITH PROBABILISTIC MODELS
    Chen, Shih-Hsin
    Chang, Pei-Chann
    Zhang, Qingfu
    Wang, Chin-Bin
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2009, 5 (12B): : 4753 - 4764