Generative Models for Inverse Imaging Problems: From mathematical foundations to physics-driven applications

被引:6
|
作者
Zhao, Zhizhen [1 ,2 ]
Ye, Jong Chul [3 ]
Bresler, Yoram [2 ,4 ]
机构
[1] Univ Illinois Urbana Champaign UIUC, William L Everitt Fac Fellow, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[2] Univ Illinois Urbana Champaign UIUC, Coordinated Sci Lab, Urbana, IL 61801 USA
[3] Korea Adv Inst Sci & Technol KAIST, Kim Jaechul Grad Sch AI, Daejon, South Korea
[4] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
关键词
Inverse problems; Computational modeling; Imaging; Generative adversarial networks; Mathematical models; Physics; CRYO-EM; RECONSTRUCTION; CYCLEGAN;
D O I
10.1109/MSP.2022.3215282
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Physics-informed generative modeling for inverse problems in computational imaging is a fast-growing field encompassing a variety of methods and applications. Here, we review a few generative modeling techniques, such as variational autoencoders (VAEs) and generative adversarial networks (GANs), as well as more recent developments in score-based generative models. Through different imaging applications, we review how the generative modeling techniques are effectively combined with the physics of the imaging problem, e.g., the measurement forward model and physical properties of the target objects, to solve the inverse problems.
引用
下载
收藏
页码:148 / 163
页数:16
相关论文
共 50 条
  • [1] Physics-driven learning for inverse problems in quantum chromodynamics
    Gert Aarts
    Kenji Fukushima
    Tetsuo Hatsuda
    Andreas Ipp
    Shuzhe Shi
    Lingxiao Wang
    Kai Zhou
    Nature Reviews Physics, 2025, 7 (3) : 154 - 163
  • [2] Physics-Driven Inverse Problems Made Tractable With Cosparse Regularization
    Kitic, Srdan
    Albera, Laurent
    Bertin, Nancy
    Gribonval, Remi
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (02) : 335 - 348
  • [3] Versatile and Scalable Cosparse Methods for Physics-Driven Inverse Problems
    Kitic, Srdan
    Bensaid, Siouar
    Albera, Laurent
    Bertin, Nancy
    Gribonval, Remi
    COMPRESSED SENSING AND ITS APPLICATIONS, 2017, : 291 - 332
  • [4] A Sampling Framework for Solving Physics-Driven Inverse Source Problems
    Murray-Bruce, John
    Dragotti, Pier Luigi
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (24) : 6365 - 6380
  • [5] Controlling Quality for a Physics-Driven Generative Models and Auxiliary Regression Approach
    Rogachev, Alexander
    Ratnikov, Fedor
    26TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS, CHEP 2023, 2024, 295
  • [6] SOLVING PHYSICS-DRIVEN INVERSE PROBLEMS VIA STRUCTURED LEAST SQUARES
    Murray-Bruce, John
    Dragotti, Pier Luigi
    2016 24TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2016, : 331 - 335
  • [7] A Physics-Driven Deep-Learning Network for Solving Nonlinear Inverse Problems
    Jin, Yuchen
    Shen, Qiuyang
    Wu, Xuqing
    Chen, Jiefu
    Huang, Yueqin
    PETROPHYSICS, 2020, 61 (01): : 86 - 98
  • [8] DH-GAN: a physics-driven untrained generative adversarial network for holographic imaging
    Chen X.
    Wang H.
    Razi A.
    Kozicki M.
    Mann C.
    Optics Express, 2023, 31 (06) : 10114 - 10235
  • [9] Physics-Driven Machine Learning for Computational Imaging
    Wen, Bihan
    Ravishankar, Saiprasad
    Zhao, Zhizhen
    Giryes, Raja
    Ye, Jong Chul
    IEEE SIGNAL PROCESSING MAGAZINE, 2023, 40 (01) : 28 - 30
  • [10] Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos
    Su, Kun
    Qian, Kaizhi
    Shlizerman, Eli
    Torralba, Antonio
    Gan, Chuang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 9749 - 9759