Generative Models for Inverse Imaging Problems: From mathematical foundations to physics-driven applications

被引:6
|
作者
Zhao, Zhizhen [1 ,2 ]
Ye, Jong Chul [3 ]
Bresler, Yoram [2 ,4 ]
机构
[1] Univ Illinois Urbana Champaign UIUC, William L Everitt Fac Fellow, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[2] Univ Illinois Urbana Champaign UIUC, Coordinated Sci Lab, Urbana, IL 61801 USA
[3] Korea Adv Inst Sci & Technol KAIST, Kim Jaechul Grad Sch AI, Daejon, South Korea
[4] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
关键词
Inverse problems; Computational modeling; Imaging; Generative adversarial networks; Mathematical models; Physics; CRYO-EM; RECONSTRUCTION; CYCLEGAN;
D O I
10.1109/MSP.2022.3215282
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Physics-informed generative modeling for inverse problems in computational imaging is a fast-growing field encompassing a variety of methods and applications. Here, we review a few generative modeling techniques, such as variational autoencoders (VAEs) and generative adversarial networks (GANs), as well as more recent developments in score-based generative models. Through different imaging applications, we review how the generative modeling techniques are effectively combined with the physics of the imaging problem, e.g., the measurement forward model and physical properties of the target objects, to solve the inverse problems.
引用
收藏
页码:148 / 163
页数:16
相关论文
共 50 条
  • [21] A Generative Variational Model for Inverse Problems in Imaging
    Habring, Andreas
    Holler, Martin
    SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2022, 4 (01): : 306 - 335
  • [22] Quantized Generative Models for Solving Inverse Problems
    Reddy, Nareddy Kartheek Kumar
    Killedar, Vinayak
    Seelamantula, Chandra Sekhar
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 1520 - 1525
  • [23] Markov chain generative adversarial neural networks for solving Bayesian inverse problems in physics applications
    Mucke, Nikolaj T.
    Sanderse, Benjamin
    Bohte, Sander M.
    Oosterlee, Cornelis W.
    COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2023, 147 : 278 - 299
  • [24] Modern Problems of Mathematical Physics and Their Applications
    Juraev, Davron Aslonqulovich
    Noeiaghdam, Samad
    AXIOMS, 2022, 11 (02)
  • [25] Physics-driven cycle network for seismic impedance inversion using conditional generative adversarial networks
    Wang, Yaojun
    Zong, Jingjing
    Wang, Liangji
    Zou, Bangli
    Chen, Ziteng
    Luo, Yang
    JOURNAL OF GEOPHYSICS AND ENGINEERING, 2023, 20 (06) : 1337 - 1347
  • [26] Lensless Imaging Based on Dual-Input Physics-Driven Neural Network
    Zuo, Jiale
    Tang, Ju
    Zhang, Mengmeng
    Zhang, Jiawei
    Ren, Zhenbo
    Di, Jianglei
    Zhao, Jianlin
    ADVANCED PHOTONICS RESEARCH, 2024,
  • [27] From seismic traces to reservoir properties: Physics-driven inversion
    Stanford University, Stanford, CA, United States
    不详
    Leading Edge, 2008, 4 (456-461):
  • [28] Group analysis and formulas in inverse problems of mathematical physics
    Neshchadim, M.V.
    Journal of Inverse and Ill-Posed Problems, 2000, 8 (03): : 287 - 305
  • [29] ON ANALYTICAL METHODS IN THE THEORY OF INVERSE PROBLEMS OF MATHEMATICAL PHYSICS
    Anikonov, Y. E.
    Neshchadim, M. V.
    SIBERIAN ELECTRONIC MATHEMATICAL REPORTS-SIBIRSKIE ELEKTRONNYE MATEMATICHESKIE IZVESTIYA, 2010, 7 : C11 - C61
  • [30] THE VARIATIONAL STATEMENTS OF THE MULTIDIMENSIONAL INVERSE PROBLEMS OF THE MATHEMATICAL PHYSICS
    ISKENDEROV, AD
    DOKLADY AKADEMII NAUK SSSR, 1984, 274 (03): : 531 - 533