Generative Models for Inverse Imaging Problems: From mathematical foundations to physics-driven applications

被引:6
|
作者
Zhao, Zhizhen [1 ,2 ]
Ye, Jong Chul [3 ]
Bresler, Yoram [2 ,4 ]
机构
[1] Univ Illinois Urbana Champaign UIUC, William L Everitt Fac Fellow, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[2] Univ Illinois Urbana Champaign UIUC, Coordinated Sci Lab, Urbana, IL 61801 USA
[3] Korea Adv Inst Sci & Technol KAIST, Kim Jaechul Grad Sch AI, Daejon, South Korea
[4] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
关键词
Inverse problems; Computational modeling; Imaging; Generative adversarial networks; Mathematical models; Physics; CRYO-EM; RECONSTRUCTION; CYCLEGAN;
D O I
10.1109/MSP.2022.3215282
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Physics-informed generative modeling for inverse problems in computational imaging is a fast-growing field encompassing a variety of methods and applications. Here, we review a few generative modeling techniques, such as variational autoencoders (VAEs) and generative adversarial networks (GANs), as well as more recent developments in score-based generative models. Through different imaging applications, we review how the generative modeling techniques are effectively combined with the physics of the imaging problem, e.g., the measurement forward model and physical properties of the target objects, to solve the inverse problems.
引用
收藏
页码:148 / 163
页数:16
相关论文
共 50 条
  • [31] MODELING AND SOLUTION OF STOCHASTIC INVERSE PROBLEMS IN MATHEMATICAL PHYSICS
    PREZIOSI, L
    TEPPATI, G
    BELLOMO, N
    MATHEMATICAL AND COMPUTER MODELLING, 1992, 16 (05) : 37 - 51
  • [32] UNIQUENESS THEOREMS FOR 2 INVERSE PROBLEMS OF MATHEMATICAL PHYSICS
    ELUBAEV, S
    DOKLADY AKADEMII NAUK SSSR, 1973, 210 (05): : 1011 - 1013
  • [33] Hypernetwork-Based Physics-Driven Personalized Federated Learning for CT Imaging
    Yang, Ziyuan
    Xia, Wenjun
    Lu, Zexin
    Chen, Yingyu
    Li, Xiaoxiao
    Zhang, Yi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 15
  • [34] Physics-driven deep learning enables temporal compressive coherent diffraction imaging
    Chen, Ziyang
    Zheng, Siming
    Tong, Zhishen
    Yuan, Xin
    OPTICA, 2022, 9 (06): : 677 - 680
  • [35] Fourier Ptychography Microscopy: Physics-Driven Models for an Easier Path to Regulated Histopathology
    Burch, J.
    Toninelli, E.
    Gibson, J.
    Zhong, J.
    Cotton, S.
    Goulter, A.
    JOURNAL OF MOLECULAR DIAGNOSTICS, 2023, 25 (11): : S159 - S159
  • [36] Enhancing Mechanical Stimulated Brillouin Scattering Imaging with Physics-Driven Model Selection
    Shaashoua, Roni
    Levy, Tal
    Rotblat, Barak
    Bilenca, Alberto
    LASER & PHOTONICS REVIEWS, 2024, 18 (06)
  • [37] Physics-Driven Deep Learning for Computational Magnetic Resonance Imaging: Combining physics and machine learning for improved medical imaging
    Hammernik, Kerstin
    Kustner, Thomas
    Yaman, Burhaneddin
    Huang, Zhengnan
    Rueckert, Daniel
    Knoll, Florian
    Akcakaya, Mehmet
    IEEE SIGNAL PROCESSING MAGAZINE, 2023, 40 (01) : 98 - 114
  • [38] Algorithmic Aspects of Inverse Problems Using Generative Models
    Hegde, Chinmay
    2018 56TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2018, : 166 - 172
  • [39] Solving linear inverse problems using generative models
    Jalali, Shirin
    Yuan, Xin
    2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 512 - 516
  • [40] Regularising Inverse Problems with Generative Machine Learning Models
    M. A. G. Duff
    N. D. F. Campbell
    M. J. Ehrhardt
    Journal of Mathematical Imaging and Vision, 2024, 66 (1) : 37 - 56