Stable Deep MRI Reconstruction Using Generative Priors

被引:3
|
作者
Zach, Martin [1 ]
Knoll, Florian [2 ]
Pock, Thomas [1 ]
机构
[1] Graz Univ Technol, Inst Comp Graph & Vis, A-8010 Graz, Austria
[2] Friedrich Alexander Univ Erlangen Nuernberg, Dept Artificial Intelligence Biomed Engn, D-91052 Erlangen, Germany
关键词
MRI; generative priors; stable inverse prob-lems; IMAGE-RECONSTRUCTION; SENSE; FRAMEWORK; LANGEVIN; EXPERTS; FIELDS;
D O I
10.1109/TMI.2023.3311345
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Data-driven approaches recently achieved remarkable success in magnetic resonance imaging (MRI) reconstruction, but integration into clinical routine remains challenging due to a lack of generalizability and interpretability. In this paper, we address these challenges in a unified framework based on generative image priors. We propose a novel deep neural network based regularizer which is trained in a generative setting on reference magnitude images only. After training, the regularizer encodes higher-level domain statistics which we demonstrate by synthesizing images without data. Embedding the trained model in a classical variational approach yields high-quality reconstructions irrespective of the sub-sampling pattern. In addition, the model shows stable behavior when confronted with out-of-distribution data in the form of contrast variation. Furthermore, a probabilistic interpretation provides a distribution of reconstructions and hence allows uncertainty quantification. To reconstruct parallel MRI, we propose a fast algorithm to jointly estimate the image and the sensitivity maps. The results demonstrate competitive performance, on par with state-of-the-art end-to-end deep learning methods, while preserving the flexibility with respect to sub-sampling patterns and allowing for uncertainty quantification.
引用
收藏
页码:3817 / 3832
页数:16
相关论文
共 50 条
  • [31] Reconstruction of incomplete wildfire data using deep generative models
    Ivek, Tomislav
    Vlah, Domagoj
    EXTREMES, 2023, 26 (02) : 251 - 271
  • [32] Reconstruction of incomplete wildfire data using deep generative models
    Tomislav Ivek
    Domagoj Vlah
    Extremes, 2023, 26 : 251 - 271
  • [33] Global Guarantees for Enforcing Deep Generative Priors by Empirical Risk
    Hand, Paul
    Voroninski, Vladislav
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2020, 66 (01) : 401 - 418
  • [34] A Novel Plug-and-Play SAR Reconstruction Framework Using Deep Priors
    Alver, Muhammed Burak
    Saleem, Ammar
    Cetin, Mujdat
    2019 IEEE RADAR CONFERENCE (RADARCONF), 2019,
  • [35] MODEL-BASED FREE-BREATHING CARDIAC MRI RECONSTRUCTION USING DEEP LEARNED & STORM PRIORS: MODL-STORM
    Biswas, Sampurna
    Aggarwal, Hemant K.
    Poddar, Sunrita
    Jacob, Mathews
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 6533 - 6537
  • [36] Digital Multitone Image Reconstruction using Deep Generative Adversarial Nets
    Guo, Jing-Ming
    Sankarasrinivasan, S.
    2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 1670 - 1673
  • [37] Compressive phase retrieval: Optimal sample complexity with deep generative priors
    Hand, Paul
    Leong, Oscar
    Voroninski, Vladislav
    COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2024, 77 (02) : 1147 - 1223
  • [38] Generative Supervised Classification Using Dirichlet Process Priors
    Davy, Manuel
    Tourneret, Jean-Yves
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (10) : 1781 - 1794
  • [39] Unsupervised Audio Source Separation using Generative Priors
    Narayanaswamy, Vivek
    Thiagarajan, Jayaraman J.
    Anirudh, Rushil
    Spanias, Andreas
    INTERSPEECH 2020, 2020, : 2657 - 2661
  • [40] Compressed Sensing MRI Reconstruction Using a Generative Adversarial Network With a Cyclic Loss
    Tran Minh Quan
    Thanh Nguyen-Duc
    Jeong, Won-Ki
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) : 1488 - 1497