Stable Deep MRI Reconstruction Using Generative Priors

被引:3
|
作者
Zach, Martin [1 ]
Knoll, Florian [2 ]
Pock, Thomas [1 ]
机构
[1] Graz Univ Technol, Inst Comp Graph & Vis, A-8010 Graz, Austria
[2] Friedrich Alexander Univ Erlangen Nuernberg, Dept Artificial Intelligence Biomed Engn, D-91052 Erlangen, Germany
关键词
MRI; generative priors; stable inverse prob-lems; IMAGE-RECONSTRUCTION; SENSE; FRAMEWORK; LANGEVIN; EXPERTS; FIELDS;
D O I
10.1109/TMI.2023.3311345
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Data-driven approaches recently achieved remarkable success in magnetic resonance imaging (MRI) reconstruction, but integration into clinical routine remains challenging due to a lack of generalizability and interpretability. In this paper, we address these challenges in a unified framework based on generative image priors. We propose a novel deep neural network based regularizer which is trained in a generative setting on reference magnitude images only. After training, the regularizer encodes higher-level domain statistics which we demonstrate by synthesizing images without data. Embedding the trained model in a classical variational approach yields high-quality reconstructions irrespective of the sub-sampling pattern. In addition, the model shows stable behavior when confronted with out-of-distribution data in the form of contrast variation. Furthermore, a probabilistic interpretation provides a distribution of reconstructions and hence allows uncertainty quantification. To reconstruct parallel MRI, we propose a fast algorithm to jointly estimate the image and the sensitivity maps. The results demonstrate competitive performance, on par with state-of-the-art end-to-end deep learning methods, while preserving the flexibility with respect to sub-sampling patterns and allowing for uncertainty quantification.
引用
收藏
页码:3817 / 3832
页数:16
相关论文
共 50 条
  • [1] Federated Learning of Generative Image Priors for MRI Reconstruction
    Elmas, Gokberk
    Dar, Salman U. H.
    Korkmaz, Yilmaz
    Ceyani, Emir
    Susam, Burak
    Ozbey, Muzaffer
    Avestimehr, Salman
    Cukur, Tolga
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (07) : 1996 - 2009
  • [2] Robust Compressed Sensing MRI with Deep Generative Priors
    Jalal, Ajil
    Arvinte, Marius
    Daras, Giannis
    Price, Eric
    Dimakis, Alexandros G.
    Tamir, Jonathan I.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [3] Image Reconstruction for MRI using Deep CNN Priors Trained without Groundtruth
    Gan, Weijie
    Eldeniz, Cihat
    Liu, Jiaming
    Chen, Sihao
    An, Hongyu
    Kamilov, Ulugbek S.
    2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, : 475 - 479
  • [4] Deep MRI Reconstruction with Generative Vision Transformers
    Korkmaz, Yilmaz
    Yurt, Mahmut
    Dar, Salman Ul Hassan
    Ozbey, Muzaffer
    Cukur, Tolga
    MACHINE LEARNING FOR MEDICAL IMAGE RECONSTRUCTION (MLMIR 2021), 2021, 12964 : 54 - 64
  • [5] Iterative Reconstruction for Low-Dose CT Using Deep Gradient Priors of Generative Model
    He, Zhuonan
    Zhang, Yikun
    Guan, Yu
    Guan, Bing
    Niu, Shanzhou
    Zhang, Yi
    Chen, Yang
    Liu, Qiegen
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2022, 6 (07) : 741 - 754
  • [6] Blind Image Deconvolution Using Deep Generative Priors
    Asim, Muhammad
    Shamshad, Fahad
    Ahmed, Ali
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 1493 - 1506
  • [7] DEEP PTYCH: SUBSAMPLED FOURIER PTYCHOGRAPHY USING GENERATIVE PRIORS
    Shamshad, Fahad
    Abbas, Farwa
    Ahmed, Ali
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 7720 - 7724
  • [8] Source Separation with Deep Generative Priors
    Jayaram, Vivek
    Thickstun, John
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [9] DLGAN: Undersampled MRI reconstruction using Deep Learning based Generative Adversarial Network
    Noor, Rida
    Wahid, Abdul
    Bazai, Sibghat Ullah
    Khan, Asad
    Fang, Meie
    Syam, M. S.
    Bhatti, Uzair Aslam
    Ghadi, Yazeed Yasin
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 93
  • [10] Shape Reconstruction using Differentiable Projections and Deep Priors
    Gadelha, Matheus
    Wang, Rui
    Maji, Subhransu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 22 - 30