Stable Deep MRI Reconstruction Using Generative Priors

被引:3
|
作者
Zach, Martin [1 ]
Knoll, Florian [2 ]
Pock, Thomas [1 ]
机构
[1] Graz Univ Technol, Inst Comp Graph & Vis, A-8010 Graz, Austria
[2] Friedrich Alexander Univ Erlangen Nuernberg, Dept Artificial Intelligence Biomed Engn, D-91052 Erlangen, Germany
关键词
MRI; generative priors; stable inverse prob-lems; IMAGE-RECONSTRUCTION; SENSE; FRAMEWORK; LANGEVIN; EXPERTS; FIELDS;
D O I
10.1109/TMI.2023.3311345
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Data-driven approaches recently achieved remarkable success in magnetic resonance imaging (MRI) reconstruction, but integration into clinical routine remains challenging due to a lack of generalizability and interpretability. In this paper, we address these challenges in a unified framework based on generative image priors. We propose a novel deep neural network based regularizer which is trained in a generative setting on reference magnitude images only. After training, the regularizer encodes higher-level domain statistics which we demonstrate by synthesizing images without data. Embedding the trained model in a classical variational approach yields high-quality reconstructions irrespective of the sub-sampling pattern. In addition, the model shows stable behavior when confronted with out-of-distribution data in the form of contrast variation. Furthermore, a probabilistic interpretation provides a distribution of reconstructions and hence allows uncertainty quantification. To reconstruct parallel MRI, we propose a fast algorithm to jointly estimate the image and the sensitivity maps. The results demonstrate competitive performance, on par with state-of-the-art end-to-end deep learning methods, while preserving the flexibility with respect to sub-sampling patterns and allowing for uncertainty quantification.
引用
收藏
页码:3817 / 3832
页数:16
相关论文
共 50 条
  • [21] Deep generative image priors for semantic face manipulation
    Hou, Xianxu
    Shen, Linlin
    Ming, Zhong
    Qiu, Guoping
    PATTERN RECOGNITION, 2023, 139
  • [22] Joint ptycho-tomography with deep generative priors
    Aslan, Selin
    Liu, Zhengchun
    Nikitin, Viktor
    Bicer, Tekin
    Leyffer, Sven
    Gursoy, Doga
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2021, 2 (04):
  • [23] Adaptive diffusion priors for accelerated MRI reconstruction
    Gungor, Alper
    Dar, Salman U. H.
    Ozturk, Saban
    Korkmaz, Yilmaz
    Bedel, Hasan A.
    Elmas, Gokberk
    Ozbey, Muzaffer
    Cukur, Tolga
    MEDICAL IMAGE ANALYSIS, 2023, 88
  • [24] MODEL BASED IMAGE RECONSTRUCTION USING DEEP LEARNED PRIORS (MODL)
    Aggarwal, Hemant Kumar
    Mani, Merry P.
    Jacob, Mathews
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 671 - 674
  • [25] RARE: Image Reconstruction Using Deep Priors Learned Without Groundtruth
    Liu, Jiaming
    Sun, Yu
    Eldeniz, Cihat
    Gan, Weijie
    An, Hongyu
    Kamilov, Ulugbek S.
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (06) : 1088 - 1099
  • [26] Blind Single Image Reflection Suppression for Face Images using Deep Generative Priors
    Chandramouli, Paramanand
    Gandikota, Kanchana Vaishnavi
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3315 - 3323
  • [27] Homotopic Gradients of Generative Density Priors for MR Image Reconstruction
    Quan, Cong
    Zhou, Jinjie
    Zhu, Yuanzheng
    Chen, Yang
    Wang, Shanshan
    Liang, Dong
    Liu, Qiegen
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (12) : 3265 - 3278
  • [28] MRI reconstruction using deep Bayesian estimation
    Luo, Guanxiong
    Zhao, Na
    Jiang, Wenhao
    Hui, Edward S.
    Cao, Peng
    MAGNETIC RESONANCE IN MEDICINE, 2020, 84 (04) : 2246 - 2261
  • [29] Inpainting Cropped Diffusion MRI Using Deep Generative Models
    Ayub, Rafi
    Zhao, Qingyu
    Meloy, M. J.
    Sullivan, Edith V.
    Pfefferbaum, Adolf
    Adeli, Ehsan
    Pohl, Kilian M.
    PREDICTIVE INTELLIGENCE IN MEDICINE, PRIME 2020, 2020, 12329 : 91 - 100
  • [30] Deep generative priors for biomolecular 3D heterogeneous reconstruction from cryo-EM projections
    Shi, Bin
    Zhang, Kevin
    Fleet, David J.
    McLeod, Robert A.
    Miller, R. J. Dwayne
    Howe, Jane Y.
    JOURNAL OF STRUCTURAL BIOLOGY, 2024, 216 (02)