Deep Generative Adversarial Neural Networks for Compressive Sensing MRI

被引:364
|
作者
Mardani, Morteza [1 ,2 ]
Gong, Enhao [1 ,2 ]
Cheng, Joseph Y. [1 ,2 ]
Vasanawala, Shreyas S. [3 ]
Zaharchuk, Greg [3 ]
Xing, Lei [1 ,4 ]
Pauly, John M. [1 ]
机构
[1] Stanford Univ, Elect Engn Dept, Stanford, CA 94305 USA
[2] Stanford Univ, Radiol Dept, Stanford, CA 94305 USA
[3] Stanford Univ, Radiol Dept, Stanford, CA 94304 USA
[4] Stanford Univ, Med Phys Dept, Stanford, CA 94305 USA
关键词
Deep learning; generative adversarial networks (GAN); convolutional neural networks (CNN); rapid reconstruction; diagnostic quality; compressed sensing (CS);
D O I
10.1109/TMI.2018.2858752
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Undersampled magnetic resonance image (MRI) reconstruction is typically an ill-posed linear inverse task. The time and resource intensive computations require tradeoffs between accuracy and speed. In addition, state-of-the-art compressed sensing (CS) analytics are not cognizant of the image diagnostic quality. To address these challenges, we propose a novel CS framework that uses generative adversarial networks (GAN) to model the (low-dimensional) manifold of high-quality MR images. Leveraging a mixture of least-squares (LS) GANs and pixel-wise l(1)/l(2) cost, a deep residual network with skip connections is trained as the generator that learns to remove the aliasing artifacts by projecting onto the image manifold. The LSGAN learns the texture details, while the l(1)/l(2) cost suppresses high-frequency noise. A discriminator network, which is a multilayer convolutional neural network (CNN), plays the role of a perceptual cost that is then jointly trained based on high-quality MR images to score the quality of retrieved images. In the operational phase, an initial aliased estimate (e.g., simply obtained by zero-filling) is propagated into the trained generator to output the desired reconstruction. This demands a very low computational overhead. Extensive evaluations are performed on a large contrast-enhanced MR dataset of pediatric patients. Images rated by expert radiologists corroborate that GANCS retrieves higher quality images with improved fine texture details compared with conventional Wavelet-based and dictionary-learning-based CS schemes as well as with deep-learning-based schemes usingpixel-wise training. In addition, it offers reconstruction times of under a few milliseconds, which are two orders of magnitude faster than the current state-of-the-art CS-MRI schemes.
引用
收藏
页码:167 / 179
页数:13
相关论文
共 50 条
  • [1] Structure Preserving Compressive Sensing MRI Reconstruction using Generative Adversarial Networks
    Deora, Puneesh
    Vasudeva, Bhavya
    Bhattacharya, Saumik
    Pradhan, Pyari Mohan
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2211 - 2219
  • [2] Recurrent Generative Adversarial Neural Networks for Compressive Imaging
    Mardani, Morteza
    Gong, Enhao
    Cheng, Joseph Y.
    Pauly, John
    Xing, Lei
    [J]. 2017 IEEE 7TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP), 2017,
  • [3] Subsampled brain MRI reconstruction by generative adversarial neural networks
    Shaul, Roy
    David, Itamar
    Shitrit, Ohad
    Raviv, Tammy Riklin
    [J]. MEDICAL IMAGE ANALYSIS, 2020, 65
  • [4] Spectrum sensing based on deep convolutional generative adversarial networks
    Liu, Zheng
    Jing, Xiaojun
    Zhang, Ronghui
    Mu, Junsheng
    [J]. IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 796 - 801
  • [5] Compressive sensing ghost imaging object detection using generative adversarial networks
    Zhai, Xiang
    Cheng, Zhengdong
    Wei, Yuan
    Liang, Zhenyu
    Chen, Yi
    [J]. OPTICAL ENGINEERING, 2019, 58 (01)
  • [6] DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction
    Yang, Guang
    Yu, Simiao
    Dong, Hao
    Slabaugh, Greg
    Dragotti, Pier Luigi
    Ye, Xujiong
    Liu, Fangde
    Arridge, Simon
    Keegan, Jennifer
    Guo, Yike
    Firmin, David
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) : 1310 - 1321
  • [7] ARGAN: Adversarially Robust Generative Adversarial Networks for Deep Neural Networks Against Adversarial Examples
    Choi, Seok-Hwan
    Shin, Jin-Myeong
    Liu, Peng
    Choi, Yoon-Ho
    [J]. IEEE Access, 2022, 10 : 33602 - 33615
  • [8] ARGAN: Adversarially Robust Generative Adversarial Networks for Deep Neural Networks Against Adversarial Examples
    Choi, Seok-Hwan
    Shin, Jin-Myeong
    Liu, Peng
    Choi, Yoon-Ho
    [J]. IEEE ACCESS, 2022, 10 : 33602 - 33615
  • [9] Detect and Remove Watermark in Deep Neural Networks via Generative Adversarial Networks
    Sun, Shichang
    Wang, Haoqi
    Xue, Mingfu
    Zhang, Yushu
    Wang, Jian
    Liu, Weiqiang
    [J]. INFORMATION SECURITY (ISC 2021), 2021, 13118 : 341 - 357
  • [10] Synthesis of 3D MRI Brain Images With Shape and Texture Generative Adversarial Deep Neural Networks
    Chong, Chee Keong
    Ho, Eric Tatt Wei
    [J]. IEEE ACCESS, 2021, 9 : 64747 - 64760