Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks

被引:309
|
作者
Dar, Salman U. H. [1 ,2 ]
Yurt, Mahmut [1 ,2 ]
Karacan, Levent [3 ]
Erdem, Aykut [3 ]
Erdem, Erkut [3 ]
Cukur, Tolga [1 ,2 ,4 ]
机构
[1] Bilkent Univ, Dept Elect & Elect Engn, TR-06800 Ankara, Turkey
[2] Bilkent Univ, Natl Magnet Resonance Res Ctr, TR-06800 Ankara, Turkey
[3] Hacettepe Univ, Dept Comp Engn, TR-06800 Ankara, Turkey
[4] Bilkent Univ, Sabuncu Brain Res Ctr, Neurosci Program, TR-06800 Ankara, Turkey
关键词
Magnetic resonance imaging; Image generation; Generative adversarial networks; Gallium nitride; Feature extraction; Task analysis; Generators; Generative adversarial network; image synthesis; multi-contrast MRI; pixel-wise loss; cycleconsistency loss; REGISTRATION; OPTIMIZATION; SCANNERS; ROBUST;
D O I
10.1109/TMI.2019.2901750
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Acquiring images of the same anatomy with multiple different contrasts increases the diversity of diagnostic information available in an MR exam. Yet, the scan time limitations may prohibit the acquisition of certain contrasts, and some contrasts may be corrupted by noise and artifacts. In such cases, the ability to synthesize unacquired or corrupted contrasts can improve diagnostic utility. For multi-contrast synthesis, the current methods learn a nonlinear intensity transformation between the source and target images, either via nonlinear regression or deterministic neural networks. These methods can, in turn, suffer from the loss of structural details in synthesized images. Here, in this paper, we propose a new approach for multi-contrast MRI synthesis based on conditional generative adversarial networks. The proposed approach preserves intermediate-to-high frequency details via an adversarial loss, and it offers enhanced synthesis performance via pixel-wise and perceptual losses for registered multi-contrast images and a cycle-consistency loss for unregistered images. Information from neighboring cross-sections are utilized to further improve synthesis quality. Demonstrations on T-1 - and T-2 - weighted images from healthy subjects and patients clearly indicate the superior performance of the proposed approach compared to the previous state-of-the-art methods. Our synthesis approach can help improve the quality and versatility of the multi-contrast MRI exams without the need for prolonged or repeated examinations.
引用
收藏
页码:2375 / 2388
页数:14
相关论文
共 50 条
  • [1] Image Synthesis in Multi-Contrast MRI with Deep Convolutional Generative Adversarial Networks
    Kawahara, D.
    Ozawa, S.
    Saito, A.
    Miki, K.
    Murakami, Y.
    Kimura, T.
    Nagata, Y.
    [J]. MEDICAL PHYSICS, 2019, 46 (06) : E160 - E160
  • [2] Generative Adversarial Training for MRA Image Synthesis Using Multi-contrast MRI
    Olut, Sahin
    Sahin, Yusuf H.
    Demir, Ugur
    Unal, Gozde
    [J]. PREDICTIVE INTELLIGENCE IN MEDICINE, 2018, 11121 : 147 - 154
  • [3] Multi-Contrast MRI Image Synthesis Using Switchable Cycle-Consistent Generative Adversarial Networks
    Zhang, Huixian
    Li, Hailong
    Dillman, Jonathan R.
    Parikh, Nehal A.
    He, Lili
    [J]. DIAGNOSTICS, 2022, 12 (04)
  • [4] Unpaired Multi-contrast MR Image Synthesis Using Generative Adversarial Networks
    Sohail, Muhammad
    Riaz, Muhammad Naveed
    Wu, Jing
    Long, Chengnian
    Li, Shaoyuan
    [J]. SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2019, 2019, 11827 : 22 - 31
  • [5] Prior-Guided Image Reconstruction for Accelerated Multi-Contrast MRI via Generative Adversarial Networks
    Dar, Salman U. H.
    Yurt, Mahmut
    Shahdloo, Mohammad
    Ildiz, Muhammed Emrullah
    Tinaz, Berk
    Cukur, Tolga
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (06) : 1072 - 1087
  • [6] edaGAN: Encoder-Decoder Attention Generative Adversarial Networks for Multi-contrast MR Image Synthesis
    Dalmaz, Onat
    Saglam, Baturay
    Gonc, Kaan
    Cukur, Tolga
    [J]. 2022 9TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND ELECTRONICS ENGINEERING (ICEEE 2022), 2022, : 320 - 324
  • [7] SAR image synthesis based on conditional generative adversarial networks
    Wang, Jianyu
    Li, Jingwen
    Sun, Bing
    Zuo, Zhixiong
    [J]. JOURNAL OF ENGINEERING-JOE, 2019, 2019 (21): : 8093 - 8097
  • [8] Undersampled Multi-Contrast MRI Reconstruction Based on Double-Domain Generative Adversarial Network
    Wei, Haining
    Li, Zhongsen
    Wang, Shuai
    Li, Rui
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (09) : 4371 - 4377
  • [9] Enhanced Text-to-Image Synthesis Conditional Generative Adversarial Networks
    Tan, Yong Xuan
    Lee, Chin Poo
    Neo, Mai
    Lim, Kian Ming
    Lim, Jit Yan
    [J]. IAENG International Journal of Computer Science, 2022, 49 (01) : 1 - 7
  • [10] Statistics Enhancement Generative Adversarial Networks for Diverse Conditional Image Synthesis
    Zuo, Zhiwen
    Li, Ailin
    Wang, Zhizhong
    Zhao, Lei
    Dong, Jianfeng
    Wang, Xun
    Wang, Meng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 6167 - 6180