Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks

被引:310
|
作者
Dar, Salman U. H. [1 ,2 ]
Yurt, Mahmut [1 ,2 ]
Karacan, Levent [3 ]
Erdem, Aykut [3 ]
Erdem, Erkut [3 ]
Cukur, Tolga [1 ,2 ,4 ]
机构
[1] Bilkent Univ, Dept Elect & Elect Engn, TR-06800 Ankara, Turkey
[2] Bilkent Univ, Natl Magnet Resonance Res Ctr, TR-06800 Ankara, Turkey
[3] Hacettepe Univ, Dept Comp Engn, TR-06800 Ankara, Turkey
[4] Bilkent Univ, Sabuncu Brain Res Ctr, Neurosci Program, TR-06800 Ankara, Turkey
关键词
Magnetic resonance imaging; Image generation; Generative adversarial networks; Gallium nitride; Feature extraction; Task analysis; Generators; Generative adversarial network; image synthesis; multi-contrast MRI; pixel-wise loss; cycleconsistency loss; REGISTRATION; OPTIMIZATION; SCANNERS; ROBUST;
D O I
10.1109/TMI.2019.2901750
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Acquiring images of the same anatomy with multiple different contrasts increases the diversity of diagnostic information available in an MR exam. Yet, the scan time limitations may prohibit the acquisition of certain contrasts, and some contrasts may be corrupted by noise and artifacts. In such cases, the ability to synthesize unacquired or corrupted contrasts can improve diagnostic utility. For multi-contrast synthesis, the current methods learn a nonlinear intensity transformation between the source and target images, either via nonlinear regression or deterministic neural networks. These methods can, in turn, suffer from the loss of structural details in synthesized images. Here, in this paper, we propose a new approach for multi-contrast MRI synthesis based on conditional generative adversarial networks. The proposed approach preserves intermediate-to-high frequency details via an adversarial loss, and it offers enhanced synthesis performance via pixel-wise and perceptual losses for registered multi-contrast images and a cycle-consistency loss for unregistered images. Information from neighboring cross-sections are utilized to further improve synthesis quality. Demonstrations on T-1 - and T-2 - weighted images from healthy subjects and patients clearly indicate the superior performance of the proposed approach compared to the previous state-of-the-art methods. Our synthesis approach can help improve the quality and versatility of the multi-contrast MRI exams without the need for prolonged or repeated examinations.
引用
收藏
页码:2375 / 2388
页数:14
相关论文
共 50 条
  • [21] Conditional Adversarial Generative Flow for Controllable Image Synthesis
    Liu, Rui
    Liu, Yu
    Gong, Xinyu
    Wang, Xiaogang
    Li, Hongsheng
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7984 - 7993
  • [22] MsCGAN: Multi-scale Conditional Generative Adversarial Networks for Person Image Generation
    Tang, Wei
    Li, Gui
    Bao, Xinyuan
    Nian, Fudong
    Li, Tong
    PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 1440 - 1445
  • [23] MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis
    Kumar, Kundan
    Kumar, Rithesh
    de Boissiere, Thibault
    Gestin, Lucas
    Teoh, Wei Zhen
    Sotelo, Jose
    de Brebisson, Alexandre
    Bengio, Yoshua
    Courville, Aaron
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [24] Dual Projection Generative Adversarial Networks for Conditional Image Generation
    Han, Ligong
    Min, Martin Renqiang
    Stathopoulos, Anastasis
    Tian, Yu
    Gao, Ruijiang
    Kadav, Asim
    Metaxas, Dimitris
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14418 - 14427
  • [25] A Survey of Image Translation Based on Conditional Generative Adversarial Networks
    Tu H.
    Wang W.
    Chen J.
    Li G.
    Wu F.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2024, 36 (01): : 14 - 32
  • [26] Transferring Microscopy Image Modalities with Conditional Generative Adversarial Networks
    Han, Liang
    Yin, Zhaozheng
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 851 - 859
  • [27] Photoacoustic image synthesis with generative adversarial networks
    Schellenberg, Melanie
    Groehl, Janek
    Dreher, Kris K.
    Noelke, Jan-Hinrich
    Holzwarth, Niklas
    Tizabi, Minu D.
    Seitel, Alexander
    Maier-Hein, Lena
    PHOTOACOUSTICS, 2022, 28
  • [28] MULTI-CONTRAST DIFFUSION TENSOR IMAGE REGISTRATION WITH STRUCTURAL MRI
    Geng, Xiujuan
    Styner, Martin
    Gupta, Aditya
    Shen, Dinggang
    Gilmore, John H.
    2012 9TH IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2012, : 684 - 687
  • [29] StegGAN: hiding image within image using conditional generative adversarial networks
    Singh, Brijesh
    Sharma, Prasen Kumar
    Huddedar, Shashank Anil
    Sur, Arijit
    Mitra, Pinaki
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (28) : 40511 - 40533
  • [30] StegGAN: hiding image within image using conditional generative adversarial networks
    Brijesh Singh
    Prasen Kumar Sharma
    Shashank Anil Huddedar
    Arijit Sur
    Pinaki Mitra
    Multimedia Tools and Applications, 2022, 81 : 40511 - 40533