Comparison of Deep Learning Image-to-image Models for Medical Image Translation

被引:0
|
作者
Yang, Zeyu [1 ,2 ]
Zoellner, Frank G. [1 ,2 ]
机构
[1] Heidelberg Univ, Med Fac Mannheim, Comp Assisted Clin Med, Mannheim, Germany
[2] Heidelberg Univ, Mannheim Inst Intelligent Syst Med, Med Fac Mannheim, Mannheim, Germany
关键词
D O I
10.1007/978-3-658-44037-4_89
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We conducted a comparative analysis of six image-to-image deep learning models for the purpose of MRI-to-CT image translation comprising resUNet, attUnet, DCGAN, pix2pixGAN with resUNet, pix2pixGAN with attUnet, and the denoising diffusion probabilistic model (DDPM). These models underwent training and assessment using the SynthRAD2023 Grand Challenge dataset. For training, 170 MRI and CT image pairs (patients) were employed, while a set of 10 patients was reserved for testing. In summary, the pix2pixGAN with resUNet achieved the hightest scores (SSIM = 0.81 +/- 0.21, MAE = 55.52 +/- 3.50, PSNR = 27.19 +/- 6.29). The DDPM displayed considerable potential in generating CT images that closely resemble real ones in terms of detail and fidelity. Nevertheless, the quality of its generated images exhibited notable fluctuations. Consequently, further refinement is necessary to stabilize its output quality.
引用
收藏
页码:344 / 349
页数:6
相关论文
共 50 条
  • [1] Deep learning for thermal-RGB image-to-image translation
    Wadsworth, Emma
    Mahajan, Advait
    Prasad, Raksha
    Menon, Rajesh
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2024, 141
  • [2] Deliberation Learning for Image-to-Image Translation
    He, Tianyu
    Xia, Yingce
    Lin, Jianxin
    Tan, Xu
    He, Di
    Qin, Tao
    Chen, Zhibo
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 2484 - 2490
  • [3] Deep learning based unpaired image-to-image translation applications for medical physics: a systematic review
    Chen, Junhua
    Chen, Shenlun
    Wee, Leonard
    Dekker, Andre
    Bermejo, Inigo
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (05):
  • [4] Breaking the Dilemma of Medical Image-to-image Translation
    Kong, Lingke
    Lian, Chenyu
    Huang, Detian
    Li, Zhenjiang
    Hu, Yanle
    Zhou, Qichao
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [5] Contrastive learning for unsupervised image-to-image translation
    Lee, Hanbit
    Seol, Jinseok
    Lee, Sang-goo
    Park, Jaehui
    Shim, Junho
    [J]. APPLIED SOFT COMPUTING, 2024, 151
  • [6] Unaligned Image-to-Image Translation by Learning to Reweight
    Xie, Shaoan
    Gong, Mingming
    Xu, Yanwu
    Zhang, Kun
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14154 - 14164
  • [7] RL-I2IT: Image-to-Image Translation with Deep Reinforcement Learning
    Wang, Xin
    Luo, Ziwei
    Hu, Jing
    Feng, Chengming
    Hu, Shu
    Zhu, Bin
    Wu, Xi
    Zhu, Hongtu
    Li, Xin
    Lyu, Siwei
    [J]. arXiv, 2023,
  • [8] DualGAN: Unsupervised Dual Learning for Image-to-Image Translation
    Yi, Zili
    Zhang, Hao
    Tan, Ping
    Gong, Minglun
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2868 - 2876
  • [9] Dual Contrastive Learning for Unsupervised Image-to-Image Translation
    Han, Junlin
    Shoeiby, Mehrdad
    Petersson, Lars
    Armin, Mohammad Ali
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 746 - 755
  • [10] Improving Learning time in Unsupervised Image-to-Image Translation
    Min, Tae-Hong
    Kim, Do-Yun
    Choi, Young-June
    [J]. 2019 1ST INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION (ICAIIC 2019), 2019, : 455 - 458