Unsupervised Medical Image Translation With Adversarial Diffusion Models

被引:128
|
作者
Ozbey, Muzaffer [1 ,2 ]
Dalmaz, Onat [1 ,2 ]
Dar, Salman U. H. [1 ,2 ]
Bedel, Hasan A. [1 ,2 ]
Ozturk, Saban [1 ,2 ,3 ]
Gungor, Alper [1 ,2 ,4 ]
Cukur, Tolga [1 ,2 ]
机构
[1] Bilkent Univ, Dept Elect & Elect Engn, TR-06800 Ankara, Turkiye
[2] Bilkent Univ, Natl Magnet Resonance Res Ctr UMRAM, TR-06800 Ankara, Turkiye
[3] Amasya Univ, Dept Elect Elect Engn, TR-05100 Amasya, Turkiye
[4] SELSAN Res Ctr, TR-06200 Ankara, Turkiye
关键词
Biological system modeling; Computational modeling; Training; Generative adversarial networks; Image synthesis; Task analysis; Generators; Medical image translation; synthesis; unsupervised; unpaired; adversarial; diffusion; generative; ESTIMATING CT IMAGE; RANDOM FOREST; MODALITY; MR;
D O I
10.1109/TMI.2023.3290149
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Imputation of missing images via source-to-target modality translation can improve diversity in medical imaging protocols. A pervasive approach for synthesizing target images involves one-shot mapping through generative adversarial networks (GAN). Yet, GAN models that implicitly characterize the image distribution can suffer from limited sample fidelity. Here, we propose a novel method based on adversarial diffusion modeling, SynDiff, for improved performance in medical image translation. To capture a direct correlate of the image distribution, SynDiff leverages a conditional diffusion process that progressively maps noise and source images onto the target image. For fast and accurate image sampling during inference, large diffusion steps are taken with adversarial projections in the reverse diffusion direction. To enable training on unpaired datasets, a cycle-consistent architecture is devised with coupled diffusive and non-diffusive modules that bilaterally translate between two modalities. Extensive assessments are reported on the utility of SynDiff against competing GAN and diffusion models in multi-contrast MRI and MRI-CT translation. Our demonstrations indicate that SynDiff offers quantitatively and qualitatively superior performance against competing baselines.
引用
收藏
页码:3524 / 3539
页数:16
相关论文
共 50 条
  • [1] Denoising Diffusion Adversarial Models for Unconditional Medical Image Generation
    Dalmaz, Onat
    Saglam, Baturay
    Elmas, Gokberk
    Mirza, Muhammad
    Cukur, Tolga
    2023 31ST SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2023,
  • [2] FDDM: unsupervised medical image translation with a frequency-decoupled diffusion model
    Li, Yunxiang
    Shao, Hua-Chieh
    Qian, Xiaoxue
    Zhang, You
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2025, 6 (02):
  • [3] Unsupervised Deep Learning for Medical Image Translation
    Schaefferkoetter, Josh
    Ortega, Claudia
    Metser, Ur
    Veit-Haibach, Patrick
    JOURNAL OF NUCLEAR MEDICINE, 2020, 61
  • [4] Unpaired Image-to-Image Translation with Diffusion Adversarial Network
    Tu, Hangyao
    Wang, Zheng
    Zhao, Yanwei
    MATHEMATICS, 2024, 12 (20)
  • [5] Unsupervised Generative Adversarial Network for Plantar Pressure Image-to-Image Translation
    Ahmadian, Mona
    Beheshti, Mohammad T. H.
    Kalhor, Ahmad
    Shirian, Amir
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 2580 - 2583
  • [6] Multi-Constraint Adversarial Networks for Unsupervised Image-to-Image Translation
    Saxena, Divya
    Kulshrestha, Tarun
    Cao, Jiannong
    Cheung, Shing-Chi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1601 - 1612
  • [7] Unsupervised image-to-image translation with multiscale attention generative adversarial network
    Wang, Fasheng
    Zhang, Qing
    Zhao, Qianyi
    Wang, Mengyin
    Sun, Fuming
    APPLIED INTELLIGENCE, 2024, 54 (08) : 6558 - 6578
  • [8] ZstGAN: An adversarial approach for Unsupervised Zero-Shot Image-to-image Translation
    Lin, Jianxin
    Xia, Yingce
    Liu, Sen
    Zhao, Shuxin
    Chen, Zhibo
    NEUROCOMPUTING, 2021, 461 : 327 - 335
  • [9] Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation
    Tang, Hao
    Xu, Dan
    Sebel, Nicu
    Yan, Yan
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [10] Unsupervised Image-to-Image Translation with Stacked Cycle-Consistent Adversarial Networks
    Li, Minjun
    Huang, Haozhi
    Ma, Lin
    Liu, Wei
    Zhang, Tong
    Jiang, Yugang
    COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 186 - 201