Unsupervised Medical Image Translation With Adversarial Diffusion Models

被引:128
|
作者
Ozbey, Muzaffer [1 ,2 ]
Dalmaz, Onat [1 ,2 ]
Dar, Salman U. H. [1 ,2 ]
Bedel, Hasan A. [1 ,2 ]
Ozturk, Saban [1 ,2 ,3 ]
Gungor, Alper [1 ,2 ,4 ]
Cukur, Tolga [1 ,2 ]
机构
[1] Bilkent Univ, Dept Elect & Elect Engn, TR-06800 Ankara, Turkiye
[2] Bilkent Univ, Natl Magnet Resonance Res Ctr UMRAM, TR-06800 Ankara, Turkiye
[3] Amasya Univ, Dept Elect Elect Engn, TR-05100 Amasya, Turkiye
[4] SELSAN Res Ctr, TR-06200 Ankara, Turkiye
关键词
Biological system modeling; Computational modeling; Training; Generative adversarial networks; Image synthesis; Task analysis; Generators; Medical image translation; synthesis; unsupervised; unpaired; adversarial; diffusion; generative; ESTIMATING CT IMAGE; RANDOM FOREST; MODALITY; MR;
D O I
10.1109/TMI.2023.3290149
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Imputation of missing images via source-to-target modality translation can improve diversity in medical imaging protocols. A pervasive approach for synthesizing target images involves one-shot mapping through generative adversarial networks (GAN). Yet, GAN models that implicitly characterize the image distribution can suffer from limited sample fidelity. Here, we propose a novel method based on adversarial diffusion modeling, SynDiff, for improved performance in medical image translation. To capture a direct correlate of the image distribution, SynDiff leverages a conditional diffusion process that progressively maps noise and source images onto the target image. For fast and accurate image sampling during inference, large diffusion steps are taken with adversarial projections in the reverse diffusion direction. To enable training on unpaired datasets, a cycle-consistent architecture is devised with coupled diffusive and non-diffusive modules that bilaterally translate between two modalities. Extensive assessments are reported on the utility of SynDiff against competing GAN and diffusion models in multi-contrast MRI and MRI-CT translation. Our demonstrations indicate that SynDiff offers quantitatively and qualitatively superior performance against competing baselines.
引用
收藏
页码:3524 / 3539
页数:16
相关论文
共 50 条
  • [21] Unsupervised image translation
    Rosales, R
    Achan, K
    Frey, B
    NINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS I AND II, PROCEEDINGS, 2003, : 472 - 478
  • [22] iFlowGAN: An Invertible Flow-Based Generative Adversarial Network for Unsupervised Image-to-Image Translation
    Dai, Longquan
    Tang, Jinhui
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (08) : 4151 - 4162
  • [23] In2I: Unsupervised Multi-Image-to-Image Translation Using Generative Adversarial Networks
    Perera, Pramuditha
    Abavisani, Mahdi
    Patel, Vishal M.
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 140 - 146
  • [24] An unsupervised approach for thermal to visible image translation using autoencoder and generative adversarial network
    Patel, Heena
    Upla, Kishor P.
    MACHINE VISION AND APPLICATIONS, 2021, 32 (04)
  • [25] An unsupervised approach for thermal to visible image translation using autoencoder and generative adversarial network
    Heena Patel
    Kishor P. Upla
    Machine Vision and Applications, 2021, 32
  • [26] Unsupervised domain adaptation network for medical image segmentation with generative adversarial networks
    Huang, Xiji
    Chen, Lingna
    PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CYBER SECURITY, ARTIFICIAL INTELLIGENCE AND DIGITAL ECONOMY, CSAIDE 2024, 2024, : 380 - 382
  • [27] Dual Adversarial Attention Mechanism for Unsupervised Domain Adaptive Medical Image Segmentation
    Chen, Xu
    Kuang, Tianshu
    Deng, Hannah
    Fung, Steve H.
    Gateno, Jaime
    Xia, James J.
    Yap, Pew-Thian
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (11) : 3445 - 3453
  • [28] Non-Adversarial Unsupervised Word Translation
    Hoshen, Yedid
    Wolf, Lior
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 469 - 478
  • [29] A multimodal comparison of latent denoising diffusion probabilistic models and generative adversarial networks for medical image synthesis
    Gustav Müller-Franzes
    Jan Moritz Niehues
    Firas Khader
    Soroosh Tayebi Arasteh
    Christoph Haarburger
    Christiane Kuhl
    Tianci Wang
    Tianyu Han
    Teresa Nolte
    Sven Nebelung
    Jakob Nikolas Kather
    Daniel Truhn
    Scientific Reports, 13
  • [30] A multimodal comparison of latent denoising diffusion probabilistic models and generative adversarial networks for medical image synthesis
    Mueller-Franzes, Gustav
    Niehues, Jan Moritz
    Khader, Firas
    Arasteh, Soroosh Tayebi
    Haarburger, Christoph
    Kuhl, Christiane
    Wang, Tianci
    Han, Tianyu
    Nolte, Teresa
    Nebelung, Sven
    Kather, Jakob Nikolas
    Truhn, Daniel
    SCIENTIFIC REPORTS, 2023, 13 (01)