Unsupervised Medical Image Translation With Adversarial Diffusion Models

被引:128
|
作者
Ozbey, Muzaffer [1 ,2 ]
Dalmaz, Onat [1 ,2 ]
Dar, Salman U. H. [1 ,2 ]
Bedel, Hasan A. [1 ,2 ]
Ozturk, Saban [1 ,2 ,3 ]
Gungor, Alper [1 ,2 ,4 ]
Cukur, Tolga [1 ,2 ]
机构
[1] Bilkent Univ, Dept Elect & Elect Engn, TR-06800 Ankara, Turkiye
[2] Bilkent Univ, Natl Magnet Resonance Res Ctr UMRAM, TR-06800 Ankara, Turkiye
[3] Amasya Univ, Dept Elect Elect Engn, TR-05100 Amasya, Turkiye
[4] SELSAN Res Ctr, TR-06200 Ankara, Turkiye
关键词
Biological system modeling; Computational modeling; Training; Generative adversarial networks; Image synthesis; Task analysis; Generators; Medical image translation; synthesis; unsupervised; unpaired; adversarial; diffusion; generative; ESTIMATING CT IMAGE; RANDOM FOREST; MODALITY; MR;
D O I
10.1109/TMI.2023.3290149
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Imputation of missing images via source-to-target modality translation can improve diversity in medical imaging protocols. A pervasive approach for synthesizing target images involves one-shot mapping through generative adversarial networks (GAN). Yet, GAN models that implicitly characterize the image distribution can suffer from limited sample fidelity. Here, we propose a novel method based on adversarial diffusion modeling, SynDiff, for improved performance in medical image translation. To capture a direct correlate of the image distribution, SynDiff leverages a conditional diffusion process that progressively maps noise and source images onto the target image. For fast and accurate image sampling during inference, large diffusion steps are taken with adversarial projections in the reverse diffusion direction. To enable training on unpaired datasets, a cycle-consistent architecture is devised with coupled diffusive and non-diffusive modules that bilaterally translate between two modalities. Extensive assessments are reported on the utility of SynDiff against competing GAN and diffusion models in multi-contrast MRI and MRI-CT translation. Our demonstrations indicate that SynDiff offers quantitatively and qualitatively superior performance against competing baselines.
引用
收藏
页码:3524 / 3539
页数:16
相关论文
共 50 条
  • [31] Zero-Shot Medical Image Translation via Frequency-Guided Diffusion Models
    Li, Yunxiang
    Shao, Hua-Chieh
    Liang, Xiao
    Chen, Liyuan
    Li, Ruiqi
    Jiang, Steve
    Wang, Jing
    Zhang, You
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (03) : 980 - 993
  • [32] Target-Guided Diffusion Models for Unpaired Cross-Modality Medical Image Translation
    Luo, Yimin
    Yang, Qinyu
    Liu, Ziyi
    Shi, Zenglin
    Huang, Weimin
    Zheng, Guoyan
    Cheng, Jun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (07) : 4062 - 4071
  • [33] Cross-conditioned Diffusion Model for Medical Image to Image Translation
    Xing, Zhaohu
    Yang, Sicheng
    Chen, Sixiang
    Ye, Tian
    Yang, Yijun
    Qin, Jing
    Zhu, Lei
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VII, 2024, 15007 : 201 - 211
  • [34] Adversarial Robustification via Text-to-Image Diffusion Models
    Choi, Daewon
    Jeong, Jongheon
    Jang, Huiwon
    Shin, Jinwoo
    COMPUTER VISION - ECCV 2024, PT LXXXI, 2025, 15139 : 158 - 177
  • [35] CSAGAN: Channel and Spatial Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation
    Yang, Rui
    Peng, Chao
    Wang, Chenchao
    Wang, Mengdan
    Chen, Yao
    Zheng, Peng
    Xiong, Neal N.
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 3258 - 3265
  • [36] Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks
    Gang Wang
    Haibo Shi
    Yufei Chen
    Bin Wu
    Applied Intelligence, 2023, 53 : 17243 - 17259
  • [37] Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks
    Wang, Gang
    Shi, Haibo
    Chen, Yufei
    Wu, Bin
    APPLIED INTELLIGENCE, 2023, 53 (14) : 17243 - 17259
  • [38] Unsupervised Generative Adversarial Networks with Cross-model Weight Transfer Mechanism for Image-to-image Translation
    Lai, Xuguang
    Bai, Xiuxiu
    Hao, Yongqiang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1814 - 1822
  • [39] Crossing-Domain Generative Adversarial Networks for Unsupervised Multi-Domain Image-to-Image Translation
    Yang, Xuewen
    Xie, Dongliang
    Wang, Xin
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 374 - 382
  • [40] ITCD: Image to Text Translation for Classification by Diffusion Models
    Ma, Yanxiang
    Xu, Yi
    PROCEEDINGS OF THE 1ST WORKSHOP ON EFFICIENCY, SECURITY, AND GENERALIZATION OF MULTIMEDIA FOUNDATION MODELS, ESGMFM 2024, 2024, : 7 - 11