AN IMPROVED DEEP LEARNING FRAMEWORK FOR MR-TO-CT IMAGE SYNTHESIS WITH A NEW HYBRID OBJECTIVE FUNCTION

被引:7
|
作者
Ang, Sui Paul [1 ]
Phung, Son Lam [1 ]
Field, Matthew [2 ,3 ]
Schira, Mark Matthias [1 ]
机构
[1] Univ Wollongong, Wollongong, NSW, Australia
[2] Univ New South Wales, Sydney, NSW, Australia
[3] Ingham Inst Appl Med Res, Liverpool, Australia
来源
2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022) | 2022年
关键词
MR-to-CT image synthesis; deep learning; GAN; structural consistency; hybrid objective function;
D O I
10.1109/ISBI52829.2022.9761546
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
There is an emerging interest in radiotherapy treatment planning that uses only magnetic resonance (MR) imaging. Current clinical workflows rely on computed tomography (CT) images for dose calculation and patient positioning, therefore synthetic CT images need to be derived from MR images. Recent efforts for MR-to-CT image synthesis have focused on unsupervised training for ease of data preparation. However, accuracy is more important than convenience. In this paper, we propose a deep learning framework for MR-to-CT image synthesis that is trained in a supervised manner. The proposed framework utilizes a new hybrid objective function to enforce visual realism, accurate electron density information, and structural consistency between the MR and CT image domains. Our experiments show that the proposed method (MAE of 68.22, PSNR of 22.28, and FID of 0.73) outperforms the existing unsupervised and supervised techniques in both quantitative and qualitative comparisons.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Frequency-Supervised MR-to-CT Image Synthesis
    Shi, Zenglin
    Mettes, Pascal
    Zheng, Guoyan
    Snoek, Cees
    DEEP GENERATIVE MODELS, AND DATA AUGMENTATION, LABELLING, AND IMPERFECTIONS, 2021, 13003 : 3 - 13
  • [2] SSGAN: Unpaired MR-To-CT Image Synthesis with Spatial Sequence GAN
    Kong, L.
    Jiang, W.
    Huang, D.
    Zhou, Q.
    Chen, Z.
    Zhang, W.
    Sheng, H.
    Yang, C.
    Qu, B.
    MEDICAL PHYSICS, 2021, 48 (06)
  • [3] Deep learning-based MR-to-CT synthesis: The influence of varying gradient echo-based MR images as input channels
    Florkow, Mateusz C.
    Zijlstra, Frank
    Willemsen, Koen
    Maspero, Matteo
    van den Berg, Cornelis A. T.
    Kerkmeijer, Linda G. W.
    Castelein, Rene M.
    Weinans, Harrie
    Viergever, Max A.
    van Stralen, Marijn
    Seevinck, Peter R.
    MAGNETIC RESONANCE IN MEDICINE, 2020, 83 (04) : 1429 - 1441
  • [4] Cardiac MR image reconstruction using cascaded hybrid dual domain deep learning framework
    Arshad, Madiha
    Najeeb, Faisal
    Khawaja, Rameesha
    Ammar, Amna
    Amjad, Kashif
    Omer, Hammad
    PLOS ONE, 2025, 20 (01):
  • [5] DLFA-NET: A HYBRID NETWORK FOR MR-TO-CT SYNTHESIS VIA GLOBAL AND LOCAL FEATURE AGGREGATION
    Chen, Zeli
    Li, Chuanpu
    Zheng, Kaiyi
    Zhang, Yiwen
    Wu, Yuankui
    Feng, Qianjin
    Zhong, Liming
    Yang, Wei
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [6] A Deep Learning Framework for Cardiac MR Under-Sampled Image Reconstruction with a Hybrid Spatial and k-Space Loss Function
    Al-Haidri, Walid
    Matveev, Igor
    Al-antari, Mugahed A.
    Zubkov, Mikhail
    DIAGNOSTICS, 2023, 13 (06)
  • [7] Balancing data consistency and diversity: Preprocessing and online data augmentation for multi-center deep learning-based MR-to-CT synthesis
    Han, Songyue
    Hemon, Cedric
    Texier, Blanche
    Kortli, Yassin
    de Crevoisier, Renaud
    Dowling, Jason
    Greer, Peter
    Bessieres, Igor
    Barateau, Anais
    Lafond, Caroline
    Nunes, Jean-Claude
    PATTERN RECOGNITION LETTERS, 2025, 189 : 56 - 63
  • [8] CycleSGAN: A cycle-consistent and semantics-preserving generative adversarial network for unpaired MR-to-CT image synthesis
    Wang, Runze
    Heimann, Alexander F.
    Tannast, Moritz
    Zheng, Guoyan
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2024, 117
  • [9] QACL: Quartet attention aware closed-loop learning for abdominal MR-to-CT synthesis via simultaneous registration
    Zhong, Liming
    Chen, Zeli
    Shu, Hai
    Zheng, Yikai
    Zhang, Yiwen
    Wu, Yuankui
    Feng, Qianjin
    Li, Yin
    Yang, Wei
    MEDICAL IMAGE ANALYSIS, 2023, 83
  • [10] Improved MR to CT Synthesis for PET/MR Attenuation Correction Using Imitation Learning
    Klaser, Kerstin
    Varsavsky, Thomas
    Markiewicz, Pawel
    Vercauteren, Tom
    Atkinson, David
    Thielemans, Kris
    Hutton, Brian
    Cardoso, M. Jorge
    Ourselin, Sebastien
    SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2019, 2019, 11827 : 13 - 21