Multimodal feature-guided diffusion model for low-count PET image denoising

被引:0
|
作者
Lin, Gengjia [1 ]
Jin, Yuxi [2 ]
Huang, Zhenxing [2 ]
Chen, Zixiang [2 ]
Liu, Haizhou [3 ,4 ]
Zhou, Chao [5 ]
Zhang, Xu [5 ]
Fan, Wei [5 ]
Zhang, Na [2 ]
Liang, Dong [2 ]
Cao, Peng [1 ]
Hu, Zhanli [2 ]
机构
[1] Northeastern Univ, Coll Comp Sci & Engn, Shenyang 110819, Peoples R China
[2] Chinese Acad Sci, Shenzhen Inst Adv Technol, Lauterbur Res Ctr Biomed Imaging, Shenzhen 518055, Peoples R China
[3] Chinese Acad Med Sci & Peking Union Med Coll, Natl Canc Ctr, Natl Clin Res Ctr Canc, Canc Hosp,Dept Radiol, Shenzhen, Peoples R China
[4] Chinese Acad Med Sci & Peking Union Med Coll, Shenzhen Hosp, Shenzhen, Peoples R China
[5] Sun Yat Sen Univ, Canc Ctr, Dept Nucl Med, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
multimodal feature-guided diffusion; physical degradation simulation; Low-count PET denoising; POSITRON-EMISSION-TOMOGRAPHY;
D O I
10.1002/mp.17764
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
BackgroundTo minimize radiation exposure while obtaining high-quality Positron Emission Tomography (PET) images, various methods have been developed to derive standard-count PET (SPET) images from low-count PET (LPET) images. Although deep learning methods have enhanced LPET images, they rarely utilize the rich complementary information from MR images. Even when MR images are used, these methods typically employ early, intermediate, or late fusion strategies to merge features from different CNN streams, failing to fully exploit the complementary properties of multimodal fusion.PurposeIn this study, we introduce a novel multimodal feature-guided diffusion model, termed MFG-Diff, designed for the denoising of LPET images with the full utilization of MRI.MethodsMFG-Diff replaces random Gaussian noise with LPET images and introduces a novel degradation operator to simulate the physical degradation processes of PET imaging. Besides, it uses a novel cross-modal guided restoration network to fully exploit the modality-specific features provided by the LPET and MR images and utilizes a multimodal feature fusion module employing cross-attention mechanisms and positional encoding at multiple feature levels for better feature fusion.ResultsUnder four counts (2.5%, 5.0%, 10%, and 25%), the images generated by our proposed network showed superior performance compared to those produced by other networks in both qualitative and quantitative evaluations, as well as in statistical analysis. In particular, the peak-signal-to-noise ratio of the generated PET images improved by more than 20% under a 2.5% count, the structural similarity index improved by more than 16%, and the root mean square error reduced by nearly 50%. On the other hand, our generated PET images had significant correlation (Pearson correlation coefficient, 0.9924), consistency, and excellent quantitative evaluation results with the SPET images.ConclusionsThe proposed method outperformed existing state-of-the-art LPET denoising models and can be used to generate highly correlated and consistent SPET images obtained from LPET images.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] FedDD: A Federated Fine-Tuning Diffusion Model for Low-count PET Denoising
    Zhou, Yinchi
    Xie, Huidong
    Zhou, Bo
    Wang, Hanzhong
    Li, Biao
    Rominger, Axel
    Shi, Kuangyu
    Liu, Chi
    JOURNAL OF NUCLEAR MEDICINE, 2024, 65
  • [2] Multimodal image registration for low-count SPECT images
    Backfrieder, W.
    Hatzl-Griesenhofer, M.
    Huber, H.
    Maschek, W.
    EUROPEAN JOURNAL OF NUCLEAR MEDICINE AND MOLECULAR IMAGING, 2005, 32 : S76 - S76
  • [3] ON THE INVERSION OF THE ANSCOMBE TRANSFORMATION IN LOW-COUNT POISSON IMAGE DENOISING
    Makitalo, Markku
    Foi, Alessandro
    LNLA: 2009 INTERNATIONAL WORKSHOP ON LOCAL AND NON-LOCAL APPROXIMATION IN IMAGE PROCESSING, 2009, : 26 - 32
  • [4] A personalized deep learning denoising strategy for low-count PET images
    Liu, Qiong
    Liu, Hui
    Mirian, Niloufar
    Ren, Sijin
    Viswanath, Varsha
    Karp, Joel
    Surti, Suleman
    Liu, Chi
    PHYSICS IN MEDICINE AND BIOLOGY, 2022, 67 (14):
  • [5] Feature-guided image stippling
    Kim, Dongyeon
    Son, Minjung
    Lee, Yunjin
    Kang, Henry
    Lee, Seungyong
    COMPUTER GRAPHICS FORUM, 2008, 27 (04) : 1209 - 1216
  • [6] Convolutional micro-networks for MR-guided low-count PET image processing
    da Costa-Luis, Casper O.
    Reader, Andrew J.
    2018 IEEE NUCLEAR SCIENCE SYMPOSIUM AND MEDICAL IMAGING CONFERENCE PROCEEDINGS (NSS/MIC), 2018,
  • [7] Optimal Inversion of the Anscombe Transformation in Low-Count Poisson Image Denoising
    Makitalo, Markku
    Foi, Alessandro
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (01) : 99 - 109
  • [8] Unified Noise-Aware Network for Low-Count PET Denoising With Varying Count Levels
    Xie, Huidong
    Liu, Qiong
    Zhou, Bo
    Chen, Xiongchao
    Guo, Xueqi
    Wang, Hanzhong
    Li, Biao
    Rominger, Axel
    Shi, Kuangyu
    Liu, Chi
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2024, 8 (04) : 366 - 378
  • [9] Low-count PET image restoration using sparse representation
    Li, Tao
    Jiang, Changhui
    Gao, Juan
    Yang, Yongfeng
    Liang, Dong
    Liu, Xin
    Zheng, Hairong
    Hu, Zhanli
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2018, 888 : 222 - 227
  • [10] Feature-guided Gaussian mixture model for image matching
    Ma, Jiayi
    Jiang, Xingyu
    Jiang, Junjun
    Gao, Yuan
    PATTERN RECOGNITION, 2019, 92 : 231 - 245