Full-TrSUN: A Full-Resolution Transformer UNet for High Quality PET Image Synthesis

被引:0
|
作者
Tan, Boyuan [1 ]
Xue, Yuxin [1 ]
Li, Lei [1 ,2 ]
Kim, Jinman [1 ]
机构
[1] Univ Sydney, Sch Comp Sci, Sydney, NSW, Australia
[2] Shanghai Jiao Tong Univ, Natl Ctr Translat Med, Inst Translat Med, Shanghai, Peoples R China
来源
MACHINE LEARNING IN MEDICAL IMAGING, PT I, MLMI 2024 | 2025年 / 15241卷
关键词
Transformer; Image Synthesis; Low-dose PET;
D O I
10.1007/978-3-031-73284-3_24
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Positron Emission Tomography (PET) is an established functional imaging modality integral to clinical practices. Despite its widespread utility, the attendant radiation exposure from PET scans has raised substantial health concerns. To address these challenges, numerous CNN-based methodologies have been developed to reconstruct standard-dose PET (SPET) images by using low-dose PET (LPET). These reconstructions are generally via image synthesizes using CNNs which by design, predominantly capture localized features, and thus struggle to encapsulate the long-range global feature correlations that are essential for fine-grained image synthesis. Transformers have demonstrated an inherent strength in capturing these extensive dependencies. However, the high computational and memory demands constrain its use to images at reduced resolutions, leading to potential loss of essential textural information for accurate PET synthesis. Our research proposes a new Full-resolution Transformer based model, named as Full-TrSUN, that applies a 3D transformer block at full image resolution designed to discern fine-grained, long-range dependencies. We also integrate a CNN-based encoder and decoder process in a U-Net architecture for PET image synthesis. The Full-TrSUN framework is designed to preserve the vital texture nuances at full resolution, enhancing the functional detail captured in PET synthesis. Our experimental results with public benchmark datasets show that our method outperformed the state-of-the-art methods with high efficiency.
引用
收藏
页码:238 / 247
页数:10
相关论文
共 50 条
  • [41] Digital Image Correlation for Full-Field High Resolution Assessment of Leaf Growth
    Campo, Adriaan
    Klosiewicz, Przemyslaw
    Dirckx, Joris
    JOURNAL OF PLANT GROWTH REGULATION, 2015, 34 (02) : 433 - 439
  • [42] Style-Guided Inference of Transformer for High-resolution Image Synthesis
    Yim, Jonghwa
    Kim, Minjae
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 1745 - 1755
  • [43] Multiview phase shifting: a full-resolution and high-speed 3D measurement framework for arbitrary shape dynamic objects
    Li, Zhongwei
    Zhong, Kai
    Li, Y. F.
    Zhou, Xiaohui
    Shi, Yusheng
    OPTICS LETTERS, 2013, 38 (09) : 1389 - 1391
  • [44] Depth-Assisted Full Resolution Network for Single Image-Based View Synthesis
    Cun, Xiaodong
    Xu, Feng
    Pun, Chi-Man
    Gao, Hao
    IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2019, 39 (02) : 52 - 64
  • [45] 8K 240-Hz full-resolution high-speed camera and slow-motion replay server systems
    Funatsu R.
    Kajiyama T.
    Yasue T.
    Kikuchi K.
    Tomioka K.
    Nakamura T.
    Okamoto H.
    Miyashita E.
    Shimamoto H.
    SMPTE Motion Imaging Journal, 2019, 128 (03): : 44 - 49
  • [46] Cognitive effect on image quality in full ultra-high definition(8 K)
    Park, DaEun
    Kim, YoonJung
    Park, YungKyung
    JOURNAL OF INFORMATION DISPLAY, 2020, 21 (02) : 103 - 111
  • [47] High image quality and stability of electrophotographic system using full color chemical toner
    Ozeki, Takamasa
    Azami, Akira
    Sato, Masumi
    Sasaki, Fumihiro
    Kondoh, Tomio
    Kotsugai, Akihiro
    ICIS '06: INTERNATIONAL CONGRESS OF IMAGING SCIENCE, FINAL PROGRAM AND PROCEEDINGS: LINKING THE EXPLOSION OF IMAGING APPLICATIONS WITH THE SCIENCE AND TECHNOLOGY OF IMAGING, 2006, : 79 - +
  • [48] High resolution full-field optical coherence tomography using high dynamic range image processing
    Leong-Hoi, A.
    Claveau, R.
    Montgomery, P. C.
    Serio, B.
    Uhring, W.
    Anstotz, F.
    Flury, M.
    OPTICAL MICRO- AND NANOMETROLOGY VI, 2016, 9890
  • [49] SSTF-Unet: Spatial-Spectral Transformer-Based U-Net for High-Resolution Hyperspectral Image Acquisition
    Liu, Haibo
    Feng, Chenguo
    Dian, Renwei
    Li, Shutao
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (12) : 18222 - 18236
  • [50] Reconstruction method to combine high temporal resolution with appropriate image quality in dynamic PET angiography
    Christian Kühnel
    Philipp Seifert
    Robert Drescher
    Martin Freesmeyer
    European Journal of Nuclear Medicine and Molecular Imaging, 2020, 47 : 2954 - 2955