Full-TrSUN: A Full-Resolution Transformer UNet for High Quality PET Image Synthesis

被引:0
|
作者
Tan, Boyuan [1 ]
Xue, Yuxin [1 ]
Li, Lei [1 ,2 ]
Kim, Jinman [1 ]
机构
[1] Univ Sydney, Sch Comp Sci, Sydney, NSW, Australia
[2] Shanghai Jiao Tong Univ, Natl Ctr Translat Med, Inst Translat Med, Shanghai, Peoples R China
关键词
Transformer; Image Synthesis; Low-dose PET;
D O I
10.1007/978-3-031-73284-3_24
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Positron Emission Tomography (PET) is an established functional imaging modality integral to clinical practices. Despite its widespread utility, the attendant radiation exposure from PET scans has raised substantial health concerns. To address these challenges, numerous CNN-based methodologies have been developed to reconstruct standard-dose PET (SPET) images by using low-dose PET (LPET). These reconstructions are generally via image synthesizes using CNNs which by design, predominantly capture localized features, and thus struggle to encapsulate the long-range global feature correlations that are essential for fine-grained image synthesis. Transformers have demonstrated an inherent strength in capturing these extensive dependencies. However, the high computational and memory demands constrain its use to images at reduced resolutions, leading to potential loss of essential textural information for accurate PET synthesis. Our research proposes a new Full-resolution Transformer based model, named as Full-TrSUN, that applies a 3D transformer block at full image resolution designed to discern fine-grained, long-range dependencies. We also integrate a CNN-based encoder and decoder process in a U-Net architecture for PET image synthesis. The Full-TrSUN framework is designed to preserve the vital texture nuances at full resolution, enhancing the functional detail captured in PET synthesis. Our experimental results with public benchmark datasets show that our method outperformed the state-of-the-art methods with high efficiency.
引用
收藏
页码:238 / 247
页数:10
相关论文
共 50 条
  • [1] Full-Resolution Quality Assessment for Pansharpening
    Scarpa, Giuseppe
    Ciotola, Matteo
    REMOTE SENSING, 2022, 14 (08)
  • [2] Progressive Image Inpainting with Full-Resolution Residual Network
    Guo, Zongyu
    Chen, Zhibo
    Yu, Tao
    Chen, Jiale
    Liu, Sen
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 2496 - 2504
  • [3] Biomedical image segmentation based on full-Resolution network
    Qu, Lei
    Wang, Meng
    Guo, Kaixuan
    Wan, Wan
    Liu, Yu
    Tang, Jun
    Wu, Jun
    Duan, Peng
    PATTERN RECOGNITION LETTERS, 2022, 153 : 232 - 238
  • [4] A Blind Full-Resolution Quality Evaluation Method for Pansharpening
    Meng, Xiangchao
    Bao, Kedi
    Shu, Jinfang
    Zhou, Bingzhong
    Shao, Feng
    Sun, Weiwei
    Li, Shutao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] Enhanced Full-Resolution Residual Network for Image Super-Resolution
    Li, Jiaoyue
    Zhao, Lifei
    Shao, Qianqian
    Liu, Weifeng
    Zhang, Kai
    Liu, Bao-Di
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7421 - 7426
  • [6] A Bayesian Procedure for Full-Resolution Quality Assessment of Pansharpened Products
    Vivone, Gemine
    Restaino, Rocco
    Chanussot, Jocelyn
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (08): : 4820 - 4834
  • [7] SAR IMAGE SUPER-RESOLUTION RECONSTRUCTION BASED ON FULL-RESOLUTION DISCRIMINATION
    Xiao, Guangyi
    Zhang, Long
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 691 - 695
  • [8] A Full-Image Full-Resolution End-to-End-Trainable CNN Framework for Image Forgery Detection
    Marra, Francesco
    Gragnaniello, Diego
    Verdoliva, Luisa
    Poggi, Giovanni
    IEEE ACCESS, 2020, 8 : 133488 - 133502
  • [9] Full-resolution, full-field-of-view, and high-quality fast Fourier single-pixel imaging
    LI, Jiaxiang
    Cheng, Kai
    Qi, Shaoting
    Zhang, Zibang
    Zheng, Guoan
    Zhong, Jingang
    OPTICS LETTERS, 2023, 48 (01) : 49 - 52
  • [10] A deep supervised transformer U-shaped full-resolution residual network for the segmentation of breast ultrasound image
    Zhou, Jiale
    Hou, Zuoxun
    Lu, Hongyan
    Wang, Wenhan
    Zhao, Wanchen
    Wang, Zenan
    Zheng, Dezhi
    Wang, Shuai
    Tang, Wenzhong
    Qu, Xiaolei
    MEDICAL PHYSICS, 2023, 50 (12) : 7513 - 7524