DeepPET: A deep encoder-decoder network for directly solving the PET image reconstruction inverse problem

被引:196
|
作者
Haggstrom, Ida [1 ]
Schmidtlein, C. Ross [1 ]
Campanella, Gabriele [1 ,3 ]
Fuchs, Thomas J. [1 ,2 ,3 ]
机构
[1] Mem Sloan Kettering Canc Ctr, Dept Med Phys, New York, NY 10065 USA
[2] Mem Sloan Kettering Canc Ctr, Dept Pathol, New York, NY 10065 USA
[3] Weill Cornell Med, Dept Physiol & Biophys, New York, NY 10065 USA
关键词
CONVOLUTIONAL NEURAL-NETWORK; CT RECONSTRUCTION; TOMOGRAPHY; PROJECTION;
D O I
10.1016/j.media.2019.03.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The purpose of this research was to implement a deep learning network to overcome two of the major bottlenecks in improved image reconstruction for clinical positron emission tomography (PET). These are the lack of an automated means for the optimization of advanced image reconstruction algorithms, and the computational expense associated with these state-of-the art methods. We thus present a novel end-to-end PET image reconstruction technique, called DeepPET, based on a deep convolutional encoder-decoder network, which takes PET sinogram data as input and directly and quickly outputs high quality, quantitative PET images. Using simulated data derived from a whole-body digital phantom, we randomly sampled the configurable parameters to generate realistic images, which were each augmented to a total of more than 291,000 reference images. Realistic PET acquisitions of these images were simulated, resulting in noisy sinogram data, used for training, validation, and testing the DeepPET network. We demonstrated that DeepPET generates higher quality images compared to conventional techniques, in terms of relative root mean squared error (11%/53% lower than ordered subset expectation maximization (OSEM)/filtered back-projection (FBP), structural similarity index (1%/11% higher than OSEM/FBP), and peak signal-to-noise ratio (1.1/3.8 dB higher than OSEM/FBP). In addition, we show that DeepPET reconstructs images 108 and 3 times faster than OSEM and FBP, respectively. Finally, DeepPET was successfully applied to real clinical data. This study shows that an end-to-end encoder-decoder network can produce high quality PET images at a fraction of the time compared to conventional methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:253 / 262
页数:10
相关论文
共 50 条
  • [1] Deep Hierarchical Encoder-Decoder Network for Image Captioning
    Xiao, Xinyu
    Wang, Lingfeng
    Ding, Kun
    Xiang, Shiming
    Pan, Chunhong
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (11) : 2942 - 2956
  • [2] Whole Image Synthesis Using a Deep Encoder-Decoder Network
    Sevetlidis, Vasileios
    Giuffrida, Mario Valerio
    Tsaftaris, Sotirios A.
    [J]. SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2016, 2016, 9968 : 127 - 137
  • [3] An encoder-decoder network for direct image reconstruction on sinograms of a long axial field of view PET
    Ruiyao Ma
    Jiaxi Hu
    Hasan Sari
    Song Xue
    Clemens Mingels
    Marco Viscione
    Venkata Sai Sundar Kandarpa
    Wei Bo Li
    Dimitris Visvikis
    Rui Qiu
    Axel Rominger
    Junli Li
    Kuangyu Shi
    [J]. European Journal of Nuclear Medicine and Molecular Imaging, 2022, 49 : 4464 - 4477
  • [4] An encoder-decoder network for direct image reconstruction on sinograms of a long axial field of view PET
    Ma, Ruiyao
    Hu, Jiaxi
    Sari, Hasan
    Xue, Song
    Mingels, Clemens
    Viscione, Marco
    Kandarpa, Venkata Sai Sundar
    Li, Wei Bo
    Visvikis, Dimitris
    Qiu, Rui
    Rominger, Axel
    Li, Junli
    Shi, Kuangyu
    [J]. EUROPEAN JOURNAL OF NUCLEAR MEDICINE AND MOLECULAR IMAGING, 2022, 49 (13) : 4464 - 4477
  • [5] Deep residual inception encoder-decoder network for amyloid PET harmonization
    Shah, Jay
    Gao, Fei
    Li, Baoxin
    Ghisays, Valentina
    Luo, Ji
    Chen, Yinghua
    Lee, Wendy
    Zhou, Yuxiang
    Benzinger, Tammie L. S.
    Reiman, Eric M.
    Chen, Kewei
    Su, Yi
    Wu, Teresa
    [J]. ALZHEIMERS & DEMENTIA, 2022, 18 (12) : 2448 - 2457
  • [6] RedCap: residual encoder-decoder capsule network for holographic image reconstruction
    Zeng, Tianjiao
    So, Hayden K-H
    Lam, Edmund Y.
    [J]. OPTICS EXPRESS, 2020, 28 (04) : 4876 - 4887
  • [7] Image Denoising Using a Deep Encoder-Decoder Network with Skip Connections
    Couturier, Raphael
    Perrot, Gilles
    Salomon, Michel
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2018), PT VI, 2018, 11306 : 554 - 565
  • [8] Iterative Deep Convolutional Encoder-Decoder Network for Medical Image Segmentation
    Kim, Jung Uk
    Kim, Hak Gu
    Ro, Yong Man
    [J]. 2017 39TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2017, : 685 - 688
  • [9] Solving Electromagnetic Inverse Scattering Problems in Inhomogeneous Media by Deep Convolutional Encoder-Decoder Structure
    Zhang, Huan Huan
    Yao, He Ming
    Jiang, Lijun
    Ng, Michael
    [J]. IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2023, 71 (03) : 2867 - 2872
  • [10] Single image deraining via deep residual attention and encoder-decoder network
    Wei, Mingrun
    Wang, Hongjuan
    Cheng, Ru
    Yu, Yue
    Wang, Lukun
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 43 (03) : 3453 - 3467