Dual-Domain Neural Network for Sparse-View Photoacoustic Image Reconstruction

被引:0
|
作者
Shen Kang [1 ,2 ]
Liu Songde [1 ,2 ]
Shi Junhui [3 ]
Tian Chao [1 ,2 ]
机构
[1] Univ Sci & Technol China, Sch Engn Sci, Hefei 230026, Anhui, Peoples R China
[2] Key Lab Precis Sci Instrumentat Anhui Higher Educ, Hefei 230026, Anhui, Peoples R China
[3] Zhejiang Lab, Hangzhou 311121, Zhejiang, Peoples R China
来源
关键词
biotechnology; photoacoustic tomography; image reconstruction; neural network; sparse views; TOMOGRAPHY;
D O I
10.3788/CJL202249.0507017
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Objective Photoacoustic computed tomography (PACT) is a fast-evolving noninvasive biomedical imaging technique that shows great potential for basic life sciences and clinical practice. To generate high-quality photoacoustic (PA) images, imaging systems need to employ a dense array of ultrasonic detectors. However, due to economic constraints, fabrication complexity, and real-time data processing requirements, ultrasonic detectors are usually arranged sparsely. Such sparsity cannot satisfy the essential conditions of stable image reconstruction and results in significant artifacts in reconstructed images. To address this issue, we develop an innovative PACT image reconstruction algorithm based on a dual-domain neural network. Methods The proposed network ( Fig. 1), which we refer to as DI-Net, consists of a data-domain network (D-Net) , a back projection layer and an image-domain network (I-Net) . Both D-Net and I-Net are designed based on U-Net, a convolutional neural network that is developed for biomedical image segmentation. Based on U-Net, an instance normalization, a skip connection, and a leaky rectified linear unit are used to enhance the performance of the DI-Net. The back projection layer is a sparse matrix with fixed parameters that allows for gradient propagation from I-Net to D-Net. First, the D-Net maps sparse-view PA data into dense-view PA data in the data domain. Then, the back projection layer transforms the dense-view PA data into a PA image. Finally, the reconstructed image is further enhanced in the image domain by the I-Net. The performance of DI-Net is evaluated through numerical simulations and in vivo experimental data that contains 128-views and 256-views undersampled data. In addition, to further demonstrate the effectiveness of the network, two popular algorithms, i.e. , filtered back projection (FBP) and Post-Unet, are compared with the proposed DI-Net. Results and Discussions We first numerically test the performance of DI-Net using a synthetic vascular phantom dataset. The reconstruction results of 128 views show that the image reconstructed by FBP is significantly contaminated by the streak-type artifacts due to sparse-view sampling. Although both the Post-Unet and the DI-Net can reconstruct artifact-free images, some details are lost in the image reconstructed by the Post-Unet while the DINet completely recovers these details. Quantitative evaluation results demonstrate that the DI-Net provides image quality with the lowest mean square error (MSE), and the highest peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) (Fig. 3, Fig. 5, and Table 1) . When the number of views is 256, streak-type artifacts caused by sparse-view sampling are reduced but are still clearly visible in the images reconstructed by FBP, while Post-Unet and DI-Net effectively suppress these artifacts and reconstruct high-quality images. Due to the increasing number of views, Post-Unet completely reconstructs the details; however the quantitative accuracy of the reconstructed image is lower than that of the DI-Net ( Fig. 4, Fig. 5, and Table 1). We further experimentally evaluated the performance of the DI-Net using an in vivo mouse slice dataset. Similar to the numerical simulations, experimental results also demonstrate the effectiveness of the proposed algorithm. Specifically, in the case of 128 views, the image reconstructed by FBP contains significant artifacts that occlude real PA structures, resulting in the loss of image details. Compared with FBP, Post-Unet demonstrate better performance; however, not all PA structures are recovered. DI-Net can achieve accurate reconstruction and the reconstructed image is consistent with the reference image ( Fig. 6, Fig. 8, and Table 2 ). In the case of 256 views, although the three algorithms reconstruct the PA structures, the image generated by DI-Net more closely resembles the reference image and has the lowest MSE and the highest PSNR and SSIM values (Fig. 7, Fig. 8, and Table 2). Conclusions In this paper, we describe an innovative PACT image reconstruction algorithm based on DI-Net, a dual-domain neural network. Both numerical simulations and in vivo experiments are used to evaluate the performance of the proposed DI-Net. The imaging results reveal that DI-Net can effectively suppress streak-type artifacts caused by undersampling and the reconstructed images are comparable with the reference image. The imaging results also demonstrate that the proposed DI-Net provides better image quality compared with the widelyused FBP algorithm and the popular Post-Unet algorithm.
引用
收藏
页数:13
相关论文
共 48 条
  • [1] Deep learning for photoacoustic tomography from sparse data
    Antholzer, Stephan
    Haltmeier, Markus
    Schwab, Johannes
    [J]. INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2019, 27 (07) : 987 - 1005
  • [2] Bell A. G., 1880, AM J SCI, V20, P305, DOI DOI 10.2475/AJS.S3-20.118.305
  • [3] A Partially-Learned Algorithm for Joint Photo-acoustic Reconstruction and Segmentation
    Boink, Yoeri E.
    Manohar, Srirang
    Brune, Christoph
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (01) : 129 - 139
  • [4] Streak artifact suppression in photoacoustic computed tomography using adaptive back projection
    Cai, Chuangjian
    Wang, Xuanhao
    Si, Ke
    Qian, Jun
    Luo, Jianwen
    Ma, Cheng
    [J]. BIOMEDICAL OPTICS EXPRESS, 2019, 10 (09) : 4803 - 4814
  • [5] Deep learning of image- and time-domain data enhances the visibility of structures in optoacoustic tomography
    Davoudi, Neda
    Lafci, Berkan
    Oezbek, Ali
    Dean-Ben, Xose Luis
    Razansky, Daniel
    [J]. OPTICS LETTERS, 2021, 46 (13) : 3029 - 3032
  • [6] Deep learning optoacoustic tomography with sparse data
    Davoudi, Neda
    Dean-Ben, Xose Luis
    Razansky, Daniel
    [J]. NATURE MACHINE INTELLIGENCE, 2019, 1 (10) : 453 - 460
  • [7] Deng KX, 2021, CHIN J LASERS, V48, DOI 10.3788/CJL202148.1507001
  • [8] Feng T., 2020, J BME FRONTIERS, V2020, P1
  • [9] Determining a function from its mean values over a family of spheres
    Finch, D
    Patch, SK
    Rakesh
    [J]. SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 2004, 35 (05) : 1213 - 1240
  • [10] MR image reconstruction using deep learning: evaluation of network structure and loss functions
    Ghodrati, Vahid
    Shao, Jiaxin
    Bydder, Mark
    Zhou, Ziwu
    Yin, Wotao
    Nguyen, Kim-Lien
    Yan, Yingli
    Hu, Peng
    [J]. QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2019, 9 (09) : 1516 - 1527