Deep learning optoacoustic tomography with sparse data

被引:165
|
作者
Davoudi, Neda [1 ,2 ,3 ]
Dean-Ben, Xose Luis [1 ,2 ,4 ,5 ]
Razansky, Daniel [1 ,2 ,4 ,5 ]
机构
[1] Swiss Fed Inst Technol, Inst Biomed Engn, Zurich, Switzerland
[2] Swiss Fed Inst Technol, Dept Informat Technol & Elect Engn, Zurich, Switzerland
[3] Tech Univ Munich, Dept Informat, Munich, Germany
[4] Univ Zurich, Fac Med, Zurich, Switzerland
[5] Univ Zurich, Inst Pharmacol & Toxicol, Zurich, Switzerland
基金
欧洲研究理事会;
关键词
PHOTOACOUSTIC TOMOGRAPHY; RECONSTRUCTION; MODEL; PERFORMANCE; INVERSION; CANCER; BRAIN; MSOT;
D O I
10.1038/s42256-019-0095-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rapidly evolving field of optoacoustic (photoacoustic) imaging and tomography is driven by a constant need for better imaging performance in terms of resolution, speed, sensitivity, depth and contrast. In practice, data acquisition strategies commonly involve sub-optimal sampling of the tomographic data, resulting in inevitable performance trade-offs and diminished image quality. We propose a new framework for efficient recovery of image quality from sparse optoacoustic data based on a deep convolutional neural network and demonstrate its performance with whole body mouse imaging in vivo. To generate accurate high-resolution reference images for optimal training, a full-view tomographic scanner capable of attaining superior cross-sectional image quality from living mice was devised. When provided with images reconstructed from substantially undersampled data or limited-view scans, the trained network was capable of enhancing the visibility of arbitrarily oriented structures and restoring the expected image quality. Notably, the network also eliminated some reconstruction artefacts present in reference images rendered from densely sampled data. No comparable gains were achieved when the training was performed with synthetic or phantom data, underlining the importance of training with high-quality in vivo images acquired by full-view scanners. The new method can benefit numerous optoacoustic imaging applications by mitigating common image artefacts, enhancing anatomical contrast and image quantification capacities, accelerating data acquisition and image reconstruction approaches, while also facilitating the development of practical and affordable imaging systems. The suggested approach operates solely on image-domain data and thus can be seamlessly applied to artefactual images reconstructed with other modalities. Optoacoustic imaging can achieve high spatial and temporal resolution but image quality is often compromised by suboptimal data acquisition. A new method employing deep learning to recover high-quality images from sparse or limited-view optoacoustic scans has been developed and demonstrated for whole-body mouse imaging in vivo.
引用
收藏
页码:453 / 460
页数:8
相关论文
共 50 条
  • [1] Deep learning optoacoustic tomography with sparse data
    Neda Davoudi
    Xosé Luís Deán-Ben
    Daniel Razansky
    [J]. Nature Machine Intelligence, 2019, 1 : 453 - 460
  • [2] A sparse deep learning approach for automatic segmentation of human vasculature in multispectral optoacoustic tomography
    Chlis, Nikolaos-Kosmas
    Karlas, Angelos
    Fasoula, Nikolina-Alexia
    Kallmayer, Michael
    Eckstein, Hans-Henning
    Theis, Fabian J.
    Ntziachristos, Vasilis
    Marr, Carsten
    [J]. PHOTOACOUSTICS, 2020, 20
  • [3] Deep learning for photoacoustic tomography from sparse data
    Antholzer, Stephan
    Haltmeier, Markus
    Schwab, Johannes
    [J]. INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2019, 27 (07) : 987 - 1005
  • [4] Deep learning-based quantitative optoacoustic tomography of deep tissues in the absence of labeled experimental data
    Li, Jiao
    Wang, Cong
    Chen, Tingting
    Lu, Tong
    Li, Shuai
    Sun, Biao
    Gao, Feng
    Ntziachristos, Vasilis
    [J]. OPTICA, 2022, 9 (01): : 32 - 41
  • [5] Deep learning-assisted wavefront correction with sparse data for holographic tomography
    Lin, Li-Chien
    Huang, Chung-Hsuan
    Chen, Yi-Fan
    Chu, Daping
    Cheng, Chau-Jern
    [J]. OPTICS AND LASERS IN ENGINEERING, 2022, 154
  • [6] Deep learning of image- and time-domain data enhances the visibility of structures in optoacoustic tomography
    Davoudi, Neda
    Lafci, Berkan
    Oezbek, Ali
    Dean-Ben, Xose Luis
    Razansky, Daniel
    [J]. OPTICS LETTERS, 2021, 46 (13) : 3029 - 3032
  • [7] Deep Learning Ultrasound Computed Tomography with Sparse Transmissions
    Liu, Zhaohui
    Wang, Jiameng
    Ding, Mingyue
    Yuchi, Ming
    [J]. INTERNATIONAL ULTRASONICS SYMPOSIUM (IEEE IUS 2021), 2021,
  • [8] Sparse signal representation at the service of quantitative optoacoustic tomography
    Rosenthal, Amir
    Razansky, Daniel
    Ntziachristos, Vasilis
    [J]. PHOTONS PLUS ULTRASOUND: IMAGING AND SENSING 2010, 2010, 7564
  • [9] Deep Learning on Big, Sparse, Behavioral Data
    De Cnudde, Sofie
    Ramon, Yanou
    Martens, David
    Provost, Foster
    [J]. BIG DATA, 2019, 7 (04) : 286 - 307
  • [10] Deep tomography of biological tissues by optoacoustic method
    Reyman, AM
    Yakovlev, IV
    Kirillov, AG
    Lozhkarev, VV
    [J]. BIOMEDICAL OPTOACOUSTICS II, 2001, 4256 : 159 - 166