Unsupervised deep learning approach for Photoacoustic spectral unmixing

被引:21
|
作者
Durairaj, Deepit Abhishek [1 ]
Agrawal, Sumit [2 ]
Johnstonbaugh, Kerrick [2 ]
Chen, Haoyang [2 ]
Karri, Sri Phani Krishna [3 ]
Kothapalli, Sri-Rajasekhar [2 ,4 ]
机构
[1] Penn State Univ, Dept Elect Engn, State Coll, PA 16802 USA
[2] Penn State Univ, Dept Biomed Engn, State Coll, PA 16802 USA
[3] Natl Inst Technol Andhra Pradesh, Dept Elect Engn, Tadepalligudem 534102, AP, India
[4] Penn State Univ, Penn State Canc Inst, Hershey, PA 17033 USA
关键词
Spectral unmixing; photoacoustic imaging; deep learning; unsupervised learning;
D O I
10.1117/12.2546964
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
In photoacoustic imaging, accurate spectral unmixing is required for revealing functional and molecular information of the tissue using multispectral photoacoustic imaging data. A significant challenge in deep-tissue photoacoustic imaging is the nonlinear dependence of the received photoacoustic signals on the local optical fluence and molecular distribution. To overcome this, we have deployed an end-to-end unsupervised neural network based on autoencoders. The proposed method employs the physical properties as the constraints to the neural network which effectively performs the unmixing and outputs the individual molecular concentration maps without a-priori knowledge of their absorption spectra. The algorithm is tested on a set of simulated multispectral photoacoustic images comprising of oxyhemoglobin, deoxy-hemoglobin and indocyanine green targets embedded inside a tissue mimicking medium. These in silico experiments demonstrated promising photoacoustic spectral unmixing results using a completely unsupervised deep learning approach.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] A NOVEL APPROACH FOR HYPERSPECTRAL IMAGE SUPERRESOLUTION USING SPECTRAL UNMIXING AND TRANSFER LEARNING
    Patel, Jignesh R.
    Joshi, Manjunath, V
    Bhatt, Jignesh S.
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 1512 - 1515
  • [32] 1 Unsupervised hyperspectral band selection with deep autoencoder unmixing
    Elkholy, Menna M.
    Mostafa, Marwa S.
    Ebeid, Hala M.
    Tolba, Mohamed
    [J]. INTERNATIONAL JOURNAL OF IMAGE AND DATA FUSION, 2022, 13 (03) : 244 - 261
  • [33] Hypergraph Regularized Deep Autoencoder for Unsupervised Unmixing Hyperspectral Images
    张泽兴
    杨斌
    [J]. Journal of Donghua University(English Edition), 2023, 40 (01) : 8 - 17
  • [34] Deep-learning-based latent space encoding for spectral unmixing of geological materials
    Pattathal, Arun, V
    Sahoo, Maitreya Mohan
    Porwal, Alok
    Karnieli, Arnon
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 183 : 307 - 320
  • [35] A Deep Learning Approach to Photoacoustic Wavefront Localization in Deep-Tissue Medium
    Johnstonbaugh, Kerrick
    Agrawal, Sumit
    Durairaj, Deepit Abhishek
    Fadden, Christopher
    Dangi, Ajay
    Karri, Phani Krishna
    Kothapalli, Sri-Rajasekhar
    [J]. IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2020, 67 (12) : 2649 - 2659
  • [36] Correcting visibility artefacts in Photoacoustic Imaging with a deep learning approach
    Godefroy, Guillaume
    Arnal, Bastien
    Bossy, Emmanuel
    [J]. OPTO-ACOUSTIC METHODS AND APPLICATIONS IN BIOPHOTONICS V, 2021, 11923
  • [37] DEEP LEARNING IN HYPERSPECTRAL UNMIXING: A REVIEW
    Bhatt, Jignesh S.
    Joshi, M., V
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 2189 - 2192
  • [38] Deep learning approach to improve tangential resolution in photoacoustic tomography
    Ajendran, Praveenbalaji R.
    Pramanik, Manojit
    [J]. BIOMEDICAL OPTICS EXPRESS, 2020, 11 (12): : 7311 - 7323
  • [39] HYPERSPECTRAL UNMIXING USING DEEP LEARNING
    Wang, Chenn-Jian
    Li, Hong
    Tang, Yuan-Yan
    [J]. PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION (ICWAPR), 2019, : 7 - 13
  • [40] UNSUPERVISED NONLINEAR SPECTRAL UNMIXING BY MEANS OF NLPCA APPLIED TO HYPERSPECTRAL IMAGERY
    Licciardi, G. A.
    Ceamanos, X.
    Doute, S.
    Chanussot, J.
    [J]. 2012 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2012, : 1369 - 1372