Unsupervised deep learning approach for Photoacoustic spectral unmixing

被引:21
|
作者
Durairaj, Deepit Abhishek [1 ]
Agrawal, Sumit [2 ]
Johnstonbaugh, Kerrick [2 ]
Chen, Haoyang [2 ]
Karri, Sri Phani Krishna [3 ]
Kothapalli, Sri-Rajasekhar [2 ,4 ]
机构
[1] Penn State Univ, Dept Elect Engn, State Coll, PA 16802 USA
[2] Penn State Univ, Dept Biomed Engn, State Coll, PA 16802 USA
[3] Natl Inst Technol Andhra Pradesh, Dept Elect Engn, Tadepalligudem 534102, AP, India
[4] Penn State Univ, Penn State Canc Inst, Hershey, PA 17033 USA
关键词
Spectral unmixing; photoacoustic imaging; deep learning; unsupervised learning;
D O I
10.1117/12.2546964
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
In photoacoustic imaging, accurate spectral unmixing is required for revealing functional and molecular information of the tissue using multispectral photoacoustic imaging data. A significant challenge in deep-tissue photoacoustic imaging is the nonlinear dependence of the received photoacoustic signals on the local optical fluence and molecular distribution. To overcome this, we have deployed an end-to-end unsupervised neural network based on autoencoders. The proposed method employs the physical properties as the constraints to the neural network which effectively performs the unmixing and outputs the individual molecular concentration maps without a-priori knowledge of their absorption spectra. The algorithm is tested on a set of simulated multispectral photoacoustic images comprising of oxyhemoglobin, deoxy-hemoglobin and indocyanine green targets embedded inside a tissue mimicking medium. These in silico experiments demonstrated promising photoacoustic spectral unmixing results using a completely unsupervised deep learning approach.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Data Analysis for Spatial-Spectral Interactions in Unsupervised Hyperspectral Unmixing
    Goenaga-Jimenez, Miguel A.
    [J]. 2016 IEEE LATIN AMERICAN CONFERENCE ON COMPUTATIONAL INTELLIGENCE (LA-CCI), 2016,
  • [42] Unsupervised Learning for Enhanced Computed Photoacoustic Microscopy
    Yang, Lulin
    Chen, Wenjing
    Kou, Tingdong
    Li, Chenyang
    You, Meng
    Shen, Junfei
    [J]. ELECTRONICS, 2024, 13 (04)
  • [43] UNSUPERVISED UNMIXING AND SEGMENTATION OF HYPER SPECTRAL IMAGES ACCOUNTING FOR SOIL FERTILITY
    Lavanya, K.
    Subalakshmi, R. Jaya
    Tamizharasi, T.
    Jane, Lydia
    Victor, Akila
    [J]. SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2022, 23 (04): : 291 - 301
  • [44] Unmixing Guided Unsupervised Network for RGB Spectral Super-Resolution
    Qu, Qiaoying
    Pan, Bin
    Xu, Xia
    Li, Tao
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4856 - 4867
  • [45] Unsupervised Multitemporal Spectral Unmixing for Detecting Multiple Changes in Hyperspectral Images
    Liu, Sicong
    Bruzzone, Lorenzo
    Bovolo, Francesca
    Du, Peijun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (05): : 2733 - 2748
  • [46] Spectral shape classification: A deep learning approach
    Masoumi, Majid
    Ben Hamza, A.
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 43 : 198 - 211
  • [47] Learning Optical Scattering Through Symmetrical Orthogonality Enforced Independent Components for Unmixing Deep Tissue Photoacoustic Signals
    Agrawal, Sumit
    Gaddale, Prameth
    Karri, Sri Phani Krishna
    Kothapalli, Sri-Rajasekhar
    [J]. IEEE SENSORS LETTERS, 2021, 5 (05)
  • [48] Deep spectral convolution network for hyperspectral image unmixing with spectral library
    Qi, Lin
    Li, Jie
    Wang, Ying
    Lei, Mingyu
    Gao, Xinbo
    [J]. SIGNAL PROCESSING, 2020, 176
  • [49] Subaerial beach profiles classification: An unsupervised deep learning approach
    Riazi, Amin
    Slovinsky, Peter A.
    [J]. CONTINENTAL SHELF RESEARCH, 2021, 226
  • [50] Analysis on spectral unmixing based on manifold learning
    Ding, Ling
    Tang, Ping
    Li, Hongyi
    [J]. Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2013, 42 (09): : 2421 - 2425