Unsupervised deep learning approach for Photoacoustic spectral unmixing

被引:21
|
作者
Durairaj, Deepit Abhishek [1 ]
Agrawal, Sumit [2 ]
Johnstonbaugh, Kerrick [2 ]
Chen, Haoyang [2 ]
Karri, Sri Phani Krishna [3 ]
Kothapalli, Sri-Rajasekhar [2 ,4 ]
机构
[1] Penn State Univ, Dept Elect Engn, State Coll, PA 16802 USA
[2] Penn State Univ, Dept Biomed Engn, State Coll, PA 16802 USA
[3] Natl Inst Technol Andhra Pradesh, Dept Elect Engn, Tadepalligudem 534102, AP, India
[4] Penn State Univ, Penn State Canc Inst, Hershey, PA 17033 USA
关键词
Spectral unmixing; photoacoustic imaging; deep learning; unsupervised learning;
D O I
10.1117/12.2546964
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
In photoacoustic imaging, accurate spectral unmixing is required for revealing functional and molecular information of the tissue using multispectral photoacoustic imaging data. A significant challenge in deep-tissue photoacoustic imaging is the nonlinear dependence of the received photoacoustic signals on the local optical fluence and molecular distribution. To overcome this, we have deployed an end-to-end unsupervised neural network based on autoencoders. The proposed method employs the physical properties as the constraints to the neural network which effectively performs the unmixing and outputs the individual molecular concentration maps without a-priori knowledge of their absorption spectra. The algorithm is tested on a set of simulated multispectral photoacoustic images comprising of oxyhemoglobin, deoxy-hemoglobin and indocyanine green targets embedded inside a tissue mimicking medium. These in silico experiments demonstrated promising photoacoustic spectral unmixing results using a completely unsupervised deep learning approach.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Temporal and spectral unmixing of photoacoustic signals by deep learning
    Zhou, Yifeng
    Zhong, Fenghe
    Hu, Song
    [J]. OPTICS LETTERS, 2021, 46 (11) : 2690 - 2693
  • [2] AN UNSUPERVISED HYPERSPECTRAL IMAGE FUSION METHOD BASED ON SPECTRAL UNMIXING AND DEEP LEARNING
    Zheng, Kexin
    Khader, Abdolraheem
    Xiao, Liang
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 2398 - 2401
  • [3] Deep Generative Endmember Modeling: An Application to Unsupervised Spectral Unmixing
    Borsoi, Ricardo Augusto
    Imbiriba, Tales
    Moreira Bermudez, Jose Carlos
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 374 - 384
  • [4] Robust blind spectral unmixing for fluorescence microscopy using unsupervised learning
    McRae, Tristan D.
    Oleksyn, David
    Miller, Jim
    Gao, Yu-Rong
    [J]. PLOS ONE, 2019, 14 (12):
  • [5] A Deep Learning Approach to Unsupervised Ensemble Learning
    Shaham, Uri
    Cheng, Xiuyuan
    Dror, Omer
    Jaffe, Ariel
    Nadler, Boaz
    Chang, Joseph
    Kluger, Yuval
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [6] Quantification of multispectral photoacoustic images: unsupervised unmixing methods comparison
    Dolet, Aneline
    Ammanouil, Rita
    Grenier, Thomas
    Richard, Cedric
    Tortoli, Piero
    Vray, Didier
    Varray, Francois
    [J]. 2018 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IUS), 2018,
  • [7] A Practical Approach for Hyperspectral Unmixing Using Deep Learning
    Vijayashekhar, S. S.
    Deshpande, Vijay S.
    Bhatt, Jignesh S.
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [8] AN APPROACH TO FULLY UNSUPERVISED HYPERSPECTRAL UNMIXING
    Gross, Wolfgang
    Schilling, Hendrik
    Middelmann, Wolfgang
    [J]. 2012 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2012, : 4714 - 4717
  • [9] An Unsupervised Binary and Multiple Change Detection Approach for Hyperspectral Imagery Based on Spectral Unmixing
    Jafarzadeh, Hamid
    Hasanlou, Mahdi
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (12) : 4888 - 4906
  • [10] Minimum Description Length approach for unsupervised spectral unmixing of multiple interfering gas species
    Fade, Julien
    Lefebvre, Sidonie
    Cezard, Nicolas
    [J]. OPTICS EXPRESS, 2011, 19 (15): : 13862 - 13872