Depth estimation in turbid media from stack of epi-illuminated microscopy images, using deep learning

被引:0
|
作者
Ghosh, Anindya [1 ,2 ]
Hohmann, Martin [1 ,2 ]
Klampfl, Florian [1 ,2 ]
Schmidt, Michael [1 ,2 ]
机构
[1] Friedrich Alexander Univ Erlangen Nurnberg, Inst Photon Technol LPT, Konrad Zuse Str 3-5, D-91052 Erlangen, Germany
[2] Friedrich Alexander Univ Erlangen Nurnberg, Erlangen Grad Sch Adv Opt Technol SAOT, Paul Gordan Str 6, D-91052 Erlangen, Germany
来源
关键词
Depth estimation; depth reconstruction; turbid media; scattering-blur; image-stack; deep learning; U-net;
D O I
10.1117/12.3029573
中图分类号
TB3 [工程材料学]; R318.08 [生物材料学];
学科分类号
0805 ; 080501 ; 080502 ;
摘要
Optical imaging is the simplest modality for any imaging applications. Also, microscopy has the best resolution among all the imaging modalities used for clinical diagnosis and biomedical research. However, detection of inclusions by optical imaging in a biological tissue might be challenging because of the scattering and absorption inside the tissue. Due to the scattering, an optical image of an object inside a turbid medium yields a scattering-induced blur, which increases with the depth of the object from the surface of the medium. This correlation has been shown in literature to be used for depth estimation from single trans-illumination images. In a similar way, the scattering-blur also changes while varying the focal plane of the imaging system. This gradual change in the contrast can be utilised to determine the actual position of the object from a stack of multiple focus-shifted images. Here, we present a proof of concept of a deep-learning based method for determining the location of objects inside turbid media, from a stack of blurred images. Since trans-illumination is not applicable for large body-parts, epi-illumination setup was used for imaging. For this preliminary study, a U-Net neural network regression model was trained and tested under simplified conditions. It takes 3D image data as input and gives a 2D depth matrix as output. Black PU structures of simple geometrical shapes were used as absorbing objects. An intra-lipid solution of 0.7% concentration was used as the scattering substrate. The black absorbers, immersed in the substrate, were imaged with microscope by varying the focal plane to obtain the image-stacks. The actual depth profile of the absorbers was measured with a 3D profilometer, which was used as corresponding ground truth for training. The predicted results from the trained model show good agreement with the ground truth for testing data.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Depth Estimation for Hazy Images using Deep Learning
    Rahadianti, Laksmita
    Sakaue, Fumihiko
    Sato, Jun
    [J]. PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 238 - 243
  • [2] Deep learning based depth map estimation of protoporphyrin IX in turbid media using dual wavelength excitation fluorescence
    Imanishi, Hinano
    Nishimura, Takahiro
    Shimojo, Yu
    Awazu, Kunio
    [J]. BIOMEDICAL OPTICS EXPRESS, 2023, 14 (10) : 5254 - 5266
  • [3] Depth Estimation from SEM Images using Deep Learning and Angular Data Diversity
    Houben, Tim
    Pisarenco, Maxim
    Huisman, Thomas
    Onvlee, Hans
    van der Sommen, Fons
    de With, Peter
    [J]. METROLOGY, INSPECTION, AND PROCESS CONTROL XXXVII, 2023, 12496
  • [4] Depth Estimation and Image Restoration by Deep Learning From Defocused Images
    Nazir, Saqib
    Vaquero, Lorenzo
    Mucientes, Manuel
    Brea, Victor M.
    Coltuc, Daniela
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 607 - 619
  • [5] JOINT ESTIMATION OF DEPTH AND ITS UNCERTAINTY FROM STEREO IMAGES USING BAYESIAN DEEP LEARNING
    Mehltretter, Max
    [J]. XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION II, 2022, 5-2 : 69 - 78
  • [6] Estimation of light penetration depth in turbid media using laser speckles
    Sidorov, Igor S.
    Miridonov, Serguei V.
    Nippolainen, Ervin
    Kamshilin, Alexei A.
    [J]. OPTICS EXPRESS, 2012, 20 (13): : 13692 - 13701
  • [7] Deep-learning-based depth estimation from light field images
    Schiopu, I.
    Munteanu, A.
    [J]. ELECTRONICS LETTERS, 2019, 55 (20) : 1086 - +
  • [8] LEARNING DEPTH CUES FROM FOCAL STACK FOR LIGHT FIELD DEPTH ESTIMATION
    Zhou, Wenhui
    Zhou, Enci
    Yan, Yuxiang
    Lin, Lili
    Lumsdaine, Andrew
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1074 - 1078
  • [9] Depth Estimation of Computer Video Images Based on Deep Learning
    Ru Xu
    [J]. Circuits, Systems, and Signal Processing, 2020, 39 : 721 - 733
  • [10] Depth Estimation of Computer Video Images Based on Deep Learning
    Xu, Ru
    [J]. CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2020, 39 (02) : 721 - 733