Image response-assisted volumetric reconstruction for simultaneous multi-color light-field microscopy

被引:0
|
作者
Yang, Yuqi [1 ]
Xing, Yue [1 ]
Jin, Xin [1 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
来源
OPTICS EXPRESS | 2024年 / 32卷 / 21期
基金
中国国家自然科学基金;
关键词
Color image processing - Field emission microscopes - Medical imaging;
D O I
10.1364/OE.536799
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Light-field microscopy enables real-time volumetric imaging, offering substantial advantages for real-time fluorescence imaging. However, when applied to multi-color imaging, positional cross-talk between different fluorescent signals in the object space reduces reconstruction accuracy. Additionally, imaging each color through sequential excitation of fluorophores significantly compromises imaging speed. In this paper, an image response-assisted volumetric reconstruction method that unmixes multi-color fluorescence light-field images using pixel support derived from the light-field imaging response is proposed. This approach enables simultaneous multi-color imaging with significantly improved volumetric reconstruction accuracy. The correctness and effectiveness of the proposed method are validated through both simulations and experiments. The root-mean-square-error of multi-color volumetric reconstruction is reduced by 37.87 % on average compared with the simultaneous multi-color reconstruction methods obtained by simply combining single-pixel spectrum conversion methods and linear unmixing method in rapid-moving micro-particle observation, showcasing high accuracy simultaneous multi-color imaging performance. Volumetric imaging of motor neurons and whole-body cells of live dual-color zebrafish larvae at 20 Hz demonstrates the ability to be applied to real biomedical imaging. (c) 2024 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
引用
收藏
页码:36344 / 36361
页数:18
相关论文
共 50 条
  • [1] High-resolution Fourier light-field microscopy for volumetric multi-color live-cell imaging
    Hua, Xuanwen
    Liu, Wenhao
    Jia, Shu
    OPTICA, 2021, 8 (05) : 614 - 620
  • [2] Aberration Modeling in Deep Learning for Volumetric Reconstruction of Light-Field Microscopy
    Zhou, You
    Jin, Zhouyu
    Zhao, Qianhui
    Xiong, Bo
    Cao, Xun
    LASER & PHOTONICS REVIEWS, 2023, 17 (10)
  • [3] Light-field microscopy for fast volumetric brain imaging
    Zhang, Zhenkun
    Cong, Lin
    Bai, Lu
    Wang, Kai
    JOURNAL OF NEUROSCIENCE METHODS, 2021, 352
  • [4] Quantum light-field microscopy for volumetric imaging with extreme depth of field
    Zhang, Yingwen
    England, Duncan
    Orth, Antony
    Karimi, Ebrahim
    Sussman, Benjamin
    PHYSICAL REVIEW APPLIED, 2024, 21 (01)
  • [5] Real-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning
    Wang, Zhaoqiang
    Zhu, Lanxin
    Zhang, Hao
    Li, Guo
    Yi, Chengqiang
    Li, Yi
    Yang, Yicong
    Ding, Yichen
    Zhen, Mei
    Gao, Shangbang
    Hsiai, Tzung K.
    Fei, Peng
    NATURE METHODS, 2021, 18 (05) : 551 - +
  • [6] Real-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning
    Zhaoqiang Wang
    Lanxin Zhu
    Hao Zhang
    Guo Li
    Chengqiang Yi
    Yi Li
    Yicong Yang
    Yichen Ding
    Mei Zhen
    Shangbang Gao
    Tzung K. Hsiai
    Peng Fei
    Nature Methods, 2021, 18 : 551 - 556
  • [7] High-resolution volumetric imaging using hybrid image of Fourier light-field microscopy and wide-field microscopy
    Liu, Wenhao
    Jia, Shu
    THREE-DIMENSIONAL AND MULTIDIMENSIONAL MICROSCOPY: IMAGE ACQUISITION AND PROCESSING XXIX, 2022, 11966
  • [8] A hybrid LSQP algorithm for simultaneous reconstruction of the temperature and absorption coefficient field from the light-field image
    Wen, Shuang
    Qi, Hong
    Liu, Shao-Bin
    Ren, Ya-Tao
    Shi, Jing-Wen
    Huang, Xing
    INFRARED PHYSICS & TECHNOLOGY, 2020, 105
  • [9] Video-rate multi-color structured illumination microscopy with simultaneous real-time reconstruction
    Andreas Markwirth
    Mario Lachetta
    Viola Mönkemöller
    Rainer Heintzmann
    Wolfgang Hübner
    Thomas Huser
    Marcel Müller
    Nature Communications, 10
  • [10] Video-rate multi-color structured illumination microscopy with simultaneous real-time reconstruction
    Markwirth, Andreas
    Lachetta, Mario
    Moenkemoeller, Viola
    Heintzmann, Rainer
    Huebner, Wolfgang
    Huser, Thomas
    Mueller, Marcel
    NATURE COMMUNICATIONS, 2019, 10 (1)