Image denoising for fluorescence microscopy by supervised to self-supervised transfer learning

被引:14
|
作者
Wang, Yina [1 ]
Pinkard, Henry [2 ,3 ,4 ,5 ]
Khwaja, Emaad [6 ]
Zhou, Shuqin [1 ,7 ]
Waller, Laura [3 ,4 ,8 ]
Huang, Bo [1 ,8 ,9 ]
机构
[1] Univ Calif San Francisco, Dept Pharmaceut Chem, San Francisco, CA 94143 USA
[2] Univ Calif Berkeley, Computat Biol Grad Grp, Berkeley, CA 94720 USA
[3] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
[4] Berkeley Inst Data Sci, Berkeley, CA 94720 USA
[5] Univ Calif San Francisco, Bakar Computat Hlth Sci Inst, San Francisco, CA 94143 USA
[6] Univ Calif San Francisco, UC Berkeley UCSF Joint Grad Program Bioengn, San Francisco, CA 94143 USA
[7] Tsinghua Univ, Sch Pharm, Beijing, Peoples R China
[8] Chan Zuckerberg Biohub, San Francisco, CA 94158 USA
[9] Univ Calif San Francisco, Dept Biochem & Biophys, San Francisco, CA 94143 USA
基金
美国国家卫生研究院;
关键词
Fluorescence microscopy;
D O I
10.1364/OE.434191
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
When using fluorescent microscopy to study cellular dynamics, trade-offs typically have to be made between light exposure and quality of recorded image to balance the phototoxicity and image signal-to-noise ratio. Image denoising is an important tool for retrieving information from dim cell images. Recently, deep learning based image denoising is becoming the leading method because of its promising denoising performance, achieved by leveraging available prior knowledge about the noise model and samples at hand. We demonstrate that incorporating temporal information in the model can further improve the results. However, the practical application of this method has seen challenges because of the requirement of large, task-specific training datasets. In this work, we addressed this challenge by combining self-supervised learning with transfer learning, which eliminated the demand of task-matched training data while maintaining denoising performance. We demonstrate its application in fluorescent imaging of different subcellular structures. (C) 2021 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
引用
收藏
页码:41303 / 41312
页数:10
相关论文
共 50 条
  • [1] Self-Supervised Joint Learning for pCLE Image Denoising
    Yang, Kun
    Zhang, Haojie
    Qiu, Yufei
    Zhai, Tong
    Zhang, Zhiguo
    [J]. SENSORS, 2024, 24 (09)
  • [2] Comparison between Supervised and Self-supervised Deep Learning for SEM Image Denoising
    Okud, Tomoyuki
    Chen, Jun
    Motoyoshi, Takahiro
    Yumiba, Ryou
    Ishikawa, Masayoshi
    Toyoda, Yasutaka
    [J]. METROLOGY, INSPECTION, AND PROCESS CONTROL XXXVII, 2023, 12496
  • [3] Spatial redundancy transformer for self-supervised fluorescence image denoising
    Li, Xinyang
    Hu, Xiaowan
    Chen, Xingye
    Fan, Jiaqi
    Zhao, Zhifeng
    Wu, Jiamin
    Wang, Haoqian
    Dai, Qionghai
    [J]. NATURE COMPUTATIONAL SCIENCE, 2023, 3 (12): : 1067 - +
  • [4] Spatial redundancy transformer for self-supervised fluorescence image denoising
    Xinyang Li
    Xiaowan Hu
    Xingye Chen
    Jiaqi Fan
    Zhifeng Zhao
    Jiamin Wu
    Haoqian Wang
    Qionghai Dai
    [J]. Nature Computational Science, 2023, 3 : 1067 - 1080
  • [5] NVST Image Denoising Based on Self-Supervised Deep Learning
    Lu Xianwei
    Liu Hui
    Shang Zhenhong
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (06)
  • [6] Self-supervised learning for CT image denoising and reconstruction: a review
    Choi, Kihwan
    [J]. BIOMEDICAL ENGINEERING LETTERS, 2024, : 1207 - 1220
  • [7] Leveraging Self-supervised Denoising for Image Segmentation
    Prakash, Mangal
    Buchholz, Tim-Oliver
    Lalit, Manan
    Tomancak, Pavel
    Jug, Florian
    Krull, Alexander
    [J]. 2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 428 - 432
  • [8] Investigating self-supervised image denoising with denaturation
    Waida, Hiroki
    Yamazaki, Kimihiro
    Tokuhisa, Atsushi
    Wada, Mutsuyo
    Wada, Yuichiro
    [J]. Neural Networks, 2025, 184
  • [9] Diffraction denoising using self-supervised learning
    Markovic, Magdalena
    Malehmir, Reza
    Malehmir, Alireza
    [J]. GEOPHYSICAL PROSPECTING, 2023, 71 (07) : 1215 - 1225
  • [10] Transfer learning for self-supervised, blind-spot seismic denoising
    Birnie, Claire
    Alkhalifah, Tariq
    [J]. FRONTIERS IN EARTH SCIENCE, 2022, 10