Image denoising for fluorescence microscopy by supervised to self-supervised transfer learning

被引:14
|
作者
Wang, Yina [1 ]
Pinkard, Henry [2 ,3 ,4 ,5 ]
Khwaja, Emaad [6 ]
Zhou, Shuqin [1 ,7 ]
Waller, Laura [3 ,4 ,8 ]
Huang, Bo [1 ,8 ,9 ]
机构
[1] Univ Calif San Francisco, Dept Pharmaceut Chem, San Francisco, CA 94143 USA
[2] Univ Calif Berkeley, Computat Biol Grad Grp, Berkeley, CA 94720 USA
[3] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
[4] Berkeley Inst Data Sci, Berkeley, CA 94720 USA
[5] Univ Calif San Francisco, Bakar Computat Hlth Sci Inst, San Francisco, CA 94143 USA
[6] Univ Calif San Francisco, UC Berkeley UCSF Joint Grad Program Bioengn, San Francisco, CA 94143 USA
[7] Tsinghua Univ, Sch Pharm, Beijing, Peoples R China
[8] Chan Zuckerberg Biohub, San Francisco, CA 94158 USA
[9] Univ Calif San Francisco, Dept Biochem & Biophys, San Francisco, CA 94143 USA
基金
美国国家卫生研究院;
关键词
Fluorescence microscopy;
D O I
10.1364/OE.434191
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
When using fluorescent microscopy to study cellular dynamics, trade-offs typically have to be made between light exposure and quality of recorded image to balance the phototoxicity and image signal-to-noise ratio. Image denoising is an important tool for retrieving information from dim cell images. Recently, deep learning based image denoising is becoming the leading method because of its promising denoising performance, achieved by leveraging available prior knowledge about the noise model and samples at hand. We demonstrate that incorporating temporal information in the model can further improve the results. However, the practical application of this method has seen challenges because of the requirement of large, task-specific training datasets. In this work, we addressed this challenge by combining self-supervised learning with transfer learning, which eliminated the demand of task-matched training data while maintaining denoising performance. We demonstrate its application in fluorescent imaging of different subcellular structures. (C) 2021 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
引用
收藏
页码:41303 / 41312
页数:10
相关论文
共 50 条
  • [31] Self-Supervised Deep Depth Denoising
    Sterzentsenko, Vladimiros
    Saroglou, Leonidas
    Chatzitofis, Anargyros
    Thermos, Spyridon
    Zioulis, Nikolaos
    Doumanoglou, Alexandros
    Zarpalas, Dimitrios
    Daras, Petros
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 1242 - 1251
  • [32] Transfer learning application of self-supervised learning in ARPES
    Ekahana, Sandy Adhitia
    Winata, Genta Indra
    Soh, Y.
    Tamai, Anna
    Milan, Radovic
    Aeppli, Gabriel
    Shi, Ming
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2023, 4 (03):
  • [33] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning
    Wang, Xinghao
    He, Junliang
    Wang, Pengyu
    Zhou, Yunhua
    Sun, Tianxiang
    Qiu, Xipeng
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 19180 - 19188
  • [34] Remote sensing image intelligent interpretation: from supervised learning to self-supervised learning
    Tao C.
    Yin Z.
    Zhu Q.
    Li H.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2021, 50 (08): : 1122 - 1134
  • [35] Self-supervised Learning Through Colorization for Microscopy Images
    Pandey, Vaidehi
    Brune, Christoph
    Strisciuglio, Nicola
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT II, 2022, 13232 : 621 - 632
  • [36] A New Self-supervised Method for Supervised Learning
    Yang, Yuhang
    Ding, Zilin
    Cheng, Xuan
    Wang, Xiaomin
    Liu, Ming
    INTERNATIONAL CONFERENCE ON COMPUTER VISION, APPLICATION, AND DESIGN (CVAD 2021), 2021, 12155
  • [37] Self-supervised Correction Learning for Semi-supervised Biomedical Image Segmentation
    Zhang, Ruifei
    Liu, Sishuo
    Yu, Yizhou
    Li, Guanbin
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 134 - 144
  • [38] IDR: Self-Supervised Image Denoising via Iterative Data Refinement
    Zhang, Yi
    Li, Dasong
    Law, Ka Lung
    Wang, Xiaogang
    Qin, Hongwei
    Li, Hongsheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2088 - 2097
  • [39] Patch-Craft Self-Supervised Training for Correlated Image Denoising
    Vaksman, Gregory
    Elad, Michael
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5795 - 5804
  • [40] Pol2Pol: self-supervised polarimetric image denoising
    Liu, Hedong
    Li, Xiaobo
    Cheng, Zhenzhou
    Liu, Tiegen
    Zhai, Jingsheng
    Hu, Haofeng
    OPTICS LETTERS, 2023, 48 (18) : 4821 - 4824