Self-supervised Single-Image Deconvolution with Siamese Neural Networks

被引:0
|
作者
Papkov, Mikhail [1 ]
Palo, Kaupo [2 ]
Parts, Leopold [1 ,3 ]
机构
[1] Univ Tartu, Inst Comp Sci, Tartu, Estonia
[2] Revvity Inc, Tallinn, Estonia
[3] Wellcome Sanger Inst, Hinxton, England
基金
英国惠康基金;
关键词
Deconvolution; Microscopy; Deep learning; SIMILARITY;
D O I
10.1007/978-3-031-58171-7_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Inverse problems in image reconstruction are fundamentally complicated by unknown noise properties. Classical iterative deconvolution approaches amplify noise and require careful parameter selection for an optimal trade-off between sharpness and grain. Deep learning methods allow for flexible parametrization of the noise and learning its properties directly from the data. Recently, self-supervised blind-spot neural networks were successfully adopted for image deconvolution by including a known point-spread function in the end-to-end training. However, their practical application has been limited to 2D images in biomedical domain because it implies large kernels, which are poorly optimized. We tackle this problem with Fast Fourier Transform convolutions that provide training speed-up in 3D microscopy deconvolution tasks. Further, we propose to adopt a Siamese invariance loss for deconvolution and empirically identify its optimal position in the neural network between blind-spot and full image branches. The experimental results show that our improved framework outperforms the previous state-of-the-art deconvolution methods with a known point spread function.
引用
收藏
页码:157 / 166
页数:10
相关论文
共 50 条
  • [1] Single-image reflection removal via self-supervised diffusion models
    Lu, Zhengyang
    Wang, Weifan
    Guo, Tianhao
    Wang, Feng
    [J]. Journal of Supercomputing, 2025, 81 (01):
  • [2] Self-Supervised Single-Image Depth Estimation From Focus and Defocus Clues
    Lu, Yawen
    Milliron, Garrett
    Slagter, John
    Lu, Guoyu
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 6281 - 6288
  • [3] Self-supervised Siamese Autoencoders
    Baier, Friederike
    Mair, Sebastian
    Fadel, Samuel G.
    [J]. ADVANCES IN INTELLIGENT DATA ANALYSIS XXII, PT I, IDA 2024, 2024, 14641 : 117 - 128
  • [4] A Self-Supervised Bootstrap Method for Single-Image 3D Face Reconstruction
    Xing, Yifan
    Tewari, Rahul
    Mendonc, Paulo R. S.
    [J]. 2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 1014 - 1023
  • [5] Siamese Image Modeling for Self-Supervised Vision Representation Learning
    Tao, Chenxin
    Zhu, Xizhou
    Su, Weijie
    Huang, Gao
    Li, Bin
    Zhou, Jie
    Qiao, Yu
    Wang, Xiaogang
    Dai, Jifeng
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 2132 - 2141
  • [6] Review on self-supervised image recognition using deep neural networks
    Ohri, Kriti
    Kumar, Mukesh
    [J]. KNOWLEDGE-BASED SYSTEMS, 2021, 224
  • [7] Animating Landscape: Self-Supervised Learning of Decoupled Motion and Appearance for Single-Image Video Synthesis
    Endo, Yuki
    Kanamori, Yoshihiro
    Kuriyama, Shigeru
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (06):
  • [8] SELF-SUPERVISED SPEAKER VERIFICATION WITH SIMPLE SIAMESE NETWORK AND SELF-SUPERVISED REGULARIZATION
    Sang, Mufan
    Li, Haoqi
    Liu, Fang
    Arnold, Andrew O.
    Wan, Li
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 6127 - 6131
  • [9] Self-supervised hamiltonian mechanics neural networks
    Zhan, Youqiu
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 271 - 275
  • [10] Self-supervised Object Tracking with Cycle-consistent Siamese Networks
    Yuan, Weihao
    Wang, Michael Yu
    Chen, Qifeng
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 10351 - 10358