Fast and Lightweight Network for Single Frame Structured Illumination Microscopy Super-Resolution

被引:9
|
作者
Cheng, Xi [1 ,2 ]
Li, Jun [1 ,2 ]
Dai, Qiang [3 ]
Fu, Zhenyong [1 ,2 ]
Yang, Jian [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens, Minist Educ, PCA Lab, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[3] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215031, Peoples R China
基金
中国博士后科学基金;
关键词
Lighting; Superresolution; Microscopy; Kernel; Convolution; Task analysis; Feature extraction; Image demoireing; structured illumination microscopy (SIM); superresolution; RESOLUTION;
D O I
10.1109/TIM.2022.3161721
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Structured illumination microscopy (SIM) is an important super-resolution-based microscopy technique that breaks the diffraction limit and enhances optical microscopy systems. With the development of biology and medical engineering, there is a high demand for real-time and robust SIM imaging under extreme low-light and short-exposure environments. Existing SIM techniques typically require multiple structured illumination frames to produce a high-resolution image. In this article, we propose a single-frame SIM (SF-SIM) based on deep learning. Our SF-SIM only needs one shot of a structured illumination frame and generates similar results compared with the traditional SIM systems that typically require 15 shots. In our SF-SIM, we propose a noise estimator that can effectively suppress the noise in the image and enable our method to work in the low-light and short-exposure environment without the need for stacking multiple frames for nonlocal denoising. We also design a bandpass attention module that makes our deep network more sensitive to the change of frequency and enhances the imaging quality. Our proposed SF-SIM is almost 14 times faster than traditional SIM methods when achieving similar results. Therefore, our method is significantly valuable for the development of microbiology and medicine.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Super-Resolution Structured Illumination Microscopy
    Heintzmann, Rainer
    Huser, Thomas
    CHEMICAL REVIEWS, 2017, 117 (23) : 13890 - 13908
  • [2] Multifocus structured illumination microscopy for fast volumetric super-resolution imaging
    Abrahamsson, Sara
    Blom, Hans
    Agostinho, Ana
    Jans, Daniel C.
    Jost, Aurelie
    Mueller, Marcel
    Nilsson, Linnea
    Bernhem, Kristoffer
    Lambert, Talley J.
    Heintzmann, Rainer
    Brismar, Hjalmar
    BIOMEDICAL OPTICS EXPRESS, 2017, 8 (09): : 4135 - 4140
  • [3] Chiral structured illumination microscopy: fast imaging chiral domains at super-resolution
    Huang, Shiang-Yu
    Zhang, Jiwei
    Foerster, Ronny
    Karras, Christian
    Heintzmann, Rainer
    Huang, Jer-Shing
    UNCONVENTIONAL OPTICAL IMAGING III, 2022, 12136
  • [4] Super-resolution reconstruction theory in structured illumination microscopy
    Zhou X.
    Dan D.
    Qian J.
    Yao B.
    Lei M.
    Lei, Ming (leiming@opt.ac.cn), 1600, Chinese Optical Society (37):
  • [5] In-Vivo Super-Resolution Microscopy by Structured Illumination
    Gustafsson, Mats G. L.
    BIOPHYSICAL JOURNAL, 2009, 96 (03) : 202A - 202A
  • [6] Structured illumination microscopy for super-resolution and optical sectioning
    Dan, Dan
    Yao, Baoli
    Lei, Ming
    CHINESE SCIENCE BULLETIN, 2014, 59 (12): : 1291 - 1307
  • [7] Structured Illumination Microscopy and Super-resolution Image Reconstruction
    Bi, Ying
    Qian, Jiaming
    Cao, Yu
    TWELFTH INTERNATIONAL CONFERENCE ON INFORMATION OPTICS AND PHOTONICS (CIOP 2021), 2021, 12057
  • [8] Structured illumination microscopy for super-resolution and optical sectioning
    Dan Dan
    Baoli Yao
    Ming Lei
    Chinese Science Bulletin, 2014, 59 (12) : 1291 - 1307
  • [9] Structured illumination microscopy for super-resolution and optical sectioning
    Dan Dan
    Baoli Yao
    Ming Lei
    Science Bulletin, 2014, (12) : 1291 - 1307
  • [10] Super-resolution scanning microscopy with virtually structured illumination
    Zhang, Su
    Li, Jingtao
    Zou, Limin
    Ding, Xuemei
    TENTH INTERNATIONAL SYMPOSIUM ON PRECISION ENGINEERING MEASUREMENTS AND INSTRUMENTATION, 2019, 11053