Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

被引:43
|
作者
Chen, Rong [1 ]
Tang, Xiao [2 ]
Zhao, Yuxuan [3 ]
Shen, Zeyu [2 ]
Zhang, Meng [3 ]
Shen, Yusheng [2 ]
Li, Tiantian [2 ]
Chung, Casper Ho Yin [4 ]
Zhang, Lijuan [5 ]
Wang, Ji [4 ]
Cui, Binbin [1 ]
Fei, Peng [3 ]
Guo, Yusong [2 ]
Du, Shengwang [1 ,6 ,7 ]
Yao, Shuhuai [1 ,4 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Chem & Biol Engn, Hong Kong, Peoples R China
[2] Hong Kong Univ Sci & Technol, Div Life Sci, Hong Kong, Peoples R China
[3] Huazhong Univ Sci & Technol, Sch Opt & Elect Informat, Wuhan 430074, Peoples R China
[4] Hong Kong Univ Sci & Technol, Dept Mech & Aerosp Engn, Hong Kong, Peoples R China
[5] Guizhou Univ, Sch Pharmaceut Sci, Guiyang 550025, Guizhou, Peoples R China
[6] Hong Kong Univ Sci & Technol, Dept Phys, Hong Kong, Peoples R China
[7] Univ Texas Dallas, Dept Phys, Richardson, TX 75080 USA
关键词
LIVE-CELL; RESOLUTION LIMIT; TRANSPORT; RECONSTRUCTION; NANOSCOPY; VIRUS;
D O I
10.1038/s41467-023-38452-2
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Multi-frame super-resolution microscopy is hampered by long acquisition times and phototoxicity, which hinder its use for live-cell imaging. Here, authors propose a deep-learning-based single-frame super-resolution approach to image cellular dynamics with high spatiotemporal resolution. Single-molecule localization microscopy (SMLM) can be used to resolve subcellular structures and achieve a tenfold improvement in spatial resolution compared to that obtained by conventional fluorescence microscopy. However, the separation of single-molecule fluorescence events that requires thousands of frames dramatically increases the image acquisition time and phototoxicity, impeding the observation of instantaneous intracellular dynamics. Here we develop a deep-learning based single-frame super-resolution microscopy (SFSRM) method which utilizes a subpixel edge map and a multicomponent optimization strategy to guide the neural network to reconstruct a super-resolution image from a single frame of a diffraction-limited image. Under a tolerable signal density and an affordable signal-to-noise ratio, SFSRM enables high-fidelity live-cell imaging with spatiotemporal resolutions of 30 nm and 10 ms, allowing for prolonged monitoring of subcellular dynamics such as interplays between mitochondria and endoplasmic reticulum, the vesicle transport along microtubules, and the endosome fusion and fission. Moreover, its adaptability to different microscopes and spectra makes it a useful tool for various imaging systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Single-Frame Super-Resolution via Compressive Sampling on Hybrid Reconstructions
    Zhang, Ji-Ping
    Dai, Tao
    Xia, Shu-Tao
    NEURAL INFORMATION PROCESSING, PT III, 2015, 9491 : 610 - 618
  • [22] Machine Learning Based Single-Frame Super-Resolution Processing for Lensless Blood Cell Counting
    Huang, Xiwei
    Jiang, Yu
    Liu, Xu
    Xu, Hang
    Han, Zhi
    Rong, Hailong
    Yang, Haiping
    Yan, Mei
    Yu, Hao
    SENSORS, 2016, 16 (11):
  • [23] An Improved Single-Frame Super-Resolution Algorithm for Magnetic Resonance Image
    Chu Jinghui
    Hu Fengshuo
    Zhang Jiaqi
    Lu Wei
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (05)
  • [24] Deep-learning-augmented microscopy for super-resolution imaging of nanoparticles
    Hu, Xin
    Jia, Xixi
    Zhang, Kai
    Lo, Tsz wing
    Fan, Yulong
    Liu, Danjun
    Wen, Jing
    Yong, Hongwei
    Rahmani, Mohsen
    Zhang, Lei
    Lei, Dangyuan
    OPTICS EXPRESS, 2024, 32 (01) : 879 - 890
  • [25] Deep learning for super-resolution localization microscopy
    Zhou, Tianyang
    Luo, Jianwen
    Liu, Xin
    OPTICS IN HEALTH CARE AND BIOMEDICAL OPTICS VIII, 2018, 10820
  • [26] Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution
    Song, Liangfeng
    Liu, Xin
    Xiong, Zihan
    Ahamed, Mostak
    An, Sha
    Zheng, Juanjuan
    Ma, Ying
    Gao, Peng
    OPTICS AND LASERS IN ENGINEERING, 2024, 174
  • [27] Deep-learning based denoising and reconstruction of super-resolution structured illumination microscopy images
    ZAFRAN HUSSAIN SHAH
    MARCEL MüLLER
    TUNG-CHENG WANG
    PHILIP MAURICE SCHEIDIG
    AXEL SCHNEIDER
    MARK SCHüTTPELZ
    THOMAS HUSER
    WOLFRAM SCHENCK
    Photonics Research, 2021, 9 (05) : 570 - 583
  • [28] Single-frame super-resolution for remote sensing images based on improved deep recursive residual network
    Jiali Tang
    Jie Zhang
    Dan Chen
    Najla Al-Nabhan
    Chenrong Huang
    EURASIP Journal on Image and Video Processing, 2021
  • [29] Single-frame super-resolution for remote sensing images based on improved deep recursive residual network
    Tang, Jiali
    Zhang, Jie
    Chen, Dan
    Al-Nabhan, Najla
    Huang, Chenrong
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2021, 2021 (01)
  • [30] Deep-learning based denoising and reconstruction of super-resolution structured illumination microscopy images
    Shah, Zafran Hussain
    Mueller, Marcel
    Wang, Tung-Cheng
    Scheidig, Philip Maurice
    Schneider, Axel
    Schuettpelz, Mark
    Huser, Thomas
    Schenck, Wolfram
    PHOTONICS RESEARCH, 2021, 9 (05) : B168 - B181