Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

被引:43
|
作者
Chen, Rong [1 ]
Tang, Xiao [2 ]
Zhao, Yuxuan [3 ]
Shen, Zeyu [2 ]
Zhang, Meng [3 ]
Shen, Yusheng [2 ]
Li, Tiantian [2 ]
Chung, Casper Ho Yin [4 ]
Zhang, Lijuan [5 ]
Wang, Ji [4 ]
Cui, Binbin [1 ]
Fei, Peng [3 ]
Guo, Yusong [2 ]
Du, Shengwang [1 ,6 ,7 ]
Yao, Shuhuai [1 ,4 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Chem & Biol Engn, Hong Kong, Peoples R China
[2] Hong Kong Univ Sci & Technol, Div Life Sci, Hong Kong, Peoples R China
[3] Huazhong Univ Sci & Technol, Sch Opt & Elect Informat, Wuhan 430074, Peoples R China
[4] Hong Kong Univ Sci & Technol, Dept Mech & Aerosp Engn, Hong Kong, Peoples R China
[5] Guizhou Univ, Sch Pharmaceut Sci, Guiyang 550025, Guizhou, Peoples R China
[6] Hong Kong Univ Sci & Technol, Dept Phys, Hong Kong, Peoples R China
[7] Univ Texas Dallas, Dept Phys, Richardson, TX 75080 USA
关键词
LIVE-CELL; RESOLUTION LIMIT; TRANSPORT; RECONSTRUCTION; NANOSCOPY; VIRUS;
D O I
10.1038/s41467-023-38452-2
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Multi-frame super-resolution microscopy is hampered by long acquisition times and phototoxicity, which hinder its use for live-cell imaging. Here, authors propose a deep-learning-based single-frame super-resolution approach to image cellular dynamics with high spatiotemporal resolution. Single-molecule localization microscopy (SMLM) can be used to resolve subcellular structures and achieve a tenfold improvement in spatial resolution compared to that obtained by conventional fluorescence microscopy. However, the separation of single-molecule fluorescence events that requires thousands of frames dramatically increases the image acquisition time and phototoxicity, impeding the observation of instantaneous intracellular dynamics. Here we develop a deep-learning based single-frame super-resolution microscopy (SFSRM) method which utilizes a subpixel edge map and a multicomponent optimization strategy to guide the neural network to reconstruct a super-resolution image from a single frame of a diffraction-limited image. Under a tolerable signal density and an affordable signal-to-noise ratio, SFSRM enables high-fidelity live-cell imaging with spatiotemporal resolutions of 30 nm and 10 ms, allowing for prolonged monitoring of subcellular dynamics such as interplays between mitochondria and endoplasmic reticulum, the vesicle transport along microtubules, and the endosome fusion and fission. Moreover, its adaptability to different microscopes and spectra makes it a useful tool for various imaging systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Deep learning advances super-resolution imaging
    Strack, Rita
    NATURE METHODS, 2018, 15 (06) : 403 - 403
  • [42] Deep learning advances super-resolution imaging
    Rita Strack
    Nature Methods, 2018, 15 : 403 - 403
  • [43] Deep Learning for Super-Resolution Biomedical Imaging
    Zhang, Hao
    Fei, Peng
    2018 IEEE 8TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER), 2018, : 435 - 439
  • [44] Deep-learning for super-resolution full-waveform LIDAR
    Liu, Gangping
    Ke, Jun
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VI, 2019, 11187
  • [45] Intracellular Dynamics of Bacterial Proteins Are Revealed by Super-resolution Microscopy
    Biteen, Julie S.
    BIOPHYSICAL JOURNAL, 2013, 105 (07) : 1547 - 1548
  • [46] Widefield light sheet microscopy using an Airy beam combined with deep-learning super-resolution
    Corsetti, Stella
    Wijesinghe, Philip
    Poulton, Persephone B.
    Sakata, Shuzo
    Vyas, Khushi
    Herrington, C. Simon
    Nylk, Jonathan
    Gasparoli, Federico
    Dholakia, Kishan
    OSA CONTINUUM, 2020, 3 (04): : 1068 - 1083
  • [47] Rating Super-Resolution Microscopy Images with Deep Learning
    Robitaille, Louis-Emile
    Durand, Audrey
    Gardner, Marc-Andre
    Gagne, Christian
    De Koninck, Paul
    Lavoie-Cardinal, Flavie
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 8141 - 8142
  • [48] Advances in Deep Learning for Super-Resolution Microscopy (Invited)
    Lu, Xinyi
    Yu, Huang
    Zhang, Zitong
    Wu, Tianxiao
    Wu, Hongjun
    Liu, Yongtao
    Zhong, Fang
    Chao, Zuo
    Qian, Chen
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (16)
  • [49] Super-resolution photoacoustic microscopy based on deep learning
    Wang, Zhuangzhuang
    Li, Sihang
    Song, Xianlin
    REAL-TIME IMAGE PROCESSING AND DEEP LEARNING 2021, 2021, 11736
  • [50] Super-Resolution Fluorescence Microscopy for Single Cell Imaging
    Feng, Han
    Wang, Xiaobo
    Xu, Zhiwei
    Zhang, Xiaoju
    Gao, Yongju
    SINGLE CELL BIOMEDICINE, 2018, 1068 : 59 - 71