Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

被引:43
|
作者
Chen, Rong [1 ]
Tang, Xiao [2 ]
Zhao, Yuxuan [3 ]
Shen, Zeyu [2 ]
Zhang, Meng [3 ]
Shen, Yusheng [2 ]
Li, Tiantian [2 ]
Chung, Casper Ho Yin [4 ]
Zhang, Lijuan [5 ]
Wang, Ji [4 ]
Cui, Binbin [1 ]
Fei, Peng [3 ]
Guo, Yusong [2 ]
Du, Shengwang [1 ,6 ,7 ]
Yao, Shuhuai [1 ,4 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Chem & Biol Engn, Hong Kong, Peoples R China
[2] Hong Kong Univ Sci & Technol, Div Life Sci, Hong Kong, Peoples R China
[3] Huazhong Univ Sci & Technol, Sch Opt & Elect Informat, Wuhan 430074, Peoples R China
[4] Hong Kong Univ Sci & Technol, Dept Mech & Aerosp Engn, Hong Kong, Peoples R China
[5] Guizhou Univ, Sch Pharmaceut Sci, Guiyang 550025, Guizhou, Peoples R China
[6] Hong Kong Univ Sci & Technol, Dept Phys, Hong Kong, Peoples R China
[7] Univ Texas Dallas, Dept Phys, Richardson, TX 75080 USA
关键词
LIVE-CELL; RESOLUTION LIMIT; TRANSPORT; RECONSTRUCTION; NANOSCOPY; VIRUS;
D O I
10.1038/s41467-023-38452-2
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Multi-frame super-resolution microscopy is hampered by long acquisition times and phototoxicity, which hinder its use for live-cell imaging. Here, authors propose a deep-learning-based single-frame super-resolution approach to image cellular dynamics with high spatiotemporal resolution. Single-molecule localization microscopy (SMLM) can be used to resolve subcellular structures and achieve a tenfold improvement in spatial resolution compared to that obtained by conventional fluorescence microscopy. However, the separation of single-molecule fluorescence events that requires thousands of frames dramatically increases the image acquisition time and phototoxicity, impeding the observation of instantaneous intracellular dynamics. Here we develop a deep-learning based single-frame super-resolution microscopy (SFSRM) method which utilizes a subpixel edge map and a multicomponent optimization strategy to guide the neural network to reconstruct a super-resolution image from a single frame of a diffraction-limited image. Under a tolerable signal density and an affordable signal-to-noise ratio, SFSRM enables high-fidelity live-cell imaging with spatiotemporal resolutions of 30 nm and 10 ms, allowing for prolonged monitoring of subcellular dynamics such as interplays between mitochondria and endoplasmic reticulum, the vesicle transport along microtubules, and the endosome fusion and fission. Moreover, its adaptability to different microscopes and spectra makes it a useful tool for various imaging systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging
    Rong Chen
    Xiao Tang
    Yuxuan Zhao
    Zeyu Shen
    Meng Zhang
    Yusheng Shen
    Tiantian Li
    Casper Ho Yin Chung
    Lijuan Zhang
    Ji Wang
    Binbin Cui
    Peng Fei
    Yusong Guo
    Shengwang Du
    Shuhuai Yao
    Nature Communications, 14
  • [2] Deep Learning Single-Frame and Multiframe Super-Resolution for Cardiac MRI
    Masutani, Evan M.
    Bahrami, Naeim
    Hsiao, Albert
    RADIOLOGY, 2020, 295 (03) : 552 - 561
  • [3] A LEARNING APPROACH FOR SINGLE-FRAME FACE SUPER-RESOLUTION
    He, Yu
    Yap, Kim-Hui
    Chau, Lap-Pui
    ISCAS: 2009 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-5, 2009, : 770 - 773
  • [4] Single-frame image super-resolution through contourlet learning
    Jiji, C. V.
    Chaudhuri, Subhasis
    EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2006, 2006 (1)
  • [5] Single-Frame Image Super-resolution through Contourlet Learning
    CV Jiji
    Subhasis Chaudhuri
    EURASIP Journal on Advances in Signal Processing, 2006
  • [6] A single-frame super-resolution innovative approach
    Torres-Mendez, Luz A.
    Ramirez-Sosa Moran, Marco I.
    Castelan, Mario
    MICAI 2007: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2007, 4827 : 640 - +
  • [7] Single-frame text super-resolution: A bayesian approach
    Dalley, G
    Freeman, B
    Marks, J
    ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5, 2004, : 3295 - 3298
  • [8] Development of Single-Frame Super-Resolution System LSI
    Yanase, Ryoji
    Isono, Hiroshi
    Azuhata, Hiroaki
    Kubota, Takeshi
    Komori, Hideki
    Matsuura, Yoshihiro
    NEC TECHNICAL JOURNAL, 2009, 4 (01): : 15 - 18
  • [9] Neighborhood issue in single-frame image super-resolution
    Su, K
    Tian, Q
    Xue, Q
    Sebe, N
    Ma, JS
    2005 IEEE International Conference on Multimedia and Expo (ICME), Vols 1 and 2, 2005, : 1123 - 1126
  • [10] Information Theoretic Limit of Single-Frame Super-Resolution
    Yamaguchi, Kotaro
    Kawakita, Masanori
    Takahashi, Norikazu
    Takeuchi, Jun'ichi
    2012 THIRD INTERNATIONAL CONFERENCE ON EMERGING SECURITY TECHNOLOGIES (EST), 2012, : 82 - 85