Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

被引:43
|
作者
Chen, Rong [1 ]
Tang, Xiao [2 ]
Zhao, Yuxuan [3 ]
Shen, Zeyu [2 ]
Zhang, Meng [3 ]
Shen, Yusheng [2 ]
Li, Tiantian [2 ]
Chung, Casper Ho Yin [4 ]
Zhang, Lijuan [5 ]
Wang, Ji [4 ]
Cui, Binbin [1 ]
Fei, Peng [3 ]
Guo, Yusong [2 ]
Du, Shengwang [1 ,6 ,7 ]
Yao, Shuhuai [1 ,4 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Chem & Biol Engn, Hong Kong, Peoples R China
[2] Hong Kong Univ Sci & Technol, Div Life Sci, Hong Kong, Peoples R China
[3] Huazhong Univ Sci & Technol, Sch Opt & Elect Informat, Wuhan 430074, Peoples R China
[4] Hong Kong Univ Sci & Technol, Dept Mech & Aerosp Engn, Hong Kong, Peoples R China
[5] Guizhou Univ, Sch Pharmaceut Sci, Guiyang 550025, Guizhou, Peoples R China
[6] Hong Kong Univ Sci & Technol, Dept Phys, Hong Kong, Peoples R China
[7] Univ Texas Dallas, Dept Phys, Richardson, TX 75080 USA
关键词
LIVE-CELL; RESOLUTION LIMIT; TRANSPORT; RECONSTRUCTION; NANOSCOPY; VIRUS;
D O I
10.1038/s41467-023-38452-2
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Multi-frame super-resolution microscopy is hampered by long acquisition times and phototoxicity, which hinder its use for live-cell imaging. Here, authors propose a deep-learning-based single-frame super-resolution approach to image cellular dynamics with high spatiotemporal resolution. Single-molecule localization microscopy (SMLM) can be used to resolve subcellular structures and achieve a tenfold improvement in spatial resolution compared to that obtained by conventional fluorescence microscopy. However, the separation of single-molecule fluorescence events that requires thousands of frames dramatically increases the image acquisition time and phototoxicity, impeding the observation of instantaneous intracellular dynamics. Here we develop a deep-learning based single-frame super-resolution microscopy (SFSRM) method which utilizes a subpixel edge map and a multicomponent optimization strategy to guide the neural network to reconstruct a super-resolution image from a single frame of a diffraction-limited image. Under a tolerable signal density and an affordable signal-to-noise ratio, SFSRM enables high-fidelity live-cell imaging with spatiotemporal resolutions of 30 nm and 10 ms, allowing for prolonged monitoring of subcellular dynamics such as interplays between mitochondria and endoplasmic reticulum, the vesicle transport along microtubules, and the endosome fusion and fission. Moreover, its adaptability to different microscopes and spectra makes it a useful tool for various imaging systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Forest Single-Frame Remote Sensing Image Super-Resolution Using GANs
    Zhao, Yafeng
    Zhang, Shuai
    Hu, Junfeng
    FORESTS, 2023, 14 (11):
  • [32] MAP-based single-frame super-resolution reconstruction for character image
    Li, Zhan
    Chen, Qing-Liang
    Peng, Qing-Yu
    Zhang, Qing-Feng
    Li, Wei-Xiang
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2015, 43 (01): : 191 - 197
  • [33] Example Based Single-frame Image Super-resolution by Support Vector Regression
    Li, Dalong
    Simske, Steven
    JOURNAL OF PATTERN RECOGNITION RESEARCH, 2010, 5 (01): : 104 - 118
  • [34] SINGLE-FRAME SUPER-RESOLUTION OF REAL-WORLD SPACEBORNE HYPERSPECTRAL DATA
    Mishra, Kavach
    Garg, Rahul Dev
    2022 12TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2022,
  • [35] Single-Frame Image Super-Resolution based on Singular Square Matrix Operator
    Rashkevych, Yurii
    Peleshko, Dmytro
    Vynokurova, Olena
    Izonin, Ivan
    Lotoshynska, Natalia
    2017 IEEE FIRST UKRAINE CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (UKRCON), 2017, : 944 - 948
  • [36] Single-frame Super Resolution Image Embedding
    Sahu, Indu
    Dewangan, Ashish
    2015 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, SIGNALS, COMMUNICATION AND OPTIMIZATION (EESCO), 2015,
  • [37] Deep-STORM: super-resolution single-molecule microscopy by deep learning
    Nehme, Elias
    Weiss, Lucien E.
    Michaeli, Tomer
    Shechtman, Yoav
    OPTICA, 2018, 5 (04): : 458 - 464
  • [38] Intracellular dynamics of the Sigma-1 receptor observed with super-resolution imaging microscopy
    Kopanchuk, Sergei
    Vavers, Edijs
    Veiksina, Santa
    Ligi, Kadri
    Zvejniece, Liga
    Dambrova, Maija
    Rinken, Ago
    PLOS ONE, 2022, 17 (05):
  • [39] Registration-free 3D super-resolution generative deep-learning network for fluorescence microscopy imaging
    Zhou, Hang
    Li, Yuxin
    Chen, Bolun
    Yang, Hao
    Zou, Maoyang
    Wen, Wu
    Ma, Yayu
    Chen, Min
    OPTICS LETTERS, 2023, 48 (23) : 6300 - 6303
  • [40] Single-frame super-resolution for high resolution optical remote-sensing data products
    Wang, Chao
    Zhu Ruifei
    Bai, Yang
    Zhang, Peng
    Fan, Haiyang
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (21) : 8099 - 8123