Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning

被引:59
|
作者
Hagita, Katsumi [1 ]
Higuchi, Takeshi [2 ]
Jinnai, Hiroshi [2 ]
机构
[1] Natl Def Acad, Dept Appl Phys, Yokosuka, Kanagawa 2398686, Japan
[2] Tohoku Univ, Inst Multidisciplinary Res Adv Mat, Aoba Ku, 2-1-1 Katahira, Sendai, Miyagi 9808577, Japan
来源
SCIENTIFIC REPORTS | 2018年 / 8卷
关键词
ELECTRON TOMOGRAPHY; NEURAL-NETWORKS; SYSTEMS;
D O I
10.1038/s41598-018-24330-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano-and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resolution is governed by the SEM, while the depth resolution, i.e., the FIB milling direction, is determined by the thickness of the stripped thin layer. In most cases, the lateral resolution is superior to the depth resolution; hence, asymmetric resolution is generated in the 3D image. Here, we propose a new approach based on an image-processing or deep-learning-based method for super-resolution of 3D images with such asymmetric resolution, so as to restore the depth resolution to achieve symmetric resolution. The deep-learning-based method learns from high-resolution sub-images obtained via SEM and recovers low-resolution sub-images parallel to the FIB milling direction. The 3D morphologies of polymeric nano-composites are used as test images, which are subjected to the deep-learning-based method as well as conventional methods. We find that the former yields superior restoration, particularly as the asymmetric resolution is increased. Our super-resolution approach for images having asymmetric resolution enables observation time reduction.
引用
下载
收藏
页数:8
相关论文
共 50 条
  • [1] Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning
    Katsumi Hagita
    Takeshi Higuchi
    Hiroshi Jinnai
    Scientific Reports, 8
  • [2] 3D Appearance Super-Resolution with Deep Learning
    Li, Yawei
    Tsiminaki, Vagia
    Timofte, Radu
    Pollefeys, Marc
    van Gool, Luc
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9663 - 9672
  • [3] An optimized approach using cryofixation for high-resolution 3D analysis by FIB-SEM
    Guo, Jiansheng
    Wang, Guan
    Tang, Wen
    Song, Dandan
    Wang, Xinqiu
    Hong, Jian
    Zhang, Zhongkai
    JOURNAL OF STRUCTURAL BIOLOGY, 2020, 212 (01)
  • [4] 3D microscale modeling of NMC cathodes using multi-resolution FIB-SEM tomography
    Ghadban, Mohamad
    Sabharwal, Mayank
    Rea, Campbell
    Li, Xiaolin
    Goode, Angela E.
    Smith, Maciah
    Murphy, Carmen
    Secanell, Marc
    JOURNAL OF POWER SOURCES, 2023, 562
  • [5] FIB-SEM 3D Spectral Imaging for Materials Characterization
    Kotula, Paul G.
    MICROSCOPY AND MICROANALYSIS, 2009, 15 : 604 - 605
  • [6] Deep learning advances super-resolution imaging
    Rita Strack
    Nature Methods, 2018, 15 : 403 - 403
  • [7] Deep learning advances super-resolution imaging
    Strack, Rita
    NATURE METHODS, 2018, 15 (06) : 403 - 403
  • [8] Deep Learning for Super-Resolution Biomedical Imaging
    Zhang, Hao
    Fei, Peng
    2018 IEEE 8TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER), 2018, : 435 - 439
  • [9] 3D Super-Resolution Imaging of Unperturbed Cells
    Carr, Alexander R.
    McCol, James
    Santos, Ana M.
    Lee, Ji-Eun
    Ponjavic, Aleks
    Klenerman, Dave
    Davis, Simon
    Lee, Steven F.
    BIOPHYSICAL JOURNAL, 2016, 110 (03) : 485A - 485A
  • [10] Super-resolution 3D live cell imaging
    Vogt, Nina
    NATURE METHODS, 2021, 18 (03) : 232 - 232