Noise2Atom: unsupervised denoising for scanning transmission electron microscopy images

被引:21
|
作者
Wang F. [1 ]
Henninen T.R. [1 ]
Keller D. [1 ]
Erni R. [1 ]
机构
[1] Electron Microscopy Center, Empa, Swiss Federal Laboratories for Materials Science and Technology, Überlandstr. 129, Dübendorf
基金
欧盟地平线“2020”; 欧洲研究理事会;
关键词
Deep learning; Denoising; STEM images; Unsupervised learning;
D O I
10.1186/s42649-020-00041-8
中图分类号
学科分类号
摘要
We propose an effective deep learning model to denoise scanning transmission electron microscopy (STEM) image series, named Noise2Atom, to map images from a source domain S to a target domain C, where S is for our noisy experimental dataset, and C is for the desired clear atomic images. Noise2Atom uses two external networks to apply additional constraints from the domain knowledge. This model requires no signal prior, no noise model estimation, and no paired training images. The only assumption is that the inputs are acquired with identical experimental configurations. To evaluate the restoration performance of our model, as it is impossible to obtain ground truth for our experimental dataset, we propose consecutive structural similarity (CSS) for image quality assessment, based on the fact that the structures remain much the same as the previous frame(s) within small scan intervals. We demonstrate the superiority of our model by providing evaluation in terms of CSS and visual quality on different experimental datasets. © 2020, The Author(s).
引用
收藏
相关论文
共 50 条
  • [1] Unsupervised deep denoising for four-dimensional scanning transmission electron microscopy
    Sadri, Alireza
    Petersen, Timothy C.
    Terzoudis-Lumsden, Emmanuel W. C.
    Esser, Bryan D.
    Etheridge, Joanne
    Findlay, Scott D.
    NPJ COMPUTATIONAL MATERIALS, 2024, 10 (01)
  • [2] Atom-by-atom chemical identification from scanning transmission electron microscopy images in presence of noise and residual aberrations
    Hofer, Christoph
    Skakalova, Viera
    Haas, Jonas
    Wang, Xiao
    Braun, Kai
    Pennington, Robert S.
    Meyer, Jannik C.
    ULTRAMICROSCOPY, 2021, 227
  • [3] Joint denoising and distortion correction of atomic scale scanning transmission electron microscopy images
    Berkels, Benjamin
    Wirth, Benedikt
    INVERSE PROBLEMS, 2017, 33 (09)
  • [4] Standardless Atom Counting in Scanning Transmission Electron Microscopy
    LeBeau, James M.
    Findlay, Scott D.
    Allen, Leslie J.
    Stemmer, Susanne
    NANO LETTERS, 2010, 10 (11) : 4405 - 4408
  • [5] Denoising of Transmission Electron Microscopy Images for Atomic Defect Identification
    Zhang, Shiyi
    Zhang, Qing
    Ran, Xu
    Wu, Xing
    Wang, Yan
    Wang, Chaolun
    2024 IEEE INTERNATIONAL SYMPOSIUM ON THE PHYSICAL AND FAILURE ANALYSIS OF INTEGRATED CIRCUITS, IPFA 2024, 2024,
  • [6] Noise2Void: unsupervised denoising of PET images
    Song, Tzu-An
    Yang, Fan
    Dutta, Joyita
    PHYSICS IN MEDICINE AND BIOLOGY, 2021, 66 (21):
  • [7] Deconvolution of scanning transmission electron microscopy images of ionomers
    Kirkmeyer, BP
    Puetter, RC
    Yahil, A
    Winey, KI
    JOURNAL OF POLYMER SCIENCE PART B-POLYMER PHYSICS, 2003, 41 (04) : 319 - 326
  • [8] Unsupervised denoising of photoacoustic images based on the Noise2Noise network
    Cheng, Yanda
    Zheng, Wenhan
    Bing, Robert
    Zhang, Huijuan
    Huang, Chuqin
    Huang, Peizhou
    Ying, Leslie
    Xia, Jun
    BIOMEDICAL OPTICS EXPRESS, 2024, 15 (08): : 4390 - 4405
  • [9] Single-atom dynamics in scanning transmission electron microscopy
    Mishra, Rohan
    Ishikawa, Ryo
    Lupini, Andrew R.
    Pennycook, Stephen J.
    MRS BULLETIN, 2017, 42 (09) : 644 - 652
  • [10] Single-atom dynamics in scanning transmission electron microscopy
    Rohan Mishra
    Ryo Ishikawa
    Andrew R. Lupini
    Stephen J. Pennycook
    MRS Bulletin, 2017, 42 : 644 - 652