Correction of AFM data artifacts using a convolutional neural network trained with synthetically generated data

被引:4
|
作者
Kocur, Viktor [1 ,3 ]
Hegrova, Veronika [2 ]
Patocka, Marek [2 ,4 ]
Neuman, Jan [2 ]
Herout, Adam [1 ]
机构
[1] Brno Univ Technol, Graph FIT, Bozetechova 2, Brno 61200, Czech Republic
[2] NenoVision, Purkynova 649-127, Brno 61200, Czech Republic
[3] Comenius Univ, Fac Math Phys & Informat, Bratislava 84248, Slovakia
[4] Brno Univ Technol, Fac Mech Engn, Tech 2896-2, Brno 61669, Czech Republic
关键词
Atomic force microscopy; Reconstruction by CNN; Machine learning for atomic force microscopy; Automatic image correction; Synthetic training data generation;
D O I
10.1016/j.ultramic.2022.113666
中图分类号
TH742 [显微镜];
学科分类号
摘要
AFM microscopy from its nature produces outputs with certain distortions, inaccuracies and errors given by its physical principle. These distortions are more or less well studied and documented. Based on the nature of the individual distortions, different reconstruction and compensation filters have been developed to post-process the scanned images. This article presents an approach based on machine learning - the involved convolutional neural network learns from pairs of distorted images and the ground truth image and then it is able to process pairs of images of interest and produce a filtered image with the artifacts removed or at least suppressed.What is important in our approach is that the neural network is trained purely on synthetic data generated by a simulator of the inputs, based on an analytical description of the physical phenomena causing the distortions. The generator produces training samples involving various combinations of the distortions. The resulting trained network seems to be able to autonomously recognize the distortions present in the testing image (no knowledge of the distortions or any other human knowledge is provided at the test time) and apply the appropriate corrections. The experimental results show that not only is the new approach better or at least on par with conventional post-processing methods, but more importantly, it does not require any operator's input and works completely autonomously. The source codes of the training set generator and of the convolutional neural net model are made public, as well as an evaluation dataset of real captured AFM images.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Drone Model Classification Using Convolutional Neural Network Trained on Synthetic Data
    Wisniewski, Mariusz
    Rana, Zeeshan A.
    Petrunin, Ivan
    [J]. JOURNAL OF IMAGING, 2022, 8 (08)
  • [2] Fish species identification using a convolutional neural network trained on synthetic data
    Allken, Vaneeda
    Handegard, Nils Olav
    Rosen, Shale
    Schreyeck, Tiffanie
    Mahiout, Thomas
    Malde, Ketil
    [J]. ICES JOURNAL OF MARINE SCIENCE, 2019, 76 (01) : 342 - 349
  • [3] Can Segmentation Models Be Trained with Fully Synthetically Generated Data?
    Fernandez, Virginia
    Pinaya, Walter Hugo Lopez
    Borges, Pedro
    Tudosiu, Petru-Daniel
    Graham, Mark S.
    Vercauteren, Tom
    Cardoso, M. Jorge
    [J]. SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2022, 2022, 13570 : 79 - 90
  • [4] Convolutional Neural Network Using Generated Data for SAR ATR with Limited Samples
    Cong, Longjian
    Gao, Lei
    Zhang, Hui
    Sun, Peng
    [J]. MIPPR 2017: PATTERN RECOGNITION AND COMPUTER VISION, 2017, 10609
  • [5] Correction of Motion Artifacts Using a Multiscale Fully Convolutional Neural Network
    Sommer, K.
    Saalbach, A.
    Brosch, T.
    Hall, C.
    Cross, N. M.
    Andre, J. B.
    [J]. AMERICAN JOURNAL OF NEURORADIOLOGY, 2020, 41 (03) : 416 - 423
  • [6] Using a synthetic data trained convolutional neural network for predicting subresolution thin layers from seismic data
    Qu, Dongfang
    Mosegaard, Klaus
    Feng, Runhai
    Nielsen, Lars
    [J]. INTERPRETATION-A JOURNAL OF SUBSURFACE CHARACTERIZATION, 2023, 11 (02): : T339 - T347
  • [7] Evaluation of Traffic Sign Recognition Methods Trained on Synthetically Generated Data
    Moiseev, Boris
    Konev, Artem
    Chigorin, Alexander
    Konushin, Anton
    [J]. ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, ACIVS 2013, 2013, 8192 : 576 - 583
  • [8] Wheat ear detection using neural networks and synthetically generated training data
    Lucks, Lukas
    Harake, Laura
    Klingbeil, Lasse
    [J]. TM-TECHNISCHES MESSEN, 2021, 88 (7-8) : 433 - 442
  • [9] Correction of out-of-FOV motion artifacts using convolutional neural network
    Wang, Chengyan
    Liang, Yucheng
    Wu, Yuan
    Zhao, Siwei
    Du, Yiping P.
    [J]. MAGNETIC RESONANCE IMAGING, 2020, 71 : 93 - 102
  • [10] Localizing microseismic events on field data using a U-Net-based convolutional neural network trained on synthetic data
    Vinard, N. A.
    Drijkoningen, G. G.
    Verschuur, D. J.
    [J]. GEOPHYSICS, 2022, 87 (02) : KS33 - KS43