Single-Step Preprocessing of Raman Spectra Using Convolutional Neural Networks

被引:47
|
作者
Wahl, Joel [1 ]
Sjodahl, Mikael [1 ]
Ramser, Kerstin [1 ]
机构
[1] Lulea Univ Technol, Dept Fluid & Expt Mech, Lulea, Sweden
基金
瑞典研究理事会;
关键词
Raman spectroscopy; convolutional neural network; CNN; preprocessing; simulated data; chemometrics; deep learning; BACKGROUND SUBTRACTION;
D O I
10.1177/0003702819888949
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Preprocessing of Raman spectra is generally done in three separate steps: (1) cosmic ray removal, (2) signal smoothing, and (3) baseline subtraction. We show that a convolutional neural network (CNN) can be trained using simulated data to handle all steps in one operation. First, synthetic spectra are created by randomly adding peaks, baseline, mixing of peaks and baseline with background noise, and cosmic rays. Second, a CNN is trained on synthetic spectra and known peaks. The results from preprocessing were generally of higher quality than what was achieved using a reference based on standardized methods (second-difference, asymmetric least squares, cross-validation). From 10(5) simulated observations, 91.4% predictions had smaller absolute error (RMSE), 90.3% had improved quality (SSIM), and 94.5% had reduced signal-to-noise (SNR) power. The CNN preprocessing generated reliable results on measured Raman spectra from polyethylene, paraffin and ethanol with background contamination from polystyrene. The result shows a promising proof of concept for the automated preprocessing of Raman spectra.
引用
收藏
页码:427 / 438
页数:12
相关论文
共 50 条
  • [1] Single convolutional neural network model for multiple preprocessing of Raman spectra
    Shen, Jiahao
    Li, Miao
    Li, Zhongfeng
    Zhang, Zhuoyong
    Zhang, Xin
    [J]. VIBRATIONAL SPECTROSCOPY, 2022, 121
  • [2] Classification of skin cancer using convolutional neural networks analysis of Raman spectra
    Bratchenko, Ivan A.
    Bratchenko, Lyudmila A.
    Khristoforova, Yulia A.
    Moryatov, Alexander A.
    V. Kozlo, Sergey
    Zakharo, Valery P.
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 219
  • [3] Cascaded Deep Convolutional Neural Networks as Improved Methods of Preprocessing Raman Spectroscopy Data
    Kazemzadeh, Mohammadrahim
    Martinez-Calderon, Miguel
    Xu, Weiliang
    Chamley, Lawrence W.
    Hisey, Colin L.
    Broderick, Neil G. R.
    [J]. ANALYTICAL CHEMISTRY, 2022, : 12907 - 12918
  • [4] Preprocessing for Image Classification by Convolutional Neural Networks
    Pal, Kuntal Kumar
    Sudeep, K. S.
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON RECENT TRENDS IN ELECTRONICS, INFORMATION & COMMUNICATION TECHNOLOGY (RTEICT), 2016, : 1778 - 1781
  • [5] Detecting and estimating the time of a single-step change in nonlinear profiles using artificial neural networks
    Ali Ghazizadeh
    Mehrdad Sarani
    Mahdi Hamid
    Ahmad Ghasemkhani
    [J]. International Journal of System Assurance Engineering and Management, 2023, 14 : 74 - 86
  • [6] Detecting and estimating the time of a single-step change in nonlinear profiles using artificial neural networks
    Ghazizadeh, Ali
    Sarani, Mehrdad
    Hamid, Mahdi
    Ghasemkhani, Ahmad
    [J]. INTERNATIONAL JOURNAL OF SYSTEM ASSURANCE ENGINEERING AND MANAGEMENT, 2023, 14 (01) : 74 - 86
  • [7] Overfitting One-Dimensional convolutional neural networks for Raman spectra identification
    Mozaffari, M. Hamed
    Tay, Li-Lin
    [J]. SPECTROCHIMICA ACTA PART A-MOLECULAR AND BIOMOLECULAR SPECTROSCOPY, 2022, 272
  • [8] THE EFFECT OF PREPROCESSING ON CONVOLUTIONAL NEURAL NETWORKS FOR MEDICAL IMAGE SEGMENTATION
    de Raad, K. B.
    van Garderen, K. A.
    Smits, M.
    van der Voort, S. R.
    Incekara, F.
    Oei, E. H. G.
    Hirvasniemi, J.
    Klein, S.
    Starmans, M. P. A.
    [J]. 2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 655 - 658
  • [9] The Effect of Mammogram Preprocessing on Microcalcification Detection with Convolutional Neural Networks
    Marchesi, Agnese
    Bria, Alessandro
    Marrocco, Claudio
    Molinara, Mario
    Mordang, Jan-Jurre
    Tortorella, Francesco
    Karssemeijer, Nico
    [J]. 2017 IEEE 30TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), 2017, : 207 - 212
  • [10] Convolutional neural network for preprocessing-free bacterial Spectra identification
    Kim, Younghoon
    Lee, Jiyoon
    Ahn, Gonie
    Santos, Ines C.
    Schug, Kevin A.
    Kim, Seoung Bum
    [J]. JOURNAL OF CHEMOMETRICS, 2020, 34 (11)