Hazards of digital smoothing filters as a preprocessing tool in multivariate calibration

被引:1
|
作者
Brown, CD [1 ]
Wentzell, PD [1 ]
机构
[1] Dalhousie Univ, Dept Chem, Trace Anal Res Ctr, Halifax, NS B3H 4J3, Canada
关键词
preprocessing; smoothing; Savitzky-Golay; digital filter; multivariate calibration; principal component regression; maximum likelihood principal component regression;
D O I
10.1002/(SICI)1099-128X(199903/04)13:2<133::AID-CEM533>3.3.CO;2-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The efficacy of smoothing first-order data as a preprocessing method for multivariate calibration is discussed. In particular, the use of symmetric smoothing filters (such as Savitzky-Golay filters) is examined from the perspective of calibration performance, in contrast with past studies based on univariate signal-to-noise improvement. It is shown mathematically that in the limit of a perfect calibration model (i.e. all the errors derive from the measurement uncertainty in the unknown sample), no gains in multivariate calibration performance can be made by the application of symmetric smoothing filters. The proof is corroborated by simulated multivariate calibration procedures, namely principal component regression (PCR). Real experimental data are also used, yielding similarly supportive evidence in favor of the theoretical result. On occasion, marginal performance enhancements (less than a factor of two) are observed in both the simulated and real data. The conditions under which these enhancements are likely to occur are discussed. The recently introduced multivariate calibration technique of maximum likelihood PCR (MLPCR) is also applied using the measurement error covariance information determined from the applied filter matrix. MLPCR is shown to be invariant in calibration performance, even under extreme filtering conditions. Copyright (C) 1999 John Wiley & Sons, Ltd.
引用
收藏
页码:133 / 152
页数:20
相关论文
共 50 条
  • [1] Hazards of digital smoothing filters as a preprocessing tool in multivariate calibration
    Trace Analysis Research Centre, Department of Chemistry, Dalhousie University, Halifax, NS B3H 4J3, Canada
    J. Chemometr., 2 (133-152):
  • [2] FAST ALGORITHMS FOR DIGITAL SMOOTHING FILTERS
    BUSH, IE
    ANALYTICAL CHEMISTRY, 1983, 55 (14) : 2353 - 2361
  • [3] THE INFLUENCE OF DATA PREPROCESSING ON THE ROBUSTNESS AND PARSIMONY OF MULTIVARIATE CALIBRATION MODELS
    DENOORD, OE
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 1994, 23 (01) : 65 - 70
  • [4] Derivative preprocessing and optimal corrections for baseline drift in multivariate calibration
    Brown, CD
    Vega-Montoto, L
    Wentzell, PD
    APPLIED SPECTROSCOPY, 2000, 54 (07) : 1055 - 1068
  • [5] PROPERTIES OF DIGITAL SMOOTHING POLYNOMIAL (DISPO) FILTERS
    ZIEGLER, H
    APPLIED SPECTROSCOPY, 1981, 35 (01) : 88 - 92
  • [6] Multidimensional digital smoothing filters for target detection
    Kennedy, Hugh L.
    SIGNAL PROCESSING, 2015, 114 : 251 - 264
  • [7] Performance evaluation of preprocessing techniques utilizing expert information in multivariate calibration
    Sharma, Sandeep
    Goodarzi, Mohammad
    Ramon, Herman
    Saeys, Wouter
    TALANTA, 2014, 121 : 105 - 112
  • [8] Ensemble preprocessing of near-infrared (NIR) spectra for multivariate calibration
    Xu, Lu
    Zhou, Yan-Ping
    Tang, Li-Juan
    Wu, Hai-Long
    Jiang, Jian-Hui
    Shen, Guo-Li
    Yu, Ru-Qin
    ANALYTICA CHIMICA ACTA, 2008, 616 (02) : 138 - 143
  • [9] ADAPTIVE FILTERS FOR DIGITAL IMAGE NOISE SMOOTHING - AN EVALUATION
    MASTIN, GA
    COMPUTER VISION GRAPHICS AND IMAGE PROCESSING, 1985, 31 (01): : 103 - 121
  • [10] EFFICIENT COMPUTATION OF POLYNOMIAL SMOOTHING DIGITAL-FILTERS
    BROMBA, MUA
    ZIEGLER, H
    ANALYTICAL CHEMISTRY, 1979, 51 (11) : 1760 - 1762