Maximum likelihood principal components regression on wavelet-compressed data

被引:10
|
作者
Leger, MN [1 ]
Wentzell, PD [1 ]
机构
[1] Dalhousie Univ, Dept Chem, Trace Anal Res Ctr, Halifax, NS B3H 4J3, Canada
关键词
maximum likelihood principal components regression; wavelet transforms; data compression; near-infrared spectroscopy; preprocessing; multivariate calibration;
D O I
10.1366/0003702041389382
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Maximum likelihood principal component regression (MLPCR) is an errors-in-variables method used to accommodate measurement error information when building multivariate calibration models. A hindrance of MLPCR has been the substantial demand on computational resources sometimes made by the algorithm, especially for certain types of error structures. Operations on these large matrices are memory intensive and time consuming, especially when techniques such as cross-validation are used. This work describes the use of wavelet transforms (WT) as a data compression method for MLPCR. It is shown that the error covariance matrix in the wavelet and spectral domains are related through a two-dimensional WT. This allows the user to account for any effects of the wavelet transform on spectral and error structures. The wavelet transform can be applied to MLPCR when using either the full error covariance matrix or the smaller pooled error covariance matrix. Simulated and experimental near-infrared data sets are used to demonstrate the benefits of using wavelets with the MLPCR algorithm. In all cases, significant compression can be obtained while maintaining favorable predictive ability. Considerable time savings were also attained, with improvements ranging from a factor of 2 to a factor of 720. Using the WT-compressed data in MLPCR gave a reduction in prediction errors compared to using the raw data in MLPCR. An analogous reduction in prediction errors was not always seen when using PCR.
引用
收藏
页码:855 / 862
页数:8
相关论文
共 50 条
  • [1] Restoration of wavelet-compressed images
    Robertson, MA
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2005, 14 (01) : 1 - 11
  • [2] Application of maximum likelihood principal components regression to fluorescence emission spectra
    Schreyer, SK
    Bidinosti, M
    Wentzell, PD
    [J]. APPLIED SPECTROSCOPY, 2002, 56 (06) : 789 - 796
  • [3] LAND CLASSIFICATION OF WAVELET-COMPRESSED FULL-WAVEFORM LIDAR DATA
    Laky, S.
    Zaletnyik, P.
    Toth, C.
    [J]. PCV 2010 - PHOTOGRAMMETRIC COMPUTER VISION AND IMAGE ANALYSIS, PT I, 2010, 38 : 115 - 119
  • [4] Wavelet-compressed representation of deep moist convection
    Yano, JI
    Bechtold, P
    Redelsperger, JL
    Guichard, F
    [J]. MONTHLY WEATHER REVIEW, 2004, 132 (06) : 1472 - 1486
  • [5] Temporal filtering of wavelet-compressed motion imagery
    Robertson, MA
    [J]. ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5, 2004, : 295 - 298
  • [6] MAXIMUM-LIKELIHOOD REGRESSION ON RELEVANT COMPONENTS
    HELLAND, IS
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1992, 54 (02): : 637 - 647
  • [7] Temporal filtering for restoration of wavelet-compressed motion imagery
    Robertson, MA
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2004, 19 (08) : 701 - 721
  • [8] Seamless multiresolution display of portable wavelet-compressed images
    Michael E. Hovanes
    John R. Grizz Deal
    Alan H. Rowberg
    [J]. Journal of Digital Imaging, 1999, 12 : 109 - 111
  • [9] CONSISTENCY OF RESTRICTED MAXIMUM LIKELIHOOD ESTIMATORS OF PRINCIPAL COMPONENTS
    Paul, Debashis
    Peng, Jie
    [J]. ANNALS OF STATISTICS, 2009, 37 (03): : 1229 - 1271
  • [10] Deep learning prediction of two-dimensional ocean dynamics with wavelet-compressed data
    Ali, Ali Muhamed
    Zhuang, Hanqi
    Ibrahim, Ali K.
    Wang, Justin L.
    Cherubin, Laurent M.
    [J]. FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2022, 5