Multi-Population Elitists Shared Genetic Algorithm for Outlier Detection of Spectroscopy Analysis

被引:2
|
作者
Cao Hui [2 ]
Zhou Yan [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Energy & Power Engn, Xian 710049, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Elect Engn, Xian 710049, Peoples R China
关键词
Outlier detection of spectroscopy analysis; Genetic algorithm; Multi-population; Elitists shared;
D O I
10.3964/j.issn.1000-0593(2011)07-1847-05
中图分类号
O433 [光谱学];
学科分类号
0703 ; 070302 ;
摘要
The present paper proposed an outlier detection method for spectral analysis based on multi-population elitists shared genetic algorithm. The method was exploited in the NIR data set analysis to remove the outliers from the data set, and partial least squares (PLS) was combined with the proposed method to build a prediction model. In contrast with Monte Carlo cross validation, leave-one-out cross validation, Mahalanobis-distance and traditional genetic algorithm for outlier detection, the prediction residual error sum of squares (PRESS) for moisture prediction model based on the proposed method decreases in the rate of 72.4%, 39.5%, 39.5% and 14.5%; the PRESS value for fat prediction model decreases in the rate of 86.2%, 75.9%, 84.9% and 19.9%; and the PRESS value for protein prediction model decreases in the rate of 56.5%, 35.7%, 35.7% and 18.2% respectively. Results indicated that the method is applicable for spectral outlier detection for different species, and the model based on the data set without the removed outliers is more accurate and robust.
引用
收藏
页码:1847 / 1851
页数:5
相关论文
共 13 条
  • [1] Bao X, 2009, ACTA CHIM SINICA, V67, P1081
  • [2] Detecting influential observations by cluster analysis and Monte Carlo cross-validation
    Bian, Xihui
    Cai, Wensheng
    Shao, Xueguang
    Chen, Da
    Grant, Edward R.
    [J]. ANALYST, 2010, 135 (11) : 2841 - 2847
  • [3] OPTIMAL MINIMAL NEURAL INTERPRETATION OF SPECTRA
    BORGGAARD, C
    THODBERG, HH
    [J]. ANALYTICAL CHEMISTRY, 1992, 64 (05) : 545 - 551
  • [4] A strategy for enhancing the reliability of near-infrared spectral analysis
    Chen, Da
    Cai, Wensheng
    Shao, Xueguang
    [J]. VIBRATIONAL SPECTROSCOPY, 2008, 47 (02) : 113 - 118
  • [5] Hydrocarbon Group Analysis of Gasoline by Raman Spectroscopy with Outlier Detection
    Dan Tu-nan
    Dai Lian-kui
    [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2010, 30 (04) : 979 - 983
  • [6] Detection of adulteration of extra-virgin olive oil by chemometric analysis of mid-infrared spectral data
    Gurdeniz, Gozde
    Ozen, Banu
    [J]. FOOD CHEMISTRY, 2009, 116 (02) : 519 - 525
  • [7] Research of multi-population agent genetic algorithm for feature selection
    Li, Yongming
    Zhang, Sujuan
    Zeng, Xiaoping
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (09) : 11570 - 11581
  • [8] Outlier detection in near-infrared spectroscopic analysis by using Monte Carlo cross-validation
    Liu ZhiChao
    Cai WenSheng
    Shao XueGuang
    [J]. SCIENCE IN CHINA SERIES B-CHEMISTRY, 2008, 51 (08): : 751 - 759
  • [9] Lü JF, 2007, CHINESE J ANAL CHEM, V35, P340
  • [10] Simultaneous variable selection and outlier detection using a robust genetic algorithm
    Wiegand, Patrick
    Pell, Randy
    Comas, Enric
    [J]. CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2009, 98 (02) : 108 - 114