OPLS methodology for analysis of pre-processing effects on spectroscopic data

被引:45
|
作者
Gabrielsson, Jon [1 ]
Jonsson, Hans
Airiau, Christian
Schmidt, Bernd
Escott, Richard
Trygg, Johan
机构
[1] Umea Univ, Res Grp Chemometr, SE-90187 Umea, Sweden
[2] GlaxoSmithKline Inc, Tonbridge, Kent, England
关键词
multi-block strategies; pre-processing; UV-data; OPLS; O2PLS; batch process;
D O I
10.1016/j.chemolab.2006.03.013
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Pre-processing of spectroscopic data is commonly applied to remove unwanted systematic variation. Possible loss of information and ambiguity regarding discarded variation are issues that complicate pre-treatment of data. In this paper, OPLS methodology is applied to evaluate different techniques for pre-processing of spectroscopic data gathered from a batch process. The objective is to present a rational scheme for analysis of preprocessing in order to understand the influence and effect of pre-treatment. O2PLS uses linear regression to divide the systematic variation in X and Y into three parts; one part with joint X-Y covariation, i.e. related to both X and Y, one part of X with Y-orthogonal variation and one part of Y with X-orthogonal variation. All of the investigated pre-treatment methods removed an additive baseline as expected. In the analysis of raw and differentiated data variation associated with the baseline was found in the Y-orthogonal part of X. Orthogonal information was also found in Y, which suggests that this preprocessing procedure not only removed variation. This would have been more difficult to detect without the O2PLS model since both raw and differentiated data must be analysed simultaneously. Development of a knowledge based strategy with OPLS methodology is an important step towards eliminating trial and error approaches to pre-processing. (c) 2006 Elsevier B.V. All rights reserved.
引用
收藏
页码:153 / 158
页数:6
相关论文
共 50 条
  • [31] Application of pre-processing of NIRS modeling data
    Wang Zhihong
    Lin Jun
    PROCEEDINGS OF THE FIRST INTERNATIONAL SYMPOSIUM ON TEST AUTOMATION & INSTRUMENTATION, VOLS 1 - 3, 2006, : 295 - 298
  • [32] Parallel Pre-processing of Affymetrix Microarray Data
    Guzzi, Pietro Hiram
    Cannataro, Mario
    EURO-PAR 2010 PARALLEL PROCESSING WORKSHOPS, 2011, 6586 : 225 - 232
  • [33] SumatraTT:: a generic data pre-processing system
    Aubrecht, P
    Miksovsky, P
    Král, L
    14TH INTERNATIONAL WORKSHOP ON DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS, 2003, : 120 - 124
  • [34] A study on data pre-processing in reverse engineering
    Liu Deping
    Shangguan Jianlin
    Chen Jianjun
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON MECHANICAL TRANSMISSIONS, VOLS 1 AND 2, 2006, : 1428 - 1432
  • [35] NanoStringNormCNV: pre-processing of NanoString CNV data
    Sendorek, Dorota H.
    Lalonde, Emilie
    Yao, Cindy Q.
    Sabelnykova, Veronica Y.
    Bristow, Robert G.
    Boutros, Paul C.
    BIOINFORMATICS, 2018, 34 (06) : 1034 - 1036
  • [36] Data Pre-processing from Production Processes for Analysis in Automotive Industry
    Simoncicova, Veronika
    Hrcka, Lukas
    Tadanai, Ondrej
    Tanuska, Pavol
    Vazan, Pavel
    CENTRAL EUROPEAN CONFERENCE ON INFORMATION AND INTELLIGENT SYSTEMS (CECIIS 2016), 2016, : 17 - 21
  • [37] Independent component analysis using random projection for data pre-processing
    Ansari, A., 1600, International Journal of Computer Science Issues (IJCSI) (09): : 3 - 3
  • [38] Data pre-processing for obstacle in automotive applications
    Wahl, M
    Georges, D
    Dang, M
    IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, 1997, : 409 - 414
  • [39] Data Pre-Processing of Inertial Measurement Unit Based on Abnormity Analysis
    Fan, Jinhua
    Song, Jianying
    Peng, Jie
    Guo, Xianfeng
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 1812 - 1816
  • [40] An intelligent data pre-processing of complex datasets
    Abdul-Rahman, Shuzlina
    Abu Bakar, Azuraliza
    Mohamed-Hussein, Zeti-Azura
    INTELLIGENT DATA ANALYSIS, 2012, 16 (02) : 305 - 325