Robust principal component analysis of electromagnetic arrays with missing data

被引:44
|
作者
Smirnov, M. Yu [1 ]
Egbert, G. D. [2 ]
机构
[1] Univ Oulu, Dept Phys, FIN-90570 Oulu, Finland
[2] Oregon State Univ, Coll Ocean & Atmospher Sci, Corvallis, OR 97330 USA
基金
芬兰科学院; 美国国家科学基金会;
关键词
Time series analysis; Magnetotelluric; Geomagnetic induction; ELECTRICAL-CONDUCTIVITY; MULTIVARIATE-ANALYSIS; OUTLIERS; MANTLE; EARTH;
D O I
10.1111/j.1365-246X.2012.05569.x
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
We describe a new algorithm for robust principal component analysis (PCA) of electromagnetic (EM) array data, extending previously developed multivariate methods to include arrays with large data gaps, and only partial overlap between site occupations. Our approach is based on a criss-cross regression scheme in which polarization parameters and spatial modes are alternately estimated with robust regression procedures. The basic scheme can be viewed as an expectation robust (ER) algorithm, of the sort that has been widely discussed in the statistical literature in the context of robust PCA, but with details of the scheme tailored to the physical specifics of EM array observations. We have tested our algorithm with synthetic and real data, including data denial experiments where we have created artificial gaps, and compared results obtained with full and incomplete data arrays. These tests reveal that for modest amounts of missing data (up to 20 per cent or so) the algorithm performs well, reproducing essentially the same dominant spatial modes that would be obtained from analysis of the complete array. The algorithm thus makes multivariate analysis practical for the first time for large heterogeneous arrays, as we illustrate by application to two different EM arrays.
引用
收藏
页码:1423 / 1438
页数:16
相关论文
共 50 条
  • [1] Robust Principal Component Analysis of Data with Missing Values
    Karkkainen, Tommi
    Saarela, Mirka
    [J]. MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, MLDM 2015, 2015, 9166 : 140 - 154
  • [2] Principal Component Analysis with Noisy and/or Missing Data
    Bailey, Stephen
    [J]. PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC, 2012, 124 (919) : 1015 - 1023
  • [3] RECONSTRUCTION OF MISSING DATA IN PRINCIPAL COMPONENT ANALYSIS
    CONDON, PE
    [J]. NUCLEAR INSTRUMENTS & METHODS, 1977, 146 (03): : 611 - 612
  • [4] Symbolic Missing Data Imputation in Principal Component Analysis
    Zuccolotto, Paola
    [J]. Statistical Analysis and Data Mining, 2011, 4 (02): : 171 - 183
  • [5] Principal component analysis of dissolution data with missing elements
    Adams, E
    Walczak, B
    Vervaet, C
    Risha, PG
    Massart, DL
    [J]. INTERNATIONAL JOURNAL OF PHARMACEUTICS, 2002, 234 (1-2) : 169 - 178
  • [6] Robust principal component analysis for functional data
    Peña, D
    Prieto, J
    [J]. TEST, 1999, 8 (01) : 56 - 60
  • [7] Robust principal component analysis for functional data
    N. Locantore
    J. S. Marron
    D. G. Simpson
    N. Tripoli
    J. T. Zhang
    K. L. Cohen
    Graciela Boente
    Ricardo Fraiman
    Babette Brumback
    Christophe Croux
    Jianqing Fan
    Alois Kneip
    John I. Marden
    Daniel Peña
    Javier Prieto
    Jim O. Ramsay
    Mariano J. Valderrama
    Ana M. Aguilera
    N. Locantore
    J. S. Marron
    D. G. Simpson
    N. Tripoli
    J. T. Zhang
    K. L. Cohen
    [J]. Test, 1999, 8 (1) : 1 - 73
  • [8] A Robust Incremental Principal Component Analysis for Feature Extraction from Stream Data with Missing Values
    Aoki, Daijiro
    Omori, Toshiaki
    Ozawa, Seiichi
    [J]. 2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [9] Missing data in principal component analysis of questionnaire data: a comparison of methods
    Van Ginkel, Joost R.
    Kroonenberg, Pieter M.
    Kiers, Henk A. L.
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2014, 84 (11) : 2298 - 2315
  • [10] Missing and Corrupted Data Recovery in Wireless Sensor Networks Based on Weighted Robust Principal Component Analysis
    He, Jingfei
    Li, Yunpei
    Zhang, Xiaoyue
    Li, Jianwei
    [J]. SENSORS, 2022, 22 (05)