CONSISTENCY OF AIC AND BIC IN ESTIMATING THE NUMBER OF SIGNIFICANT COMPONENTS IN HIGH-DIMENSIONAL PRINCIPAL COMPONENT ANALYSIS

被引:29
|
作者
Bai, Zhidong [1 ,2 ]
Choi, Kwok Pui [3 ]
Fujikoshi, Yasunori [4 ]
机构
[1] Northeast Normal Univ, KLAS MOE, Changchun 130024, Jilin, Peoples R China
[2] Northeast Normal Univ, Sch Math & Stat, Changchun 130024, Jilin, Peoples R China
[3] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore 117546, Singapore
[4] Hiroshima Univ, Grad Sch Sci, Dept Math, Hiroshima 7398526, Japan
来源
ANNALS OF STATISTICS | 2018年 / 46卷 / 03期
关键词
AIC; BIC; consistency; dimensionality; high-dimensional framework; number of significant components; principal component analysis; random matrix theory; signal processing; spiked model; SMALLEST EIGENVALUES; COVARIANCE-MATRIX; MODEL SELECTION; LINEAR-MODEL; CRITERIA; REGRESSION; EQUALITY;
D O I
10.1214/17-AOS1577
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper, we study the problem of estimating the number of significant components in principal component analysis (PCA), which corresponds to the number of dominant eigenvalues of the covariance matrix of p variables. Our purpose is to examine the consistency of the estimation criteria AIC and BIC based on the model selection criteria by Akaike [In 2nd International Symposium on Information Theory (1973) 267-281, Akademia Kiado] and Schwarz [Estimating the dimension of a model 6 (1978) 461464] under a high-dimensional asymptotic framework. Using random matrix theory techniques, we derive sufficient conditions for the criterion to be strongly consistent for the case when the dominant population eigenvalues are bounded, and when the dominant eigenvalues tend to infinity. Moreover, the asymptotic results are obtained without normality assumption on the population distribution. Simulation studies are also conducted, and results show that the sufficient conditions in our theorems are essential.
引用
收藏
页码:1050 / 1076
页数:27
相关论文
共 50 条
  • [1] Variance Variation Criterion and Consistency in Estimating the Number of Significant Signals of High-dimensional PCA
    Wang, Guan-peng
    Cui, Heng-jian
    [J]. ACTA MATHEMATICAE APPLICATAE SINICA-ENGLISH SERIES, 2022, 38 (03): : 513 - 531
  • [2] Variance Variation Criterion and Consistency in Estimating the Number of Significant Signals of High-dimensional PCA
    Guan-peng Wang
    Heng-jian Cui
    [J]. Acta Mathematicae Applicatae Sinica, English Series, 2022, 38 : 513 - 531
  • [3] On principal component analysis for high-dimensional XCSR
    Behdad, Mohammad
    French, Tim
    Barone, Luigi
    Bennamoun, Mohammed
    [J]. EVOLUTIONARY INTELLIGENCE, 2012, 5 (02) : 129 - 138
  • [4] On principal component analysis for high-dimensional XCSR
    Mohammad Behdad
    Tim French
    Luigi Barone
    Mohammed Bennamoun
    [J]. Evolutionary Intelligence, 2012, 5 (2) : 129 - 138
  • [5] Asymptotics of AIC, BIC and Cp model selection rules in high-dimensional regression
    Bai, Zhidong
    Choi, Kwok Pui
    Fujikoshi, Yasunori
    Hu, Jiang
    [J]. BERNOULLI, 2022, 28 (04) : 2375 - 2403
  • [6] Principal component analysis for sparse high-dimensional data
    Raiko, Tapani
    Ilin, Alexander
    Karhunen, Juha
    [J]. NEURAL INFORMATION PROCESSING, PART I, 2008, 4984 : 566 - 575
  • [7] High-dimensional principal component analysis with heterogeneous missingness
    Zhu, Ziwei
    Wang, Tengyao
    Samworth, Richard J.
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2022, 84 (05) : 2000 - 2031
  • [8] PRINCIPAL COMPONENT ANALYSIS IN VERY HIGH-DIMENSIONAL SPACES
    Lee, Young Kyung
    Lee, Eun Ryung
    Park, Byeong U.
    [J]. STATISTICA SINICA, 2012, 22 (03) : 933 - 956
  • [9] Test for high-dimensional outliers with principal component analysis
    Nakayama, Yugo
    Yata, Kazuyoshi
    Aoshima, Makoto
    [J]. JAPANESE JOURNAL OF STATISTICS AND DATA SCIENCE, 2024,
  • [10] Forecasting High-Dimensional Covariance Matrices Using High-Dimensional Principal Component Analysis
    Shigemoto, Hideto
    Morimoto, Takayuki
    [J]. AXIOMS, 2022, 11 (12)