Optimal hypothesis testing for high dimensional covariance matrices

被引:79
|
作者
Cai, T. Tony [1 ]
Ma, Zongming [1 ]
机构
[1] Univ Penn, Wharton Sch, Dept Stat, Philadelphia, PA 19104 USA
关键词
correlation matrix; covariance matrix; high-dimensional data; likelihood ratio test; minimax hypothesis testing; power; testing covariance structure;
D O I
10.3150/12-BEJ455
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper considers testing a covariance matrix Sigma in the high dimensional setting where the dimension p can be comparable or much larger than the sample size n. The problem of testing the hypothesis H-0 : Sigma = Sigma(0) for a given covariance matrix Sigma(0) is studied from a minimax point of view. We first characterize the boundary that separates the testable region from the non-testable region by the Frobenius norm when the ratio between the dimension p over the sample size n is bounded. A test based on a U-statistic is introduced and is shown to be rate optimal over this asymptotic regime. Furthermore, it is shown that the power of this test uniformly dominates that of the corrected likelihood ratio test (CLRT) over the entire asymptotic regime under which the CLRT is applicable. The power of the U-statistic based test is also analyzed when p/n is unbounded.
引用
收藏
页码:2359 / 2388
页数:30
相关论文
共 50 条
  • [41] A high dimensional nonparametric test for proportional covariance matrices
    Xu, Kai
    Tian, Yan
    He, Daojiang
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2021, 184
  • [42] Projected tests for high-dimensional covariance matrices
    Wu, Tung-Lung
    Li, Ping
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2020, 207 : 73 - 85
  • [43] Estimation of High Dimensional Covariance Matrices by Shrinkage Algorithms
    Li, Jianbo
    Zhou, Jie
    Zhang, Bin
    Li, X. Rong
    [J]. 2017 20TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2017, : 955 - 962
  • [44] Estimating High Dimensional Covariance Matrices and its Applications
    Bai, Jushan
    Shi, Shuzhong
    [J]. ANNALS OF ECONOMICS AND FINANCE, 2011, 12 (02): : 199 - 215
  • [45] Nearly Optimal Sample Size in Hypothesis Testing for High-Dimensional Regression
    Javanmard, Adel
    Montanari, Andrea
    [J]. 2013 51ST ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2013, : 1427 - 1434
  • [46] OPTIMAL ESTIMATES FOR COVARIANCE MATRICES
    SHAIKIN, ME
    [J]. AUTOMATION AND REMOTE CONTROL, 1973, 34 (01) : 53 - 60
  • [47] On testing for homogeneity of the covariance matrices
    Xiaoning Z.
    Ping J.
    Xiaoming J.
    [J]. Korean Journal of Computational and Applied Mathematics, 2001, 8 (2): : 269 - 278
  • [48] TESTING FOR EQUALITY OF COVARIANCE MATRICES
    GREENSTR.RL
    CONNOR, RJ
    [J]. BIOMETRICS, 1968, 24 (04) : 1033 - &
  • [49] TESTING PROPORTIONALITY OF COVARIANCE MATRICES
    FEDERER, WT
    [J]. ANNALS OF MATHEMATICAL STATISTICS, 1951, 22 (01): : 102 - 106
  • [50] On testing for homogeneity of the covariance matrices
    Xiaoning, Zhang
    Ping, Jing
    Xiaoming, Ji
    [J]. Journal of Applied Mathematics and Computing, 2001, 8 (02) : 269 - 278