Optimal hypothesis testing for high dimensional covariance matrices

被引:79
|
作者
Cai, T. Tony [1 ]
Ma, Zongming [1 ]
机构
[1] Univ Penn, Wharton Sch, Dept Stat, Philadelphia, PA 19104 USA
关键词
correlation matrix; covariance matrix; high-dimensional data; likelihood ratio test; minimax hypothesis testing; power; testing covariance structure;
D O I
10.3150/12-BEJ455
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper considers testing a covariance matrix Sigma in the high dimensional setting where the dimension p can be comparable or much larger than the sample size n. The problem of testing the hypothesis H-0 : Sigma = Sigma(0) for a given covariance matrix Sigma(0) is studied from a minimax point of view. We first characterize the boundary that separates the testable region from the non-testable region by the Frobenius norm when the ratio between the dimension p over the sample size n is bounded. A test based on a U-statistic is introduced and is shown to be rate optimal over this asymptotic regime. Furthermore, it is shown that the power of this test uniformly dominates that of the corrected likelihood ratio test (CLRT) over the entire asymptotic regime under which the CLRT is applicable. The power of the U-statistic based test is also analyzed when p/n is unbounded.
引用
收藏
页码:2359 / 2388
页数:30
相关论文
共 50 条
  • [1] Hypothesis testing for high-dimensional covariance matrices
    Li, Weiming
    Qin, Yingli
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2014, 128 : 108 - 119
  • [2] Hypothesis testing for the identity of high-dimensional covariance matrices
    Qian, Manling
    Tao, Li
    Li, Erqian
    Tian, Maozai
    [J]. STATISTICS & PROBABILITY LETTERS, 2020, 161
  • [3] Power computation for hypothesis testing with high-dimensional covariance matrices
    Lin, Ruitao
    Liu, Zhongying
    Zheng, Shurong
    Yin, Guosheng
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2016, 104 : 10 - 23
  • [4] Testing linear hypothesis of high-dimensional means with unequal covariance matrices
    Cao, Mingxiang
    Liang, Shiting
    He, Daojiang
    Xu, Kai
    [J]. JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2022, 51 (02) : 526 - 541
  • [5] Testing linear hypothesis of high-dimensional means with unequal covariance matrices
    Mingxiang Cao
    Shiting Liang
    Daojiang He
    Kai Xu
    [J]. Journal of the Korean Statistical Society, 2022, 51 : 526 - 541
  • [6] HYPOTHESIS TESTING OF COMPLEX COVARIANCE MATRICES
    MILLER, KS
    ROCHWARGER, MM
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1976, 22 (01) : 26 - 33
  • [7] High-dimensional testing for proportional covariance matrices
    Tsukuda, Koji
    Matsuura, Shun
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2019, 171 : 412 - 420
  • [8] TESTING HOMOGENEITY OF HIGH-DIMENSIONAL COVARIANCE MATRICES
    Zheng, Shurong
    Lin, Ruitao
    Guo, Jianhua
    Yin, Guosheng
    [J]. STATISTICA SINICA, 2020, 30 (01) : 35 - 53
  • [9] On structure testing for component covariance matrices of a high dimensional mixture
    Li, Weiming
    Yao, Jianfeng
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2018, 80 (02) : 293 - 318
  • [10] Testing proportionality of two high-dimensional covariance matrices
    Cheng, Guanghui
    Liu, Baisen
    Tian, Guoliang
    Zheng, Shurong
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2020, 150