Random matrix improved covariance estimation for a large class of metrics*

被引:1
|
作者
Tiomoko, Malik [1 ,2 ]
Bouchard, Florent [3 ]
Ginolhac, Guillaume [3 ]
Couillet, Romain [1 ,2 ]
机构
[1] Univ ParisSaclay, Cent Supelec, Gif Sur Yvette, France
[2] Univ Grenoble Alpes, GIPSA Lab, Grenoble, France
[3] Univ Savoie Mt Blanc, LISTIC, Chambery, France
关键词
machine learning; SPECTRUM ESTIMATION; OPTIMIZATION; EIGENVALUES; ALGORITHMS; SUBSPACE;
D O I
10.1088/1742-5468/abcaf2
中图分类号
O3 [力学];
学科分类号
08 ; 0801 ;
摘要
Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation method for a wide family of metrics. This method is shown to largely outperform the sample covariance matrix estimate and to compete with state-of-the-art methods, while at the same time being computationally simpler and faster. Applications to linear and quadratic discriminant analyses also show significant gains, therefore suggesting a practical relevance for statistical machine learning.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Random Matrix Improved Covariance Estimation for a Large Class of Metrics
    Tiomoko, Malik
    Bouchard, Florent
    Ginolhac, Guillaume
    Couillet, Romain
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [2] Random matrix-improved estimation of covariance matrix distances
    Couillet, Romain
    Tiomoko, Malik
    Zozor, Steeve
    Moisan, Eric
    JOURNAL OF MULTIVARIATE ANALYSIS, 2019, 174
  • [3] An improved banded estimation for large covariance matrix
    Yang, Wenyu
    Kang, Xiaoning
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2023, 52 (01) : 141 - 155
  • [4] Improved estimation of the logarithm of the covariance matrix
    Mestre, Xavier
    Rubio, Francisco
    Vallet, Pascal
    2012 IEEE 7TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2012, : 377 - 380
  • [5] SPECTRUM ESTIMATION FOR LARGE DIMENSIONAL COVARIANCE MATRICES USING RANDOM MATRIX THEORY
    El Karoui, Noureddine
    ANNALS OF STATISTICS, 2008, 36 (06): : 2757 - 2790
  • [6] On a Class of Shrinkage Priors for Covariance Matrix Estimation
    Wang, Hao
    Pillai, Natesh S.
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2013, 22 (03) : 689 - 707
  • [7] IMPROVED ESTIMATION OF A PATTERNED COVARIANCE-MATRIX
    DEY, DK
    GELFAND, AE
    JOURNAL OF MULTIVARIATE ANALYSIS, 1989, 31 (01) : 107 - 116
  • [8] Improved estimation of a covariance matrix in an elliptically contoured matrix distribution
    Leung, PL
    Ng, FY
    JOURNAL OF MULTIVARIATE ANALYSIS, 2004, 88 (01) : 131 - 137
  • [9] ESTIMATION OF RESOLUTION AND COVARIANCE FOR LARGE MATRIX INVERSIONS
    ZHANG, J
    MCMECHAN, GA
    GEOPHYSICAL JOURNAL INTERNATIONAL, 1995, 121 (02) : 409 - 426
  • [10] Estimation of the covariance matrix of random effects in longitudinal studies
    Sun, Yan
    Zhang, Wenyang
    Tong, Howell
    ANNALS OF STATISTICS, 2007, 35 (06): : 2795 - 2814