Ultra high-dimensional multivariate posterior contraction rate under shrinkage priors

被引:2
|
作者
Zhang, Ruoyang [1 ]
Ghosh, Malay [1 ]
机构
[1] Univ Florida, Dept Stat, Gainesville, FL 32611 USA
关键词
Gaussian scale mixture; Multivariate regression; Unknown covariance matrix; BAYESIAN VARIABLE SELECTION; LINEAR-REGRESSION; HORSESHOE ESTIMATOR; GROUP LASSO; SPARSE; CONSISTENCY; REDUCTION;
D O I
10.1016/j.jmva.2021.104835
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In recent years, shrinkage priors have received much attention in high-dimensional data analysis from a Bayesian perspective. Compared with widely used spike-and-slab priors, shrinkage priors have better computational efficiency. But the theoretical properties, especially posterior contraction rate, which is important in uncertainty quantification, are not established in many cases. In this paper, we apply global-local shrinkage priors to high-dimensional multivariate linear regression with unknown covariance matrix. We show that when the prior is highly concentrated near zero and has heavy tail, the posterior contraction rates for both coefficients matrix and covariance matrix are nearly optimal. Our results hold when number of features p grows much faster than the sample size n, which is of great interest in modern data analysis. We show that a class of readily implementable scale mixture of normal priors satisfies the conditions of the main theorem. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] A High-Dimensional Test for Multivariate Analysis of Variance Under a Low-Dimensional Factor Structure
    Cao, Mingxiang
    Zhao, Yanling
    Xu, Kai
    He, Daojiang
    Huang, Xudong
    COMMUNICATIONS IN MATHEMATICS AND STATISTICS, 2022, 10 (04) : 581 - 597
  • [32] Compatible priors for model selection of high-dimensional Gaussian DAGs
    Peluso, Stefano
    Consonni, Guido
    ELECTRONIC JOURNAL OF STATISTICS, 2020, 14 (02): : 4110 - 4132
  • [33] Variational Bayes for High-Dimensional Linear Regression With Sparse Priors
    Ray, Kolyan
    Szabo, Botond
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2022, 117 (539) : 1270 - 1281
  • [34] Nearly optimal Bayesian shrinkage for high-dimensional regression
    Qifan Song
    Faming Liang
    ScienceChina(Mathematics), 2023, 66 (02) : 409 - 442
  • [35] Optimal shrinkage estimator for high-dimensional mean vector
    Bodnar, Taras
    Okhrin, Ostap
    Parolya, Nestor
    JOURNAL OF MULTIVARIATE ANALYSIS, 2019, 170 : 63 - 79
  • [36] THE SPARSE LAPLACIAN SHRINKAGE ESTIMATOR FOR HIGH-DIMENSIONAL REGRESSION
    Huang, Jian
    Ma, Shuangge
    Li, Hongzhe
    Zhang, Cun-Hui
    ANNALS OF STATISTICS, 2011, 39 (04): : 2021 - 2046
  • [37] Shrinkage and Sparse Estimation for High-Dimensional Linear Models
    Asl, M. Noori
    Bevrani, H.
    Belaghi, R. Arabi
    Ahmed, Syed Ejaz
    PROCEEDINGS OF THE THIRTEENTH INTERNATIONAL CONFERENCE ON MANAGEMENT SCIENCE AND ENGINEERING MANAGEMENT, VOL 1, 2020, 1001 : 147 - 156
  • [38] Empirical priors for prediction in sparse high-dimensional linear regression
    Martin, Ryan
    Tang, Yiqi
    Journal of Machine Learning Research, 2020, 21
  • [39] Matrix means and a novel high-dimensional shrinkage phenomenon
    Lodhia, Asad
    Levin, Keith
    Levina, Elizaveta
    BERNOULLI, 2022, 28 (04) : 2578 - 2605
  • [40] Nearly optimal Bayesian shrinkage for high-dimensional regression
    Song, Qifan
    Liang, Faming
    SCIENCE CHINA-MATHEMATICS, 2023, 66 (02) : 409 - 442