Bayesian Inference on Hierarchical Nonlocal Priors in Generalized Linear Models

被引:0
|
作者
Cao, Xuan [1 ]
Lee, Kyoungjae [2 ]
机构
[1] Univ Cincinnati, Dept Math Sci, Cincinnati, OH USA
[2] Sungkyunkwan Univ, Dept Stat, Seoul, South Korea
来源
BAYESIAN ANALYSIS | 2024年 / 19卷 / 01期
关键词
high-dimensional; nonlocal prior; strong selection consistency; VARIABLE-SELECTION; PRIOR DENSITIES; REGRESSION; GIBBS;
D O I
10.1214/22-BA1350SUPP
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Variable selection methods with nonlocal priors have been widely studied in linear regression models, and their theoretical and empirical performances have been reported. However, the crucial model selection properties for hierarchical nonlocal priors in high-dimensional generalized linear regression have rarely been investigated. In this paper, we consider a hierarchical nonlocal prior for high -dimensional logistic regression models and investigate theoretical properties of the posterior distribution. Specifically, a product moment (pMOM) nonlocal prior is imposed over the regression coefficients with an Inverse-Gamma prior on the tun-ing parameter. Under standard regularity assumptions, we establish strong model selection consistency in a high-dimensional setting, where the number of covariates is allowed to increase at a sub-exponential rate with the sample size. We imple-ment the Laplace approximation for computing the posterior probabilities, and a modified shotgun stochastic search procedure is suggested for efficiently exploring the model space. We demonstrate the validity of the proposed method through simulation studies and an RNA-sequencing dataset for stratifying disease risk.
引用
收藏
页码:99 / 122
页数:24
相关论文
共 50 条
  • [1] Hyper Nonlocal Priors for Variable Selection in Generalized Linear Models
    Wu, Ho-Hsiang
    Ferreira, Marco A. R.
    Elkhouly, Mohamed
    Ji, Tieming
    [J]. SANKHYA-SERIES A-MATHEMATICAL STATISTICS AND PROBABILITY, 2020, 82 (01): : 147 - 185
  • [2] Hyper Nonlocal Priors for Variable Selection in Generalized Linear Models
    Ho-Hsiang Wu
    Marco A. R. Ferreira
    Mohamed Elkhouly
    Tieming Ji
    [J]. Sankhya A, 2020, 82 : 147 - 185
  • [3] Bayesian inference for generalized linear mixed models
    Fong, Youyi
    Rue, Havard
    Wakefield, Jon
    [J]. BIOSTATISTICS, 2010, 11 (03) : 397 - 412
  • [4] Bayesian inference for sparse generalized linear models
    Seeger, Matthias
    Gerwinn, Sebastian
    Bethge, Matthias
    [J]. MACHINE LEARNING: ECML 2007, PROCEEDINGS, 2007, 4701 : 298 - +
  • [5] Bayesian inference for generalized linear models for spiking neurons
    Gerwinn, Sebastian
    Macke, Jakob H.
    Bethge, Matthias
    [J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2010, 4
  • [6] Unified Bayesian Inference Framework for Generalized Linear Models
    Meng, Xiangming
    Wu, Sheng
    Zhu, Jiang
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (03) : 398 - 402
  • [7] Differentially Private Bayesian Inference for Generalized Linear Models
    Kulkarni, Tejas
    Jalko, Joonas
    Koskela, Antti
    Kaski, Samuel
    Honkela, Antti
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [8] Bayesian Variable Selection and Computation for Generalized Linear Models with Conjugate Priors
    Chen, Ming-Hui
    Huang, Lan
    Ibrahim, Joseph G.
    Kim, Sungduk
    [J]. BAYESIAN ANALYSIS, 2008, 3 (03): : 585 - 613
  • [9] Approximate Bayesian Inference in Spatial Generalized Linear Mixed Models
    Eidsvik, Jo
    Martino, Sara
    Rue, Havard
    [J]. SCANDINAVIAN JOURNAL OF STATISTICS, 2009, 36 (01) : 1 - 22
  • [10] Semiparametric Bayesian inference on generalized linear measurement error models
    Nian-Sheng Tang
    De-Wang Li
    An-Min Tang
    [J]. Statistical Papers, 2017, 58 : 1091 - 1113