Incorporating spatial structure into inclusion probabilities for Bayesian variable selection in generalized linear models with the spike-and-slab elastic net

被引:4
|
作者
Leach, Justin M. [1 ]
Aban, Inmaculada [1 ]
Yi, Nengjun [1 ]
机构
[1] Univ Alabama Birmingham, Dept Biostat, Sch Publ Hlth, 1665 Univ Blvd, Birmingham, AL 35233 USA
基金
美国国家卫生研究院;
关键词
Spike-and-slab; Bayesian variable selection; Penalized likelihood; Generalized linear models; Elastic net; Alzheimer's disease; SURFACE-BASED ANALYSIS; REGULARIZATION; REGRESSION; NETWORK;
D O I
10.1016/j.jspi.2021.07.010
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Spike-and-slab priors model predictors as arising from a mixture of distributions: those that should (slab) or should not (spike) remain in the model. The spike-and-slab lasso (SSL) is a mixture of double exponentials, extending the single lasso penalty by imposing different penalties on parameters based on their inclusion probabilities. The SSL was extended to Generalized Linear Models (GLM) for application in genetics/genomics, and can handle many highly correlated predictors of a scalar outcome, but does not incorporate these relationships into variable selection. When images/spatial data are used to model a scalar outcome, relevant parameters tend to cluster spatially, and model performance may benefit from incorporating spatial structure into variable selection. We propose to incorporate spatial information by assigning intrinsic autoregressive priors to the logit prior probabilities of inclusion, which results in more similar shrinkage penalties among spatially adjacent parameters. Using MCMC to fit Bayesian models can be computationally prohibitive for large-scale data, but we fit the model by adapting a computationally efficient coordinate-descent-based EM algorithm. A simulation study and an application to Alzheimer's Disease imaging data show that incorporating spatial information can improve model fitness. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:141 / 152
页数:12
相关论文
共 31 条
  • [1] Variable Fusion for Bayesian Linear Regression via Spike-and-slab Priors
    Wu, Shengyi
    Shimamura, Kaito
    Yoshikawa, Kohei
    Murayama, Kazuaki
    Kawano, Shuichi
    [J]. INTELLIGENT DECISION TECHNOLOGIES, KES-IDT 2021, 2021, 238 : 491 - 501
  • [2] Generalized Spike-and-Slab Priors for Bayesian Group Feature Selection Using Expectation Propagation
    Hernandez-Lobato, Daniel
    Miguel Hernandez-Lobato, Jose
    Dupont, Pierre
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2013, 14 : 1891 - 1945
  • [3] The Spike-and-Slab Lasso Generalized Linear Models for Prediction and Associated Genes Detection
    Tang, Zaixiang
    Shen, Yueping
    Zhang, Xinyan
    Yi, Nengjun
    [J]. GENETICS, 2017, 205 (01) : 77 - +
  • [4] Group spike-and-slab lasso generalized linear models for disease prediction and associated genes detection by incorporating pathway information
    Tang, Zaixiang
    Shen, Yueping
    Li, Yan
    Zhang, Xinyan
    Wen, Jia
    Qian, Chen'ao
    Zhuang, Wenzhuo
    Shi, Xinghua
    Yi, Nengjun
    [J]. BIOINFORMATICS, 2018, 34 (06) : 901 - 910
  • [5] Which UGC features drive web purchase intent? A spike-and-slab Bayesian Variable Selection Approach
    Owusu, Richard A.
    Mutshinda, Crispin M.
    Antai, Imoh
    Dadzie, Kofi Q.
    Winston, Evelyn M.
    [J]. INTERNET RESEARCH, 2016, 26 (01) : 22 - 37
  • [6] Fast Bayesian variable selection for high dimensional linear models: Marginal solo spike and slab priors
    Chen, Su
    Walker, Stephen G.
    [J]. ELECTRONIC JOURNAL OF STATISTICS, 2019, 13 (01): : 284 - 309
  • [7] Bayesian variable selection using spike-and-slab priors with application to high dimensional electroencephalography data by local modelling
    Mohammed, Shariq
    Dey, Dipak K.
    Zhang, Yuping
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES C-APPLIED STATISTICS, 2019, 68 (05) : 1305 - 1326
  • [8] A sparse Bayesian approach to model structure selection and parameter estimation of dynamical systems using spike-and-slab priors
    Nayek, R.
    Worden, K.
    Cross, E. J.
    Fuentes, R.
    [J]. PROCEEDINGS OF INTERNATIONAL CONFERENCE ON NOISE AND VIBRATION ENGINEERING (ISMA2020) / INTERNATIONAL CONFERENCE ON UNCERTAINTY IN STRUCTURAL DYNAMICS (USD2020), 2020, : 3639 - 3653
  • [9] Bayesian variable selection in generalized additive partial linear models
    Banerjee, Sayantan
    Ghosal, Subhashis
    [J]. STAT, 2014, 3 (01): : 363 - 378
  • [10] Bayesian projection approaches to variable selection in generalized linear models
    Nott, David J.
    Leng, Chenlei
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2010, 54 (12) : 3227 - 3241