The Bayesian adaptive lasso regression

被引:126
|
作者
Alhamzawi, Rahim [1 ]
Ali, Haithem Taha Mohammad [2 ]
机构
[1] Univ Al Qadisiyah, Dept Stat, Coll Adm & Econ, Al Diwaniyah, Iraq
[2] Nawroz Univ, Coll Comp & Informat Technol, Dahuk, Iraq
关键词
Adaptive lasso; Bayesian inference; Gibbs sampler; Hierarchical model; Linear regression; VARIABLE SELECTION; ORACLE PROPERTIES; ELASTIC NET; REGULARIZATION;
D O I
10.1016/j.mbs.2018.06.004
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Classical adaptive lasso regression is known to possess the oracle properties; namely, it performs as well as if the correct submodel were known in advance. However, it requires consistent initial estimates of the regression coefficients, which are generally not available in high dimensional settings. In addition, none of the algorithms used to obtain the adaptive lasso estimators provide a valid measure of standard error. To overcome these drawbacks, some Bayesian approaches have been proposed to obtain the adaptive lasso and related estimators. In this paper, we consider a fully Bayesian treatment for the adaptive lasso that leads to a new Gibbs sampler with tractable full conditional posteriors. Through simulations and real data analyses, we compare the performance of the new Gibbs sampler with some of the existing Bayesian and non-Bayesian methods. Results show that the new approach performs well in comparison to the existing Bayesian and non-Bayesian approaches.
引用
收藏
页码:75 / 82
页数:8
相关论文
共 50 条
  • [21] Hierarchical Bayesian LASSO for a negative binomial regression
    Fu, Shuai
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2016, 86 (11) : 2182 - 2203
  • [22] Bayesian Lasso and multinomial logistic regression on GPU
    Cesnovar, Rok
    Strumbelj, Erik
    [J]. PLOS ONE, 2017, 12 (06):
  • [23] Bayesian Lasso-mixed quantile regression
    Alhamzawi, Rahim
    Yu, Keming
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2014, 84 (04) : 868 - 880
  • [24] Adaptive Lasso and group-Lasso for functional Poisson regression
    Ivanoff, Stephane
    Picard, Franck
    Rivoirard, Vincent
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [25] Model uncertainty and variable selection in Bayesian lasso regression
    Chris Hans
    [J]. Statistics and Computing, 2010, 20 : 221 - 229
  • [26] Bayesian Fused Lasso Regression for Dynamic Binary Networks
    Betancourt, Brenda
    Rodriguez, Abel
    Boyd, Naomi
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2017, 26 (04) : 840 - 850
  • [27] THE BAYESIAN NESTED LASSO FOR MIXED FREQUENCY REGRESSION MODELS
    Ghosh, Satyajit
    Khare, Kshitij
    Michailidis, George
    [J]. ANNALS OF APPLIED STATISTICS, 2023, 17 (03): : 2279 - 2304
  • [28] Model uncertainty and variable selection in Bayesian lasso regression
    Hans, Chris
    [J]. STATISTICS AND COMPUTING, 2010, 20 (02) : 221 - 229
  • [29] PREDICTIVE MODEL SELECTION CRITERIA FOR BAYESIAN LASSO REGRESSION
    Kawano, Shuichi
    Hoshina, Ibuki
    Shimamura, Kaito
    Konishi, Sadanori
    [J]. JOURNAL JAPANESE SOCIETY OF COMPUTATIONAL STATISTICS, 2015, 28 (01): : 67 - 82
  • [30] Adaptive sparse group LASSO in quantile regression
    Mendez-Civieta, Alvaro
    Aguilera-Morillo, M. Carmen
    Lillo, Rosa E.
    [J]. ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2021, 15 (03) : 547 - 573