The Bayesian adaptive lasso regression

被引:126
|
作者
Alhamzawi, Rahim [1 ]
Ali, Haithem Taha Mohammad [2 ]
机构
[1] Univ Al Qadisiyah, Dept Stat, Coll Adm & Econ, Al Diwaniyah, Iraq
[2] Nawroz Univ, Coll Comp & Informat Technol, Dahuk, Iraq
关键词
Adaptive lasso; Bayesian inference; Gibbs sampler; Hierarchical model; Linear regression; VARIABLE SELECTION; ORACLE PROPERTIES; ELASTIC NET; REGULARIZATION;
D O I
10.1016/j.mbs.2018.06.004
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Classical adaptive lasso regression is known to possess the oracle properties; namely, it performs as well as if the correct submodel were known in advance. However, it requires consistent initial estimates of the regression coefficients, which are generally not available in high dimensional settings. In addition, none of the algorithms used to obtain the adaptive lasso estimators provide a valid measure of standard error. To overcome these drawbacks, some Bayesian approaches have been proposed to obtain the adaptive lasso and related estimators. In this paper, we consider a fully Bayesian treatment for the adaptive lasso that leads to a new Gibbs sampler with tractable full conditional posteriors. Through simulations and real data analyses, we compare the performance of the new Gibbs sampler with some of the existing Bayesian and non-Bayesian methods. Results show that the new approach performs well in comparison to the existing Bayesian and non-Bayesian approaches.
引用
收藏
页码:75 / 82
页数:8
相关论文
共 50 条
  • [1] Bayesian adaptive Lasso quantile regression
    Alhamzawi, Rahim
    Yu, Keming
    Benoit, Dries F.
    [J]. STATISTICAL MODELLING, 2012, 12 (03) : 279 - 297
  • [2] Bayesian bootstrap adaptive lasso estimators of regression models
    Li, Bohan
    Wu, Juan
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2021, 91 (08) : 1651 - 1680
  • [3] Bayesian Adaptive Lasso for Ordinal Regression With Latent Variables
    Feng, Xiang-Nan
    Wu, Hao-Tian
    Song, Xin-Yuan
    [J]. SOCIOLOGICAL METHODS & RESEARCH, 2017, 46 (04) : 926 - 953
  • [4] Bayesian lasso regression
    Hans, Chris
    [J]. BIOMETRIKA, 2009, 96 (04) : 835 - 845
  • [5] USE BAYESIAN ADAPTIVE LASSO FOR TOBIT REGRESSION WITH REAL DATA
    AL-Sabbah, Shrook A. S.
    Raheem, Saif Hosam
    [J]. INTERNATIONAL JOURNAL OF AGRICULTURAL AND STATISTICAL SCIENCES, 2021, 17 : 2169 - 2173
  • [6] Bayesian Adaptive Lasso for Regression Models with Nonignorable Missing Responses
    Zhao, Yuanying
    Duan, Xingde
    [J]. JOURNAL OF MATHEMATICS, 2022, 2022
  • [7] Bayesian adaptive Lasso
    Chenlei Leng
    Minh-Ngoc Tran
    David Nott
    [J]. Annals of the Institute of Statistical Mathematics, 2014, 66 : 221 - 244
  • [8] Bayesian adaptive Lasso
    Leng, Chenlei
    Minh-Ngoc Tran
    Nott, David
    [J]. ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2014, 66 (02) : 221 - 244
  • [9] Variational inference on a Bayesian adaptive lasso Tobit quantile regression model
    Wang, Zhiqiang
    Wu, Ying
    Cheng, WeiLi
    [J]. STAT, 2023, 12 (01):
  • [10] ROBUST BAYESIAN LASSO REGRESSION
    Khadembashiri, Z.
    [J]. JOURNAL OF FUNDAMENTAL AND APPLIED SCIENCES, 2016, 8 : 1848 - 1858