Bayesian Regularized Quantile Regression

被引:99
|
作者
Li, Qing [1 ]
Xi, Ruibin [2 ]
Lin, Nan [1 ]
机构
[1] Washington Univ, Dept Math, St Louis, MO 63130 USA
[2] Harvard Univ, Sch Med, Ctr Biomed Informat, Cambridge, MA 02138 USA
来源
BAYESIAN ANALYSIS | 2010年 / 5卷 / 03期
关键词
Quantile regression; Regularization; Gibbs sampler; Bayesian analysis; Lasso; Elastic net; Group lasso; VARIABLE SELECTION; MODEL SELECTION; SHRINKAGE;
D O I
10.1214/10-BA521
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Regularization, e. g. lasso, has been shown to be effective in quantile regression in improving the prediction accuracy (Li and Zhu 2008; Wu and Liu 2009). This paper studies regularization in quantile regressions from a Bayesian perspective. By proposing a hierarchical model framework, we give a generic treatment to a set of regularization approaches, including lasso, group lasso and elastic net penalties. Gibbs samplers are derived for all cases. This is the first work to discuss regularized quantile regression with the group lasso penalty and the elastic net penalty. Both simulated and real data examples show that Bayesian regularized quantile regression methods often outperform quantile regression without regularization and their non-Bayesian counterparts with regularization.
引用
收藏
页码:533 / 556
页数:24
相关论文
共 50 条
  • [1] Regularized Bayesian quantile regression
    El Adlouni, Salaheddine
    Salaou, Garba
    St-Hilaire, Andre
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2018, 47 (01) : 277 - 293
  • [2] Bayesian Regularized Regression Based on Composite Quantile Method
    Wei-hua ZHAO
    Ri-quan ZHANG
    Ya-zhao L
    Ji-cai LIU
    [J]. Acta Mathematicae Applicatae Sinica, 2016, 32 (02) : 495 - 512
  • [3] Bayesian regularized regression based on composite quantile method
    Wei-hua Zhao
    Ri-quan Zhang
    Ya-zhao Lü
    Ji-cai Liu
    [J]. Acta Mathematicae Applicatae Sinica, English Series, 2016, 32 : 495 - 512
  • [4] Bayesian Regularized Regression Based on Composite Quantile Method
    Zhao, Wei-hua
    Zhang, Ri-quan
    Lu, Ya-zhao
    Liu, Ji-cai
    [J]. ACTA MATHEMATICAE APPLICATAE SINICA-ENGLISH SERIES, 2016, 32 (02): : 495 - 512
  • [5] New Gibbs sampling methods for bayesian regularized quantile regression
    Alhamzawi, Rahim
    Alhamzawi, Ahmed
    Ali, Haithem Taha Mohammad
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2019, 110 : 52 - 65
  • [6] Bayesian LASSO-Regularized quantile regression for linear regression models with autoregressive errors
    Tian, Yuzhu
    Shen, Silian
    Lu, Ge
    Tang, Manlai
    Tian, Maozai
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2019, 48 (03) : 777 - 796
  • [7] Bayesian quantile regression
    Yu, KM
    Moyeed, RA
    [J]. STATISTICS & PROBABILITY LETTERS, 2001, 54 (04) : 437 - 447
  • [8] Regularized linear censored quantile regression
    Son, Minjeong
    Choi, Taehwa
    Shin, Seung Jun
    Jung, Yoonsuh
    Choi, Sangbum
    [J]. JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2022, 51 (02) : 589 - 607
  • [9] Regularized partially functional quantile regression
    Yao, Fang
    Sue-Chee, Shivon
    Wang, Fan
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2017, 156 : 39 - 56
  • [10] Regularized linear censored quantile regression
    Minjeong Son
    Taehwa Choi
    Seung Jun Shin
    Yoonsuh Jung
    Sangbum Choi
    [J]. Journal of the Korean Statistical Society, 2022, 51 : 589 - 607