A Unified Algorithm for Penalized Convolution Smoothed Quantile Regression

被引:1
|
作者
Man, Rebeka [1 ]
Pan, Xiaoou [2 ]
Tan, Kean Ming [1 ]
Zhou, Wen-Xin [3 ]
机构
[1] Univ Michigan, Dept Stat, Ann Arbor, MI USA
[2] Univ Calif San Diego, Dept Math, La Jolla, CA USA
[3] Univ Illinois, Dept Informat & Decis Sci, Chicago, IL 60607 USA
关键词
Convolution smoothing; Lasso; Majorize-minimization algorithm; Penalized optimization; Quantile estimation regression; VARIABLE SELECTION; REGULARIZATION; SHRINKAGE; MODELS;
D O I
10.1080/10618600.2023.2275999
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Penalized quantile regression (QR) is widely used for studying the relationship between a response variable and a set of predictors under data heterogeneity in high-dimensional settings. Compared to penalized least squares, scalable algorithms for fitting penalized QR are lacking due to the non-differentiable piecewise linear loss function. To overcome the lack of smoothness, a recently proposed convolution-type smoothed method brings an interesting tradeoff between statistical accuracy and computational efficiency for both standard and penalized quantile regressions. In this article, we propose a unified algorithm for fitting penalized convolution smoothed quantile regression with various commonly used convex penalties, accompanied by an R-language package conquer available from the Comprehensive R Archive Network. We perform extensive numerical studies to demonstrate the superior performance of the proposed algorithm over existing methods in both statistical and computational aspects. We further exemplify the proposed algorithm by fitting a fused lasso additive QR model on the world happiness data.
引用
收藏
页码:625 / 637
页数:13
相关论文
共 50 条
  • [1] Penalized weighted smoothed quantile regression for high-dimensional longitudinal data
    Song, Yanan
    Han, Haohui
    Fu, Liya
    Wang, Ting
    [J]. STATISTICS IN MEDICINE, 2024, 43 (10) : 2007 - 2042
  • [2] Penalized expectile regression: an alternative to penalized quantile regression
    Lina Liao
    Cheolwoo Park
    Hosik Choi
    [J]. Annals of the Institute of Statistical Mathematics, 2019, 71 : 409 - 438
  • [3] Penalized expectile regression: an alternative to penalized quantile regression
    Liao, Lina
    Park, Cheolwoo
    Choi, Hosik
    [J]. ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2019, 71 (02) : 409 - 438
  • [4] A coordinate descent algorithm for computing penalized smooth quantile regression
    Mkhadri, Abdallah
    Ouhourane, Mohamed
    Oualkacha, Karim
    [J]. STATISTICS AND COMPUTING, 2017, 27 (04) : 865 - 883
  • [5] A coordinate descent algorithm for computing penalized smooth quantile regression
    Abdallah Mkhadri
    Mohamed Ouhourane
    Karim Oualkacha
    [J]. Statistics and Computing, 2017, 27 : 865 - 883
  • [6] Hierarchically penalized quantile regression
    Kang, Jongkyeong
    Bang, Sungwan
    Jhun, Myoungshic
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2016, 86 (02) : 340 - 356
  • [7] Penalized quantile regression tree
    Kim, Jaeoh
    Cho, HyungJun
    Bang, Sungwan
    [J]. KOREAN JOURNAL OF APPLIED STATISTICS, 2016, 29 (07) : 1361 - 1371
  • [8] Group penalized quantile regression
    Ouhourane, Mohamed
    Yang, Yi
    Benedet, Andrea L.
    Oualkacha, Karim
    [J]. STATISTICAL METHODS AND APPLICATIONS, 2022, 31 (03): : 495 - 529
  • [9] Group penalized quantile regression
    Mohamed Ouhourane
    Yi Yang
    Andréa L. Benedet
    Karim Oualkacha
    [J]. Statistical Methods & Applications, 2022, 31 : 495 - 529
  • [10] Composite smoothed quantile regression
    Yan, Yibo
    Wang, Xiaozhou
    Zhang, Riquan
    [J]. STAT, 2023, 12 (01):