Quantile regression for massive data set

被引:1
|
作者
Jiang, Rong [1 ]
Chen, Shi [2 ]
Wang, Fu-Ya [2 ]
机构
[1] Shanghai Polytech Univ, Sch Math Phys & Stat, Shanghai, Peoples R China
[2] Donghua Univ, Dept Stat, Shanghai, Peoples R China
关键词
Asymmetric Laplace distribution; EM algorithm; Massive data; Quantile regression; MAXIMUM-LIKELIHOOD; ALGORITHM;
D O I
10.1080/03610918.2023.2202840
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Traditional statistical analysis is challenged by modern massive data sets, which have huge sample size and dimension. Quantile regression has become a popular alternative to least squares method for providing comprehensive description of the response distribution and robustness against heavy-tailed error distributions. On the other hand, non-smooth quantile loss poses a new challenge to massive data sets. To address the problem, we transform the non-differentiable quantile loss function into a convex quadratic loss function based on Expectation-maximization (EM) algorithm using an asymmetric Laplace distribution. Both simulations and real data application are conducted to illustrate the performance of the proposed methods.
引用
收藏
页码:5875 / 5883
页数:9
相关论文
共 50 条
  • [1] Distributed quantile regression for massive heterogeneous data
    Hu, Aijun
    Jiao, Yuling
    Liu, Yanyan
    Shi, Yueyong
    Wu, Yuanshan
    NEUROCOMPUTING, 2021, 448 : 249 - 262
  • [2] Distributed optimal subsampling for quantile regression with massive data
    Chao, Yue
    Ma, Xuejun
    Zhu, Boya
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2024, 233
  • [3] Single-index composite quantile regression for massive data
    Jiang, Rong
    Yu, Keming
    JOURNAL OF MULTIVARIATE ANALYSIS, 2020, 180
  • [4] Optimal subsampling for composite quantile regression model in massive data
    Shao, Yujing
    Wang, Lei
    STATISTICAL PAPERS, 2022, 63 (04) : 1139 - 1161
  • [5] Optimal subsampling for composite quantile regression model in massive data
    Yujing Shao
    Lei Wang
    Statistical Papers, 2022, 63 : 1139 - 1161
  • [6] Optimal subsampling algorithms for composite quantile regression in massive data
    Jin, Jun
    Liu, Shuangzhe
    Ma, Tiefeng
    STATISTICS, 2023, 57 (04) : 811 - 843
  • [7] Optimal subsampling for large-sample quantile regression with massive data
    Shao, Li
    Song, Shanshan
    Zhou, Yong
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2023, 51 (02): : 420 - 443
  • [8] Composite quantile regression for massive datasets
    Jiang, Rong
    Hu, Xueping
    Yu, Keming
    Qian, Weimin
    STATISTICS, 2018, 52 (05) : 980 - 1004
  • [9] Block average quantile regression for massive dataset
    Qifa Xu
    Chao Cai
    Cuixia Jiang
    Fang Sun
    Xue Huang
    Statistical Papers, 2020, 61 : 141 - 165
  • [10] Block average quantile regression for massive dataset
    Xu, Qifa
    Cai, Chao
    Jiang, Cuixia
    Sun, Fang
    Huang, Xue
    STATISTICAL PAPERS, 2020, 61 (01) : 141 - 165