Quantile regression for massive data set

被引:1
|
作者
Jiang, Rong [1 ]
Chen, Shi [2 ]
Wang, Fu-Ya [2 ]
机构
[1] Shanghai Polytech Univ, Sch Math Phys & Stat, Shanghai, Peoples R China
[2] Donghua Univ, Dept Stat, Shanghai, Peoples R China
关键词
Asymmetric Laplace distribution; EM algorithm; Massive data; Quantile regression; MAXIMUM-LIKELIHOOD; ALGORITHM;
D O I
10.1080/03610918.2023.2202840
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Traditional statistical analysis is challenged by modern massive data sets, which have huge sample size and dimension. Quantile regression has become a popular alternative to least squares method for providing comprehensive description of the response distribution and robustness against heavy-tailed error distributions. On the other hand, non-smooth quantile loss poses a new challenge to massive data sets. To address the problem, we transform the non-differentiable quantile loss function into a convex quadratic loss function based on Expectation-maximization (EM) algorithm using an asymmetric Laplace distribution. Both simulations and real data application are conducted to illustrate the performance of the proposed methods.
引用
收藏
页码:5875 / 5883
页数:9
相关论文
共 50 条
  • [41] Quantile Regression and Beyond in Statistical Analysis of Data
    Alhamzawi, Rahim
    Yu, Keming
    Mallick, Himel
    JOURNAL OF PROBABILITY AND STATISTICS, 2019, 2019
  • [42] Bootstrap Inference for Panel Data Quantile Regression
    Galvao, Antonio F.
    Parker, Thomas
    Xiao, Zhijie
    JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2024, 42 (02) : 628 - 639
  • [43] Bayesian Quantile Regression for Big Data Analysis
    Chu, Yuanqi
    Hu, Xueping
    Yu, Keming
    NEW FRONTIERS IN BAYESIAN STATISTICS, BAYSM 2021, 2022, 405 : 11 - 22
  • [44] Quantile association regression on bivariate survival data
    Chen, Ling-Wan
    Cheng, Yu
    Ding, Ying
    Li, Ruosha
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2021, 49 (03): : 612 - 636
  • [45] Optimal subsampling for quantile regression in big data
    Wang, Haiying
    Ma, Yanyuan
    BIOMETRIKA, 2021, 108 (01) : 99 - 112
  • [46] Distributed quantile regression for longitudinal big data
    Fan, Ye
    Lin, Nan
    Yu, Liqun
    COMPUTATIONAL STATISTICS, 2024, 39 (02) : 751 - 779
  • [47] Approximate Bayesian Quantile Regression for Panel Data
    Pulcini, Antonio
    Liseo, Brunero
    ADVANCES IN COMPLEX DATA MODELING AND COMPUTATIONAL METHODS IN STATISTICS, 2015, : 173 - 189
  • [48] Bayesian quantile regression for longitudinal data models
    Luo, Youxi
    Lian, Heng
    Tian, Maozai
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2012, 82 (11) : 1635 - 1649
  • [49] Transformed Dynamic Quantile Regression on Censored Data
    Chu, Chi Wing
    Sit, Tony
    Xu, Gongjun
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2021, 116 (534) : 874 - 886
  • [50] Renewable quantile regression for streaming data sets
    Jiang, Rong
    Yu, Keming
    NEUROCOMPUTING, 2022, 508 : 208 - 224