GRADIENT-INDUCED MODEL-FREE VARIABLE SELECTION WITH COMPOSITE QUANTILE REGRESSION

被引:2
|
作者
He, Xin [1 ]
Wang, Junhui [1 ]
Lv, Shaogao [2 ]
机构
[1] City Univ Hong Kong, Dept Math, Hong Kong, Hong Kong, Peoples R China
[2] Nanjing Audit Univ, Coll Sci, Nanjing, Jiangsu, Peoples R China
关键词
Lasso; learning gradients; quantile regression; reproducing kernel Hilbert space (RKHS); sparsity; variable selection; DERIVATIVES; LIKELIHOOD; SHRINKAGE;
D O I
10.5705/ss.202016.0222
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Variable selection is central to sparse modeling, and many methods have been proposed under various model assumptions. Most existing methods are based on an explicit functional relationship, while we are concerned with a model-free variable selection method that attempts to identify informative variables that are related to the response by simultaneously examining the sparsity in multiple conditional quantile functions. It does not require specification of the underlying model for the response. The proposed method is implemented via an efficient computing algorithm that couples the majorize-minimization algorithm and the proximal gradient descent algorithm. Its asymptotic estimation and variable selection consistencies are established, without explicit model assumptions, that assure the truly informative variables are correctly identified with high probability. The effectiveness of the proposed method is supported by a variety of simulated and real-life examples.
引用
收藏
页码:1521 / 1538
页数:18
相关论文
共 50 条
  • [1] Model-free variable selection for conditional mean in regression
    Dong, Yuexiao
    Yu, Zhou
    Zhu, Liping
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2020, 152 (152)
  • [2] Shrinkage inverse regression estimation for model-free variable selection
    Bondell, Howard D.
    Li, Lexin
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2009, 71 : 287 - 299
  • [3] Model-free variable selection
    Li, LX
    Cook, RD
    Nachtsheim, CJ
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2005, 67 : 285 - 299
  • [4] MODEL-FREE COORDINATE TEST AND VARIABLE SELECTION VIA DIRECTIONAL REGRESSION
    Yu, Zhou
    Dong, Yuexiao
    STATISTICA SINICA, 2016, 26 (03) : 1159 - 1174
  • [5] Weighted composite quantile estimation and variable selection method for censored regression model
    Tang, Linjun
    Zhou, Zhangong
    Wu, Changchun
    STATISTICS & PROBABILITY LETTERS, 2012, 82 (03) : 653 - 663
  • [6] Composite quantile regression and variable selection in single-index coefficient model
    Zhang, Riquan
    Lv, Yazhao
    Zhao, Weihua
    Liu, Jicai
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2016, 176 : 1 - 21
  • [7] Variable selection via composite quantile regression with dependent errors
    Tang, Yanlin
    Song, Xinyuan
    Zhu, Zhongyi
    STATISTICA NEERLANDICA, 2015, 69 (01) : 1 - 20
  • [8] Improved composite quantile regression and variable selection with nonignorable dropouts
    Ma, Wei
    Wang, Lei
    RANDOM MATRICES-THEORY AND APPLICATIONS, 2022, 11 (01)
  • [9] VARIABLE SELECTION IN QUANTILE REGRESSION
    Wu, Yichao
    Liu, Yufeng
    STATISTICA SINICA, 2009, 19 (02) : 801 - 817
  • [10] Composite quantile regression and the oracle model selection theory
    Zou, Hui
    Yuan, Ming
    ANNALS OF STATISTICS, 2008, 36 (03): : 1108 - 1126