SCAD-Penalized Least Absolute Deviation Regression in High-Dimensional Models

被引:19
|
作者
Wang, Mingqiu [1 ,2 ]
Song, Lixin [1 ]
Tian, Guo-Liang [3 ]
机构
[1] Dalian Univ Technol, Sch Math Sci, Dalian 116023, Liaoning, Peoples R China
[2] Qufu Normal Univ, Sch Stat, Qufu, Peoples R China
[3] Univ Hong Kong, Dept Stat & Actuarial Sci, Hong Kong, Hong Kong, Peoples R China
基金
中国博士后科学基金;
关键词
Empirical process; LAD-SCAD estimator; Oracle property; Rank correlation screening; Stochastic equicontinuity; Variable selection; VARIABLE SELECTION; ASYMPTOTIC-BEHAVIOR; ROBUST REGRESSION; DIVERGING NUMBER; M-ESTIMATORS; PARAMETERS; LIKELIHOOD; LASSO; SHRINKAGE; P2/N;
D O I
10.1080/03610926.2013.781643
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
When outliers and/or heavy-tailed errors exist in linear models, the least absolute deviation (LAD) regression is a robust alternative to the ordinary least squares regression. Existing variable-selection methods in linear models based on LAD regression either only consider the finite number of predictors or lack the oracle property associated with the estimator. In this article, we focus on the variable selection via LAD regression with a diverging number of parameters. The rate of convergence of the LAD estimator with the smoothly clipped absolute deviation (SCAD) penalty function is established. Furthermore, we demonstrate that, under certain regularity conditions, the penalized estimator with a properly selected tuning parameter enjoys the oracle property. In addition, the rank correlation screening method originally proposed by Li et al. (2011) is applied to deal with ultrahigh dimensional data. Simulation studies are conducted for revealing the finite sample performance of the estimator. We further illustrate the proposed methodology by a real example.
引用
收藏
页码:2452 / 2472
页数:21
相关论文
共 50 条
  • [1] SCAD-PENALIZED REGRESSION IN HIGH-DIMENSIONAL PARTIALLY LINEAR MODELS
    Xie, Huiliang
    Huang, Jian
    [J]. ANNALS OF STATISTICS, 2009, 37 (02): : 673 - 696
  • [2] SCAD-penalized quantile regression for high-dimensional data analysis and variable selection
    Amin, Muhammad
    Song, Lixin
    Thorlie, Milton Abdul
    Wang, Xiaoguang
    [J]. STATISTICA NEERLANDICA, 2015, 69 (03) : 212 - 235
  • [3] Variable Selection via SCAD-Penalized Quantile Regression for High-Dimensional Count Data
    Khan, Dost Muhammad
    Yaqoob, Anum
    Iqbal, Nadeem
    Wahid, Abdul
    Khalil, Umair
    Khan, Mukhtaj
    Abd Rahman, Mohd Amiruddin
    Mustafa, Mohd Shafie
    Khan, Zardad
    [J]. IEEE ACCESS, 2019, 7 : 153205 - 153216
  • [4] FUSED LASSO PENALIZED LEAST ABSOLUTE DEVIATION ESTIMATOR FOR HIGH DIMENSIONAL LINEAR REGRESSION
    Liu, Yanqing
    Tao, Jiyuan
    Zhang, Huan
    Xiu, Xianchao
    Kong, Lingchen
    [J]. NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2018, 8 (01): : 97 - 117
  • [5] SCAD-penalized regression for varying-coefficient models with autoregressive errors
    Qiu, Jia
    Li, Degao
    You, Jinhong
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2015, 137 : 100 - 118
  • [6] Penalized weighted least absolute deviation regression
    Gao, Xiaoli
    Feng, Yang
    [J]. STATISTICS AND ITS INTERFACE, 2018, 11 (01) : 79 - 89
  • [7] SCAD-penalized regression in additive partially linear proportional hazards models with an ultra-high-dimensional linear part
    Lian, Heng
    Li, Jianbo
    Tang, Xingyu
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2014, 125 : 50 - 64
  • [8] Penalized least-squares estimation for regression coefficients in high-dimensional partially linear models
    Ni, Huey-Fan
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2012, 142 (02) : 379 - 389
  • [9] A NEW PENALIZED LEAST ABSOLUTE DEVIATION MODEL FOR HIGH DIMENSIONAL SPARSE LINEAR REGRESSION AND AN EFFICIENT SEQUENTIAL LINEAR PROGRAMMING ALGORITHM
    Qin, Zhenzhi
    Zhang, Liping
    [J]. PACIFIC JOURNAL OF OPTIMIZATION, 2021, 17 (02): : 227 - 250
  • [10] Sparse Logistic Regression for Diagnosis of Liver Fibrosis in Rat by Using SCAD-Penalized Likelihood
    Yan, Fang-Rong
    Lin, Jin-Guan
    Liu, Yu
    [J]. JOURNAL OF BIOMEDICINE AND BIOTECHNOLOGY, 2011,