SCAD-Ridge penalized likelihood estimators for ultra-high dimensional models

被引:1
|
作者
Dong, Ying [1 ]
Song, Lixin [2 ]
Amin, Muhammad [2 ,3 ]
机构
[1] Dalian Nationalities Univ, Fac Sci, Dalian 116600, Peoples R China
[2] Dalian Univ Technol, Sch Math Sci, Dalian 116023, Peoples R China
[3] NIFA, Peshawar 446, Pakistan
来源
关键词
Maximum likelihood estimation; Oracle property; SCAD-Ridge penalization; Ultra-high dimension; Variable selection; GENERALIZED LINEAR-MODELS; VARIABLE SELECTION; DIVERGING NUMBER; COORDINATE DESCENT; FEATURE SPACE; ELASTIC-NET; REGRESSION; LASSO; PARAMETERS; REGULARIZATION;
D O I
10.15672/HJMS.201612518375
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Extraction of as much information as possible from huge data is a burning issue in the modern statistics due to more variables as compared to observations therefore penalization has been employed to resolve that kind of issues. Many achievements have already been made by such penalization techniques. Due to the large number of variables in many research areas declare it a high dimensional problem and with this the sample correlation becomes very large. In this paper, we studied the maximum likelihood estimation of variable selection under smoothly clipped absolute deviation (SCAD) and Ridge penalties with ultra-high dimension settings to solve this problem. We established the oracle property of the proposed model under some conditions by following the theoretical method of Kown and Kim (2012) [19]. These result can greatly broaden the application scope of high-dimension data. Numerical studies are discussed to assess the performance of the proposed method. The SCAD-Ridge given better results than the Lasso, Enet and SCAD.
引用
收藏
页码:423 / 436
页数:14
相关论文
共 50 条
  • [21] Forward variable selection for ultra-high dimensional quantile regression models
    Honda, Toshio
    Lin, Chien-Tong
    [J]. ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2023, 75 (03) : 393 - 424
  • [22] Forward variable selection for ultra-high dimensional quantile regression models
    Toshio Honda
    Chien-Tong Lin
    [J]. Annals of the Institute of Statistical Mathematics, 2023, 75 : 393 - 424
  • [23] SCAD-penalized quantile regression for high-dimensional data analysis and variable selection
    Amin, Muhammad
    Song, Lixin
    Thorlie, Milton Abdul
    Wang, Xiaoguang
    [J]. STATISTICA NEERLANDICA, 2015, 69 (03) : 212 - 235
  • [24] Spline estimator for ultra-high dimensional partially linear varying coefficient models
    Wang, Zhaoliang
    Xue, Liugen
    Li, Gaorong
    Lu, Fei
    [J]. ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2019, 71 (03) : 657 - 677
  • [25] Spline estimator for ultra-high dimensional partially linear varying coefficient models
    Zhaoliang Wang
    Liugen Xue
    Gaorong Li
    Fei Lu
    [J]. Annals of the Institute of Statistical Mathematics, 2019, 71 : 657 - 677
  • [26] Sparsity identification in ultra-high dimensional quantile regression models with longitudinal data
    Gao, Xianli
    Liu, Qiang
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2020, 49 (19) : 4712 - 4736
  • [27] Robust adaptive variable selection in ultra-high dimensional linear regression models
    Ghosh, Abhik
    Jaenada, Maria
    Pardo, Leandro
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2024, 94 (03) : 571 - 603
  • [28] Forward Variable Selection for Sparse Ultra-High Dimensional Varying Coefficient Models
    Cheng, Ming-Yen
    Honda, Toshio
    Zhang, Jin-Ting
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2016, 111 (515) : 1209 - 1221
  • [29] High-Dimensional Censored Regression via the Penalized Tobit Likelihood
    Jacobson, Tate
    Zou, Hui
    [J]. JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2024, 42 (01) : 286 - 297
  • [30] Robust penalized empirical likelihood in high dimensional longitudinal data analysis
    Fu, Liya
    Hu, Shuwen
    Li, Jiaqi
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2024, 228 : 11 - 22