Shrinkage parameter selection via modified cross-validation approach for ridge regression model

被引:26
|
作者
Algamal, Zakariya Yahya [1 ]
机构
[1] Univ Mosul, Dept Stat & Informat, Mosul, Iraq
关键词
Multicollinearity; Ridge regression; Cross-validation; Shrinkage; Monte Carlo simulation; PERFORMANCE; ESTIMATORS; CHOICE;
D O I
10.1080/03610918.2018.1508704
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The ridge regression estimator has been consistently demonstrated to be an attractive shrinkage method to reduce the effects of multicollinearity. The choice of the ridge shrinkage parameter is critical. Cross-validation method is a widely adopted method for shrinkage parameter selection. However, cross-validation method suffers from instability in determining the best shrinkage parameter. To address this problem, a modification of the cross-validation method is proposed by repeating fold assignment. And then, a proper quantile value of the best shrinkage parameter values is utilized. Simulation and real data example results demonstrate that the proposed method is outperformed cross-validation and generalized cross-validation methods.
引用
收藏
页码:1922 / 1930
页数:9
相关论文
共 50 条
  • [21] A survey of cross-validation procedures for model selection
    Arlot, Sylvain
    Celisse, Alain
    [J]. STATISTICS SURVEYS, 2010, 4 : 40 - 79
  • [22] MODEL-STRUCTURE SELECTION BY CROSS-VALIDATION
    STOICA, P
    EYKHOFF, P
    JANSSEN, P
    SODERSTROM, T
    [J]. INTERNATIONAL JOURNAL OF CONTROL, 1986, 43 (06) : 1841 - 1878
  • [23] On Estimating Model in Feature Selection With Cross-Validation
    Qi, Chunxia
    Diao, Jiandong
    Qiu, Like
    [J]. IEEE ACCESS, 2019, 7 : 33454 - 33463
  • [24] Cross-validation for selecting a model selection procedure
    Zhang, Yongli
    Yang, Yuhong
    [J]. JOURNAL OF ECONOMETRICS, 2015, 187 (01) : 95 - 112
  • [25] LINEAR-MODEL SELECTION BY CROSS-VALIDATION
    SHAO, J
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1993, 88 (422) : 486 - 494
  • [26] Cross-validation criteria for SETAR model selection
    De Gooijer, JG
    [J]. JOURNAL OF TIME SERIES ANALYSIS, 2001, 22 (03) : 267 - 281
  • [27] GENERALIZED CROSS-VALIDATION FOR COVARIANCE MODEL SELECTION
    MARCOTTE, D
    [J]. MATHEMATICAL GEOLOGY, 1995, 27 (05): : 659 - 672
  • [28] Wavelet shrinkage using cross-validation
    Nason, GP
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1996, 58 (02): : 463 - 479
  • [29] Bayesian estimation of the shrinkage parameter in ridge regression
    Firinguetti-Limone, Luis
    Pereira-Barahona, Manuel
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2020, 49 (12) : 3314 - 3327
  • [30] Modified cross-validation in semiparametric regression models with dependent errors
    Aneiros-Pérez, G
    Quintela-del-Rio, A
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2001, 30 (02) : 289 - 307