Comparison of regression models under multicollinearity

被引:3
|
作者
Lakshmi, Bagya H. [1 ]
Gallo, M. [2 ]
Srinivasan, M. R. [1 ]
机构
[1] Univ Madras, Dept Stat, Madras 600004, Tamil Nadu, India
[2] Univ Naples LOrientale, Dept Human & Social Sci, Pzza S Giovanni 30, I-80134 Naples, Italy
关键词
Linear regression; Multicollinearity; Ridge Estimator; Generalized Ridge; Directed Ridge; Partial Ridge; Least Square Estimator; Mean Squared Error; Signal to Noise; Proportion of Replication;
D O I
10.1285/i20705948v11n1p340
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Multicollinearity is a major problem in linear regression analysis and several methods exists in the literature to deal with the same. Ridge regression is one of the most popular methods to overcome the problem followed by Generalized Ridge Regression (GRR) and Directed Ridge Regression (DRR). However, there exist many computational issues in using the above methods. Partial Ridge Regression (PRR) method is a computationally viable approach by selectively adjusting the ridge constants using the cutoff criteria. In this paper, the performance of the Partial Ridge Regression approach has been evaluated through a simulation study based on the mean squared error (MSE) criterion. Comparing with other methods of ridge regression, the study indicates that the Partial ridge regression by cutoff criteria performs better than the existing methods.
引用
收藏
页码:340 / 368
页数:29
相关论文
共 50 条
  • [1] Multicollinearity in Logistic Regression Models
    Bayman, Emine Ozgur
    Dexter, Franklin
    [J]. ANESTHESIA AND ANALGESIA, 2021, 133 (02): : 362 - 365
  • [2] Partial ridge regression under multicollinearity
    Chandrasekhar, C. K.
    Bagyalakshmi, H.
    Srinivasan, M. R.
    Gallo, M.
    [J]. JOURNAL OF APPLIED STATISTICS, 2016, 43 (13) : 2462 - 2473
  • [3] New multicollinearity indicators in linear regression models
    Curto, Jose Dias
    Pinto, Jose Castro
    [J]. INTERNATIONAL STATISTICAL REVIEW, 2007, 75 (01) : 114 - 121
  • [4] A new measure of multicollinearity in linear regression models
    Kovács, P
    Petres, T
    Tóth, L
    [J]. INTERNATIONAL STATISTICAL REVIEW, 2005, 73 (03) : 405 - 412
  • [5] The Goldilocks Dilemma: Impacts of Multicollinearity-A Comparison of Simple Linear Regression, Multiple Regression, and Ordered Variable Regression Models
    Baird, Grayson L.
    Bieber, Stephen L.
    [J]. JOURNAL OF MODERN APPLIED STATISTICAL METHODS, 2016, 15 (01) : 332 - 357
  • [6] Multiple choice from competing regression models under multicollinearity based on standardized update
    Ueki, Masao
    Kawasaki, Yoshinori
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2013, 63 : 31 - 41
  • [7] MULTICOLLINEARITY IN REGRESSION-MODELS WITH MULTIPLE DISTANCE MEASURES
    HEIKKILA, E
    [J]. JOURNAL OF REGIONAL SCIENCE, 1988, 28 (03) : 345 - 362
  • [8] Impact of multicollinearity on small sample hydrologic regression models
    Kroll, Charles N.
    Song, Peter
    [J]. WATER RESOURCES RESEARCH, 2013, 49 (06) : 3756 - 3769
  • [9] Performance Comparison of Penalized Regression Methods in Poisson Regression under High-Dimensional Sparse Data with Multicollinearity
    Choosawat, Chutikarn
    Reangsephet, Orawan
    Srisuradetchai, Patchanok
    Lisawadi, Supranee
    [J]. THAILAND STATISTICIAN, 2020, 18 (03): : 306 - 318
  • [10] RIDGE-REGRESSION AS A TECHNIQUE FOR ANALYZING MODELS WITH MULTICOLLINEARITY
    KIDWELL, JS
    BROWN, LH
    [J]. JOURNAL OF MARRIAGE AND THE FAMILY, 1982, 44 (02): : 287 - 299