On the estimation of ridge penalty in linear regression: Simulation and application

被引:1
|
作者
Khan, Muhammad Shakir [1 ,2 ]
Ali, Amjad [1 ]
Suhail, Muhammad [3 ]
Alotaibi, Eid Sadun [4 ]
Alsubaie, Nahaa Eid [4 ]
机构
[1] Islamia Coll Peshawar, Peshawar, Pakistan
[2] Livestock & Dairy Dev Dept Research Wing Peshawar, Khyber Pakhtunkhwa, Pakistan
[3] Univ Agr, Dept Stat, Peshawar Amir Muhammad Khan Campus, Mardan, Pakistan
[4] Taif Univ, AlKhurmah Univ Coll, Dept Math, POB 11099, Taif 21944, Saudi Arabia
关键词
Linear regression model; Multicollinearity; Ridge regression; Two parameter ridge estimators; Mean square error; Monte Carlo simulation; Prediction; PERFORMANCE;
D O I
10.1016/j.kjs.2024.100273
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
According to existing literature, the ordinary least squares (OLS) estimators are not the best in presence of multicollinearity. The inability of OLS estimators against multicollinearity has paved the way for the development of various ridge type estimators for circumventing the problem of multicollinearity. In this paper improved two-parameter ridge (ITPR) estimators are proposed. A simulation study is used to evaluate the performance of proposed estimators based on minimum mean squared error (MSE) criterion. The simulative results reveal that, based on minimum MSE, ITPR2 was the most efficient estimator compared to the considered estimators in the study. Finally, a real-life dataset is analyzed to demonstrate the applications of the proposed estimators and also checked their efficacy for mitigation of multicollinearity.
引用
下载
收藏
页数:10
相关论文
共 50 条
  • [31] Linearized Restricted Ridge Regression Estimator in Linear Regression
    Liu, Xu-Qing
    Gao, Feng
    Xu, Jian-Wen
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2012, 41 (24) : 4503 - 4514
  • [32] The General Linear Test in the Ridge Regression
    Bae, Whasoo
    Kim, Minji
    Kim, Choongrak
    COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2014, 21 (04) : 297 - 307
  • [33] Shrinkage Ridge Estimators in Linear Regression
    Arashi, M.
    Tabatabaey, S. M. M.
    Bashtian, M. Hassanzadeh
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2014, 43 (04) : 871 - 904
  • [34] Ridge estimation of a semiparametric regression model
    Hu, HC
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2005, 176 (01) : 215 - 222
  • [35] RIDGE ESTIMATION IN LOGISTIC-REGRESSION
    LEE, AH
    SILVAPULLE, MJ
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 1988, 17 (04) : 1231 - 1257
  • [36] More on the restricted ridge regression estimation
    Kaciranlar, Selahattin
    Sakallioglu, Sadullah
    Ozkale, M. Revan
    Guler, Huseyin
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2011, 81 (11) : 1433 - 1448
  • [37] Ridge regression estimation for survey samples
    Park, Mingue
    Yang, Min
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2008, 37 (04) : 532 - 543
  • [38] Poisson regression diagnostics with ridge estimation
    Khan, Aamna
    Ullah, Muhammad Aman
    Amin, Muhammad
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2023, 52 (09) : 4174 - 4192
  • [39] MINIMAX RIDGE-REGRESSION ESTIMATION
    CASELLA, G
    ANNALS OF STATISTICS, 1980, 8 (05): : 1036 - 1056
  • [40] More on the unbiased ridge regression estimation
    Jibo Wu
    Hu Yang
    Statistical Papers, 2016, 57 : 31 - 42