Penalized Regression with Ordinal Predictors

被引:52
|
作者
Gertheiss, Jan [1 ]
Tutz, Gerhard [1 ]
机构
[1] Univ Munich, D-80799 Munich, Germany
关键词
Basis function approach; classical linear model; dummy coding; generalized linear models; generalized ridge regression; ordinal predictors; penalized likelihood estimation; RANK ORDER CATEGORIES; RIDGE-REGRESSION; MODELS; ASSIGNMENT; VARIABLES; NUMBERS;
D O I
10.1111/j.1751-5823.2009.00088.x
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
P>Ordered categorial predictors are a common case in regression modelling. In contrast to the case of ordinal response variables, ordinal predictors have been largely neglected in the literature. In this paper, existing methods are reviewed and the use of penalized regression techniques is proposed. Based on dummy coding two types of penalization are explicitly developed; the first imposes a difference penalty, the second is a ridge type refitting procedure. Also a Bayesian motivation is provided. The concept is generalized to the case of non-normal outcomes within the framework of generalized linear models by applying penalized likelihood estimation. Simulation studies and real world data serve for illustration and to compare the approaches to methods often seen in practice, namely simple linear regression on the group labels and pure dummy coding. Especially the proposed difference penalty turns out to be highly competitive.
引用
收藏
页码:345 / 365
页数:21
相关论文
共 50 条
  • [1] A constrained regression model for an ordinal response with ordinal predictors
    Javier Espinosa
    Christian Hennig
    [J]. Statistics and Computing, 2019, 29 : 869 - 890
  • [2] A constrained regression model for an ordinal response with ordinal predictors
    Espinosa, Javier
    Hennig, Christian
    [J]. STATISTICS AND COMPUTING, 2019, 29 (05) : 869 - 890
  • [3] Ordinal ridge regression with categorical predictors
    Zahid, Faisal M.
    Ramzan, Shahla
    [J]. JOURNAL OF APPLIED STATISTICS, 2012, 39 (01) : 161 - 171
  • [4] A Two-Step Penalized Regression Method with Networked Predictors
    Luo, Chong
    Pan, Wei
    Shen, Xiaotong
    [J]. STATISTICS IN BIOSCIENCES, 2012, 4 (01) : 27 - 46
  • [5] A Two-Step Penalized Regression Method with Networked Predictors
    Chong Luo
    Wei Pan
    Xiaotong Shen
    [J]. Statistics in Biosciences, 2012, 4 (1) : 27 - 46
  • [6] The LASSO on latent indices for regression modeling with ordinal categorical predictors
    Hui, Francis K. C.
    Muller, Samuel
    Welsh, A. H.
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2020, 149
  • [7] Penalized expectile regression: an alternative to penalized quantile regression
    Lina Liao
    Cheolwoo Park
    Hosik Choi
    [J]. Annals of the Institute of Statistical Mathematics, 2019, 71 : 409 - 438
  • [8] Modelling monotonic effects of ordinal predictors in Bayesian regression models
    Burkner, Paul-Christian
    Charpentier, Emmanuel
    [J]. BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2020, 73 (03): : 420 - 451
  • [9] Penalized expectile regression: an alternative to penalized quantile regression
    Liao, Lina
    Park, Cheolwoo
    Choi, Hosik
    [J]. ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2019, 71 (02) : 409 - 438
  • [10] Penalized Ordinal Regression Methods for Predicting Stage of Cancer in High-Dimensional Covariate Spaces
    Gentry, Amanda Elswick
    Jackson-Cook, Colleen K.
    Lyon, Debra E.
    Archer, Kellie J.
    [J]. CANCER INFORMATICS, 2015, 14 : 201 - 208