Comparative study of L1 regularized logistic regression methods for variable selection

被引:2
|
作者
El Guide, M. [1 ]
Jbilou, K. [2 ,3 ]
Koukouvinos, C. [4 ]
Lappa, A. [4 ]
机构
[1] Mohammed VI Polytech Univ, Ctr Behav Econ & Decis Making, Green City, Morocco
[2] Univ Littoral Cote dOpale, Dept Math, Calais, France
[3] Mohammed VI Polytech Univ, Complex Syst Engn & Human Syst, Green City, Morocco
[4] Natl Tech Univ Athens, Dept Math, Athens, Greece
关键词
Logistic regression model; regularization; L-1-norm; variable selection; MODELS;
D O I
10.1080/03610918.2020.1752379
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
L-1 regularized logistic regression consists an important tool in data science and is dedicated to solve sparse generalized linear problems. The L-1 regularization is widely used in variable selection and estimation in generalized linear model analysis. This approach is intended to select the statistically important predictors. In this paper we compare the performance of some existing L-1 regularized logistic regression methods. The goal of our simulation study is directed toward the variable selection performance of regularized logistic regression in high dimensions. We consider three varying n (number of observations), p (number of predictors) settings and we support this comparison analysis by conducting various simulated experiments taking into consideration the correlation structure of the design matrix.
引用
收藏
页码:4957 / 4972
页数:16
相关论文
共 50 条
  • [1] L1/2 regularized Logistic regression
    [J]. Zhao, Q. (zhao.qian@stu.xjtu.edu.cn), 1600, Science Press (25):
  • [2] Bregman Distance to L1 Regularized Logistic Regression
    Das Gupta, Mithun
    Huang, Thomas S.
    [J]. 19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 2577 - 2580
  • [3] Honest variable selection in linear and logistic regression models via l1 and l1 + l2 penalization
    Bunea, Florentina
    [J]. ELECTRONIC JOURNAL OF STATISTICS, 2008, 2 : 1153 - 1194
  • [4] Krylov subspace solvers for l1 regularized logistic regression method
    El Guide, M.
    Jbilou, K.
    Koukouvinos, C.
    Lappa, A.
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2023, 52 (06) : 2738 - 2751
  • [5] A PRIMAL AND DUAL ACTIVE SET ALGORITHM FOR TRUNCATED L1 REGULARIZED LOGISTIC REGRESSION
    Kang, Lican
    Luo, Yuan
    Yang, Jerry Zhijian
    Zhu, Chang
    [J]. JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (04) : 2452 - 2463
  • [6] Regularized logistic regression and multiobjective variable selection for classifying MEG data
    Roberto Santana
    Concha Bielza
    Pedro Larrañaga
    [J]. Biological Cybernetics, 2012, 106 : 389 - 405
  • [7] Regularized (bridge) logistic regression for variable selection based on ROC criterion
    Tian, Guo-Liang
    Fang, Hong-Bin
    Liu, Zhenqiu
    Tan, Ming T.
    [J]. STATISTICS AND ITS INTERFACE, 2009, 2 (04) : 493 - 502
  • [8] Regularized logistic regression and multiobjective variable selection for classifying MEG data
    Santana, Roberto
    Bielza, Concha
    Larranaga, Pedro
    [J]. BIOLOGICAL CYBERNETICS, 2012, 106 (6-7) : 389 - 405
  • [9] L1-2 Regularized Logistic Regression
    Qin, Jing
    Lou, Yifei
    [J]. CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 779 - 783
  • [10] Variable selection for functional regression models via the L1 regularization
    Matsui, Hidetoshi
    Konishi, Sadanori
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2011, 55 (12) : 3304 - 3310