AIC for the group Lasso in generalized linear models

被引:1
|
作者
Komatsu, Satoshi [1 ]
Yamashita, Yuta [2 ]
Ninomiya, Yoshiyuki [3 ]
机构
[1] Grad Univ Adv Studies, Dept Stat Sci, 10-3 Midori Cho, Tachikawa, Tokyo 1908562, Japan
[2] Natl Mutual Insurance Federat Agr Cooperat, Chiyoda Ku, 2-7-9 Hirakawa Cho, Tokyo 1028630, Japan
[3] Inst Stat Math, Dept Math Anal & Stat Inference, 10-3 Midori Cho, Tachikawa, Tokyo 1908562, Japan
关键词
Group-sparsity penalty; Information criterion; Statistical asymptotic theory; Tuning parameter; Variable selection; GROUP SELECTION; INFERENCE; BENEFIT;
D O I
10.1007/s42081-019-00052-0
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
When covariates are assumed to be clustered in groups in regression problems, the group Lasso is useful, because it tends to drive all the weights in one group to zero together. The group Lasso includes a tuning parameter which controls a penalty level, and an unbiased estimator of the true prediction error is derived as a Cp-type criterion to select an appropriate value of the tuning parameter. However, in general, the Cp-type criterion cannot be derived in generalized linear regressions such as a logistic regression. Hence, this paper obtains the AIC for the group Lasso based on its original definition under the framework of generalized linear models. In terms of computational cost, our criterion is clearly better than the cross validation, but it is shown through simulation studies that the performance of the our criterion is almost the same as or better than that of the cross validation.
引用
收藏
页码:545 / 558
页数:14
相关论文
共 50 条
  • [1] AIC for the group Lasso in generalized linear models
    Satoshi Komatsu
    Yuta Yamashita
    Yoshiyuki Ninomiya
    [J]. Japanese Journal of Statistics and Data Science, 2019, 2 : 545 - 558
  • [2] AIC for the Lasso in generalized linear models
    Ninomiya, Yoshiyuki
    Kawano, Shuichi
    [J]. ELECTRONIC JOURNAL OF STATISTICS, 2016, 10 (02): : 2537 - 2560
  • [3] Convergence and sparsity of Lasso and group Lasso in high-dimensional generalized linear models
    Lichun Wang
    Yuan You
    Heng Lian
    [J]. Statistical Papers, 2015, 56 : 819 - 828
  • [4] Convergence and sparsity of Lasso and group Lasso in high-dimensional generalized linear models
    Wang, Lichun
    You, Yuan
    Lian, Heng
    [J]. STATISTICAL PAPERS, 2015, 56 (03) : 819 - 828
  • [5] Overlapping group lasso for high-dimensional generalized linear models
    Zhou, Shengbin
    Zhou, Jingke
    Zhang, Bo
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2019, 48 (19) : 4903 - 4917
  • [6] Adaptive group Lasso for high-dimensional generalized linear models
    Wang, Mingqiu
    Tian, Guo-Liang
    [J]. STATISTICAL PAPERS, 2019, 60 (05) : 1469 - 1486
  • [7] Adaptive group Lasso for high-dimensional generalized linear models
    Mingqiu Wang
    Guo-Liang Tian
    [J]. Statistical Papers, 2019, 60 : 1469 - 1486
  • [8] An adaptive group LASSO approach for domain selection in functional generalized linear models
    Sun, Yifan
    Wang, Qihua
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2022, 219 : 13 - 32
  • [9] Independently Interpretable Lasso for Generalized Linear Models
    Takada, Masaaki
    Suzuki, Taiji
    Fujisawa, Hironori
    [J]. NEURAL COMPUTATION, 2020, 32 (06) : 1168 - 1221
  • [10] Generalized fused Lasso for grouped data in generalized linear models
    Ohishi, Mineaki
    [J]. STATISTICS AND COMPUTING, 2024, 34 (04)