AIC for the group Lasso in generalized linear models

被引:1
|
作者
Komatsu, Satoshi [1 ]
Yamashita, Yuta [2 ]
Ninomiya, Yoshiyuki [3 ]
机构
[1] Grad Univ Adv Studies, Dept Stat Sci, 10-3 Midori Cho, Tachikawa, Tokyo 1908562, Japan
[2] Natl Mutual Insurance Federat Agr Cooperat, Chiyoda Ku, 2-7-9 Hirakawa Cho, Tokyo 1028630, Japan
[3] Inst Stat Math, Dept Math Anal & Stat Inference, 10-3 Midori Cho, Tachikawa, Tokyo 1908562, Japan
关键词
Group-sparsity penalty; Information criterion; Statistical asymptotic theory; Tuning parameter; Variable selection; GROUP SELECTION; INFERENCE; BENEFIT;
D O I
10.1007/s42081-019-00052-0
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
When covariates are assumed to be clustered in groups in regression problems, the group Lasso is useful, because it tends to drive all the weights in one group to zero together. The group Lasso includes a tuning parameter which controls a penalty level, and an unbiased estimator of the true prediction error is derived as a Cp-type criterion to select an appropriate value of the tuning parameter. However, in general, the Cp-type criterion cannot be derived in generalized linear regressions such as a logistic regression. Hence, this paper obtains the AIC for the group Lasso based on its original definition under the framework of generalized linear models. In terms of computational cost, our criterion is clearly better than the cross validation, but it is shown through simulation studies that the performance of the our criterion is almost the same as or better than that of the cross validation.
引用
收藏
页码:545 / 558
页数:14
相关论文
共 50 条
  • [31] The Generalized Lasso With Non-Linear Observations
    Plan, Yaniv
    Vershynin, Roman
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2016, 62 (03) : 1528 - 1537
  • [32] Estimation of group means in generalized linear mixed models
    Duan, Jiexin
    Levine, Michael
    Luo, Junxiang
    Qu, Yongming
    [J]. PHARMACEUTICAL STATISTICS, 2020, 19 (05) : 646 - 661
  • [33] The robust desparsified lasso and the focused information criterion for high-dimensional generalized linear models
    Pandhare, S. C.
    Ramanathan, T. V.
    [J]. STATISTICS, 2023, 57 (01) : 1 - 25
  • [34] On the behaviour of marginal and conditional AIC in linear mixed models
    Greven, Sonja
    Kneib, Thomas
    [J]. BIOMETRIKA, 2010, 97 (04) : 773 - 789
  • [35] Asymptotic bootstrap corrections of AIC for linear regression models
    Seghouane, Abd-Krim
    [J]. SIGNAL PROCESSING, 2010, 90 (01) : 217 - 224
  • [36] Use generalized linear models or generalized partially linear models?
    Li, Xinmin
    Liang, Haozhe
    Haerdle, Wolfgang
    Liang, Hua
    [J]. STATISTICS AND COMPUTING, 2023, 33 (05)
  • [37] Use generalized linear models or generalized partially linear models?
    Xinmin Li
    Haozhe Liang
    Wolfgang Härdle
    Hua Liang
    [J]. Statistics and Computing, 2023, 33
  • [38] ON LOCALLY OPTIMAL DESIGNS FOR GENERALIZED LINEAR MODELS WITH GROUP EFFECTS
    Stufken, John
    Yang, Min
    [J]. STATISTICA SINICA, 2012, 22 (04) : 1765 - 1786
  • [39] Autonomous Tracking and State Estimation With Generalized Group Lasso
    Gao, Rui
    Sarkka, Simo
    Claveria-Vega, Ruben
    Godsill, Simon
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (11) : 12056 - 12070
  • [40] Multiple Change-Points Estimation in Linear Regression Models via Sparse Group Lasso
    Zhang, Bingwen
    Geng, Jun
    Lai, Lifeng
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (09) : 2209 - 2224