AIC for the group Lasso in generalized linear models

被引:1
|
作者
Komatsu, Satoshi [1 ]
Yamashita, Yuta [2 ]
Ninomiya, Yoshiyuki [3 ]
机构
[1] Grad Univ Adv Studies, Dept Stat Sci, 10-3 Midori Cho, Tachikawa, Tokyo 1908562, Japan
[2] Natl Mutual Insurance Federat Agr Cooperat, Chiyoda Ku, 2-7-9 Hirakawa Cho, Tokyo 1028630, Japan
[3] Inst Stat Math, Dept Math Anal & Stat Inference, 10-3 Midori Cho, Tachikawa, Tokyo 1908562, Japan
关键词
Group-sparsity penalty; Information criterion; Statistical asymptotic theory; Tuning parameter; Variable selection; GROUP SELECTION; INFERENCE; BENEFIT;
D O I
10.1007/s42081-019-00052-0
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
When covariates are assumed to be clustered in groups in regression problems, the group Lasso is useful, because it tends to drive all the weights in one group to zero together. The group Lasso includes a tuning parameter which controls a penalty level, and an unbiased estimator of the true prediction error is derived as a Cp-type criterion to select an appropriate value of the tuning parameter. However, in general, the Cp-type criterion cannot be derived in generalized linear regressions such as a logistic regression. Hence, this paper obtains the AIC for the group Lasso based on its original definition under the framework of generalized linear models. In terms of computational cost, our criterion is clearly better than the cross validation, but it is shown through simulation studies that the performance of the our criterion is almost the same as or better than that of the cross validation.
引用
收藏
页码:545 / 558
页数:14
相关论文
共 50 条
  • [41] Adaptive group LASSO selection in quantile models
    Ciuperca, Gabriela
    [J]. STATISTICAL PAPERS, 2019, 60 (01) : 173 - 197
  • [42] Adaptive group LASSO selection in quantile models
    Gabriela Ciuperca
    [J]. Statistical Papers, 2019, 60 : 173 - 197
  • [43] Identifying Pediatric Cancer Clusters in Florida Using Log-Linear Models and Generalized Lasso Penalties
    Wang, Hao
    Rodriguez, Abel
    [J]. STATISTICS AND PUBLIC POLICY, 2014, 1 (01): : 86 - 96
  • [44] Debiased lasso after sample splitting for estimation and inference in high-dimensional generalized linear models
    Vazquez, Omar
    Nan, Bin
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2024,
  • [45] A note on conditional AIC for linear mixed-effects models
    Liang, Hua
    Wu, Hulin
    Zou, Guohua
    [J]. BIOMETRIKA, 2008, 95 (03) : 773 - 778
  • [46] Generalized linear models
    Neuhaus, John
    McCulloch, Charles
    [J]. WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2011, 3 (05): : 407 - 413
  • [47] Estimation of group means using Bayesian generalized linear mixed models
    LaLonde, Amy
    Qu, Yongming
    [J]. PHARMACEUTICAL STATISTICS, 2020, 19 (04) : 482 - 491
  • [48] Estimation of group means when adjusting for covariates in generalized linear models
    Qu, Yongming
    Luo, Junxiang
    [J]. PHARMACEUTICAL STATISTICS, 2015, 14 (01) : 56 - 62
  • [49] Generalized linear models
    McCulloch, CE
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2000, 95 (452) : 1320 - 1324
  • [50] Generalized linear models
    Burzykowski, Tomasz
    Geubbelmans, Melvin
    Rousseau, Axel-Jan
    Valkenborg, Dirk
    [J]. AMERICAN JOURNAL OF ORTHODONTICS AND DENTOFACIAL ORTHOPEDICS, 2023, 164 (04) : 604 - 606