Convergence and sparsity of Lasso and group Lasso in high-dimensional generalized linear models

被引:0
|
作者
Lichun Wang
Yuan You
Heng Lian
机构
[1] Beijing Jiaotong University,Department of Mathematics
[2] Nanyang Technological University,Division of Mathematical Sciences, School of Physical and Mathematical Sciences
来源
Statistical Papers | 2015年 / 56卷
关键词
Grouped variables; Lasso penalty; Variable selection;
D O I
暂无
中图分类号
学科分类号
摘要
In this short paper, we investigate Lasso regularized generalized linear models in the “small n\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$n$$\end{document}, large p\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$p$$\end{document}” setting. While similar problems have been well-studied with SCAD penalty, the study of Lasso penalty is mostly restricted to the least squares loss function. Here we show the convergence rate of the Lasso penalized estimator as well as the sparsity property under suitable assumptions. We also extend the results to group Lasso regularized models when the variables are naturally grouped.
引用
下载
收藏
页码:819 / 828
页数:9
相关论文
共 50 条
  • [1] Convergence and sparsity of Lasso and group Lasso in high-dimensional generalized linear models
    Wang, Lichun
    You, Yuan
    Lian, Heng
    STATISTICAL PAPERS, 2015, 56 (03) : 819 - 828
  • [2] Adaptive group Lasso for high-dimensional generalized linear models
    Wang, Mingqiu
    Tian, Guo-Liang
    STATISTICAL PAPERS, 2019, 60 (05) : 1469 - 1486
  • [3] Overlapping group lasso for high-dimensional generalized linear models
    Zhou, Shengbin
    Zhou, Jingke
    Zhang, Bo
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2019, 48 (19) : 4903 - 4917
  • [4] Adaptive group Lasso for high-dimensional generalized linear models
    Mingqiu Wang
    Guo-Liang Tian
    Statistical Papers, 2019, 60 : 1469 - 1486
  • [5] High-dimensional generalized linear models and the lasso
    van de Geer, Sara A.
    ANNALS OF STATISTICS, 2008, 36 (02): : 614 - 645
  • [6] The sparsity and bias of the lasso selection in high-dimensional linear regression
    Zhang, Cun-Hui
    Huang, Jian
    ANNALS OF STATISTICS, 2008, 36 (04): : 1567 - 1594
  • [7] On the oracle property of adaptive group Lasso in high-dimensional linear models
    Zhang, Caiya
    Xiang, Yanbiao
    STATISTICAL PAPERS, 2016, 57 (01) : 249 - 265
  • [8] On the oracle property of adaptive group Lasso in high-dimensional linear models
    Caiya Zhang
    Yanbiao Xiang
    Statistical Papers, 2016, 57 : 249 - 265
  • [9] Moderately clipped LASSO for the high-dimensional generalized linear model
    Lee, Sangin
    Ku, Boncho
    Kown, Sunghoon
    COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2020, 27 (04) : 445 - 458
  • [10] The robust desparsified lasso and the focused information criterion for high-dimensional generalized linear models
    Pandhare, S. C.
    Ramanathan, T. V.
    STATISTICS, 2023, 57 (01) : 1 - 25