A remark on the lasso and the Dantzig selector

被引:15
|
作者
de Castro, Yohann [1 ]
机构
[1] Univ Paris 11, Dept Math, Fac Sci Orsay, F-91405 Orsay, France
关键词
Lasso; Dantzig selector; Oracle inequality; Almost-Euclidean section; Distortion; MODEL SELECTION;
D O I
10.1016/j.spl.2012.09.020
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This article investigates a new parameter for the high-dimensional regression with noise: the distortion. This latter has attracted a lot of attention recently with the appearance of new deterministic constructions of "almost"-Euclidean sections of the L1-ball. It measures how far is the intersection between the kernel of the design matrix and the unit L1-ball from an L2-ball. We show that the distortion holds enough information to derive oracle inequalities (i.e. a comparison to an ideal situation where one knows the s largest coefficients of the target) for the lasso and the Dantzig selector. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:304 / 314
页数:11
相关论文
共 50 条
  • [1] SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
    Bickel, Peter J.
    Ritov, Ya'acov
    Tsybakov, Alexandre B.
    [J]. ANNALS OF STATISTICS, 2009, 37 (04): : 1705 - 1732
  • [2] Transductive versions of the LASSO and the Dantzig Selector
    Alquier, Pierre
    Hebiri, Mohamed
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2012, 142 (09) : 2485 - 2500
  • [3] DASSO: connections between the Dantzig selector and lasso
    James, Gareth M.
    Radchenko, Peter
    Lv, Jinchi
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2009, 71 : 127 - 142
  • [4] A Multi-Stage Framework for Dantzig Selector and LASSO
    Liu, Ji
    Wonka, Peter
    Ye, Jieping
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2012, 13 : 1189 - 1219
  • [5] A multi-stage framework for dantzig selector and LASSO
    Liu, Ji
    Wonka, Peter
    Ye, Jieping
    [J]. Journal of Machine Learning Research, 2012, 13 : 1189 - 1219
  • [6] Selecting Informative Genes by Lasso and Dantzig Selector for Linear Classifiers
    Zheng, Songfeng
    Liu, Weixiang
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2010, : 677 - 680
  • [7] Simultaneous lasso and dantzig selector in high dimensional nonparametric regression
    [J]. Wang, S. (wangshiqing@ncwu.edu.cn), 1600, CESER Publications, Post Box No. 113, Roorkee, 247667, India (42):
  • [8] Simultaneous Lasso and Dantzig Selector in High Dimensional Nonparametric Regression
    Wang, Shiqing
    Su, Limin
    [J]. INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS & STATISTICS, 2013, 42 (12): : 103 - 118
  • [9] Optimal Designs for Lasso and Dantzig Selector Using Expander Codes
    de Castro, Yohann
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (11) : 7293 - 7299
  • [10] Adaptive lasso and Dantzig selector for spatial point processes intensity estimation
    Choiruddin, Achmad
    Coeurjolly, Jean-Francois
    Letue, Frederique
    [J]. BERNOULLI, 2023, 29 (03) : 1849 - 1876