Aggregation and sparsity via l1 penalized least squares

被引:39
|
作者
Bunea, Florentina [1 ]
Tsybakov, Alexandre B.
Wegkamp, Marten H.
机构
[1] Florida State Univ, Dept Stat, Tallahassee, FL 32306 USA
[2] Univ Paris 06, Lab Probabilites & Modeles Aleatoires, F-75252 Paris 05, France
[3] Inst Informat Transmiss Problems, Moscow, Russia
来源
LEARNING THEORY, PROCEEDINGS | 2006年 / 4005卷
关键词
D O I
10.1007/11776420_29
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper shows that near optimal rates of aggregation and adaptation to unknown sparsity can be simultaneously achieved via, penalized least squares in a nonparametric regression setting. The main tool is a novel oracle inequality on the sum between the empirical squared loss of the penalized least squares estimate and a term reflecting the sparsity of the unknown regression function.
引用
收藏
页码:379 / 391
页数:13
相关论文
共 50 条
  • [41] A Novel Method of DOA Tracking by Penalized Least Squares
    Panahi, Ashkan
    Viberg, Mats
    [J]. 2013 IEEE 5TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP 2013), 2013, : 61 - 64
  • [42] Generalized Penalized Least Squares and Its Statistical Characteristics
    DING Shijun TAO Benzao
    [J]. Geo-spatial Information Science, 2006, (04) : 255 - 259
  • [43] Complexity penalized least squares estimators: Analytical results
    Wittich, O.
    Kempe, A.
    Winkler, G.
    Liebscher, V.
    [J]. MATHEMATISCHE NACHRICHTEN, 2008, 281 (04) : 582 - 595
  • [44] Penalized Weighted Least Squares to Small Area Estimation
    Zhu, Rong
    Zou, Guohua
    Liang, Hua
    Zhu, Lixing
    [J]. SCANDINAVIAN JOURNAL OF STATISTICS, 2016, 43 (03) : 736 - 756
  • [45] Convergence of discrete and penalized least squares spherical splines
    Baramidze, Victoria
    Lai, Ming-Jun
    [J]. JOURNAL OF APPROXIMATION THEORY, 2011, 163 (09) : 1091 - 1106
  • [46] Generalized Penalized Least Squares and Its Statistical Characteristics
    Ding Shijun
    Tao Benzao
    [J]. GEO-SPATIAL INFORMATION SCIENCE, 2006, 9 (04) : 255 - 259
  • [47] Penalized least squares estimation with weakly dependent data
    JianQing Fan
    Lei Qi
    Xin Tong
    [J]. Science China Mathematics, 2016, 59 : 2335 - 2354
  • [48] Penalized least squares regression methods and applications to neuroimaging
    Bunea, Florentina
    She, Yiyuan
    Ombao, Hernando
    Gongvatana, Assawin
    Devlin, Kate
    Cohen, Ronald
    [J]. NEUROIMAGE, 2011, 55 (04) : 1519 - 1527
  • [49] Morphological weighted penalized least squares for background correction
    Li, Zhong
    Zhan, De-Jian
    Wang, Jia-Jun
    Huang, Jing
    Xu, Qing-Song
    Zhang, Zhi-Min
    Zheng, Yi-Bao
    Liang, Yi-Zeng
    Wang, Hong
    [J]. ANALYST, 2013, 138 (16) : 4483 - 4492
  • [50] `Evaluation of the Penalized Least Squares Method for Strain Computation
    Moulart, Raphael
    Rotinat, Rene
    [J]. EXPERIMENTAL AND APPLIED MECHANICS, VOL 4, 2016, : 43 - 50