CONFIDENCE SETS IN SPARSE REGRESSION

被引:59
|
作者
Nickl, Richard [1 ]
van de Geer, Sara [2 ]
机构
[1] Univ Cambridge, Dept Pure Math & Math Stat, Stat Lab, Cambridge CB3 0WB, England
[2] ETH, CH-8092 Zurich, Switzerland
来源
ANNALS OF STATISTICS | 2013年 / 41卷 / 06期
关键词
Composite testing problem; high-dimensional inference; detection boundary; quadratic risk estimation; GAUSSIAN REGRESSION; DANTZIG SELECTOR; ESTIMATORS; BALLS; BANDS;
D O I
10.1214/13-AOS1170
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The problem of constructing confidence sets in the high-dimensional linear model with n response variables and p parameters, possibly p >= n, is considered. Full honest adaptive inference is possible if the rate of sparse estimation does not exceed n(-1/4), otherwise sparse adaptive confidence sets exist only over strict subsets of the parameter spaces for which sparse estimators exist. Necessary and sufficient conditions for the existence of confidence sets that adapt to a fixed sparsity level of the parameter vector are given in terms of minimal l(2)-separation conditions on the parameter space. The design conditions cover common coherence assumptions used in models for sparsity, including (possibly correlated) sub-Gaussian designs.
引用
收藏
页码:2852 / 2876
页数:25
相关论文
共 50 条
  • [1] Confidence sets for nonparametric wavelet regression
    Genovese, CR
    Wasserman, L
    [J]. ANNALS OF STATISTICS, 2005, 33 (02): : 698 - 729
  • [2] Sparse confidence sets for normal mean models
    Ning, Yang
    Cheng, Guang
    [J]. INFORMATION AND INFERENCE-A JOURNAL OF THE IMA, 2023, 12 (03)
  • [3] Estimation and confidence sets for sparse normal mixtures
    Cai, T. Tony
    Jin, Jiashun
    Low, Mark G.
    [J]. ANNALS OF STATISTICS, 2007, 35 (06): : 2421 - 2449
  • [4] A SIMULTANEOUS CONFIDENCE BAND FOR SPARSE LONGITUDINAL REGRESSION
    Ma, Shujie
    Yang, Lijian
    Carroll, Raymond J.
    [J]. STATISTICA SINICA, 2012, 22 (01) : 95 - 122
  • [5] Adaptive confidence sets in shape restricted regression
    Bellec, Pierre C.
    [J]. BERNOULLI, 2021, 27 (01) : 66 - 92
  • [6] Implementable confidence sets in high dimensional regression
    Carpentier, Alexandra
    [J]. ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 38, 2015, 38 : 120 - 128
  • [7] Confidence sets for a level set in linear regression
    Wan, Fang
    Liu, Wei
    Bretz, Frank
    [J]. STATISTICS IN MEDICINE, 2024, 43 (06) : 1103 - 1118
  • [8] Universal confidence sets for the mode of a regression function
    Sinotina, Tatiana
    Vogel, Silvia
    [J]. IMA JOURNAL OF MANAGEMENT MATHEMATICS, 2012, 23 (04) : 309 - 323
  • [9] Sparse regression for large data sets with outliers
    Bottmer, Lea
    Croux, Christophe
    Wilms, Ines
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2022, 297 (02) : 782 - 794
  • [10] Confidence Intervals for Sparse Penalized Regression With Random Designs
    Yu, Guan
    Yin, Liang
    Lu, Shu
    Liu, Yufeng
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2020, 115 (530) : 794 - 809