PROJECTION-BASED INFERENCE FOR HIGH-DIMENSIONAL LINEAR MODELS

被引:0
|
作者
Yi, Sangyoon [1 ]
Zhang, Xianyang [1 ]
机构
[1] Texas A&M Univ, Dept Stat, College Stn, TX 77843 USA
关键词
Confidence interval; high-dimensional linear models; Lasso; quadratic programming; POST-SELECTION INFERENCE; CONFIDENCE-INTERVALS; REGIONS; RATES; TESTS;
D O I
10.5705/ss.202019.0283
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We develop a new method to estimate the projection direction in the debiased Lasso estimator. The basic idea is to decompose the overall bias into two terms, corresponding to strong and weak signals, respectively. We propose estimating the projection direction by balancing the squared biases associated with the strong and weak signals and the variance of the projection-based estimator. A standard quadratic programming solver can solve the resulting optimization problem efficiently. We show theoretically that the unknown set of strong signals can be estimated consistently, and that the projection-based estimator enjoys asymptotic normality under suitable assumptions. A slight modification of our procedure leads to an estimator with a potentially smaller order of bias than that of the original debiased Lasso. We further generalize our method to conduct an inference for a sparse linear combination of the regression coefficients. Numerical studies demonstrate the advantage of the proposed approach in terms of coverage accuracy over several existing alternatives.
引用
收藏
页码:915 / 937
页数:23
相关论文
共 50 条
  • [1] Projection-based High-dimensional Sign Test
    Hui Chen
    Chang Liang Zou
    Run Ze Li
    Acta Mathematica Sinica, English Series, 2022, 38 : 683 - 708
  • [2] Projection-based High-dimensional Sign Test
    Hui CHEN
    Chang Liang ZOU
    Run Ze LI
    Acta Mathematica Sinica,English Series, 2022, (04) : 683 - 708
  • [3] Projection-based High-dimensional Sign Test
    Chen, Hui
    Zou, Chang Liang
    Li, Run Ze
    ACTA MATHEMATICA SINICA-ENGLISH SERIES, 2022, 38 (04) : 683 - 708
  • [4] Projection-Based Partitioning for Large, High-Dimensional Datasets
    Ilies, Iulian
    Wilhelm, Adalbert
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2010, 19 (02) : 474 - 492
  • [5] Simultaneous Inference for High-Dimensional Linear Models
    Zhang, Xianyang
    Cheng, Guang
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (518) : 757 - 768
  • [6] High-dimensional inference in misspecified linear models
    Buehlmann, Peter
    van de Geer, Sara
    ELECTRONIC JOURNAL OF STATISTICS, 2015, 9 (01): : 1449 - 1473
  • [7] A projection-based conditional dependence measure with applications to high-dimensional undirected graphical models
    Fan, Jianqing
    Feng, Yang
    Xia, Lucy
    JOURNAL OF ECONOMETRICS, 2020, 218 (01) : 119 - 139
  • [8] Projection-based techniques for high-dimensional optimal transport problems
    Zhang, Jingyi
    Ma, Ping
    Zhong, Wenxuan
    Meng, Cheng
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2023, 15 (02)
  • [9] High-dimensional robust inference for censored linear models
    Jiayu Huang
    Yuanshan Wu
    Science China Mathematics, 2024, 67 : 891 - 918
  • [10] High-dimensional robust inference for censored linear models
    Huang, Jiayu
    Wu, Yuanshan
    SCIENCE CHINA-MATHEMATICS, 2024, 67 (04) : 891 - 918