A bootstrap recipe for post-model-selection inference under linear regression models

被引:4
|
作者
Lee, S. M. S. [1 ]
Wu, Y. [2 ]
机构
[1] Univ Hong Kong, Dept Stat & Actuarial Sci, Pokfulam, Hong Kong, Peoples R China
[2] Univ Waterloo, Dept Stat & Actuarial Sci, 200 Univ Ave West, Waterloo, ON N2L 3G1, Canada
关键词
Bootstrap; Least squares estimator; Post-model-selection; Regression; LEAST-SQUARES; CONFIDENCE-INTERVALS; VARIABLE SELECTION; LASSO;
D O I
10.1093/biomet/asy046
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
We propose a general bootstrap recipe for estimating the distributions of post-model-selection least squares estimators under a linear regression model. The recipe constrains residual bootstrapping within the most parsimonious, approximately correct, models to yield a distribution estimator which is consistent provided any wrong candidate model is sufficiently separated from the approximately correct ones. Our theory applies to a broad class of model selection methods based on information criteria or sparse estimation. The empirical performance of our procedure is illustrated with simulated data.
引用
收藏
页码:873 / 890
页数:18
相关论文
共 50 条
  • [1] Post-model-selection inference in linear regression models: An integrated review
    Zhang, Dongliang
    Khalili, Abbas
    Asgharian, Masoud
    [J]. STATISTICS SURVEYS, 2022, 16 : 86 - 136
  • [2] Post-Model-Selection Prediction Intervals for Generalized Linear Models
    Dustin, Dean
    Clarke, Bertrand
    [J]. SANKHYA-SERIES A-MATHEMATICAL STATISTICS AND PROBABILITY, 2024,
  • [3] Bootstrap inference in functional linear regression models with scalar response under heteroscedasticity
    Yeon, Hyemin
    Dai, Xiongtao
    Nordman, Daniel J.
    [J]. ELECTRONIC JOURNAL OF STATISTICS, 2024, 18 (02): : 3590 - 3627
  • [4] Bootstrap inference in functional linear regression models with scalar response
    Yeon, Hyemin
    Dai, Xiongtao
    Nordman, Daniel J.
    [J]. BERNOULLI, 2023, 29 (04) : 2599 - 2626
  • [5] Model selection in linear regression using paired bootstrap
    Rabbi, Fazli
    Khan, Salahuddin
    Khalil, Alamgir
    Mashwani, Wali Khan
    Shafiq, Muhammad
    Goktas, Pinar
    Unvan, Yuksel Akay
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2021, 50 (07) : 1629 - 1639
  • [6] Bootstrap model selection in generalized linear models
    Pan, W
    Le, CT
    [J]. JOURNAL OF AGRICULTURAL BIOLOGICAL AND ENVIRONMENTAL STATISTICS, 2001, 6 (01) : 49 - 61
  • [7] Bootstrap model selection in generalized linear models
    Wei Pan
    Chap T. Le
    [J]. Journal of Agricultural, Biological, and Environmental Statistics, 2001, 6
  • [8] VALID POST-SELECTION INFERENCE IN MODEL-FREE LINEAR REGRESSION
    Kuchibhotla, Arun K.
    Brown, Lawrence D.
    Buja, Andreas
    Cai, Junhui
    George, Edward, I
    Zhao, Linda H.
    [J]. ANNALS OF STATISTICS, 2020, 48 (05): : 2953 - 2981
  • [9] Bayesian Post-Model-Selection Estimation
    Harel, Nadav
    Routtenberg, Tirza
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 175 - 179
  • [10] On Various Confidence Intervals Post-Model-Selection
    Leeb, Hannes
    Poetscher, Benedikt M.
    Ewald, Karl
    [J]. STATISTICAL SCIENCE, 2015, 30 (02) : 216 - 227