A bootstrap recipe for post-model-selection inference under linear regression models

被引:4
|
作者
Lee, S. M. S. [1 ]
Wu, Y. [2 ]
机构
[1] Univ Hong Kong, Dept Stat & Actuarial Sci, Pokfulam, Hong Kong, Peoples R China
[2] Univ Waterloo, Dept Stat & Actuarial Sci, 200 Univ Ave West, Waterloo, ON N2L 3G1, Canada
关键词
Bootstrap; Least squares estimator; Post-model-selection; Regression; LEAST-SQUARES; CONFIDENCE-INTERVALS; VARIABLE SELECTION; LASSO;
D O I
10.1093/biomet/asy046
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
We propose a general bootstrap recipe for estimating the distributions of post-model-selection least squares estimators under a linear regression model. The recipe constrains residual bootstrapping within the most parsimonious, approximately correct, models to yield a distribution estimator which is consistent provided any wrong candidate model is sufficiently separated from the approximately correct ones. Our theory applies to a broad class of model selection methods based on information criteria or sparse estimation. The empirical performance of our procedure is illustrated with simulated data.
引用
收藏
页码:873 / 890
页数:18
相关论文
共 50 条
  • [31] Robust model selection using the out-of-bag bootstrap in linear regression
    Fazli Rabbi
    Alamgir Khalil
    Ilyas Khan
    Muqrin A. Almuqrin
    Umair Khalil
    Mulugeta Andualem
    [J]. Scientific Reports, 12
  • [32] Robust model selection using the out-of-bag bootstrap in linear regression
    Rabbi, Fazli
    Khalil, Alamgir
    Khan, Ilyas
    Almuqrin, Muqrin A.
    Khalil, Umair
    Andualem, Mulugeta
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [33] CALIBRATED PERCENTILE DOUBLE BOOTSTRAP FOR ROBUST LINEAR REGRESSION INFERENCE
    McCarthy, Daniel
    Zhang, Kai
    Brown, Lawrence D.
    Berk, Richard
    Buja, Andreas
    George, Edward, I
    Zhao, Linda
    [J]. STATISTICA SINICA, 2018, 28 (04) : 2565 - 2589
  • [34] Post-Selection Inference for Generalized Linear Models With Many Controls
    Belloni, Alexandre
    Chernozhukov, Victor
    Wei, Ying
    [J]. JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2016, 34 (04) : 606 - 619
  • [35] Cluster-Robust Bootstrap Inference in Quantile Regression Models
    Hagemann, Andreas
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (517) : 446 - 456
  • [36] PARTIALLY LINEAR MODEL SELECTION BY THE BOOTSTRAP
    Mueller, Samuel
    Vial, Celine
    [J]. AUSTRALIAN & NEW ZEALAND JOURNAL OF STATISTICS, 2009, 51 (02) : 183 - 200
  • [37] Can one estimate the unconditional distribution of post-model-selection estimators?
    Leeb, Hannes
    Poetscher, Benedikt M.
    [J]. ECONOMETRIC THEORY, 2008, 24 (02) : 338 - 376
  • [38] Can one estimate the conditional distribution of post-model-selection estimators?
    Leeb, Hannes
    Poetscher, Benedikt M.
    [J]. ANNALS OF STATISTICS, 2006, 34 (05): : 2554 - 2591
  • [39] On bandwidth selection in partial linear regression models under dependence
    Aneiros-Pérez, G
    [J]. STATISTICS & PROBABILITY LETTERS, 2002, 57 (04) : 393 - 401
  • [40] Fast bootstrap methodology for regression model selection
    Lendasse, A
    Simon, G
    Wertz, V
    Verleysen, M
    [J]. NEUROCOMPUTING, 2005, 64 : 161 - 181