A bootstrap recipe for post-model-selection inference under linear regression models

被引:4
|
作者
Lee, S. M. S. [1 ]
Wu, Y. [2 ]
机构
[1] Univ Hong Kong, Dept Stat & Actuarial Sci, Pokfulam, Hong Kong, Peoples R China
[2] Univ Waterloo, Dept Stat & Actuarial Sci, 200 Univ Ave West, Waterloo, ON N2L 3G1, Canada
关键词
Bootstrap; Least squares estimator; Post-model-selection; Regression; LEAST-SQUARES; CONFIDENCE-INTERVALS; VARIABLE SELECTION; LASSO;
D O I
10.1093/biomet/asy046
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
We propose a general bootstrap recipe for estimating the distributions of post-model-selection least squares estimators under a linear regression model. The recipe constrains residual bootstrapping within the most parsimonious, approximately correct, models to yield a distribution estimator which is consistent provided any wrong candidate model is sufficiently separated from the approximately correct ones. Our theory applies to a broad class of model selection methods based on information criteria or sparse estimation. The empirical performance of our procedure is illustrated with simulated data.
引用
收藏
页码:873 / 890
页数:18
相关论文
共 50 条
  • [41] Bootstrap variables selection in neural network regression models
    Giordano, F
    La Rocca, M
    Perna, C
    [J]. ADVANCES IN MULTIVARIATE DATA ANALYSIS, 2004, : 109 - 120
  • [42] Bootstrap approximation in a partially linear regression model
    Liang, H
    Härdle, W
    Sommerfeld, V
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2000, 91 (02) : 413 - 426
  • [43] Bootstrap Calibration in Functional Linear Regression Models with Applications
    Gonzalez-Manteiga, Wenceslao
    Martinez-Calvo, Adela
    [J]. COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, : 199 - 207
  • [44] Fast cluster bootstrap methods for linear regression models
    MacKinnon, James G.
    [J]. ECONOMETRICS AND STATISTICS, 2023, 26 : 52 - 71
  • [45] Bootstrap J tests of nonnested linear regression models
    Davidson, R
    MacKinnon, JG
    [J]. JOURNAL OF ECONOMETRICS, 2002, 109 (01) : 167 - 193
  • [46] Asymptotic bootstrap corrections of AIC for linear regression models
    Seghouane, Abd-Krim
    [J]. SIGNAL PROCESSING, 2010, 90 (01) : 217 - 224
  • [47] On the Length of Post-Model-Selection Confidence Intervals Conditional on Polyhedral Constraints
    Kivaranovic, Danijel
    Leeb, Hannes
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2021, 116 (534) : 845 - 857
  • [48] UNIFORM ASYMPTOTIC INFERENCE AND THE BOOTSTRAP AFTER MODEL SELECTION
    Tibshirani, Ryan J.
    Rinaldo, Alessandro
    Tibshirani, Rob
    Wasserman, Larry
    [J]. ANNALS OF STATISTICS, 2018, 46 (03): : 1255 - 1287
  • [49] Bias-Corrected Bootstrap Inference for Regression Models with Autocorrelated Errors
    Kim, Jae
    [J]. ECONOMICS BULLETIN, 2005, 3
  • [50] Predictive inference on equicorrelated linear regression models
    Khan, S
    Bhatti, MI
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 1998, 95 (2-3) : 205 - 217