Can one estimate the conditional distribution of post-model-selection estimators?

被引:122
|
作者
Leeb, Hannes
Poetscher, Benedikt M.
机构
[1] Yale Univ, Dept Stat, New Haven, CT 06511 USA
[2] Univ Vienna, Dept Stat, A-1010 Vienna, Austria
来源
ANNALS OF STATISTICS | 2006年 / 34卷 / 05期
关键词
inference after model selection; post-model-selection estimator; pre-test estimator; selection of regressors; Akaike's information criterion AIC; thresholding; model uncertainty; consistency; uniform consistency; lower risk bound;
D O I
10.1214/009053606000000821
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider the problem of estimating the conditional distribution of a post-model-selection estimator where the conditioning is on the selected model. The notion of a post-model-selection estimator here refers to the combined procedure resulting from first selecting a model (e.g., by a model selection criterion such as AIC or by a hypothesis testing procedure) and then estimating the parameters in the selected model (e.g., by least-squares or maximum likelihood), all based on the same data set. We show that it is impossible to estimate this distribution with reasonable accuracy even asymptotically. In particular, we show that no estimator for this distribution can be uniformly consistent (not even locally). This follows as a corollary to (local) minimax lower bounds on the performance of estimators for this distribution. Similar impossibility results are also obtained for the conditional distribution of linear functions (e.g., predictors) of the post-model-selection estimator.
引用
收藏
页码:2554 / 2591
页数:38
相关论文
共 30 条