Variable selection using penalized empirical likelihood

被引:11
|
作者
Ren YunWen [1 ,2 ]
Zhang XinSheng [1 ]
机构
[1] Fudan Univ, Sch Management, Dept Stat, Shanghai 200433, Peoples R China
[2] Peking Univ, Guanghua Sch Management, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
EmBIC; moment restrictions; oracle property; penalized empirical likelihood (PEL); SCAD; tuning parameters; MODEL SELECTION; REGRESSION; LASSO;
D O I
10.1007/s11425-011-4231-8
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper considers variable selection for moment restriction models. We propose a penalized empirical likelihood (PEL) approach that has desirable asymptotic properties comparable to the penalized likelihood approach, which relies on a correct parametric likelihood specification. In addition to being consistent and having the oracle property, PEL admits inference on parameter without having to estimate its estimator's covariance. An approximate algorithm, along with a consistent BIC-type criterion for selecting the tuning parameters, is provided for PEL. The proposed algorithm enjoys considerable computational efficiency and overcomes the drawback of the local quadratic approximation of nonconcave penalties. Simulation studies to evaluate and compare the performances of our method with those of the existing ones show that PEL is competitive and robust. The proposed method is illustrated with two real examples.
引用
收藏
页码:1829 / 1845
页数:17
相关论文
共 50 条
  • [41] Variable selection in generalized estimating equations via empirical likelihood and Gaussian pseudo-likelihood
    Xu, Jianwen
    Zhang, Jiamao
    Fu, Liya
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2019, 48 (04) : 1239 - 1250
  • [42] A penalized criterion for variable selection in classification
    Mary-Huard, Tristan
    Robin, Stephane
    Daudin, Jean-Jacques
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2007, 98 (04) : 695 - 705
  • [43] Variable selection in semiparametric cure models based on penalized likelihood, with application to breast cancer clinical trials
    Liu, Xiang
    Peng, Yingwei
    Tu, Dongsheng
    Liang, Hua
    [J]. STATISTICS IN MEDICINE, 2012, 31 (24) : 2882 - 2891
  • [44] Orthogonal weighted empirical likelihood-based variable selection for semiparametric instrumental variable models
    Huang, Jiting
    Zhao, Peixin
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2018, 47 (18) : 4375 - 4388
  • [45] Selection of Mixed Copula Model via Penalized Likelihood
    Cai, Zongwu
    Wang, Xian
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2014, 109 (506) : 788 - 801
  • [46] A Penalized h-Likelihood Variable Selection Algorithm for Generalized Linear Regression Models with Random Effects
    Xie, Yanxi
    Li, Yuewen
    Xia, Zhijie
    Yan, Ruixia
    Luan, Dongqing
    [J]. COMPLEXITY, 2020, 2020
  • [47] Tuning parameter selection in high dimensional penalized likelihood
    Fan, Yingying
    Tang, Cheng Yong
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2013, 75 (03) : 531 - 552
  • [48] Penalized likelihood and Bayesian function selection in regression models
    Fabian Scheipl
    Thomas Kneib
    Ludwig Fahrmeir
    [J]. AStA Advances in Statistical Analysis, 2013, 97 : 349 - 385
  • [49] Differentially private model selection with penalized and constrained likelihood
    Lei, Jing
    Charest, Anne-Sophie
    Slavkovic, Aleksandra
    Smith, Adam
    Fienberg, Stephen
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-STATISTICS IN SOCIETY, 2018, 181 (03) : 609 - 633
  • [50] Penalized likelihood and Bayesian function selection in regression models
    Scheipl, Fabian
    Kneib, Thomas
    Fahrmeir, Ludwig
    [J]. ASTA-ADVANCES IN STATISTICAL ANALYSIS, 2013, 97 (04) : 349 - 385