Stochastic Stepwise Ensembles for Variable Selection

被引:37
|
作者
Xin, Lu [1 ]
Zhu, Mu [1 ]
机构
[1] Univ Waterloo, Dept Stat & Actuarial Sci, Waterloo, ON N2L 3G1, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
False negative rate; False positive rate; LASSO; Ranking; Stochastic search; Strength-diversity tradeoff; REGRESSION; SHRINKAGE;
D O I
10.1080/10618600.2012.679223
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this article, we advocate the ensemble approach for variable selection. We point out that the stochastic mechanism used to generate the variable-selection ensemble (VSE) must be picked with care. We construct a VSE using a stochastic stepwise algorithm and compare its performance with numerous state-of-the-art algorithms. Supplemental materials for the article are available online.
引用
收藏
页码:275 / 294
页数:20
相关论文
共 50 条
  • [41] Feature selection for ensembles
    Opitz, DW
    SIXTEENTH NATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE (AAAI-99)/ELEVENTH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE (IAAI-99), 1999, : 379 - 384
  • [42] Strong Consistency of Variable Selection for Stationary Linear Stochastic Systems
    Zhao Wenxiao
    Yin, G. George
    Bai Er-Wei
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 1719 - 1723
  • [43] Stochastic search variable selection for log-linear models
    Ntzoufras, I
    Forster, JJ
    Dellaportas, P
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2000, 68 (01) : 23 - 37
  • [44] A STEPWISE VARIABLE SELECTION PROCEDURE FOR NON-LINEAR REGRESSION-MODELS - REPLY
    PEDUZZI, PN
    HARDY, RJ
    HOLFORD, TR
    BIOMETRICS, 1981, 37 (03) : 596 - 596
  • [45] Simultaneous outlier detection and variable selection via difference-based regression model and stochastic search variable selection
    Park, Jong Suk
    Park, Chun Gun
    Lee, Kyeong Eun
    COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2019, 26 (02) : 149 - 161
  • [46] Stochastic ensembles of thermodynamic potentials
    Feistel, Rainer
    ACCREDITATION AND QUALITY ASSURANCE, 2011, 16 (4-5) : 225 - 235
  • [47] Entropy of stochastic blockmodel ensembles
    Peixoto, Tiago P.
    PHYSICAL REVIEW E, 2012, 85 (05)
  • [48] On the stochastic control of quantum ensembles
    Brockett, R
    Khaneja, N
    SYSTEM THEORY: MODELING, ANALYSIS, AND CONTROL, 2000, 518 : 75 - 96
  • [49] Synchronization in ensembles of stochastic resonators
    Neiman, A
    Moss, F
    Schimansky-Geier, L
    Ebeling, W
    APPLIED NONLINEAR DYNAMICS AND STOCHASTIC SYSTEMS NEAR THE MILLENNIUM, 1997, (411): : 151 - 156
  • [50] Stochastic ensembles of thermodynamic potentials
    Rainer Feistel
    Accreditation and Quality Assurance, 2011, 16 : 225 - 235