Stochastic Stepwise Ensembles for Variable Selection

被引：37

作者：

Xin, Lu ^{[1
]}

Zhu, Mu ^{[1
]}

机构：

[1] Univ Waterloo, Dept Stat & Actuarial Sci, Waterloo, ON N2L 3G1, Canada

来源：

JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS | 2012年 / 21卷 / 02期

基金：

加拿大自然科学与工程研究理事会;

关键词：

False negative rate; False positive rate; LASSO; Ranking; Stochastic search; Strength-diversity tradeoff; REGRESSION; SHRINKAGE;

D O I：

10.1080/10618600.2012.679223

中图分类号：

O21 [概率论与数理统计]; C8 [统计学];

学科分类号：

020208 ; 070103 ; 0714 ;

摘要：

In this article, we advocate the ensemble approach for variable selection. We point out that the stochastic mechanism used to generate the variable-selection ensemble (VSE) must be picked with care. We construct a VSE using a stochastic stepwise algorithm and compare its performance with numerous state-of-the-art algorithms. Supplemental materials for the article are available online.

引用

页码：275 / 294

页数：20

共 50 条

[1] Stochastic correlation coefficient ensembles for variable selection
Che, JinXing
Yang, YouLong
[J]. JOURNAL OF APPLIED STATISTICS, 2017, 44 (10) : 1721 - 1742
[2] On selective learning in stochastic stepwise ensembles
Chun-Xia Zhang
Sang-Woon Kim
Jiang-She Zhang
[J]. International Journal of Machine Learning and Cybernetics, 2020, 11 : 217 - 230
[3] On selective learning in stochastic stepwise ensembles
Zhang, Chun-Xia
Kim, Sang-Woon
Zhang, Jiang-She
[J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2020, 11 (01) : 217 - 230
[4] Variable selection by ensembles for the Cox
Zhu, Mu
Fan, Guangzhe
[J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2011, 81 (12) : 1983 - 1992
[5] Pruning variable selection ensembles
Zhang, Chunxia
Wu, Yilei
Zhu, Mu
[J]. STATISTICAL ANALYSIS AND DATA MINING, 2019, 12 (03) : 168 - 184
[6] Stepwise variable selection in factor analysis
Yutaka Kano
Akira Harada
[J]. Psychometrika, 2000, 65 : 7 - 22
[7] Stepwise variable selection in factor analysis
Kano, Y
Harada, A
[J]. PSYCHOMETRIKA, 2000, 65 (01) : 7 - 22
[8] STEPWISE DISCRETE VARIABLE SELECTION PROCEDURE
GOLDSTEIN, M
DILLON, WR
[J]. COMMUNICATIONS IN STATISTICS PART A-THEORY AND METHODS, 1977, 6 (14): : 1423 - 1436
[9] A Novel Technique to Prune Variable Selection Ensembles
Ren, Liang-Pin
Zhang, Chun-Xia
Xuan, Hai-Yan
[J]. 2017 13TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2017, : 449 - 454
[10] Variable Selection by Stepwise Slicing in Nonparametric Regression
Nong, Jifu
[J]. INTERNATIONAL JOINT CONFERENCE ON COMPUTATIONAL SCIENCES AND OPTIMIZATION, VOL 1, PROCEEDINGS, 2009, : 430 - 433

← 1 2 3 4 5 →