Optimal feature selection for support vector machines

被引:149
|
作者
Nguyen, Minh Hoai [1 ]
de la Torre, Fernando [1 ]
机构
[1] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
关键词
Support vector machine; Feature selection; Feature extraction;
D O I
10.1016/j.patcog.2009.09.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Selecting relevant features for support vector machine (SVM) classifiers is important for a variety of reasons such as generalization performance, computational efficiency, and feature interpretability. Traditional SVM approaches to feature selection typically extract features and learn SVM parameters independently. Independently performing these two steps might result in a loss of information related to the classification process. This paper proposes a convex energy-based framework to jointly perform feature selection and SVM parameter learning for linear and non-linear kernels. Experiments on various databases show significant reduction of features used while maintaining classification performance. (C) 2009 Elsevier Ltd. All rights reserved.
引用
收藏
页码:584 / 591
页数:8
相关论文
共 50 条
  • [1] Feature selection for support vector machines
    Hermes, L
    Buhmann, JM
    [J]. 15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS: PATTERN RECOGNITION AND NEURAL NETWORKS, 2000, : 712 - 715
  • [2] Feature selection for bagging of support vector machines
    Li, Guo-Zheng
    Liu, Tian-Yu
    [J]. PRICAI 2006: TRENDS IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2006, 4099 : 271 - 277
  • [3] Feature selection for multiclass support vector machines
    Aazi, F. Z.
    Abdesselam, R.
    Achchab, B.
    Elouardighi, A.
    [J]. AI COMMUNICATIONS, 2016, 29 (05) : 583 - 593
  • [4] Stable Feature Selection with Support Vector Machines
    Kamkar, Iman
    Gupta, Sunil Kumar
    Dinh Phung
    Venkatesh, Svetha
    [J]. AI 2015: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2015, 9457 : 298 - 308
  • [5] Feature selection for linear support vector machines
    Liang, Zhizheng
    Zhao, Tuo
    [J]. 18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2006, : 606 - 609
  • [6] Optimal parameter selection in support vector machines
    Schittkowski, K.
    [J]. JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2005, 1 (04) : 465 - 476
  • [7] Linear penalization support vector machines for feature selection
    Miranda, J
    Montoya, R
    Weber, R
    [J]. PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PROCEEDINGS, 2005, 3776 : 188 - 192
  • [8] Comparison of Feature Selection Methods in Support Vector Machines
    Kim, Kwangsu
    Park, Changyi
    [J]. KOREAN JOURNAL OF APPLIED STATISTICS, 2013, 26 (01) : 131 - 139
  • [9] Feature selection using support vector machines.
    Brank, J
    Grobelnik, M
    Milic-Frayling, N
    Mladenic, D
    [J]. DATA MINING III, 2002, 6 : 261 - 273
  • [10] Feature selection for support vector machines with RBF kernel
    Quanzhong Liu
    Chihau Chen
    Yang Zhang
    Zhengguo Hu
    [J]. Artificial Intelligence Review, 2011, 36 : 99 - 115