DCA based algorithms for feature selection in multi-class support vector machine

被引:16
|
作者
Hoai An Le Thi [1 ,2 ,3 ]
Manh Cuong Nguyen [3 ]
机构
[1] Ton Duc Thang Univ, Dept Management Sci & Technol Dev, Ho Chi Minh City, Vietnam
[2] Ton Duc Thang Univ, Fac Math & Stat, Ho Chi Minh City, Vietnam
[3] Univ Lorraine, Lab Theoret & Appl Comp Sci LITA EA 3097, F-57045 Metz, France
关键词
Feature selection; MSVM; DC programming; DCA; DC approximation; Exact penalty; GENE SELECTION; VARIABLE SELECTION; CANCER CLASSIFICATION; ADAPTIVE LASSO; SVM-RFE;
D O I
10.1007/s10479-016-2333-y
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper addresses the problem of feature selection for Multi-class Support Vector Machines. Two models involving the (the zero norm) and the - regularizations are considered for which two continuous approaches based on DC (Difference of Convex functions) programming and DCA (DC Algorithms) are investigated. The first is DC approximation via several sparse inducing functions and the second is an exact reformulation approach using penalty techniques. Twelve versions of DCA based algorithms are developed on which empirical computational experiments are fully performed. Numerical results on real-world datasets show the efficiency and the superiority of our methods versus one of the best standard algorithms on both feature selection and classification.
引用
收藏
页码:273 / 300
页数:28
相关论文
共 50 条
  • [31] A new Support Vector Machine for multi-class classification
    Tian, YJ
    Qi, ZQ
    Deng, NY
    [J]. FIFTH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY - PROCEEDINGS, 2005, : 18 - 22
  • [32] MSVMpack: A Multi-Class Support Vector Machine Package
    Lauer, Fabien
    Guermeur, Yann
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2011, 12 : 2293 - 2296
  • [33] Support vector machine networks for multi-class classification
    Shih, FY
    Zhang, K
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2005, 19 (06) : 775 - 786
  • [34] Feature Selection via Scaling Factor Integrated Multi-Class Support Vector Machines
    Xu, Jinglin
    Nie, Feiping
    Han, Junwei
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3168 - 3174
  • [35] A new support vector machine for multi-class classification
    Qi, ZQ
    Tian, YJ
    Deng, NY
    [J]. COMPUTATIONAL INTELLIGENCE AND SECURITY, PT 1, PROCEEDINGS, 2005, 3801 : 580 - 585
  • [36] A MULTI-CLASS SUPPORT VECTOR MACHINE: THEORY AND MODEL
    Sun, Minghe
    [J]. INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING, 2013, 12 (06) : 1175 - 1199
  • [37] A Twin Multi-Class Classification Support Vector Machine
    Yitian Xu
    Rui Guo
    Laisheng Wang
    [J]. Cognitive Computation, 2013, 5 : 580 - 588
  • [38] Linear Multi-class Classification Support Vector Machine
    Xu, Yan
    Shao, Yuanhai
    Tian, Yingjie
    Deng, Naiyang
    [J]. CUTTING-EDGE RESEARCH TOPICS ON MULTIPLE CRITERIA DECISION MAKING, PROCEEDINGS, 2009, 35 : 635 - +
  • [39] A Twin Multi-Class Classification Support Vector Machine
    Xu, Yitian
    Guo, Rui
    Wang, Laisheng
    [J]. COGNITIVE COMPUTATION, 2013, 5 (04) : 580 - 588
  • [40] Multi-Class Support Vector Machine for Credit Scoring
    Tang, Bo
    Qiu, Saibing
    [J]. ADVANCES IN COMPUTING, CONTROL AND INDUSTRIAL ENGINEERING, 2012, 235 : 419 - 422