DCA based algorithms for feature selection in multi-class support vector machine

被引:16
|
作者
Hoai An Le Thi [1 ,2 ,3 ]
Manh Cuong Nguyen [3 ]
机构
[1] Ton Duc Thang Univ, Dept Management Sci & Technol Dev, Ho Chi Minh City, Vietnam
[2] Ton Duc Thang Univ, Fac Math & Stat, Ho Chi Minh City, Vietnam
[3] Univ Lorraine, Lab Theoret & Appl Comp Sci LITA EA 3097, F-57045 Metz, France
关键词
Feature selection; MSVM; DC programming; DCA; DC approximation; Exact penalty; GENE SELECTION; VARIABLE SELECTION; CANCER CLASSIFICATION; ADAPTIVE LASSO; SVM-RFE;
D O I
10.1007/s10479-016-2333-y
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper addresses the problem of feature selection for Multi-class Support Vector Machines. Two models involving the (the zero norm) and the - regularizations are considered for which two continuous approaches based on DC (Difference of Convex functions) programming and DCA (DC Algorithms) are investigated. The first is DC approximation via several sparse inducing functions and the second is an exact reformulation approach using penalty techniques. Twelve versions of DCA based algorithms are developed on which empirical computational experiments are fully performed. Numerical results on real-world datasets show the efficiency and the superiority of our methods versus one of the best standard algorithms on both feature selection and classification.
引用
收藏
页码:273 / 300
页数:28
相关论文
共 50 条
  • [41] Feature selection and tumor classification for microarray data using relaxed Lasso and generalized multi-class support vector machine
    Kang, Chuanze
    Huo, Yanhao
    Xin, Lihui
    Tian, Baoguang
    Yu, Bin
    [J]. JOURNAL OF THEORETICAL BIOLOGY, 2019, 463 : 77 - 91
  • [42] Classification and feature selection algorithms for multi-class CGH data
    Liu, Jun
    Ranka, Sanjay
    Kahveci, Tamer
    [J]. BIOINFORMATICS, 2008, 24 (13) : I86 - I95
  • [43] Histogram Based Color Object Classification by Multi-class Support Vector Machine
    Mumcu, Tarik Veli
    Aliskan, Ibrahim
    Gulez, Kayhan
    Tuna, Gurkan
    [J]. ADVANCED INTELLIGENT COMPUTING, 2011, 6838 : 218 - +
  • [44] Hand postures recognition based on multi-class classification support vector machine
    Zhang, Kai
    [J]. Journal of Computational Information Systems, 2015, 11 (18): : 6789 - 6796
  • [45] Spike sorting based on multi-class support vector machine with superposition resolution
    Ding, Weidong
    Yuan, Jingqi
    [J]. MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2008, 46 (02) : 139 - 145
  • [46] Stellar Spectra Classification Method Based on Multi-Class Support Vector Machine
    Zhang Jing
    Liu Zhong-bao
    Song Wen-ai
    Fu Li-zhen
    Zhang Yong-lai
    [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38 (07) : 2307 - 2310
  • [47] Fuzzy Rules Extraction from Support Vector Machines for Multi-class Classification with Feature Selection
    Chaves, Adriana da Costa F.
    Vellasco, Marley
    Tanscheit, Ricardo
    [J]. ADVANCES IN NEURO-INFORMATION PROCESSING, PT II, 2009, 5507 : 386 - 393
  • [48] Spike sorting based on multi-class support vector machine with superposition resolution
    Weidong Ding
    Jingqi Yuan
    [J]. Medical & Biological Engineering & Computing, 2008, 46 : 139 - 145
  • [49] Multi-class prediction of weighted support vector machine based on temporal data
    Meng, Zhiqing
    Peng, Lifang
    Zhou, Gengui
    Zhu, Yihua
    [J]. 2006 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY, PTS 1 AND 2, PROCEEDINGS, 2006, : 73 - 77
  • [50] Descendant hierarchical support vector machine for multi-class problems
    Benabdeslem, Khalid
    [J]. 2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, : 1470 - 1475