DCA based algorithms for feature selection in multi-class support vector machine

被引:16
|
作者
Hoai An Le Thi [1 ,2 ,3 ]
Manh Cuong Nguyen [3 ]
机构
[1] Ton Duc Thang Univ, Dept Management Sci & Technol Dev, Ho Chi Minh City, Vietnam
[2] Ton Duc Thang Univ, Fac Math & Stat, Ho Chi Minh City, Vietnam
[3] Univ Lorraine, Lab Theoret & Appl Comp Sci LITA EA 3097, F-57045 Metz, France
关键词
Feature selection; MSVM; DC programming; DCA; DC approximation; Exact penalty; GENE SELECTION; VARIABLE SELECTION; CANCER CLASSIFICATION; ADAPTIVE LASSO; SVM-RFE;
D O I
10.1007/s10479-016-2333-y
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper addresses the problem of feature selection for Multi-class Support Vector Machines. Two models involving the (the zero norm) and the - regularizations are considered for which two continuous approaches based on DC (Difference of Convex functions) programming and DCA (DC Algorithms) are investigated. The first is DC approximation via several sparse inducing functions and the second is an exact reformulation approach using penalty techniques. Twelve versions of DCA based algorithms are developed on which empirical computational experiments are fully performed. Numerical results on real-world datasets show the efficiency and the superiority of our methods versus one of the best standard algorithms on both feature selection and classification.
引用
收藏
页码:273 / 300
页数:28
相关论文
共 50 条
  • [21] Network Intrusion Detection Based on Multi-Class Support Vector Machine
    Anh Vu Le
    Hoai An Le Thi
    Manh Cuong Nguyen
    Zidna, Ahmed
    [J]. COMPUTATIONAL COLLECTIVE INTELLIGENCE - TECHNOLOGIES AND APPLICATIONS, PT I, 2012, 7653 : 536 - 543
  • [22] Bangla Sign Digits Recognition Using HOG Feature Based Multi-Class Support Vector Machine
    Hasan, Md Mahmudul
    Ahsan, Sk Mohammad Masudul
    [J]. 2019 4TH INTERNATIONAL CONFERENCE ON ELECTRICAL INFORMATION AND COMMUNICATION TECHNOLOGY (EICT), 2019,
  • [23] A Novel Technique for Support Vector Machine based Multi-class Classifier
    Manikandan, J.
    Venkataramani, B.
    Amudha, V.
    Arafat, A. Majed
    Sahu, Hruday
    [J]. 2008 IEEE REGION 10 CONFERENCE: TENCON 2008, VOLS 1-4, 2008, : 134 - 139
  • [24] Support Vector Machine Based Fast Multi-Class Classification Method
    Song, Zhao-Qing
    Chen, Yao
    Guo, Zhen-Kai
    Zhang, Yuan
    [J]. INTERNATIONAL CONFERENCE ON CONTROL ENGINEERING AND AUTOMATION (ICCEA 2014), 2014, : 1 - 7
  • [25] A NEW SCATTER-BASED MULTI-CLASS SUPPORT VECTOR MACHINE
    Jenssen, Robert
    Kloft, Marius
    Sonnenburg, Soeren
    Zien, Alexander
    Mueller, Klaus-Robert
    [J]. 2011 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2011,
  • [26] WEIGHTED MULTI-CLASS SUPPORT VECTOR MACHINE BASED ON BINARY TREE
    Mi, Xiao-Ya
    Ha, Ming-Hu
    Chen, Xu
    [J]. PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 1293 - +
  • [27] Multi-class sentiment classification: The experimental comparisons of feature selection and machine learning algorithms
    Liu, Yang
    Bi, Jian-Wu
    Fan, Zhi-Ping
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2017, 80 : 323 - 339
  • [28] A Novel Multi-class Support Vector Machine Based on Fuzzy Theories
    Zhang, Yong
    Chi, Zhongxian
    Sun, Yu
    [J]. INTELLIGENT COMPUTING, PART I: INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING, ICIC 2006, PART I, 2006, 4113 : 42 - 50
  • [29] MULTI-CLASS FUZZY SUPPORT VECTOR MACHINE BASED ON DISMISSING MARGIN
    Yan, Wei-Yun
    He, Qiang
    [J]. PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 1139 - +
  • [30] Optimal Decision Tree Based Multi-class Support Vector Machine
    Bala, Manju
    Agrawal, R. K.
    [J]. INFORMATICA-JOURNAL OF COMPUTING AND INFORMATICS, 2011, 35 (02): : 197 - 209