DCA based algorithms for feature selection in multi-class support vector machine

被引:16
|
作者
Hoai An Le Thi [1 ,2 ,3 ]
Manh Cuong Nguyen [3 ]
机构
[1] Ton Duc Thang Univ, Dept Management Sci & Technol Dev, Ho Chi Minh City, Vietnam
[2] Ton Duc Thang Univ, Fac Math & Stat, Ho Chi Minh City, Vietnam
[3] Univ Lorraine, Lab Theoret & Appl Comp Sci LITA EA 3097, F-57045 Metz, France
关键词
Feature selection; MSVM; DC programming; DCA; DC approximation; Exact penalty; GENE SELECTION; VARIABLE SELECTION; CANCER CLASSIFICATION; ADAPTIVE LASSO; SVM-RFE;
D O I
10.1007/s10479-016-2333-y
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper addresses the problem of feature selection for Multi-class Support Vector Machines. Two models involving the (the zero norm) and the - regularizations are considered for which two continuous approaches based on DC (Difference of Convex functions) programming and DCA (DC Algorithms) are investigated. The first is DC approximation via several sparse inducing functions and the second is an exact reformulation approach using penalty techniques. Twelve versions of DCA based algorithms are developed on which empirical computational experiments are fully performed. Numerical results on real-world datasets show the efficiency and the superiority of our methods versus one of the best standard algorithms on both feature selection and classification.
引用
收藏
页码:273 / 300
页数:28
相关论文
共 50 条
  • [1] DCA based algorithms for feature selection in multi-class support vector machine
    Hoai An Le Thi
    Manh Cuong Nguyen
    [J]. Annals of Operations Research, 2017, 249 : 273 - 300
  • [2] Efficient Algorithms for Feature Selection in Multi-class Support Vector Machine
    Hoai An Le Thi
    Manh Cuong Nguyen
    [J]. ADVANCED COMPUTATIONAL METHODS FOR KNOWLEDGE ENGINEERING, 2013, 479 : 41 - 52
  • [3] Feature selection with kernelized multi-class support vector machine
    Guo, Yinan
    Zhang, Zirui
    Tang, Fengzhen
    [J]. PATTERN RECOGNITION, 2021, 117
  • [4] Two multi-class lagrangian support vector machine algorithms
    Duan, Hua
    Liu, Quanchang
    He, Guoping
    Zeng, Qingtian
    [J]. ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS, PROCEEDINGS: WITH ASPECTS OF ARTIFICIAL INTELLIGENCE, 2007, 4682 : 891 - 899
  • [5] Gene selection based on multi-class support vector machines and genetic algorithms
    de Souza, Bruno Feres
    de Carvalho, Andre Ponce de Leon F.
    [J]. GENETICS AND MOLECULAR RESEARCH, 2005, 4 (03) : 599 - 607
  • [6] Multi-class support vector machine
    Franc, V
    Hlavác, V
    [J]. 16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL II, PROCEEDINGS, 2002, : 236 - 239
  • [7] Feature selection for multi-class problems using support vector machines
    Li, GZ
    Yang, J
    Liu, GP
    Xue, L
    [J]. PRICAI 2004: TRENDS IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2004, 3157 : 292 - 300
  • [8] An efficient algorithm on multi-class support vector machine model selection
    Xu, P
    Chan, AK
    [J]. PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS 2003, VOLS 1-4, 2003, : 3229 - 3232
  • [9] Multi-class support vector machine based on the minimization of class variance
    Zhiqiang Zhang
    Zeqian Xu
    Junyan Tan
    Hui Zou
    [J]. Neural Processing Letters, 2021, 53 : 517 - 533
  • [10] Multi-class support vector machine based on the minimization of class variance
    Zhang, Zhiqiang
    Xu, Zeqian
    Tan, Junyan
    Zou, Hui
    [J]. NEURAL PROCESSING LETTERS, 2021, 53 (01) : 517 - 533