Multi-Objective Models for Sparse Optimization in Linear Support Vector Machine Classification

被引:0
|
作者
Pirouz, Behzad [1 ]
Pirouz, Behrouz [2 ]
机构
[1] Univ Calabria, Dept Comp Engn Modelling Elect & Syst Engn, I-87036 Arcavacata Di Rende, Italy
[2] Univ Calabria, Dept Civil Engn, I-87036 Arcavacata Di Rende, Italy
关键词
support vector machine; feature selection; sparse optimization; multi-objective optimization problems; multi-objective machine learning; EPSILON-CONSTRAINT METHOD;
D O I
10.3390/math11173721
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The design of linear Support Vector Machine (SVM) classification techniques is generally a Multi-objective Optimization Problem (MOP). These classification techniques require finding appropriate trade-offs between two objectives, such as the amount of misclassified training data (classification error) and the number of non-zero elements of the separator hyperplane. In this article, we review several linear SVM classification models in the form of multi-objective optimization. We put particular emphasis on applying sparse optimization (in terms of minimization of the number of non-zero elements of the separator hyperplane) to Feature Selection (FS) for multi-objective optimization linear SVM. Our primary purpose is to demonstrate the advantages of considering linear SVM classification techniques as MOPs. In multi-objective cases, we can obtain a set of Pareto optimal solutions instead of one optimal solution in single-objective cases. The results of these linear SVMs are reported on some classification datasets. The test problems are specifically designed to challenge the number of non-zero components of the normal vector of the separator hyperplane. We used these datasets for multi-objective and single-objective models.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] ADHD classification based on a multi-objective support vector machine
    Du, Hai-Peng
    Shao, Li-Zhen
    Zhang, Dong-Hui
    [J]. Gongcheng Kexue Xuebao/Chinese Journal of Engineering, 2020, 42 (04): : 441 - 447
  • [2] Solving Dynamic Multi-objective Optimization Problems via Support Vector Machine
    Jiang, Min
    Hu, Weizhen
    Qiu, Liming
    Shi, Minghui
    Tan, Kay Chen
    [J]. PROCEEDINGS OF 2018 TENTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2018, : 819 - 824
  • [3] A multi-objective artificial immune algorithm for parameter optimization in support vector machine
    Aydin, Ilhan
    Karakose, Mehmet
    Akin, Erhan
    [J]. APPLIED SOFT COMPUTING, 2011, 11 (01) : 120 - 129
  • [4] Application of Particle Swarm Optimization Based on Support Vector Machine in Multi-objective Structure Optimization
    Chang, Chenyang
    Zhai, Jingmei
    Xia, Qinxiang
    Cai, Bing
    [J]. ADVANCES IN ENGINEERING DESIGN AND OPTIMIZATION III, PTS 1 AND 2, 2012, 201-202 : 283 - +
  • [5] Least Squares Support Vector Machine for Ranking Solutions of Multi-Objective Water Resources Allocation Optimization Models
    Liu, Weilin
    Liu, Lina
    Tong, Fang
    [J]. WATER, 2017, 9 (04)
  • [6] Using support vector machines in multi-objective optimization
    Yun, YB
    Nakayama, H
    Arakawa, M
    [J]. 2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 223 - 228
  • [7] Multi-objective optimization for support vector regression parameters
    Wang, Xiaogang
    Tong, Zhen
    Wang, Fuli
    [J]. Information, Management and Algorithms, Vol II, 2007, : 194 - 196
  • [8] Solving Dynamic Multi-objective Optimization Problems Using Incremental Support Vector Machine
    Hu, Weizhen
    Jiang, Min
    Gao, Xing
    Tan, Kay Chen
    Cheung, Yiu-ming
    [J]. 2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2019, : 2794 - 2799
  • [9] Multi-objective multiclass support vector machine for pattern recognition
    Tatsumi, K.
    Hayashida, K.
    Higashi, H.
    Tanino, T.
    [J]. PROCEEDINGS OF SICE ANNUAL CONFERENCE, VOLS 1-8, 2007, : 1091 - 1094
  • [10] Robust Image Watermarking Using Support Vector Machine and Multi-objective Particle Swarm Optimization
    Jain, Kapil
    Kumar, Parmalik
    [J]. ADVANCES IN COMPUTING AND DATA SCIENCES, PT I, 2021, 1440 : 571 - 591