The soft-margin Support Vector Machine with ordered weighted average

被引:12
|
作者
Marin, Alfredo [1 ]
Martinez-Merino, Luisa I. [2 ,3 ,4 ]
Puerto, Justo [2 ]
Rodriguez-Chia, Antonio M. [3 ]
机构
[1] Univ Murcia, Fac Matemat, Dept Estadist & Invest Operat, Murcia, Spain
[2] Univ Sevilla IMUS, Inst Matemat, Seville, Spain
[3] Univ Cadiz, Fac Ciencias, Dept Estadist & Invest Operat, Puerto Real, Cadiz, Spain
[4] Univ Cadiz, Puerto Real, Cadiz, Spain
关键词
Data science; Classification; Support Vector Machine; OWA operators; Mixed integer quadratic programming; FEATURE-SELECTION; FORMULATIONS;
D O I
10.1016/j.knosys.2021.107705
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper deals with a cost sensitive extension of the standard Support Vector Machine (SVM) using an ordered weighted sum of the deviations of misclassified individuals with respect to their corresponding supporting hyperplanes. In contrast with previous heuristic approaches, an exact method that applies the ordered weighted average operator in the classical SVM model is proposed. Specifically, when weights are sorted in non-decreasing order, a quadratic continuous formulation is developed. For general weights, a mixed integer quadratic formulation is proposed. In addition, our results prove that nonlinear kernel functions can be also applied to these new models extending its applicability beyond the linear case. Extensive computational results reported in the paper show that the predictive performance provided by the proposed exact solution approaches are better than the ones provided by the classical models (linear and nonlinear kernel) and similar or better than the previous ones provided by the heuristic solution by Maldonado et al. (2018). (c) 2021 The Authors. Published by Elsevier B.V.This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by- nc- nd/4.0/).
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Support vector machine soft margin classifiers: Error analysis
    Chen, DR
    Wu, Q
    Ying, YM
    Zhou, DX
    JOURNAL OF MACHINE LEARNING RESEARCH, 2004, 5 : 1143 - 1175
  • [22] Soft-Margin Mixture of Regressions
    Huang, Dong
    Han, Longfei
    De la Torre, Fernando
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4058 - 4066
  • [23] Soft sensor modeling based on the soft margin support vector regression machine
    Ye, Tao
    Zhu, Xuefeng
    Huang, Daoping
    Li, Xiangyang
    2007 IEEE INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION, VOLS 1-7, 2007, : 3279 - 3284
  • [24] Soft-Margin Softmax for Deep Classification
    Liang, Xuezhi
    Wang, Xiaobo
    Lei, Zhen
    Liao, Shengcai
    Li, Stan Z.
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 413 - 421
  • [25] Soft-margin classification of object manifolds
    Cohen, Uri
    Sompolinsky, Haim
    PHYSICAL REVIEW E, 2022, 106 (02)
  • [26] A Fuzzy Support Vector Machine with Weighted Margin for Flight Delay Early Warning
    Chen, Haiyan
    Wang, Jiandong
    Yan, Xuefeng
    FIFTH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, VOL 3, PROCEEDINGS, 2008, : 331 - 335
  • [27] UAV Anomaly Detection Method Based on Convolutional Autoencoder and Support Vector Data Description with 0/1 Soft-Margin Loss
    Chen, Huakun
    Lyu, Yongxi
    Shi, Jingping
    Zhang, Weiguo
    DRONES, 2024, 8 (10)
  • [28] Robust 1-Norm Soft Margin Smooth Support Vector Machine
    Chien, Li-Jen
    Lee, Yuh-Jye
    Kao, Zhi-Peng
    Chang, Chih-Cheng
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2010, 2010, 6283 : 145 - 152
  • [29] Quantum algorithm for soft margin support vector machine with hinge loss function
    Hailing L.
    Jie Z.
    Sujuan Q.
    Fei G.
    Journal of China Universities of Posts and Telecommunications, 2022, 29 (04): : 32 - 41
  • [30] Quantum algorithm for soft margin support vector machine with hinge loss function
    Liu Hailing
    Zhang Jie
    Qin Sujuan
    Gao Fei
    The Journal of China Universities of Posts and Telecommunications, 2022, 29 (04) : 32 - 41