Robust L1-norm multi-weight vector projection support vector machine with efficient algorithm

被引:13
|
作者
Chen, Wei-Jie [1 ,2 ]
Li, Chun-Na [1 ]
Shao, Yuan-Hai [3 ]
Zhang, Ju [1 ]
Deng, Nai-Yang [4 ]
机构
[1] Zhejiang Univ Technol, Zhijiang Coll, Hangzhou 310024, Zhejiang, Peoples R China
[2] Univ Technol Sydney, Ctr Artificial Intelligence, Sydney, NSW 2007, Australia
[3] Hainan Univ, Sch Econ & Management, Haikou 570228, Hainan, Peoples R China
[4] China Agr Univ, Coll Sci, Beijing 083, Peoples R China
基金
中国国家自然科学基金;
关键词
Support vector machine; Multi-weight vector projections; L-1-norm ratio optimization; Outliers; Multiple projections; SEMI-SUPERVISED CLASSIFICATION; LINEAR DISCRIMINANT-ANALYSIS; L1-NORM MAXIMIZATION; SVM; DIAGNOSIS;
D O I
10.1016/j.neucom.2018.04.083
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The recently proposed multi-weight vector projection support vector machine (EMVSVM) is an excellent multi-projections classifier. However, the formulation of MVSVM is based on the L-2-norm criterion, which makes it prone to be affected by outliers. To alleviate this issue, in this paper, we propose a robust L-1 norm MVSVM method, termed as MVSVM L-1. Specifically, our MVSVM L-1 aims to seek a pair of multiple projections such that, for each class, it maximizes the ratio of the L-1-norm between-class dispersion and the L-1-norm within-class dispersion. To optimize such L-1-norm ratio problem, a simple but efficient iterative algorithm is further presented. The convergence of the algorithm is also analyzed theoretically. Extensive experimental results on both synthetic and real-world datasets confirm the feasibility and effectiveness of the proposed MVSVM L-1. (c) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:345 / 361
页数:17
相关论文
共 50 条
  • [41] An l1-norm loss based twin support vector regression and its geometric extension
    Peng, Xinjun
    Chen, De
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (09) : 2573 - 2588
  • [42] Efficient Algorithm for Localized Support Vector Machine
    Cheng, Haibin
    Tan, Pang-Ning
    Jin, Rong
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2010, 22 (04) : 537 - 549
  • [43] On the advantages of weighted L1-norm support vector learning for unbalanced binary classification problems
    Eitrich, Tatjana
    Lang, Bruno
    [J]. 2006 3RD INTERNATIONAL IEEE CONFERENCE INTELLIGENT SYSTEMS, VOLS 1 AND 2, 2006, : 565 - 570
  • [44] L1-Norm Distance Minimization-Based Fast Robust Twin Support Vector k-Plane Clustering
    Ye, Qiaolin
    Zhao, Henghao
    Li, Zechao
    Yang, Xubing
    Gao, Shangbing
    Yin, Tongming
    Ye, Ning
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (09) : 4494 - 4503
  • [45] QUADRATIC SURFACE SUPPORT VECTOR MACHINE WITH L1 NORM REGULARIZATION
    Mousavi, Ahmad
    Gao, Zheming
    Han, Lanshan
    Lim, Alvin
    [J]. JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2022, 18 (03) : 1835 - 1861
  • [46] DC Algorithm for Extended Robust Support Vector Machine
    Fujiwara, Shuhei
    Takeda, Akiko
    Kanamori, Takafumi
    [J]. NEURAL COMPUTATION, 2017, 29 (05) : 1406 - 1438
  • [47] Estimates for differential operators of vector analysis involving L1-norm
    Maz'ya, V.
    [J]. JOURNAL OF THE EUROPEAN MATHEMATICAL SOCIETY, 2010, 12 (01) : 221 - 240
  • [48] Simple Modification of Oja Rule Limits L1-Norm of Weight Vector and Leads to Sparse Connectivity
    Aparin, Vladimir
    [J]. NEURAL COMPUTATION, 2012, 24 (03) : 724 - 743
  • [49] An Online Algorithm for Support Vector Machine Based on Subgradient Projection
    Liu, Hua
    Sun, Zonghai
    [J]. CONTROL ENGINEERING AND APPLIED INFORMATICS, 2011, 13 (03): : 18 - 24
  • [50] L1-norm least squares support vector regression via the alternating direction method of multipliers
    Ye Y.-F.
    Ying C.
    Jiang Y.-X.
    Li C.-N.
    [J]. Journal of Advanced Computational Intelligence and Intelligent Informatics, 2017, 21 (06) : 1017 - 1025