Ramp loss nonparallel support vector machine for pattern classification

被引:42
|
作者
Liu, Dalian [1 ,2 ]
Shi, Yong [1 ,3 ,4 ,5 ]
Tian, Yingjie [3 ,4 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
[2] Beijing Union Univ, Dept Basic Course Teaching, Beijing 100101, Peoples R China
[3] Chinese Acad Sci, Res Ctr Fictitious Econ & Data Sci, Beijing 100190, Peoples R China
[4] Chinese Acad Sci, Key Lab Big Data Min & Knowledge Management, Beijing 100190, Peoples R China
[5] Univ Nebraska, Collegae Informat Sci & Technol, Omaha, NE 68182 USA
基金
中国国家自然科学基金;
关键词
Support vector machine; Twin support vector machine; CCCP; Ramp loss; Sparseness; SELECTION;
D O I
10.1016/j.knosys.2015.05.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel sparse and robust nonparallel hyperplane classifier, named Ramp loss Nonparallel Support Vector Machine (RNPSVM), for binary classification. By introducing the Ramp loss function and also proposing a new non-convex and non-differentiable loss function based on the epsilon-insensitive loss function, RNPSVM can explicitly incorporate noise and outlier suppression in the training process, has less support vectors and the increased sparsity leads to its better scaling properties. The non-convexity of RNPSVM can be efficiently solved by the Concave-Convex Procedure and experimental results on benchmark datasets confirm the effectiveness of the proposed algorithm. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:224 / 233
页数:10
相关论文
共 50 条
  • [21] Ramp Loss Linear Programming Support Vector Machine
    Huang, Xiaolin
    Shi, Lei
    Suykens, Johan A. K.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2014, 15 : 2185 - 2211
  • [22] Ramp loss least squares support vector machine
    Liu, Dalian
    Shi, Yong
    Tian, Yingjie
    Huang, Xiankai
    JOURNAL OF COMPUTATIONAL SCIENCE, 2016, 14 : 61 - 68
  • [23] Robust nonparallel support vector machine with privileged information for pattern recognition
    Liu, Liming
    Li, Ping
    Chu, Maoxiang
    Liu, Shuming
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (04) : 1465 - 1482
  • [24] Robust nonparallel support vector machine with privileged information for pattern recognition
    Liming Liu
    Ping Li
    Maoxiang Chu
    Shuming Liu
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 1465 - 1482
  • [25] Smooth support vector machine with generalized pinball loss for Pattern Classification
    Dawrawee Makmuang
    Wachiraphong Ratiphaphongthon
    Rabian Wangkeeree
    The Journal of Supercomputing, 2023, 79 : 11684 - 11706
  • [26] Smooth support vector machine with generalized pinball loss for Pattern Classification
    Makmuang, Dawrawee
    Ratiphaphongthon, Wachiraphong
    Wangkeeree, Rabian
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (11): : 11684 - 11706
  • [27] A feature selection method for nonparallel plane support vector machine classification
    Ye, Qiaolin
    Zhao, Chunxia
    Ye, Ning
    Zheng, Hao
    Chen, Xiaobo
    OPTIMIZATION METHODS & SOFTWARE, 2012, 27 (03): : 431 - 443
  • [28] Nonparallel Hyperplanes Support Vector Machine for Multi-class Classification
    Ju, Xuchan
    Tian, Yingjie
    Liu, Dalian
    Qi, Zhiquan
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, ICCS 2015 COMPUTATIONAL SCIENCE AT THE GATES OF NATURE, 2015, 51 : 1574 - 1582
  • [29] ν-Improved nonparallel support vector machine
    Sun, Fengmin
    Lian, Shujun
    SCIENTIFIC REPORTS, 2022, 12 (01):
  • [30] An Improved Nonparallel Support Vector Machine
    Liu, Liming
    Chu, Maoxiang
    Gong, Rongfen
    Zhang, Li
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (11) : 5129 - 5143