Efficient sparse nonparallel support vector machines for classification

被引:28
|
作者
Tian, Yingjie [1 ]
Ju, Xuchan [2 ]
Qi, Zhiquan [1 ]
机构
[1] Chinese Acad Sci, Res Ctr Fictitious Econ & Data Sci, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Acad Math & Syst Sci, Beijing 100190, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2014年 / 24卷 / 05期
基金
中国国家自然科学基金;
关键词
Support vector machines; Twin support vector machines; Nonparallel; Structural risk minimization principle; Sparseness;
D O I
10.1007/s00521-012-1331-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel nonparallel classifier, named sparse nonparallel support vector machine (SNSVM), for binary classification. Different with the existing nonparallel classifiers, such as the twin support vector machines (TWSVMs), SNSVM has several advantages: It constructs two convex quadratic programming problems for both linear and nonlinear cases, which can be solved efficiently by successive overrelaxation technique; it does not need to compute the inverse matrices any more before training; it has the similar sparseness with standard SVMs; it degenerates to the TWSVMs when the parameters are appropriately chosen. Therefore, SNSVM is certainly superior to them theoretically. Experimental results on lots of data sets show the effectiveness of our method in both sparseness and classification accuracy and, therefore, confirm the above conclusions further.
引用
收藏
页码:1089 / 1099
页数:11
相关论文
共 50 条
  • [11] Efficient Sparse Least Squares Support Vector Machines for Regression
    Si Gangquan
    Shi Jianquan
    Guo Zhang
    Zhao Weili
    2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 5173 - 5178
  • [12] ν-Nonparallel support vector machine for pattern classification
    Yingjie Tian
    Qin Zhang
    Dalian Liu
    Neural Computing and Applications, 2014, 25 : 1007 - 1020
  • [13] Using a novel support vector machines for efficient classification
    Yong Wang
    Wei Zhang
    Jun Chen
    Li Xiao
    Jianfu Li
    ICMIT 2007: MECHATRONICS, MEMS, AND SMART MATERIALS, PTS 1 AND 2, 2008, 6794
  • [14] Building Sparse Support Vector Machines for Multi-Instance Classification
    Fu, Zhouyu
    Lu, Guojun
    Ting, Kai Ming
    Zhang, Dengsheng
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT I, 2011, 6911 : 471 - 486
  • [15] Nonparallel Support Vector Machines for Multiple-instance Learning
    Zhang, Qin
    Tian, Yingjie
    Liu, Dalian
    FIRST INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND QUANTITATIVE MANAGEMENT, 2013, 17 : 1063 - 1072
  • [16] A sparse -regularized support vector machines for efficient natural language learning
    Wu, Yu-Chieh
    KNOWLEDGE AND INFORMATION SYSTEMS, 2014, 39 (02) : 305 - 328
  • [17] Efficient Sparse Approximation of Support Vector Machines Solving a Kernel Lasso
    Aliquintuy, Marcelo
    Frandi, Emanuele
    Nanculef, Ricardo
    Suykens, Johan A. K.
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2016, 2017, 10125 : 208 - 216
  • [18] Learning with label proportions based on nonparallel support vector machines
    Chen, Zhensong
    Qi, Zhiquan
    Wang, Bo
    Cui, Limeng
    Meng, Fan
    Shi, Yong
    KNOWLEDGE-BASED SYSTEMS, 2017, 119 : 126 - 141
  • [19] Alternating Direction Method of Multipliers for Nonparallel Support Vector Machines
    Shen, Xin
    Niu, Lingfeng
    Tian, Yingjie
    Shi, Yong
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOP (ICDMW), 2015, : 1171 - 1176
  • [20] ν-Structural Nonparallel Support Vector Machine for Pattern Classification
    Chen, Dandan
    Tian, Yingjie
    2016 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE WORKSHOPS (WIW 2016), 2016, : 33 - 36