Sequential minimal optimization for SVM with pinball loss

被引:49
|
作者
Huang, Xiaolin [1 ]
Shi, Lei [2 ]
Suykens, Johan A. K. [1 ]
机构
[1] Katholieke Univ Leuven, Dept Elect Engn, ESAT STADIUS, B-3001 Louvain, Belgium
[2] Fudan Univ, Sch Math Sci, Shanghai 200433, Peoples R China
基金
欧洲研究理事会; 中国国家自然科学基金;
关键词
Support vector machine; Pinball loss; Sequential minimal optimization; SMO ALGORITHM; SUPPORT; CONVERGENCE; CLASSIFIER;
D O I
10.1016/j.neucom.2014.08.033
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To pursue the insensitivity to feature noise and the stability to re-sampling, a new type of support vector machine (SVM) has been established via replacing the hinge loss in the classical SVM by the pinball loss and was hence called a pin-SVM. Though a different loss function is used, pin-SVM has a similar structure as the classical SVM. Specifically, the dual problem of pin-SVM is a quadratic programming problem with box constraints, for which the sequential minimal optimization (SMO) technique is applicable. In this paper, we establish SMO algorithms for pin-SVM and its sparse version. The numerical experiments on real-life data sets illustrate both the good performance of pin-SVMs and the effectiveness of the established SMO methods. (C) 2014 Elsevier By. All rights reserved.
引用
下载
收藏
页码:1596 / 1603
页数:8
相关论文
共 50 条
  • [1] Transient stability assessment in bulk power grids using sequential minimal optimization based support vector machine with pinball loss
    Wang, Changjiang
    Kou, Xiao
    Jiang, Tao
    Chen, Houhe
    Li, Guoqing
    Li, Fangxing
    ELECTRIC POWER SYSTEMS RESEARCH, 2023, 214
  • [2] VLSI Design of Sequential Minimal Optimization Algorithm for SVM Learning
    Kuan, Ta-Wen
    Wang, Jhing-Fa
    Wang, Jia-Ching
    Gu, Gaung-Hui
    ISCAS: 2009 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-5, 2009, : 2509 - 2512
  • [3] VLSI Design of an SVM Learning Core on Sequential Minimal Optimization Algorithm
    Kuan, Ta-Wen
    Wang, Jhing-Fa
    Wang, Jia-Ching
    Lin, Po-Chuan
    Gu, Gaung-Hui
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2012, 20 (04) : 673 - 683
  • [4] Stochastic Sequential Minimal Optimization for Large-Scale Linear SVM
    Peng, Shili
    Hu, Qinghua
    Dang, Jianwu
    Peng, Zhichao
    NEURAL INFORMATION PROCESSING, ICONIP 2017, PT I, 2017, 10634 : 279 - 288
  • [5] Fixed-Size Pegasos for Hinge and Pinball Loss SVM
    Jumutc, Vilen
    Huang, Xiaolin
    Suykens, Johan A. K.
    2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [6] VLSI Design of Modified Sequential Minimal Optimization Algorithm for Fast SVM Training
    Feng, Lichen
    Li, Zunchao
    Wang, Yuanfa
    Zheng, Chuang
    Guan, Yunhe
    2016 13TH IEEE INTERNATIONAL CONFERENCE ON SOLID-STATE AND INTEGRATED CIRCUIT TECHNOLOGY (ICSICT), 2016, : 627 - 629
  • [7] Fast Training of Structured SVM Using Fixed-Threshold Sequential Minimal Optimization
    Lee, Changki
    Jang, Myung-Gil
    ETRI JOURNAL, 2009, 31 (02) : 121 - 128
  • [8] Improved sparse pinball twin SVM
    Tanveer, M.
    Rajani, T.
    Ganaie, M. A.
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 3287 - 3291
  • [9] On improving sequential minimal optimization
    Wu, ZL
    Li, CH
    PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2004, : 4308 - 4313
  • [10] A fast conjugate functional gain sequential minimal optimization training algorithm for LS-SVM model
    Yu, Lang
    Ma, Xin
    Li, Shengjie
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (08): : 6095 - 6113