A new weighted least squares support vector machines and its sequential minimal optimization algorithm

被引:0
|
作者
Liguo, Wang [1 ,2 ]
Ye, Zhang [1 ]
Junping, Zhang [1 ]
机构
[1] Harbin Inst Technol, Dept Informat Engn, Harbin 150006, Peoples R China
[2] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
关键词
weighted least squares support vector machines (WLSSVM); robust property; sparse approximation; sequential minimal optimization (SMO) algorithm;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
east squares support vector machines (LSSVM) is widely used in pattern recognition and artificial intelligence domain in recent years for its efficiency in classification and regression. The solution of LSSVM is an optimization problem of a Sum squared error (SSE) cost function with only equality constraints and can be solved in a simple linear system. However, its generalization performance is sensitive to noise points and outliers that are often existent in training dataset. In order to endow robustness to LSSVM, a new method for computing weight vector of error is proposed and the substituting of weighted error vector for original error vector in LSSVM gives birth to a new weighted LSSVM. The method gets weight factor by computing distance between sample and its corresponding class center. Sequential minimal optimization (SMO) algorithm is also extended to the new method for its efficient application. Comparison experiments show superiority of the new method in terms of generalization performance, robust property and sparse approximation. Especially, the new method is much faster than the other method for large number of samples.
引用
收藏
页码:285 / 288
页数:4
相关论文
共 50 条
  • [1] An extrapolated sequential minimal optimization algorithm for support vector machines
    Lai, D
    Mani, N
    Palaniswami, M
    [J]. PROCEEDINGS OF INTERNATIONAL CONFERENCE ON INTELLIGENT SENSING AND INFORMATION PROCESSING, 2004, : 415 - 421
  • [2] Dynamic weighted least squares support vector machines
    Fan, Yu-Gang
    Li, Ping
    Song, Zhi-Huan
    [J]. Kongzhi yu Juece/Control and Decision, 2006, 21 (10): : 1129 - 1133
  • [3] Study on least squares support vector machines algorithm and its application
    Zhang, MG
    Li, ZM
    Li, WH
    [J]. ICTAI 2005: 17TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2005, : 686 - 688
  • [4] Improved weighted least squares support vector machines algorithm and its applications in spectroscopic quantitative analysis
    Lu Jian-Feng
    Dai Lian-Kui
    [J]. CHINESE JOURNAL OF ANALYTICAL CHEMISTRY, 2007, 35 (03) : 340 - 344
  • [5] Research on Least Squares Support Vector Machines Algorithm
    Ming, Zhao
    [J]. PROCEEDINGS OF THE 2015 INTERNATIONAL INDUSTRIAL INFORMATICS AND COMPUTER ENGINEERING CONFERENCE, 2015, : 1432 - 1435
  • [6] Set membership estimation by weighted least squares support vector machines
    Chai, Wei
    Sun, Xian-Fang
    [J]. Dianji yu Kongzhi Xuebao/Electric Machines and Control, 2009, 13 (03): : 431 - 435
  • [7] Study of on-line weighted least squares support vector machines
    Wen, XJ
    Xu, XM
    Cai, YZ
    [J]. ADVANCES IN NATURAL COMPUTATION, PT 1, PROCEEDINGS, 2005, 3610 : 51 - 60
  • [8] Recursive Update Algorithm for Least Squares Support Vector Machines
    Hoi-Ming Chi
    Okan K. Ersoy
    [J]. Neural Processing Letters, 2003, 17 : 165 - 173
  • [9] Recursive update algorithm for least squares support vector machines
    Chi, HM
    Ersoy, OK
    [J]. NEURAL PROCESSING LETTERS, 2003, 17 (02) : 165 - 173
  • [10] Melt index prediction by weighted least squares support vector machines
    Shi, Jian
    Liu, Xinggao
    [J]. JOURNAL OF APPLIED POLYMER SCIENCE, 2006, 101 (01) : 285 - 289