SMO algorithm for least-squares SVM formulations

被引：99
|
作者：
Keerthi, SS [1 ]
Shevade, SK
机构：
[1] Natl Univ Singapore, Dept Mech Engn, Singapore 117576, Singapore
[2] Natl Univ Singapore, Genome Inst Singapore, Singapore 117528, Singapore
来源：
NEURAL COMPUTATION | 2003年 / 15卷 / 02期
关键词：
D O I：
10.1162/089976603762553013
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This article extends the well-known SMO algorithm of support vector machines (SVMs) to least-squares SVM formulations that include LS-SVM classification, kernel ridge regression, and a particular form of regularized kernel Fisher discriminant. The algorithm is shown to be asymptotically convergent. It is also extremely easy to implement. Computational experiments show that the algorithm is fast and scales efficiently (quadratically) as a function of the number of examples.
引用
收藏
页码：487 / 507
页数：21
相关论文
共 50 条
  • [21] Optimal rates for the regularized least-squares algorithm
    Caponnetto, A.
    De Vito, E.
    [J]. FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2007, 7 (03) : 331 - 368
  • [22] AN ALGORITHM FOR LEAST-SQUARES ESTIMATION OF NONLINEAR PARAMETERS
    MARQUARDT, DW
    [J]. JOURNAL OF THE SOCIETY FOR INDUSTRIAL AND APPLIED MATHEMATICS, 1963, 11 (02): : 431 - 441
  • [23] A probabilistic derivation of the partial least-squares algorithm
    Gustafsson, MG
    [J]. JOURNAL OF CHEMICAL INFORMATION AND COMPUTER SCIENCES, 2001, 41 (02): : 288 - 294
  • [24] A REFORMULATION OF THE PARTIAL LEAST-SQUARES REGRESSION ALGORITHM
    YOUNG, PJ
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1994, 15 (01): : 225 - 230
  • [25] A recursive algorithm for nonlinear least-squares problems
    A. Alessandri
    M. Cuneo
    S. Pagnan
    M. Sanguineti
    [J]. Computational Optimization and Applications, 2007, 38 : 195 - 216
  • [26] THE EXTENDED CLASSICAL TOTAL LEAST-SQUARES ALGORITHM
    VANHUFFEL, S
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 1989, 25 (01) : 111 - 119
  • [27] Exact initialization of the recursive least-squares algorithm
    Stoica, P
    Åhgren, P
    [J]. INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2002, 16 (03) : 219 - 230
  • [28] A fast least-squares algorithm for population inference
    R Mitchell Parry
    May D Wang
    [J]. BMC Bioinformatics, 14
  • [29] Adaptive Robust Least-Squares Smoothing Algorithm
    Lin, Xu
    Liang, Xiong
    Li, Wei
    Chen, Changxin
    Cheng, Lin
    Wang, Hongyue
    Zhang, Qingqing
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [30] Adaptive Algorithm for Constrained Least-Squares Problems
    Z.F. Li
    M.R. Osborne
    T. Prvan
    [J]. Journal of Optimization Theory and Applications, 2002, 114 : 423 - 441
12345