Leave-one-out bounds for support vector regression model selection

被引:79
|
作者
Chang, MW [1 ]
Lin, CJ [1 ]
机构
[1] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 106, Taiwan
关键词
D O I
10.1162/0899766053491869
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Minimizing bounds of leave-one-out errors is an important and efficient approach for support vector machine (SVM) model selection. Past research focuses on their use for classification but not regression. In this letter, we derive various leave-one-out bounds for support vector regression (SVR) and discuss the difference from those for classification. Experiments demonstrate that the proposed bounds are competitive with Bayesian SVR for parameter selection. We also discuss the differentiability of leave-one-out bounds.
引用
收藏
页码:1188 / 1222
页数:35
相关论文
共 50 条
  • [1] Leave-one-out bounds for Support Vector Regression
    Tian, Yingjie
    Deng, Naiyang
    [J]. INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE FOR MODELLING, CONTROL & AUTOMATION JOINTLY WITH INTERNATIONAL CONFERENCE ON INTELLIGENT AGENTS, WEB TECHNOLOGIES & INTERNET COMMERCE, VOL 2, PROCEEDINGS, 2006, : 1061 - +
  • [2] Leave-one-out bounds for support vector ordinal regression machine
    Zhixia Yang
    Yingjie Tian
    Naiyang Deng
    [J]. Neural Computing and Applications, 2009, 18 : 731 - 748
  • [3] Leave-one-out bounds for support vector ordinal regression machine
    Yang, Zhixia
    Tian, Yingjie
    Deng, Naiyang
    [J]. NEURAL COMPUTING & APPLICATIONS, 2009, 18 (07): : 731 - 748
  • [4] Estimating the leave-one-out error for support vector regression
    Liu, JX
    Tan, YJ
    [J]. PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS AND BRAIN, VOLS 1-3, 2005, : 208 - 213
  • [5] A leave-one-out bound for v-support vector regression
    Qin Ruxin
    Chen Jing
    Deng Naiyang
    Tian Yingjie
    [J]. COMPUTATIONAL SCIENCE - ICCS 2007, PT 3, PROCEEDINGS, 2007, 4489 : 669 - +
  • [6] Leave-one-out support vector machines
    Weston, J
    [J]. IJCAI-99: PROCEEDINGS OF THE SIXTEENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOLS 1 & 2, 1999, : 727 - 731
  • [7] Leave-one-out bounds for kernel methods
    Zhang, T
    [J]. NEURAL COMPUTATION, 2003, 15 (06) : 1397 - 1437
  • [8] Gene selection based on leave-one-out cross validation and least squares support vector machine
    Jiang, Jingqing
    Liang, Yanchun
    Wu, Chunguo
    [J]. DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2007, 14 : 149 - 154
  • [9] Dichotomous logistic regression with leave-one-out validation
    Teh, Sin Yin
    Othman, Abdul Rahman
    Khoo, Michael Boon Chong
    [J]. World Academy of Science, Engineering and Technology, 2010, 62 : 1001 - 1010
  • [10] Leave-One-Out Bound for Crammer-Singer Multiclass Support Vector Machine
    Zhao, Yan-Mei
    Yang, Zhi-Xia
    [J]. OPERATIONS RESEARCH AND ITS APPLICATIONS, 2010, 12 : 98 - +