Hierarchical learning in polynomial support vector machines

被引:0
|
作者
Risau-Gusman, S [1 ]
Gordon, MB [1 ]
机构
[1] CEA Grenoble, DRFMC, SPSMS, F-38054 Grenoble 09, France
关键词
learning theory; support vector machines;
D O I
10.1023/A:1012442008732
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We study the typical properties of polynomial Support Vector Machines within a Statistical Mechanics approach that takes into account the number of high order features relative to the input space dimension. We analyze the effect of different features' normalizations on the generalization error, for different kinds of learning tasks. If the normalization is adequately selected, hierarchical learning of features of increasing order takes place as a function of the training set size. Otherwise, the performance worsens, and there is no hierarchical learning at all.
引用
收藏
页码:53 / 70
页数:18
相关论文
共 50 条
  • [21] Polynomial-time decomposition algorithms for support vector machines
    Hush, D
    Scovel, C
    [J]. MACHINE LEARNING, 2003, 51 (01) : 51 - 71
  • [22] MP-polynomial kernel for training support vector machines
    Mejia-Guevara, Ivan
    Kuri-Morales, Angel
    [J]. PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS AND APPLICATIONS, PROCEEDINGS, 2007, 4756 : 584 - +
  • [23] Using Polynomial Kernel Support Vector Machines for Speaker Verification
    Yaman, Sibel
    Pelecanos, Jason
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2013, 20 (09) : 901 - 904
  • [24] Learning students' learning patterns with support vector machines
    Liu, Chao-Lin
    [J]. FOUNDATIONS OF INTELLIGENT SYSTEMS, PROCEEDINGS, 2006, 4203 : 601 - 611
  • [25] A comparative analysis of support vector machines and extreme learning machines
    Liu, Xueyi
    Gao, Chuanhou
    Li, Ping
    [J]. NEURAL NETWORKS, 2012, 33 : 58 - 66
  • [26] Relevance regression learning with support vector machines
    Apolloni, Bruno
    Malchiodi, Dario
    Valerio, Lorenzo
    [J]. NONLINEAR ANALYSIS-THEORY METHODS & APPLICATIONS, 2010, 73 (09) : 2855 - 2867
  • [27] Visualization of support vector machines with unsupervised learning
    Hamel, Lutz
    [J]. PROCEEDINGS OF THE 2006 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE IN BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, 2006, : 148 - 155
  • [28] Infinite ensemble learning with support vector machines
    Lin, HT
    Li, L
    [J]. MACHINE LEARNING: ECML 2005, PROCEEDINGS, 2005, 3720 : 242 - 254
  • [29] Learning of kernel functions in support vector machines
    Yang, Chih-Cheng
    Lee, Wan-Jui
    Lee, Shie-Jue
    [J]. 2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, : 1150 - +
  • [30] Robust learning and generalization with support vector machines
    Buhot, A
    Gordon, MB
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 2001, 34 (21): : 4377 - 4388