Hierarchical learning in polynomial support vector machines

被引:0
|
作者
Risau-Gusman, S [1 ]
Gordon, MB [1 ]
机构
[1] CEA Grenoble, DRFMC, SPSMS, F-38054 Grenoble 09, France
关键词
learning theory; support vector machines;
D O I
10.1023/A:1012442008732
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We study the typical properties of polynomial Support Vector Machines within a Statistical Mechanics approach that takes into account the number of high order features relative to the input space dimension. We analyze the effect of different features' normalizations on the generalization error, for different kinds of learning tasks. If the normalization is adequately selected, hierarchical learning of features of increasing order takes place as a function of the training set size. Otherwise, the performance worsens, and there is no hierarchical learning at all.
引用
收藏
页码:53 / 70
页数:18
相关论文
共 50 条
  • [1] Hierarchical Learning in Polynomial Support Vector Machines
    Sebastian Risau-Gusman
    Mirta B. Gordon
    [J]. Machine Learning, 2002, 46 : 53 - 70
  • [2] Support vector machines learning noisy polynomial rules
    Opper, M
    Urbanczik, R
    [J]. PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2001, 302 (1-4) : 110 - 118
  • [3] Learning Kernels for Support Vector Machines with Polynomial Powers of Sigmoid
    Fernandes, Silas E. N.
    Pilastri, Andre Luiz
    Pereira, Luis A. M.
    Pires, Rafael G.
    Papa, Joao P.
    [J]. 2014 27TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2014, : 259 - 265
  • [4] Hierarchical support vector machines
    Liu, ZG
    Shi, WZ
    Qin, QQ
    Li, XW
    Xie, DH
    [J]. IGARSS 2005: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-8, PROCEEDINGS, 2005, : 186 - 189
  • [5] Hierarchical learning strategy in relation extraction using support vector machines
    Zhou, GuoDong
    Zhang, Min
    Fu, Guohong
    [J]. INFORMATION RETRIEVAL TECHNOLOGY, PROCEEDINGS, 2006, 4182 : 67 - 78
  • [6] Polynomial Smooth Twin Support Vector Machines
    Ding, Shifei
    Huang, Huajuan
    Xu, Xinzheng
    Wang, Jian
    [J]. APPLIED MATHEMATICS & INFORMATION SCIENCES, 2014, 8 (04): : 2063 - 2071
  • [7] Understanding Support Vector Machines with Polynomial Kernels
    Vinge, Rikard
    McKelvey, Tomas
    [J]. 2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [8] A Note on Support Vector Machines with Polynomial Kernels
    Tong, Hongzhi
    [J]. NEURAL COMPUTATION, 2016, 28 (01) : 71 - 88
  • [9] Research on polynomial functions for smoothing support vector machines
    Liu, Ye-Qing
    Liu, San-Yang
    Gu, Ming-Tao
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2009, 31 (06): : 1450 - 1453
  • [10] Analysis of legendre polynomial kernel in support vector machines
    Djelloul, Naima
    Amir, Abdessamad
    [J]. INTERNATIONAL JOURNAL OF COMPUTING SCIENCE AND MATHEMATICS, 2019, 10 (06) : 580 - 595