Tight bounds for the VC-dimension of piecewise polynomial networks

被引:0
|
作者
Sakurai, A
机构
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
O(ws(s log d + log(dqh/s))) and O(ws((h/s) log q)+ log(dqh/s)) are upper bounds for the VC-dimension of a set of neural networks of units with piecewise polynomial activation functions, where s is the depth of the network, h is the number of hidden units, w is the number of adjustable parameters, q is the maximum of the number of polynomial segments of the activation function, and d is the maximum degree of the polynomials; also Omega(ws log(dqh/s)) is a lower bound for the VC-dimension of such a network set, which are tight for the cases s = Theta(h) and a is constant. For the special case q = 1, the VC-dimension is Theta(ws log d).
引用
收藏
页码:323 / 329
页数:7
相关论文
共 50 条
  • [1] Almost linear VC-dimension bounds for piecewise polynomial networks
    Bartlett, PL
    Maiorov, V
    [J]. NEURAL COMPUTATION, 1998, 10 (08) : 2159 - 2173
  • [2] Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks
    Bartlett, Peter L.
    Harvey, Nick
    Liaw, Christopher
    Mehrabian, Abbas
    [J]. Journal of Machine Learning Research, 2019, 20
  • [3] Nearly-tight VC-dimension and Pseudodimension Bounds for Piecewise Linear Neural Networks
    Bartlett, Peter L.
    Harvey, Nick
    Liaw, Christopher
    Mehrabian, Abbas
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20 : 1 - 17
  • [4] Almost linear VC dimension bounds for piecewise polynomial networks
    Bartlett, PL
    Maiorov, V
    Meir, R
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 11, 1999, 11 : 190 - 196
  • [5] Tight Lower Bounds on the VC-dimension of Geometric Set Systems
    Csikos, Monika
    Mustafa, Nabil H.
    Kupayskii, Audrey
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [6] Tight bounds on the maximum size of a set of permutations with bounded VC-dimension
    Cibulka, Josef
    Kyncl, Jan
    [J]. JOURNAL OF COMBINATORIAL THEORY SERIES A, 2012, 119 (07) : 1461 - 1478
  • [7] ON THE PRACTICAL APPLICABILITY OF VC-DIMENSION BOUNDS
    HOLDEN, SB
    NIRANJAN, M
    [J]. NEURAL COMPUTATION, 1995, 7 (06) : 1265 - 1288
  • [8] Lower Bounds for Evolution Strategies Using VC-Dimension
    Teytaud, Olivier
    Fournier, Herve
    [J]. PARALLEL PROBLEM SOLVING FROM NATURE - PPSN X, PROCEEDINGS, 2008, 5199 : 102 - +
  • [9] VC-Dimension Based Generalization Bounds for Relational Learning
    Kuzelka, Ondrej
    Wang, Yuyi
    Schockaert, Steven
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT II, 2019, 11052 : 259 - 275
  • [10] LOWER BOUNDS ON THE VC-DIMENSION OF SMOOTHLY PARAMETERIZED FUNCTION CLASSES
    LEE, WS
    BARTLETT, PL
    WILLIAMSON, RC
    [J]. NEURAL COMPUTATION, 1995, 7 (05) : 1040 - 1053