A Deep Connection Between the Vapnik-Chervonenkis Entropy and the Rademacher Complexity

被引：17

作者：

Anguita, Davide ^{[1
]}

Ghio, Alessandro ^{[1
]}

Oneto, Luca ^{[1
]}

Ridella, Sandro ^{[1
]}

机构：

[1] Univ Genoa, Dept Elect Elect Telecommun Engn & Naval Architec, I-16145 Genoa, Italy

来源：

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS | 2014年 / 25卷 / 12期

关键词：

Complexity measures; Rademacher complexity; statistical learning theory; Vapnik-Chervonenkis (VC) entropy; MODEL SELECTION; INEQUALITIES; DIMENSION;

D O I：

10.1109/TNNLS.2014.2307359

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper, we derive a deep connection between the Vapnik-Chervonenkis (VC) entropy and the Rademacher complexity. For this purpose, we first refine some previously known relationships between the two notions of complexity and then derive new results, which allow computing an admissible range for the Rademacher complexity, given a value of the VC-entropy, and vice versa. The approach adopted in this paper is new and relies on the careful analysis of the combinatorial nature of the problem. The obtained results improve the state of the art on this research topic.

引用

页码：2202 / 2211

页数：10

共 50 条

[31] On Vapnik-Chervonenkis density over indiscernible sequences
Guingona, Vincent
Hill, Cameron Donnay
[J]. MATHEMATICAL LOGIC QUARTERLY, 2014, 60 (1-2) : 59 - 65
[32] Sample compression, learnability, and the Vapnik-Chervonenkis dimension
Floyd, S
Warmuth, M
[J]. MACHINE LEARNING, 1995, 21 (03) : 269 - 304
[33] Sign rank versus Vapnik-Chervonenkis dimension
Alon, N.
Moran, S.
Yehudayoff, A.
[J]. SBORNIK MATHEMATICS, 2017, 208 (12) : 1724 - 1757
[34] STATISTICAL-MECHANICS CALCULATION OF VAPNIK-CHERVONENKIS BOUNDS FOR PERCEPTRONS
ENGEL, A
FINK, W
[J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1993, 26 (23): : 6893 - 6914
[35] The Vapnik-Chervonenkis dimension of graph and recursive neural networks
Scarselli, Franco
Tsoi, Ah Chung
Hagenbuchner, Markus
[J]. NEURAL NETWORKS, 2018, 108 : 248 - 259
[36] Vapnik-Chervonenkis dimension and density on Johnson and Hamming graphs
Adler, Isolde
Benediktsson, Bjarki Geir
Macpherson, Dugald
[J]. DISCRETE APPLIED MATHEMATICS, 2022, 312 : 29 - 44
[37] THE VAPNIK-CHERVONENKIS DIMENSION OF DECISION TREES WITH BOUNDED RANK
SIMON, HU
[J]. INFORMATION PROCESSING LETTERS, 1991, 39 (03) : 137 - 141
[38] Adaptation, Performance and Vapnik-Chervonenkis Dimension of Straight Line Programs
Montana, Jose L.
Alonso, Cesar L.
Borges, Cruz E.
Crespo, Jose L.
[J]. GENETIC PROGRAMMING, 2009, 5481 : 315 - +
[39] Pseudovaluation domains with Vapnik-Chervonenkis classes of definable sets
Bélair, L
[J]. COMMUNICATIONS IN ALGEBRA, 2000, 28 (08) : 3785 - 3793
[40] BOUNDING SAMPLE-SIZE WITH THE VAPNIK-CHERVONENKIS DIMENSION
SHAWETAYLOR, J
ANTHONY, M
BIGGS, NL
[J]. DISCRETE APPLIED MATHEMATICS, 1993, 42 (01) : 65 - 73

← 1 2 3 4 5 →