Transductive Rademacher Complexity and its Applications

被引:29
|
作者
El-Yaniv, Ran [1 ]
Pechyony, Dmitry [1 ]
机构
[1] Technion Israel Inst Technol, Dept Comp Sci, IL-32000 Haifa, Israel
关键词
PROBABILITY-INEQUALITIES;
D O I
10.1613/jair.2587
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We develop a technique for deriving data-dependent error bounds for transductive learning algorithms based on transductive Rademacher complexity. Our technique is based on a novel general error bound for transduction in terms of transductive Rademacher complexity, together with a novel bounding technique for Rademacher averages for particular algorithms, in terms of their "unlabeled-labeled" representation. This technique is relevant to many advanced graph-based transductive algorithms and we demonstrate its effectiveness by deriving error bounds to three well known algorithms. Finally, we present a new PAC-Bayesian bound for mixtures of transductive algorithms based on our Rademacher bounds.
引用
收藏
页码:193 / 234
页数:42
相关论文
共 50 条
  • [1] Transductive rademacher complexity and its applications
    El-Yaniv, Ran
    Pechyony, Dmitry
    [J]. LEARNING THEORY, PROCEEDINGS, 2007, 4539 : 157 - +
  • [2] Permutational Rademacher Complexity A New Complexity Measure for Transductive Learning
    Tolstikhin, Ilya
    Zhivotovskiy, Nikita
    Blanchard, Gilles
    [J]. ALGORITHMIC LEARNING THEORY, ALT 2015, 2015, 9355 : 209 - 223
  • [3] Rademacher margin complexity
    Wang, Liwei
    Feng, Jufu
    [J]. LEARNING THEORY, PROCEEDINGS, 2007, 4539 : 620 - +
  • [4] Refined Rademacher Chaos Complexity Bounds with Applications to the Multikernel Learning Problem
    Lei, Yunwen
    Ding, Lixin
    [J]. NEURAL COMPUTATION, 2014, 26 (04) : 739 - 760
  • [5] On the Rademacher Complexity of Weighted Automata
    Balle, Borja
    Mohri, Mehryar
    [J]. ALGORITHMIC LEARNING THEORY, ALT 2015, 2015, 9355 : 179 - 193
  • [6] Local Rademacher Complexity Machine
    Oneto, Luca
    Ridella, Sandro
    Anguita, Davide
    [J]. NEUROCOMPUTING, 2019, 342 : 24 - 32
  • [7] Rademacher complexity for Markov chains: Applications to kernel smoothing and Metropolis-Hastings
    Bertail, Patrice
    Portier, Francois
    [J]. BERNOULLI, 2019, 25 (4B) : 3912 - 3938
  • [8] Rademacher Inequalities with Applications
    Sergey Utev
    Syeda Rabab Mudakkar
    [J]. Journal of Theoretical Probability, 2014, 27 : 301 - 314
  • [9] Percolation centrality via Rademacher Complexity
    De Lima, Alane M.
    Da Silva, Murilo V. G.
    Vignatti, Andre L.
    [J]. DISCRETE APPLIED MATHEMATICS, 2022, 323 : 201 - 216
  • [10] Rademacher Inequalities with Applications
    Utev, Sergey
    Mudakkar, Syeda Rabab
    [J]. JOURNAL OF THEORETICAL PROBABILITY, 2014, 27 (01) : 301 - 314