Globally optimal on-line learning rules

被引：0
|
作者：
Rattray, M [1 ]
Saad, D [1 ]
机构：
[1] Aston Univ, Dept Comp Sci & Appl Math, Birmingham B4 7ET, W Midlands, England
来源：
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 10 | 1998年 / 10卷
关键词：
D O I：
暂无
中图分类号：
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号：
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要：
We present a method for determining the globally optimal on-line learning rule for a soft committee machine. under a statistical mechanics framework. This work complements previous results on locally optimal rules, where only the rate of change in generalization error was considered. We maximize the total reduction in generalization error over the whole learning process and show how the resulting rule can significantly outperform the locally optimal rule.
引用
收藏
页码：322 / 328
页数：7
相关论文
共 50 条
  • [1] Globally optimal on-line learning rules for multi-layer neural networks
    Rattray, M
    Saad, D
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1997, 30 (22): : L771 - L776
  • [2] Globally optimal parameters for on-line learning in multilayer neural networks
    Saad, D
    Rattray, M
    [J]. PHYSICAL REVIEW LETTERS, 1997, 79 (13) : 2578 - 2581
  • [3] Optimal On-Line Allocation Rules with Verification
    Epitropou, Markos
    Vohra, Rakesh
    [J]. ALGORITHMIC GAME THEORY (SAGT 2019), 2019, 11801 : 3 - 17
  • [4] Fast, On-Line Learning of Globally Consistent Maps
    Tom Duckett
    Stephen Marsland
    Jonathan Shapiro
    [J]. Autonomous Robots, 2002, 12 : 287 - 300
  • [5] Fast, on-line learning of globally consistent maps
    Duckett, T
    Marsland, S
    Shapiro, J
    [J]. AUTONOMOUS ROBOTS, 2002, 12 (03) : 287 - 300
  • [6] Globally optimal active contours, sequential Monte Carlo and on-line learning for vessel segmentation
    Florin, Charles
    Paragios, Nikos
    Williams, Jim
    [J]. COMPUTER VISION - ECCV 2006, PT 3, PROCEEDINGS, 2006, 3953 : 476 - 489
  • [7] On-line AdaTron learning of unlearnable rules
    Inoue, J
    Nishimori, H
    [J]. PHYSICAL REVIEW E, 1997, 55 (04): : 4544 - 4551
  • [8] Analysis of on-line training with optimal learning rates
    Rattray, M
    Saad, D
    [J]. PHYSICAL REVIEW E, 1998, 58 (05): : 6379 - 6391
  • [9] On-line testing of globally asynchronous circuits
    Shang, D
    Bystrov, A
    Yakovlev, A
    Koppad, D
    [J]. 11TH IEEE INTERNATIONAL ON-LINE TESTING SYMPOSIUM, 2005, : 135 - 140
  • [10] On-line learning of non-monotonic rules by simple perceptron
    Inoue, J
    Nishimori, H
    Kabashima, Y
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1997, 30 (11): : 3795 - 3816
12345