Dynamics of on-line gradient descent learning for multilayer neural networks

被引：0
|
作者：
Saad, D [1 ]
Solla, SA [1 ]
机构：
[1] ASTON UNIV,DEPT COMP SCI & APPL MATH,BIRMINGHAM B4 7ET,W MIDLANDS,ENGLAND
来源：
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 8: PROCEEDINGS OF THE 1995 CONFERENCE | 1996年 / 8卷
关键词：
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
引用
收藏
页码：302 / 308
页数：5
相关论文
共 50 条
  • [1] Theoretical analysis of batch and on-line training for gradient descent learning in neural networks
    Nakama, Takehiko
    [J]. NEUROCOMPUTING, 2009, 73 (1-3) : 151 - 159
  • [2] Natural gradient descent for on-line learning
    Rattray, M
    Saad, D
    Amari, S
    [J]. PHYSICAL REVIEW LETTERS, 1998, 81 (24) : 5461 - 5464
  • [3] ANALYSIS OF GRADIENT DESCENT LEARNING ALGORITHMS FOR MULTILAYER FEEDFORWARD NEURAL NETWORKS
    GUO, H
    GELFAND, SB
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS, 1991, 38 (08): : 883 - 894
  • [4] Learning dynamics of gradient descent optimization in deep neural networks
    Wu, Wei
    Jing, Xiaoyuan
    Du, Wencai
    Chen, Guoliang
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (05)
  • [5] Learning dynamics of gradient descent optimization in deep neural networks
    Wei Wu
    Xiaoyuan Jing
    Wencai Du
    Guoliang Chen
    [J]. Science China Information Sciences, 2021, 64
  • [6] Learning dynamics of gradient descent optimization in deep neural networks
    Wei WU
    Xiaoyuan JING
    Wencai DU
    Guoliang CHEN
    [J]. Science China(Information Sciences), 2021, 64 (05) : 17 - 31
  • [7] Globally optimal parameters for on-line learning in multilayer neural networks
    Saad, D
    Rattray, M
    [J]. PHYSICAL REVIEW LETTERS, 1997, 79 (13) : 2578 - 2581
  • [8] Analysis of natural gradient descent for multilayer neural networks
    Rattray, M
    Saad, D
    [J]. PHYSICAL REVIEW E, 1999, 59 (04): : 4523 - 4532
  • [9] Matrix-update for accelerated on-line learning in multilayer neural networks
    Bos, S
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1998, 31 (22): : L413 - L417
  • [10] Finite-size effects in on-line learning of multilayer neural networks
    Barber, D
    Saad, D
    Sollich, P
    [J]. EUROPHYSICS LETTERS, 1996, 34 (02): : 151 - 156
12345