Convergence of an online gradient method for BP neural networks with stochastic inputs

被引：0
|
作者：
Li, ZX
Wu, W [1 ]
Feng, GR
Lu, HF
机构：
[1] Dalian Univ Technol, Dept Appl Math, Dalian 116023, Peoples R China
[2] Dalian Maritime Univ, Dept Math, Dalian 116000, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Math, Shanghai 200000, Peoples R China
来源：
ADVANCES IN NATURAL COMPUTATION, PT 1, PROCEEDINGS | 2005年 / 3610卷
关键词：
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
An online gradient method for BP neural networks is presented and discussed. The input training examples are permuted stochastically in each cycle of iteration. A monotonicity and a weak convergence of deterministic nature for the method are proved.
引用
收藏
页码：720 / 729
页数：10
相关论文
共 50 条
  • [1] Convergence of an online gradient method for feedforward neural networks with stochastic inputs
    Li, ZX
    Wu, W
    Tian, YL
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2004, 163 (01) : 165 - 176
  • [2] CONVERGENCE OF ONLINE GRADIENT METHOD WITH A PENALTY TERM FOR FEEDFORWARD NEURAL NETWORKS WITH STOCHASTIC INPUTS
    邵红梅
    吴微
    李峰
    [J]. Numerical Mathematics(Theory,Methods and Applications), 2005, (01) : 87 - 96
  • [3] Deterministic convergence of an online gradient method for BP neural networks
    Wu, W
    Feng, GR
    Li, ZX
    Xu, YS
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2005, 16 (03): : 533 - 540
  • [4] Convergence analysis of online gradient method for BP neural networks
    Wu, Wei
    Wang, Jian
    Cheng, Mingsong
    Li, Zhengxue
    [J]. NEURAL NETWORKS, 2011, 24 (01) : 91 - 98
  • [5] Convergence of Online Gradient Method with Penalty for BP Neural Networks
    Shao Hong-mei 1
    [J]. Communications in Mathematical Research, 2010, 26 (01) : 67 - 75
  • [6] Convergence of Online gradient algorithm with Stochastic inputs for Pi-Sigma neural networks
    Kang, Xidai
    Xiong, Yan
    Zhang, Chao
    Wu, Wei
    [J]. 2007 IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTATIONAL INTELLIGENCE, VOLS 1 AND 2, 2007, : 564 - +
  • [7] Deterministic convergence of an online gradient method for neural networks
    Wu, W
    Xu, YS
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2002, 144 (1-2) : 335 - 347
  • [8] Convergence of Online Gradient Method for Recurrent Neural Networks
    Ding, Xiaoshuai
    Zhang, Ruiting
    [J]. JOURNAL OF INTERDISCIPLINARY MATHEMATICS, 2015, 18 (1-2) : 159 - 177
  • [9] Boundedness and Convergence of Online Gradient Method With Penalty for Feedforward Neural Networks
    Zhang, Huisheng
    Wu, Wei
    Liu, Fei
    Yao, Mingchen
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (06): : 1050 - 1054
  • [10] Convergence of online gradient method for pi-sigma neural networks
    Department of Applied Mathematics, Dalian University of Technology, Dalian 116024, China
    不详
    [J]. J. Comput. Inf. Syst, 2007, 6 (2345-2352):
12345