A complement to the back-propagation algorithm: An upper bound for the learning rate

被引:0
|
作者
Cerqueira, JJF [1 ]
Palhares, AGB [1 ]
Madrid, MK [1 ]
机构
[1] Univ Estadual Campinas, BR-13081970 Campinas, SP, Brazil
关键词
D O I
10.1109/IJCNN.2000.860823
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents as complement for the back-propagation algorithm, a local convergence analysis gotten from a vectorial approach. The analysis is made through application of Lyapunov's second method, and it supplies an upper bound for the learning rate.
引用
收藏
页码:517 / 522
页数:6
相关论文
共 50 条
  • [21] GPU Implementation of the Multiple Back-Propagation Algorithm
    Lopes, Noel
    Ribeiro, Bernardete
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING, PROCEEDINGS, 2009, 5788 : 449 - 456
  • [22] Reconstruction of CT images by the back-propagation algorithm
    Ohkawa, I
    Tobaru, S
    Nakao, Z
    Chen, YW
    1998 SECOND INTERNATIONAL CONFERENCE ON KNOWLEDGE-BASED INTELLIGENT ELECTRONIC SYSTEMS, KES '98, PROCEEDINGS, VOL, 3, 1998, : 150 - 154
  • [23] The generalized back-propagation algorithm with convergence analysis
    Ng, SC
    Leung, SH
    Luk, A
    ISCAS '99: PROCEEDINGS OF THE 1999 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 5: SYSTEMS, POWER ELECTRONICS, AND NEURAL NETWORKS, 1999, : 612 - +
  • [24] A back-propagation algorithm with adaptive momentum factor
    Department of Applied Mathematics, Dalian University of Technology, Dalian 116024, China
    不详
    Dalian Haishi Daxue Xuebao, 2008, 4 (45-47+51):
  • [25] NEURAL CONTROLLER BASED ON BACK-PROPAGATION ALGORITHM
    SAERENS, M
    SOQUET, A
    IEE PROCEEDINGS-F RADAR AND SIGNAL PROCESSING, 1991, 138 (01) : 55 - 62
  • [26] Improving the training time of the back-propagation algorithm
    Mulawka, J.J.
    Verma, B.K.
    Microcomputer Applications, 1994, 13 (02): : 85 - 88
  • [27] An extension of the back-propagation algorithm to complex numbers
    Nitta, T
    NEURAL NETWORKS, 1997, 10 (08) : 1391 - 1415
  • [28] Back-propagation algorithm with variable adaptive momentum
    Hameed, Alaa Ali
    Karlik, Bekir
    Salman, Mohammad Shukri
    KNOWLEDGE-BASED SYSTEMS, 2016, 114 : 79 - 87
  • [29] An Improved Back-Propagation Neural Network Algorithm
    Hao, Pan
    MECHATRONICS ENGINEERING, COMPUTING AND INFORMATION TECHNOLOGY, 2014, 556-562 : 4586 - 4590
  • [30] A generalized back-propagation algorithm for faster convergence
    Ng, SC
    Leung, SH
    Luk, A
    ICNN - 1996 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOLS. 1-4, 1996, : 409 - 413