A complement to the back-propagation algorithm: An upper bound for the learning rate

被引：0
|
作者：
Cerqueira, JJF [1 ]
Palhares, AGB [1 ]
Madrid, MK [1 ]
机构：
[1] Univ Estadual Campinas, BR-13081970 Campinas, SP, Brazil
来源：
IJCNN 2000: PROCEEDINGS OF THE IEEE-INNS-ENNS INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOL IV | 2000年
关键词：
D O I：
10.1109/IJCNN.2000.860823
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper presents as complement for the back-propagation algorithm, a local convergence analysis gotten from a vectorial approach. The analysis is made through application of Lyapunov's second method, and it supplies an upper bound for the learning rate.
引用
收藏
页码：517 / 522
页数：6
相关论文
共 50 条
  • [11] Convergence of the generalized back-propagation algorithm with constant learning rates
    Ng, SC
    Leung, SH
    Luk, A
    IEEE WORLD CONGRESS ON COMPUTATIONAL INTELLIGENCE, 1998, : 1090 - 1094
  • [12] A Diffferential Adaptive Learning Rate Method for Back-Propagation Neural Networks
    Iranmanesh, Saeid
    NN'09: PROCEEDINGS OF THE 10TH WSEAS INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, 2009, : 30 - 34
  • [13] A differential adaptive learning rate method for back-propagation neural networks
    Department of Computer Engineering, Azad University of Qazvin, Iran
    不详
    World Acad. Sci. Eng. Technol., 2009, (289-292):
  • [14] Back-propagation extreme learning machine
    Zou, Weidong
    Xia, Yuanqing
    Cao, Weipeng
    SOFT COMPUTING, 2022, 26 (18) : 9179 - 9188
  • [15] ACCELERATED LEARNING IN BACK-PROPAGATION NETS
    SCHMIDHUBER, J
    CONNECTIONISM IN PERSPECTIVE, 1989, : 439 - 445
  • [16] BACK-PROPAGATION LEARNING IN EXPERT NETWORKS
    LACHER, RC
    HRUSKA, SI
    KUNCICKY, DC
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (01): : 62 - 72
  • [17] Back-propagation learning algorithm and parallel computers: The CLEPSYDRA mapping scheme
    d'Acierno, A
    NEUROCOMPUTING, 2000, 31 (1-4) : 67 - 85
  • [18] Based on Privacy Preserving for Back-propagation Neural Network Learning Algorithm
    Wang, Jian
    ADVANCED MATERIALS AND INFORMATION TECHNOLOGY PROCESSING, PTS 1-3, 2011, 271-273 : 857 - 862
  • [19] Speed up the back-propagation learning algorithm by the broadcast communication model
    Hong, TP
    Lee, JJ
    ICNN - 1996 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOLS. 1-4, 1996, : 1340 - 1344
  • [20] Back-propagation extreme learning machine
    Weidong Zou
    Yuanqing Xia
    Weipeng Cao
    Soft Computing, 2022, 26 : 9179 - 9188
12345