A complement to the back-propagation algorithm: An upper bound for the learning rate

被引：0
|
作者：
Cerqueira, JJF [1 ]
Palhares, AGB [1 ]
Madrid, MK [1 ]
机构：
[1] Univ Estadual Campinas, BR-13081970 Campinas, SP, Brazil
来源：
IJCNN 2000: PROCEEDINGS OF THE IEEE-INNS-ENNS INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOL IV | 2000年
关键词：
D O I：
10.1109/IJCNN.2000.860823
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper presents as complement for the back-propagation algorithm, a local convergence analysis gotten from a vectorial approach. The analysis is made through application of Lyapunov's second method, and it supplies an upper bound for the learning rate.
引用
收藏
页码：517 / 522
页数：6
相关论文
共 50 条
  • [41] Analysis of global convergence and learning parameters of the back-propagation algorithm for quadratic functions
    Zeng, Zhigang
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS, PROCEEDINGS: WITH ASPECTS OF ARTIFICIAL INTELLIGENCE, 2007, 4682 : 7 - 13
  • [42] Second order back-propagation learning algorithm and its application for neural network
    Liu, TN
    Ren, WJ
    Chen, GY
    Xu, BC
    Yu, D
    PROCEEDINGS OF THE 3RD WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-5, 2000, : 817 - 820
  • [43] Implementation of the RBF neural chip with the back-propagation algorithm for on-line learning
    Kim, J. S.
    Jung, S.
    APPLIED SOFT COMPUTING, 2015, 29 : 233 - 244
  • [44] An algorithm for learning principal curves with principal component analysis and back-propagation network
    Wang, Y. H.
    Guo, Y.
    Fu, Y. C.
    Shen, Z. Y.
    PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS, 2007, : 447 - +
  • [45] Implementation of the RBF Neural Chip with the On-line Learning Back-Propagation Algorithm
    Kim, Jeong-seob
    Jung, Seul
    2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 377 - 383
  • [46] LEARNING BY BACK-PROPAGATION - COMPUTING IN A SYSTOLIC WAY
    MILLAN, JD
    BOFILL, P
    LECTURE NOTES IN COMPUTER SCIENCE, 1989, 366 : 235 - 252
  • [47] Awesome back-propagation machine learning paradigm
    Assem Badr
    Neural Computing and Applications, 2021, 33 : 13225 - 13249
  • [48] New parallel algorithms for back-propagation learning
    Alves, RLD
    de Melo, JD
    Neto, ADD
    Albuquerque, ACML
    PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, : 2686 - 2691
  • [49] AN ANALYSIS OF PREMATURE SATURATION IN BACK-PROPAGATION LEARNING
    LEE, Y
    OH, SH
    KIM, MW
    NEURAL NETWORKS, 1993, 6 (05) : 719 - 728
  • [50] Awesome back-propagation machine learning paradigm
    Badr, Assem
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (20): : 13225 - 13249
12345