Parallel Learning of Feedforward Neural Networks Without Error Backpropagation

被引:14
|
作者
Bilski, Jaroslaw [1 ]
Wilamowski, Bogdan M. [2 ]
机构
[1] Czestochowa Tech Univ, Inst Computat Intelligence, Czestochowa, Poland
[2] Auburn Univ, Auburn, AL 36849 USA
关键词
Forward-only computation; Neural network training; Parallel architectures; REALIZATION; ALGORITHM;
D O I
10.1007/978-3-319-39378-0_6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A parallel architecture of the steepest descent algorithm for training fully connected feedforward neural networks is presented. This solution is based on a new idea of learning neural networks without error backpropagation. The proposed solution is based on completely new parallel structures to effectively reduce high computational load of this algorithm. Detailed parallel 2D and 3D neural network learning structures are explicitely discussed.
引用
收藏
页码:57 / 69
页数:13
相关论文
共 50 条
  • [1] Complex-Valued Feedforward Neural Networks Learning Without Backpropagation
    Guo, Wei
    Huang, He
    Huang, Tingwen
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2017), PT IV, 2017, 10637 : 100 - 107
  • [2] A general backpropagation algorithm for feedforward neural networks learning
    Yu, XH
    Efe, MO
    Kaynak, O
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (01): : 251 - 254
  • [3] A backpropagation learning algorithm with graph regularization for feedforward neural networks
    Fan, Yetian
    Yang, Wenyu
    [J]. INFORMATION SCIENCES, 2022, 607 : 263 - 277
  • [4] Learning polynomial feedforward neural networks by genetic programming and backpropagation
    Nikolaev, NY
    Iba, H
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (02): : 337 - 350
  • [5] Exponentiated backpropagation algorithm for multilayer feedforward neural networks
    Srinivasan, N
    Ravichandran, V
    Chan, KL
    Vidhya, JR
    Ramakirishnan, S
    Krishnan, SM
    [J]. ICONIP'02: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING: COMPUTATIONAL INTELLIGENCE FOR THE E-AGE, 2002, : 327 - 331
  • [6] A Modified Backpropagation Training Algorithm for Feedforward Neural Networks*
    T. Kathirvalavakumar
    P. Thangavel
    [J]. Neural Processing Letters, 2006, 23 : 111 - 119
  • [7] Feedforward backpropagation artificial neural networks on reconfigurable meshes
    Jenq, JJ
    Li, WN
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 1998, 14 (5-6): : 313 - 319
  • [8] A modified backpropagation training algorithm for feedforward neural networks
    Kathirvalavakumar, T
    Thangavel, P
    [J]. NEURAL PROCESSING LETTERS, 2006, 23 (02) : 111 - 119
  • [9] A remark on the error-backpropagation learning algorithm for spiking neural networks
    Yang, Jie
    Yang, Wenyu
    Wu, Wei
    [J]. APPLIED MATHEMATICS LETTERS, 2012, 25 (08) : 1118 - 1120
  • [10] Noise-Boosted Backpropagation Learning of Feedforward Threshold Neural Networks for Function Approximation
    Duan, Lingling
    Duan, Fabing
    Chapeau-Blondeau, Francois
    Abbott, Derek
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70