Backpropagation

被引:3
|
作者
Andrew, AM
机构
[1] Earley, Reading
关键词
cybernetics; networks; learning; algorithms;
D O I
10.1108/03684920110405601
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The popular backpropagation algorithm for training neural nets is a special case of an earlier principle of significance feedback, which in turn has much in common with Selfridge's "Pandemonium" and a connection with McCufloch's "redundancy of potential command" Ways in which the effects might operate in real neural nets are reviewed, and the ideas are related to the current interest in heterogeneous agents. The tendency to restrict attention to numerical optimisation is regretted.
引用
下载
收藏
页码:1110 / 1117
页数:8
相关论文
共 50 条
  • [1] Backpropagation and the brain
    Lillicrap, Timothy P.
    Santoro, Adam
    Marris, Luke
    Akerman, Colin J.
    Hinton, Geoffrey
    NATURE REVIEWS NEUROSCIENCE, 2020, 21 (06) : 335 - 346
  • [2] Bidirectional Backpropagation
    Adigun, Olaoluwa
    Kosko, Bart
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (05): : 1982 - 1994
  • [3] Nonlinear backpropagation: Doing backpropagation without derivatives of the activation function
    Hertz, J
    Krogh, A
    Lautrup, B
    Lehmann, T
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1997, 8 (06): : 1321 - 1327
  • [4] Backpropagation and the brain
    Timothy P. Lillicrap
    Adam Santoro
    Luke Marris
    Colin J. Akerman
    Geoffrey Hinton
    Nature Reviews Neuroscience, 2020, 21 : 335 - 346
  • [5] BACKPROPAGATION WITH HOMOTOPY
    YANG, LP
    YU, WZ
    NEURAL COMPUTATION, 1993, 5 (03) : 363 - 366
  • [6] A CORRELATIVE VIEW ON BACKPROPAGATION
    LINDEN, A
    KINDERMANN, J
    CONNECTIONISM IN PERSPECTIVE, 1989, : 377 - 384
  • [7] Modelling with constructive backpropagation
    Lehtokangas, M
    NEURAL NETWORKS, 1999, 12 (4-5) : 707 - 716
  • [8] From backpropagation to neurocontrol
    Werbos, PJ
    SIXTH, SEVENTH, AND EIGHTH WORKSHOPS ON VIRTUAL INTELLIGENCE: ACADEMIC/INDUSTRIAL/NASA/DEFENSE TECHNICAL INTERCHANGE AND TUTORIALS, 1996, 2878 : 476 - 536
  • [9] An energy backpropagation algorithm
    Aal-Yhia, Ahmad Hashim Hussein
    Sharieh, Ahmad
    WORLD CONGRESS ON ENGINEERING 2007, VOLS 1 AND 2, 2007, : 122 - +
  • [10] EXTENDED BACKPROPAGATION ALGORITHM
    YAM, YF
    CHOW, TWS
    ELECTRONICS LETTERS, 1993, 29 (19) : 1701 - 1702