A remark on the error-backpropagation learning algorithm for spiking neural networks

被引:20
|
作者
Yang, Jie [1 ]
Yang, Wenyu [1 ]
Wu, Wei [1 ]
机构
[1] Dalian Univ Technol, Sch Math Sci, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Spiking neuron; Error-backpropagation; Differentiation of the firing time with respect to the state; NEURONS;
D O I
10.1016/j.aml.2012.02.016
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In the error-backpropagation learning algorithm for spiking neural networks, one has to differentiate the firing time t(alpha) as a functional of the state function x(t). But this differentiation is impossible to perform directly since t(alpha) cannot be formulated in a standard form as a functional of x(t). To overcome this difficulty, Bohte et al. (2002) (1] assume that there is a linear relationship between the firing time t(alpha) and the state x(t) around t = t(alpha). In terms of this assumption, the Frechet derivative of the functional is equal to the derivative of an ordinary function that can be computed directly and easily. Our contribution in this short note is to prove that this equality of differentiations is in fact mathematically correct, without the help of the linearity assumption. (C) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1118 / 1120
页数:3
相关论文
共 50 条
  • [1] A Proof of a Key Formula in the Error-Backpropagation Learning Algorithm for Multiple Spiking Neural Networks
    Yang, Wenyu
    Yang, Dakun
    Fan, Yetian
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2014, 2014, 8866 : 19 - 26
  • [2] Error-Backpropagation in Networks of Fractionally Predictive Spiking Neurons
    Bohte, Sander M.
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2011, PT I, 2011, 6791 : 60 - 68
  • [3] Error-backpropagation in temporally encoded networks of spiking neurons
    Bohte, SM
    Kok, JN
    La Poutré, H
    [J]. NEUROCOMPUTING, 2002, 48 : 17 - 37
  • [4] Quadratic optimization method for multilayer neural networks with local error-backpropagation
    Liu, CS
    Tseng, CH
    [J]. INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 1999, 30 (08) : 889 - 898
  • [5] BPSpike II: A New Backpropagation Learning Algorithm for Spiking Neural Networks
    Matsuda, Satoshi
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2016, PT II, 2016, 9948 : 56 - 65
  • [6] Supervised Learning in Multilayer Spiking Neural Networks With Spike Temporal Error Backpropagation
    Luo, Xiaoling
    Qu, Hong
    Wang, Yuchen
    Yi, Zhang
    Zhang, Jilun
    Zhang, Malu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) : 10141 - 10153
  • [7] ADAPTIVE NOISE FILTERING USING AN ERROR-BACKPROPAGATION NEURAL NETWORK
    WEBER, M
    CRILLY, PB
    BLASS, WE
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 1991, 40 (05) : 820 - 825
  • [8] Learning algorithm for spiking neural networks
    Amin, HH
    Fujii, RH
    [J]. ADVANCES IN NATURAL COMPUTATION, PT 1, PROCEEDINGS, 2005, 3610 : 456 - 465
  • [9] Spiking Neural Networks Using Backpropagation
    Syed, Tehreem
    Kakani, Vijay
    Cui, Xuenan
    Kim, Hakil
    [J]. 2021 IEEE REGION 10 SYMPOSIUM (TENSYMP), 2021,
  • [10] Neural networks with robust backpropagation learning algorithm
    Walczak, B
    [J]. ANALYTICA CHIMICA ACTA, 1996, 322 (1-2) : 21 - 29