A Proof of a Key Formula in the Error-Backpropagation Learning Algorithm for Multiple Spiking Neural Networks

被引:1
|
作者
Yang, Wenyu [1 ]
Yang, Dakun [2 ]
Fan, Yetian [3 ]
机构
[1] Huazhong Agr Univ, Coll Sci, Wuhan, Peoples R China
[2] Sun Yat Sen Univ, Sch Informat Sci & Technol, Guangzhou 510275, Guangdong, Peoples R China
[3] Dalian Univ Technol, Sch Math Sci, Dalian, Peoples R China
来源
关键词
Spiking neuron; Error-backpropagation; Differentiation of the firing time; Implicit function theorem; GRADIENT DESCENT; NEURONS; CLASSIFICATION;
D O I
10.1007/978-3-319-12436-0_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the error-backpropagation learning algorithm for spiking neural networks, solving the differentiation of the firing time t(alpha) with respect to the weight w is essential. Bohte et al. see the firing time t(alpha) as a functional of the state variable x(t). But the differentiation of the firing time t(alpha) with respect to the state variable x(t) is impossible to perform directly. To overcome this problem, Bohte et al. assume that the state variable x(t) is a linear function of the time t around t = t(alpha). Then, it seems that the solution of Bohte et al. is used by all related Literatures. In particular, Ghosh-Dastidar and Adeli offer another explanation. In this paper, we consider the firing time t(alpha) as a function of the time t and the weight w and prove that the key formula for multiple spiking neural networks is in fact mathematically correct through the implicit function theorem.
引用
收藏
页码:19 / 26
页数:8
相关论文
共 50 条
  • [1] A remark on the error-backpropagation learning algorithm for spiking neural networks
    Yang, Jie
    Yang, Wenyu
    Wu, Wei
    [J]. APPLIED MATHEMATICS LETTERS, 2012, 25 (08) : 1118 - 1120
  • [2] Error-Backpropagation in Networks of Fractionally Predictive Spiking Neurons
    Bohte, Sander M.
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2011, PT I, 2011, 6791 : 60 - 68
  • [3] Error-backpropagation in temporally encoded networks of spiking neurons
    Bohte, SM
    Kok, JN
    La Poutré, H
    [J]. NEUROCOMPUTING, 2002, 48 : 17 - 37
  • [4] Quadratic optimization method for multilayer neural networks with local error-backpropagation
    Liu, CS
    Tseng, CH
    [J]. INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 1999, 30 (08) : 889 - 898
  • [5] BPSpike II: A New Backpropagation Learning Algorithm for Spiking Neural Networks
    Matsuda, Satoshi
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2016, PT II, 2016, 9948 : 56 - 65
  • [6] Supervised Learning in Multilayer Spiking Neural Networks With Spike Temporal Error Backpropagation
    Luo, Xiaoling
    Qu, Hong
    Wang, Yuchen
    Yi, Zhang
    Zhang, Jilun
    Zhang, Malu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) : 10141 - 10153
  • [7] BPSpike: a backpropagation learning for all parameters in spiking neural networks with multiple layers and multiple spikes
    Matsuda, Satoshi
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 293 - 298
  • [8] ADAPTIVE NOISE FILTERING USING AN ERROR-BACKPROPAGATION NEURAL NETWORK
    WEBER, M
    CRILLY, PB
    BLASS, WE
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 1991, 40 (05) : 820 - 825
  • [9] Spiking Neural Networks Using Backpropagation
    Syed, Tehreem
    Kakani, Vijay
    Cui, Xuenan
    Kim, Hakil
    [J]. 2021 IEEE REGION 10 SYMPOSIUM (TENSYMP), 2021,
  • [10] Learning algorithm for spiking neural networks
    Amin, HH
    Fujii, RH
    [J]. ADVANCES IN NATURAL COMPUTATION, PT 1, PROCEEDINGS, 2005, 3610 : 456 - 465