Error-Backpropagation in Networks of Fractionally Predictive Spiking Neurons

被引:0
|
作者
Bohte, Sander M. [1 ]
机构
[1] CWI, Life Sci Grp, NL-1097 XG Amsterdam, Netherlands
关键词
NEOCORTICAL PYRAMIDAL NEURONS; ADAPTATION; MODELS; MEMORY; SYSTEM;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We develop a learning rule for networks of spiking neurons where signals are encoded using fractionally predictive spike-coding. In this paradigm, neural output signals are encoded as a sum of shifted power-law kernels. Simple greedy thresholding can compute this encoding, and spike-trains are then exactly the signal's fractional derivative. Fractionally predictive spike-coding exploits natural statistics and is consistent with observed spike-rate adaptation in real neurons; its multiple-timescale properties also reconciles notions of spike-time coding and spike-rate coding. Previously, we argued that properly tuning the decoding kernel at receiving neurons can implement spectral filtering; the applicability to general temporal filtering was left open. Here, we present an error-backpropagation algorithm to learn these decoding filters, and we show that networks of fractionally predictive spiking neurons can then implement temporal filters such as delayed responses, delayed match-to-sampling, and temporal versions of the XOR problem.
引用
收藏
页码:60 / 68
页数:9
相关论文
共 50 条
  • [41] Dynamic layer-span connecting spiking neural networks with backpropagation training
    Zijjian Wang
    Yuxuan Huang
    Yaqin Zhu
    Binxing Xu
    Long Chen
    [J]. Complex & Intelligent Systems, 2024, 10 : 1937 - 1952
  • [42] Fast sigmoidal networks via spiking neurons
    Maass, W
    [J]. NEURAL COMPUTATION, 1997, 9 (02) : 279 - 304
  • [43] Gradient Learning in Networks of Smoothly Spiking Neurons
    Sima, Jiri
    [J]. ADVANCES IN NEURO-INFORMATION PROCESSING, PT II, 2009, 5507 : 179 - 186
  • [44] Inverse stochastic resonance in networks of spiking neurons
    Uzuntarla, Muhammet
    Barreto, Ernest
    Torres, Joaquin J.
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2017, 13 (07)
  • [45] Building functional networks of spiking model neurons
    L F Abbott
    Brian DePasquale
    Raoul-Martin Memmesheimer
    [J]. Nature Neuroscience, 2016, 19 : 350 - 355
  • [46] CBP-QSNN: Spiking Neural Networks Quantized Using Constrained Backpropagation
    Yoo, Donghyung
    Jeong, Doo Seok
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2023, 13 (04) : 1137 - 1146
  • [47] Networks of spiking neurons in modeling and problem solving
    Cios, KJ
    Swiercz, W
    Jackson, W
    [J]. NEUROCOMPUTING, 2004, 61 : 99 - 119
  • [48] Implementing Signature Neural Networks with Spiking Neurons
    Luis Carrillo-Medina, Jose
    Latorre, Roberto
    [J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2016, 10
  • [49] Effects of noise on recurrence in networks of spiking neurons
    Roberts, Patrick D.
    [J]. 2003, Elsevier (52-54)
  • [50] Nonperiodic synchronization in heterogeneous networks of spiking neurons
    Thivierge, Jean-Philippe
    Cisek, Paul
    [J]. JOURNAL OF NEUROSCIENCE, 2008, 28 (32): : 7968 - 7978