Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting

被引:414
|
作者
Ponulak, Filip [1 ,2 ]
Kasinski, Andrzej [1 ]
机构
[1] Poznan Univ Tech, Inst Control & Informat Engn, PL-60965 Poznan, Poland
[2] Univ Freiburg, Bernstein Ctr Computat Neurosci, D-79104 Freiburg, Germany
关键词
DEPENDENT SYNAPTIC PLASTICITY; INSTRUCTIVE SIGNALS; INTERNAL-MODELS; CEREBELLUM; MECHANISMS; PRECISION; NEURONS; PATHWAY;
D O I
10.1162/neco.2009.11-08-901
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning from instructions or demonstrations is a fundamental property of our brain necessary to acquire new knowledge and develop novel skills or behavioral patterns. This type of learning is thought to be involved in most of our daily routines. Although the concept of instruction-based learning has been studied for several decades, the exact neural mechanisms implementing this process remain unrevealed. One of the central questions in this regard is, How do neurons learn to reproduce template signals (instructions) encoded in precisely timed sequences of spikes? Here we present a model of supervised learning for biologically plausible neurons that addresses this question. In a set of experiments, we demonstrate that our approach enables us to train spiking neurons to reproduce arbitrary template spike patterns in response to given synaptic stimuli even in the presence of various sources of noise. We show that the learning rule can also be used for decision-making tasks. Neurons can be trained to classify categories of input signals based on only a temporal configuration of spikes. The decision is communicated by emitting precisely timed spike trains associated with given input categories. Trained neurons can perform the classification task correctly even if stimuli and corresponding decision times are temporally separated and the relevant information is consequently highly overlapped by the ongoing neural activity. Finally, we demonstrate that neurons can be trained to reproduce sequences of spikes with a controllable time shift with respect to target templates. A reproduced signal can follow or even precede the targets. This surprising result points out that spiking neurons can potentially be applied to forecast the behavior (firing times) of other reference neurons or networks.
引用
收藏
页码:467 / 510
页数:44
相关论文
共 50 条
  • [1] A Supervised Multi-Spike Learning Algorithm for Spiking Neural Networks
    Miao, Yu
    Tang, Huajin
    Pan, Gang
    [J]. 2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018, : 420 - 426
  • [2] Supervised learning with spiking neural networks
    Xin, JG
    Embrechts, MJ
    [J]. IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 1772 - 1777
  • [3] Supervised learning in multilayer spiking neural networks with inner products of spike trains
    Lin, Xianghong
    Wang, Xiangwen
    Hao, Zhanjun
    [J]. NEUROCOMPUTING, 2017, 237 : 59 - 70
  • [4] Supervised Learning in Multilayer Spiking Neural Networks With Spike Temporal Error Backpropagation
    Luo, Xiaoling
    Qu, Hong
    Wang, Yuchen
    Yi, Zhang
    Zhang, Jilun
    Zhang, Malu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) : 10141 - 10153
  • [5] Supervised Learning With First-to-Spike Decoding in Multilayer Spiking Neural Networks
    Gardner, Brian
    Gruening, Andre
    [J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2021, 15
  • [6] Comparison of supervised learning methods for spike time coding in spiking neural networks
    Institute of Control and Information Engineering, Poznań University of Technology, ul. Piotrowo 3a, 60-965 Poznań, Poland
    [J]. Int. J. Appl. Math. Comput. Sci., 2006, 1 (101-113):
  • [7] A Supervised Multi-spike Learning Algorithm for Recurrent Spiking Neural Networks
    Lin, Xianghong
    Shi, Guoyong
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT I, 2018, 11139 : 222 - 234
  • [8] Analysis of the ReSuMe learning process for spiking neural networks
    Ponulak, Filip
    [J]. INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2008, 18 (02) : 117 - 127
  • [9] Supervised Learning in Multilayer Spiking Neural Networks
    Sporea, Ioana
    Gruening, Andre
    [J]. NEURAL COMPUTATION, 2013, 25 (02) : 473 - 509
  • [10] Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural Networks
    Zhang, Wenrui
    Li, Peng
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33