Local Delay Plasticity Supports Generalized Learning in Spiking Neural Networks

被引:0
|
作者
Farner, Jorgen Jensen [1 ]
Ramstad, Ola Huse [1 ,2 ]
Nichele, Stefano [1 ,3 ]
Heiney, Kristine [1 ,4 ]
机构
[1] Oslo Metropolitan Univ, Dept Comp Sci, Oslo, Norway
[2] Norwegian Univ Sci & Technol, Dept Neuromed & Movement Sci, Trondheim, Norway
[3] Ostfold Univ Coll, Dept Comp Sci & Commun, Halden, Norway
[4] Norwegian Univ Sci & Technol, Dept Comp Sci, Trondheim, Norway
关键词
delay plasticity; local learning; spiking neural networks; Izhikevich neuron; generalized learning; POLYCHRONIZATION;
D O I
10.1007/978-3-031-57430-6_19
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We propose a novel local learning rule for spiking neural networks in which spike propagation times undergo activity-dependent plasticity. Our plasticity rule aligns pre-synaptic spike times to produce a stronger and more rapid response. Inputs are encoded by latency coding and outputs decoded by matching similar patterns of output spiking activity. We demonstrate the use of this method in a three-layer feed-foward network with inputs from a database of handwritten digits. Networks consistently showed improved classification accuracy after training, and training with this method also allowed networks to generalize to an input class unseen during training. Our proposed method takes advantage of the ability of spiking neurons to support many different time-locked sequences of spikes, each of which can be activated by different input activations. The proof-of-concept shown here demonstrates the great potential for local delay learning to expand the memory capacity and generalizability of spiking neural networks and offers new perspectives on how to configure neuromorphic hardware.
引用
收藏
页码:241 / 255
页数:15
相关论文
共 50 条
  • [1] Supervised Learning in Spiking Neural Networks with Synaptic Delay Plasticity: An Overview
    Lan, Yawen
    Li, Qiang
    [J]. CURRENT BIOINFORMATICS, 2020, 15 (08) : 854 - 865
  • [2] Supervised learning in spiking neural networks with synaptic delay-weight plasticity
    Zhang, Malu
    Wu, Jibin
    Belatreche, Ammar
    Pan, Zihan
    Xie, Xiurui
    Chua, Yansong
    Li, Guoqi
    Qu, Hong
    Li, Haizhou
    [J]. NEUROCOMPUTING, 2020, 409 : 103 - 118
  • [3] Delay-weight plasticity-based supervised learning in optical spiking neural networks
    YANAN HAN
    SHUIYING XIANG
    ZHENXING REN
    CHENTAO FU
    AIJUN WEN
    YUE HAO
    [J]. Photonics Research, 2021, 9 (04) : 119 - 127
  • [4] Delay-weight plasticity-based supervised learning in optical spiking neural networks
    Han, Yanan
    Xiang, Shuiying
    Ren, Zhenxing
    Fu, Chentao
    Wen, Aijun
    Hao, Yue
    [J]. PHOTONICS RESEARCH, 2021, 9 (04) : B119 - B127
  • [5] Fast learning without synaptic plasticity in spiking neural networks
    Subramoney, Anand
    Bellec, Guillaume
    Scherr, Franz
    Legenstein, Robert
    Maass, Wolfgang
    [J]. SCIENTIFIC REPORTS, 2024, 14 (01)
  • [6] Training Spiking Neural Networks with Local Tandem Learning
    Yang, Qu
    Wu, Jibin
    Zhang, Malu
    Chua, Yansong
    Wang, Xinchao
    Li, Haizhou
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [7] Delay learning based on temporal coding in Spiking Neural Networks
    Sun, Pengfei
    Wu, Jibin
    Zhang, Malu
    Devos, Paul
    Botteldooren, Dick
    [J]. NEURAL NETWORKS, 2024, 180
  • [8] ASP: Learning to Forget With Adaptive Synaptic Plasticity in Spiking Neural Networks
    Panda, Priyadarshini
    Allred, Jason M.
    Ramanathan, Shriram
    Roy, Kaushik
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2018, 8 (01) : 51 - 64
  • [9] Temporal Dependent Local Learning for Deep Spiking Neural Networks
    Ma, Chenxiang
    Xu, Junhai
    Yu, Qiang
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [10] SpikePropamine: Differentiable Plasticity in Spiking Neural Networks
    Schmidgall, Samuel
    Ashkanazy, Julia
    Lawson, Wallace
    Hays, Joe
    [J]. FRONTIERS IN NEUROROBOTICS, 2021, 15