Supervised learning in spiking neural networks with synaptic delay-weight plasticity

被引:43
|
作者
Zhang, Malu [1 ,2 ]
Wu, Jibin [2 ]
Belatreche, Ammar [3 ]
Pan, Zihan [2 ]
Xie, Xiurui [4 ]
Chua, Yansong [4 ]
Li, Guoqi [5 ]
Qu, Hong [1 ]
Li, Haizhou [2 ,4 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Peoples R China
[2] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore, Singapore
[3] Northumbria Univ, Fac Engn & Environm, Dept Comp & Informat Sci, Newcastle Upon Tyne, Tyne & Wear, England
[4] ASTAR, Inst Infocomm Res, Singapore, Singapore
[5] Tsinghua Univ, Beijing Innovat Ctr Future Chip, Dept Precis Instrument, Beijing 100084, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Spiking neurons; Spiking neural networks; Supervised learning; Synaptic plasticity; Synaptic weight; Synaptic delay; ALGORITHM; CLASSIFICATION; SYSTEM; RESUME;
D O I
10.1016/j.neucom.2020.03.079
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking neurons encode information through their spiking temporal patterns. Although the precise spike-timing based encoding scheme has long been recognised, the exact mechanism that underlies the learning of such precise spike-timing in the brain remains an open question. Most of the existing learning methods for spiking neurons are based on synaptic weight adjustment. However, biological evidences suggest that synaptic delays can also be modulated to play an important role in the learning process. This paper investigates the viability of integrating synaptic delay plasticity into supervised learning and proposes a novel learning method that adjusts both the synaptic delays and weights of the learning neurons to make them fire precisely timed spikes, that is referred to as synaptic delay-weight plasticity. Remote Supervised Method (ReSuMe) and Perceptron Based Spiking Neuron Learning Rule (PBSNLR), two representative supervised learning methods, are studied to illustrate how the synaptic delay-weight plasticity works. The performance of the proposed learning method is thoroughly evaluated on synthetic data and is further demonstrated on real-world classification tasks. The experiments show that the synaptic delay-weight learning method outperforms the traditional synaptic weight learning methods in many ways. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:103 / 118
页数:16
相关论文
共 50 条
  • [1] Delay-weight plasticity-based supervised learning in optical spiking neural networks
    Han, Yanan
    Xiang, Shuiying
    Ren, Zhenxing
    Fu, Chentao
    Wen, Aijun
    Hao, Yue
    [J]. PHOTONICS RESEARCH, 2021, 9 (04) : B119 - B127
  • [2] Delay-weight plasticity-based supervised learning in optical spiking neural networks
    YANAN HAN
    SHUIYING XIANG
    ZHENXING REN
    CHENTAO FU
    AIJUN WEN
    YUE HAO
    [J]. Photonics Research, 2021, 9 (04) : 119 - 127
  • [3] Supervised Learning in Spiking Neural Networks with Synaptic Delay Plasticity: An Overview
    Lan, Yawen
    Li, Qiang
    [J]. CURRENT BIOINFORMATICS, 2020, 15 (08) : 854 - 865
  • [4] Synaptic delay plasticity based on frequency-switched VCSELs for optical delay-weight spiking neural networks
    Lu, Yao
    Zhang, Wenjia
    Fu, Bangqi
    DU, Jiangbing
    He, Zuyuan
    [J]. OPTICS LETTERS, 2022, 47 (21) : 5587 - 5590
  • [5] Fast learning without synaptic plasticity in spiking neural networks
    Subramoney, Anand
    Bellec, Guillaume
    Scherr, Franz
    Legenstein, Robert
    Maass, Wolfgang
    [J]. SCIENTIFIC REPORTS, 2024, 14 (01)
  • [6] ASP: Learning to Forget With Adaptive Synaptic Plasticity in Spiking Neural Networks
    Panda, Priyadarshini
    Allred, Jason M.
    Ramanathan, Shriram
    Roy, Kaushik
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2018, 8 (01) : 51 - 64
  • [7] Supervised learning with spiking neural networks
    Xin, JG
    Embrechts, MJ
    [J]. IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 1772 - 1777
  • [8] Local Delay Plasticity Supports Generalized Learning in Spiking Neural Networks
    Farner, Jorgen Jensen
    Ramstad, Ola Huse
    Nichele, Stefano
    Heiney, Kristine
    [J]. ARTIFICIAL LIFE AND EVOLUTIONARY COMPUTATION, WIVACE 2023, 2024, 1977 : 241 - 255
  • [9] Memristor-based synaptic plasticity and unsupervised learning of spiking neural networks
    Zohreh Hajiabadi
    Majid Shalchian
    [J]. Journal of Computational Electronics, 2021, 20 : 1625 - 1636
  • [10] Meta-SpikePropamine: learning to learn with synaptic plasticity in spiking neural networks
    Schmidgall, Samuel
    Hays, Joe
    [J]. FRONTIERS IN NEUROSCIENCE, 2023, 17