A biologically plausible supervised learning method for spiking neural networks using the symmetric STDP rule

被引:97
|
作者
Hao, Yunzhe [1 ,2 ]
Huang, Xuhui [1 ]
Dong, Meng [1 ]
Xu, Bo [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Res Ctr Brain Inspired Intelligence, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, CAS Ctr Excellence Brain Sci & Intelligence Techn, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Spiking neural networks; Dopamine-modulated spike-timing dependent plasticity; Pattern recognition; Supervised learning; Biologically plausibility; TIMING-DEPENDENT PLASTICITY; DOPAMINERGIC MODULATION; VISUAL-CORTEX; HOMEOSTASIS; REWARD; ENERGY;
D O I
10.1016/j.neunet.2019.09.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking neural networks (SNNs) possess energy-efficient potential due to event-based computation. However, supervised training of SNNs remains a challenge as spike activities are non-differentiable. Previous SNNs training methods can be generally categorized into two basic classes, i.e., backpropagation-like training methods and plasticity-based learning methods. The former methods are dependent on energy-inefficient real-valued computation and non-local transmission, as also required in artificial neural networks (ANNs), whereas the latter are either considered to be biologically implausible or exhibit poor performance. Hence, biologically plausible (bio-plausible) high-performance supervised learning (SL) methods for SNNs remain deficient. In this paper, we proposed a novel bioplausible SNN model for SL based on the symmetric spike-timing dependent plasticity (sym-STDP) rule found in neuroscience. By combining the sym-STDP rule with bio-plausible synaptic scaling and intrinsic plasticity of the dynamic threshold, our SNN model implemented SL well and achieved good performance in the benchmark recognition task (MNIST dataset). To reveal the underlying mechanism of our SL model, we visualized both layer-based activities and synaptic weights using the t-distributed stochastic neighbor embedding (t-SNE) method after training and found that they were well clustered, thereby demonstrating excellent classification ability. Furthermore, to verify the robustness of our model, we trained it on another more realistic dataset (Fashion-MNIST), which also showed good performance. As the learning rules were bio-plausible and based purely on local spike events, our model could be easily applied to neuromorphic hardware for online training and may be helpful for understanding SL information processing at the synaptic level in biological neural systems. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:387 / 395
页数:9
相关论文
共 50 条
  • [1] Biologically Plausible Models of Homeostasis and STDP: Stability and Learning in Spiking Neural Networks
    Carlson, Kristofor D.
    Richert, Micah
    Dutt, Nikil
    Krichmar, Jeffrey L.
    [J]. 2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [2] A review of learning in biologically plausible spiking neural networks
    Taherkhani, Aboozar
    Belatreche, Ammar
    Li, Yuhua
    Cosma, Georgina
    Maguire, Liam P.
    McGinnity, T. M.
    [J]. NEURAL NETWORKS, 2020, 122 (122) : 253 - 272
  • [3] Biologically Plausible Sequence Learning with Spiking Neural Networks
    Liu, Zuozhu
    Chotibut, Thiparat
    Hillar, Christopher
    Lin, Shaowei
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 1316 - 1323
  • [4] A MORE BIOLOGICALLY PLAUSIBLE LEARNING RULE FOR NEURAL NETWORKS
    MAZZONI, P
    ANDERSEN, RA
    JORDAN, MI
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1991, 88 (10) : 4433 - 4437
  • [5] Touch Modality Classification using Spiking Neural Networks and Supervised-STDP Learning
    Dabbous, Ali
    Ibrahim, Ali
    Valle, Maurizio
    Bartolozzi, Chiara
    [J]. 2021 28TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS, AND SYSTEMS (IEEE ICECS 2021), 2021,
  • [6] An STDP-Based Supervised Learning Algorithm for Spiking Neural Networks
    Hu, Zhanhao
    Wang, Tao
    Hu, Xiaolin
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 92 - 100
  • [7] A biologically plausible learning rule for the Infomax on recurrent neural networks
    Hayakawa, Takashi
    Kaneko, Takeshi
    Aoyagi, Toshio
    [J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2014, 8
  • [8] An unsupervised STDP-based spiking neural network inspired by biologically plausible learning rules and connections
    Dong, Yiting
    Zhao, Dongcheng
    Li, Yang
    Zeng, Yi
    [J]. NEURAL NETWORKS, 2023, 165 : 799 - 808
  • [9] A forecast-based biologically-plausible STDP learning rule
    Davies, Sergio
    Rast, Alexander
    Galluppi, Francesco
    Furber, Steve
    [J]. 2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 1810 - 1817
  • [10] Temporal sequence learning via adaptation in biologically plausible spiking neural networks
    Renato Duarte
    Peggy Seriès
    Abigail Morrison
    [J]. BMC Neuroscience, 15 (Suppl 1)