Rapid Feedforward Computation by Temporal Encoding and Learning With Spiking Neurons

被引:113
|
作者
Yu, Qiang [1 ]
Tang, Huajin [2 ]
Tan, Kay Chen [1 ]
Li, Haizhou [2 ,3 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 119260, Singapore
[2] Agcy Sci Technol & Res, Inst Infocomm Res, Singapore 138632, Singapore
[3] Univ New S Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
关键词
Pattern recognition; spatiotemporal patterns; spike-timing-dependent plasticity (STDP); spiking neural network (SNN); supervised learning; temporal encoding; temporal learning; RETINAL GANGLION-CELLS; NEURAL-NETWORK; OBJECT RECOGNITION; INFORMATION; PRECISION; PATTERN; CODE; ARCHITECTURE; TEMPOTRON; MODELS;
D O I
10.1109/TNNLS.2013.2245677
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Primates perform remarkably well in cognitive tasks such as pattern recognition. Motivated by recent findings in biological systems, a unified and consistent feedforward system network with a proper encoding scheme and supervised temporal rules is built for solving the pattern recognition task. The temporal rules used for processing precise spiking patterns have recently emerged as ways of emulating the brain's computation from its anatomy and physiology. Most of these rules could be used for recognizing different spatiotemporal patterns. However, there arises the question of whether these temporal rules could be used to recognize real-world stimuli such as images. Furthermore, how the information is represented in the brain still remains unclear. To tackle these problems, a proper encoding method and a unified computational model with consistent and efficient learning rule are proposed. Through encoding, external stimuli are converted into sparse representations, which also have properties of invariance. These temporal patterns are then learned through biologically derived algorithms in the learning layer, followed by the final decision presented through the readout layer. The performance of the model with images of digits from the MNIST database is presented. The results show that the proposed model is capable of recognizing images correctly with a performance comparable to that of current benchmark algorithms. The results also suggest a plausibility proof for a class of feedforward models of rapid and robust recognition in the brain.
引用
收藏
页码:1539 / 1552
页数:14
相关论文
共 50 条
  • [1] Connectomic constraints on computation in feedforward networks of spiking neurons
    Venkatakrishnan Ramaswamy
    Arunava Banerjee
    [J]. Journal of Computational Neuroscience, 2014, 37 : 209 - 228
  • [2] Connectomic constraints on computation in feedforward networks of spiking neurons
    Ramaswamy, Venkatakrishnan
    Banerjee, Arunava
    [J]. JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2014, 37 (02) : 209 - 228
  • [3] Pattern Recognition Computation in A Spiking Neural Network with Temporal Encoding and Learning
    Yu, Qiang
    Tan, K. C.
    Tang, Huajin
    [J]. 2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2012,
  • [4] Learning under weight constraints in networks of temporal encoding spiking neurons
    Wu, Q. X.
    McGinnity, T. M.
    Maguire, L. P.
    Glackin, B.
    Belatreche, A.
    [J]. NEUROCOMPUTING, 2006, 69 (16-18) : 1912 - 1922
  • [5] Fast temporal encoding and decoding with spiking neurons
    Horn, D
    Levanda, S
    [J]. NEURAL COMPUTATION, 1998, 10 (07) : 1705 - 1720
  • [6] On the complexity of learning for spiking neurons with temporal coding
    Maass, W
    Schmitt, M
    [J]. INFORMATION AND COMPUTATION, 1999, 153 (01) : 26 - 46
  • [7] Noise as a Resource for Computation and Learning in Networks of Spiking Neurons
    Maass, Wolfgang
    [J]. PROCEEDINGS OF THE IEEE, 2014, 102 (05) : 860 - 880
  • [8] A Direct Computation Method of Supervised Learning for Spiking Neurons
    一种脉冲神经元监督学习的直接计算方法
    [J]. Wang, Guo-En (150251932@qq.com), 1600, Chinese Institute of Electronics (49): : 331 - 337
  • [9] Wavelet decomposition and phase encoding of temporal signals using spiking neurons
    Wang, Zhenzhong
    Guo, Lilin
    Adjouadi, Malek
    [J]. NEUROCOMPUTING, 2016, 173 : 1203 - 1210
  • [10] Supervised Learning in Spiking Neural Networks for Precise Temporal Encoding
    Gardner, Brian
    Gruning, Andre
    [J]. PLOS ONE, 2016, 11 (08):