An ensemble unsupervised spiking neural network for objective recognition

被引:21
|
作者
Fu, Qiang [1 ]
Dong, Hongbin [1 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Spiking neural network; STDP; Unsupervised training; Ensemble learning; Transfer learning;
D O I
10.1016/j.neucom.2020.07.109
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It is now known that the spiking neuron is a basic unit of spiking neural networks (SNNs). Spiking neu-rons modulate the nervous cells via receiving external incentives, generation of action potential and firing spikes. The SNNs usually used for pattern recognition tasks or complex computation depending on the brain-like characteristic. Although the SNNs have no advantages comparing with the deep neural networks in terms of classification accuracy, the SNNs have more characteristics of biological neurons. In this paper, a hierarchical SNN, comprising convolutional and pooling layers, is designed. The proposed SNN consists of excitatory and inhibitory neurons based on the mechanism of the primate brain. A temporal coding (rank order) manner is used to encode the input patterns. It depends on the rank of the spike arrival on post synapses to establish the priority of input spikes for a particular pattern. The spike-timing dependent plasticity (STDP) learning rule is used in convolutional layers to extract visual features in an unsupervised learning manner. During the classification stage, a lateral inhibition mechanism is used to prevent the non-firing neurons and produce distinguishable results. In order to improve the performance of our SNN, an ensemble SNN architecture using the voting method is proposed, and transfer learning is used to avoid re-training the SNN when solving the different tasks. The hand-written digits classification task on MNIST, CIFAR-10, and BreaKHis databases are used to verify the performance of the proposed SNN. Experimental results show that by using the ensemble architecture and transfer learning, the classification accuracy of 99.27% for the MNIST database, overall accuracy is 93% for the CIFAR-10 database, and overall accuracy is 96.97% for BreaKHis database. In the meantime, this work achieves a better performance than the benchmarking approaches. Taken together, the results of our work suggest that the ensemble SNN architecture with transfer learning is key to improving the performance of the SNN. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:47 / 58
页数:12
相关论文
共 50 条
  • [1] An Unsupervised Spiking Deep Neural Network for Object Recognition
    Song, Zeyang
    Wu, Xi
    Yuan, Mengwen
    Tang, Huajin
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2019, PT II, 2019, 11555 : 361 - 370
  • [2] Finger Vein Recognition Based on Unsupervised Spiking Neural Network
    Yang, Li
    Xu, Xiang
    Yao, Qiong
    [J]. BIOMETRIC RECOGNITION, CCBR 2023, 2023, 14463 : 55 - 64
  • [3] <bold>A New Unsupervised Neural Network for Pattern Recognition with Spiking Neurons</bold>
    Lorenzo, Riano
    Riccardo, Rizzo
    Antonio, Chella
    [J]. 2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, : 3903 - +
  • [4] Neural encoding with unsupervised spiking convolutional neural network
    Wang, Chong
    Yan, Hongmei
    Huang, Wei
    Sheng, Wei
    Wang, Yuting
    Fan, Yun-Shuang
    Liu, Tao
    Zou, Ting
    Li, Rong
    Chen, Huafu
    [J]. COMMUNICATIONS BIOLOGY, 2023, 6 (01)
  • [5] Neural encoding with unsupervised spiking convolutional neural network
    Chong Wang
    Hongmei Yan
    Wei Huang
    Wei Sheng
    Yuting Wang
    Yun-Shuang Fan
    Tao Liu
    Ting Zou
    Rong Li
    Huafu Chen
    [J]. Communications Biology, 6
  • [6] Unsupervised Learning in an Ensemble of Spiking Neural Networks Mediated by ITDP
    Shim, Yoonsik
    Philippides, Andrew
    Staras, Kevin
    Husbands, Phil
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2016, 12 (10)
  • [7] Unsupervised SFQ-Based Spiking Neural Network
    Karamuftuoglu, Mustafa Altay
    Ucpinar, Beyza Zeynep
    Razmkhah, Sasan
    Kamal, Mehdi
    Pedram, Massoud
    [J]. IEEE TRANSACTIONS ON APPLIED SUPERCONDUCTIVITY, 2024, 34 (03)
  • [8] A Fully Memristive Spiking Neural Network with Unsupervised Learning
    Zhou, Peng
    Choi, Dong-Uk
    Eshraghian, Jason K.
    Kang, Sung-Mo
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 634 - 638
  • [9] A Parallel Spiking Neural Network Based on Adaptive Lateral Inhibition Mechanism for Objective Recognition
    Fu, Qiang
    Dong, Hongbin
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [10] Object shape recognition using tactile sensor arrays by a spiking neural network with unsupervised learning
    Kim, Jaehun
    Kim, Sung-Phil
    Kim, Jungjun
    Hwang, Heeseon
    Kim, Jaehyun
    Park, Doowon
    Jeong, Unyong
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 178 - 183