Hardware Friendly Probabilistic Spiking Neural Network With Long-Term and Short-Term Plasticity

被引:13
|
作者
Hsieh, Hung-Yi [1 ]
Tang, Kea-Tiong [1 ]
机构
[1] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
关键词
Gradient descent learning; hardware compatible; Hebbian learning; probabilistic spiking neural network; resolution requirement reduction; short-term plasticity; ELECTRONIC NOSE; SAR ADC; CLASSIFICATION; NEURONS; ARRAY; IMPLEMENTATION; SYSTEM;
D O I
10.1109/TNNLS.2013.2271644
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a probabilistic spiking neural network (PSNN) with unimodal weight distribution, possessing long-and short-term plasticity. The proposed algorithm is derived by both the arithmetic gradient decent calculation and bioinspired algorithms. The algorithm is benchmarked by the Iris and Wisconsin breast cancer (WBC) data sets. The network features fast convergence speed and high accuracy. In the experiment, the PSNN took not more than 40 epochs for convergence. The average testing accuracy for Iris and WBC data is 96.7% and 97.2%, respectively. To test the usefulness of the PSNN to real world application, the PSNN was also tested with the odor data, which was collected by our self-developed electronic nose (e-nose). Compared with the algorithm (K-nearest neighbor) that has the highest classification accuracy in the e-nose for the same odor data, the classification accuracy of the PSNN is only 1.3% less but the memory requirement can be reduced at least 40%. All the experiments suggest that the PSNN is hardware friendly. First, it requires only nine-bits weight resolution for training and testing. Second, the PSNN can learn complex data sets with a little number of neurons that in turn reduce the cost of VLSI implementation. In addition, the algorithm is insensitive to synaptic noise and the parameter variation induced by the VLSI fabrication. Therefore, the algorithm can be implemented by either software or hardware, making it suitable for wider application.
引用
收藏
页码:2063 / 2074
页数:12
相关论文
共 50 条
  • [1] Development of a Short-Term to Long-Term Supervised Spiking Neural Network Processor
    Bailey, Tony James
    Ford, Andrew J.
    Barve, Siddharth
    Wells, Jacob
    Jha, Rashmi
    [J]. IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2020, 28 (11) : 2410 - 2423
  • [2] PRESYNAPTIC AND POSTSYNAPTIC LOCI OF SHORT-TERM AND LONG-TERM PLASTICITY
    WHITE, WF
    NADLER, JV
    COTMAN, CW
    [J]. FEDERATION PROCEEDINGS, 1978, 37 (03) : 524 - 524
  • [3] A COMPACT AND CONFIGURABLE LONG SHORT-TERM MEMORY NEURAL NETWORK HARDWARE ARCHITECTURE
    Chen, Kewei
    Huang, Leilei
    Li, Minjiang
    Zeng, Xiaoyang
    Fan, Yibo
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 4168 - 4172
  • [4] Novel Spiking Neural Network Utilizing Short-Term and Long-term Dynamics of 3-Terminal Resistive Crossbar Arrays
    Wenke, Sam
    Rush, Andrew
    Bailey, Tony
    Jha, Rashmi
    [J]. 2017 IEEE 60TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2017, : 432 - 435
  • [5] Influences of short-term and long-term plasticity of memristive synapse on firing activity of neuronal network
    Li, Zhi-Jun
    Zhang, Jing
    [J]. Chinese Physics B, 2024, 33 (12)
  • [6] Influences of short-term and long-term plasticity of memristive synapse on firing activity of neuronal network
    李志军
    张晶
    [J]. Chinese Physics B, 2024, 33 (12) : 557 - 567
  • [7] Financial Crisis Prediction Based on Long-Term and Short-Term Memory Neural Network
    Ling, Tang
    Cai, Yinying
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [8] CUE: A Unified Spiking Neuron Model of Short-Term and Long-Term Memory
    Gosmann, Jan
    Eliasmith, Chris
    [J]. PSYCHOLOGICAL REVIEW, 2021, 128 (01) : 104 - 124
  • [9] A SHORT-TERM IN LONG-TERM
    KELLY, FL
    [J]. AMERICAN JOURNAL OF NURSING, 1988, 88 (11) : 1479 - 1480
  • [10] Mesoscopic population equations for spiking neural networks with synaptic short-term plasticity
    Schmutz, Valentin
    Gerstner, Wulfram
    Schwalger, Tilo
    [J]. JOURNAL OF MATHEMATICAL NEUROSCIENCE, 2020, 10 (01):