Hardware Friendly Probabilistic Spiking Neural Network With Long-Term and Short-Term Plasticity

被引:13
|
作者
Hsieh, Hung-Yi [1 ]
Tang, Kea-Tiong [1 ]
机构
[1] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
关键词
Gradient descent learning; hardware compatible; Hebbian learning; probabilistic spiking neural network; resolution requirement reduction; short-term plasticity; ELECTRONIC NOSE; SAR ADC; CLASSIFICATION; NEURONS; ARRAY; IMPLEMENTATION; SYSTEM;
D O I
10.1109/TNNLS.2013.2271644
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a probabilistic spiking neural network (PSNN) with unimodal weight distribution, possessing long-and short-term plasticity. The proposed algorithm is derived by both the arithmetic gradient decent calculation and bioinspired algorithms. The algorithm is benchmarked by the Iris and Wisconsin breast cancer (WBC) data sets. The network features fast convergence speed and high accuracy. In the experiment, the PSNN took not more than 40 epochs for convergence. The average testing accuracy for Iris and WBC data is 96.7% and 97.2%, respectively. To test the usefulness of the PSNN to real world application, the PSNN was also tested with the odor data, which was collected by our self-developed electronic nose (e-nose). Compared with the algorithm (K-nearest neighbor) that has the highest classification accuracy in the e-nose for the same odor data, the classification accuracy of the PSNN is only 1.3% less but the memory requirement can be reduced at least 40%. All the experiments suggest that the PSNN is hardware friendly. First, it requires only nine-bits weight resolution for training and testing. Second, the PSNN can learn complex data sets with a little number of neurons that in turn reduce the cost of VLSI implementation. In addition, the algorithm is insensitive to synaptic noise and the parameter variation induced by the VLSI fabrication. Therefore, the algorithm can be implemented by either software or hardware, making it suitable for wider application.
引用
下载
收藏
页码:2063 / 2074
页数:12
相关论文
共 50 条
  • [31] LONG-TERM VS SHORT-TERM
    PORTER, JR
    FORTUNE, 1986, 114 (05) : 20 - 20
  • [32] Hardware Architecture of Bidirectional Long Short-Term Memory Neural Network for Optical Character Recognition
    Rybalkin, Vladimir
    Wehn, Norbert
    Yousefi, Mohammad Reza
    Stricker, Didier
    PROCEEDINGS OF THE 2017 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE), 2017, : 1390 - 1395
  • [33] An On-Chip Learning, Low-Power Probabilistic Spiking Neural Network with Long-Term Memory
    Hsieh, Hung-Yi
    Tang, Kea-Tiong
    2013 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS), 2013, : 5 - 8
  • [34] Critical neural networks with short- and long-term plasticity
    van Kessenich, L. Michiels
    Lukovic, M.
    de Arcangelis, L.
    Herrmann, H. J.
    PHYSICAL REVIEW E, 2018, 97 (03)
  • [35] Self-organized Short-Term Memory Mechanism in Spiking Neural Network
    Kiselev, Mikhail
    ADAPTIVE AND NATURAL COMPUTING ALGORITHMS, PT I, 2011, 6593 : 120 - 129
  • [36] Short-term Wind Speed Forecasting Model Based on Spiking Neural Network
    Han, Fengyang
    Li, Runmin
    Qian, Dianwei
    2018 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2018, : 359 - 363
  • [37] Probabilistic Short-Term Solar Driver Forecasting With Neural Network Ensembles
    Daniell, Joshua D.
    Mehta, Piyush M.
    SPACE WEATHER-THE INTERNATIONAL JOURNAL OF RESEARCH AND APPLICATIONS, 2024, 22 (03):
  • [38] Neural Probabilistic Forecasting of Symbolic Sequences With Long Short-Term Memory
    Hauser, Michael
    Fu, Yiwei
    Phoha, Shashi
    Ray, Asok
    JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 2018, 140 (08):
  • [39] Spike-Weighted Spiking Neural Network with Spiking Long Short-Term Memory: A Biomimetic Approach to Decoding Brain Signals
    Mcmillan, Kyle
    So, Rosa Qiyue
    Libedinsky, Camilo
    Ang, Kai Keng
    Premchand, Brian
    ALGORITHMS, 2024, 17 (04)
  • [40] Short-Term Traffic Flow Forecast Based on Parallel Long Short-Term Memory Neural Network
    Qiao, Songlin
    Sun, Rencheng
    Fan, Guangpeng
    Liu, Ji
    PROCEEDINGS OF 2017 8TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2017), 2017, : 253 - 257