CIRM-SNN: Certainty Interval Reset Mechanism Spiking Neuron for Enabling High Accuracy Spiking Neural Network

被引:1
|
作者
Niu, Li-Ye [1 ]
Wei, Ying [1 ,2 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Peoples R China
[2] Peking Univ, Informat Technol R&D Innovat Ctr, Shaoxing, Peoples R China
关键词
Spiking neural network; Continuous normalization; Certainty interval reset; Firing rate; Modulation factor; PLASTICITY;
D O I
10.1007/s11063-023-11274-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking neural network (SNN) based on sparse trigger and event-driven information processing has the advantages of ultra-low power consumption and hardware friendliness. As a new generation of neural networks, SNN is widely concerned. At present, the most effective way to realize deep SNN is through artificial neural network (ANN) conversion. Compared with the original ANN, the converted SNN suffers from performance loss. This paper adjusts the spike firing rate of spiking neurons to minimize the performance loss of SNN in the conversion process. We map the ANN weights to the corresponding SNN after continuous normalization, which ensures that the spike firing rate of the neuron is in the normal range. We propose a certainty interval reset mechanism (CIRM), which effectively reduces the loss of membrane potential and avoids the problem of neuronal over-activation. In the experiment, we added a modulation factor to the CIRM to further adjust the spike firing rate of neurons. The accuracy of the converted SNN on CIFAR-10 is 1.026% higher than that of the original ANN. The algorithm not only achieves the lossless conversion of ANN, but also reduces the network energy consumption. Our algorithm also effectively improves the accuracy of SNN (VGG-15) on CIFAR-100 and decreases the network delay. The work of this paper is of great significance for developing high-precision depth SNN.
引用
收藏
页码:7561 / 7582
页数:22
相关论文
共 18 条
  • [1] CIRM-SNN: Certainty Interval Reset Mechanism Spiking Neuron for Enabling High Accuracy Spiking Neural Network
    Li-Ye Niu
    Ying Wei
    Neural Processing Letters, 2023, 55 : 7561 - 7582
  • [2] Nonpolar Neuron for ANN-SNN Conversion Toward Ternary Spiking Neural Network
    Fu, Jiawei
    Wen, Xinyu
    Chen, Qi
    He, Yuhui
    Miao, Xiang-Shui
    8TH IEEE ELECTRON DEVICES TECHNOLOGY & MANUFACTURING CONFERENCE, EDTM 2024, 2024, : 616 - 618
  • [3] HF-SNN: High-Frequency Spiking Neural Network
    Su, Jing
    Li, Jing
    IEEE ACCESS, 2021, 9 : 51950 - 51957
  • [4] High-Accuracy Spiking Neural Network for Objective Recognition Based on Proportional Attenuating Neuron
    Li-Ye Niu
    Ying Wei
    Jun-Yu Long
    Wen-Bo Liu
    Neural Processing Letters, 2022, 54 : 1055 - 1073
  • [5] High-Accuracy Spiking Neural Network for Objective Recognition Based on Proportional Attenuating Neuron
    Niu, Li-Ye
    Wei, Ying
    Long, Jun-Yu
    Liu, Wen-Bo
    NEURAL PROCESSING LETTERS, 2022, 54 (02) : 1055 - 1073
  • [6] DoB-SNN: A New Neuron Assembly-inspired Spiking Neural Network for Pattern Classification
    Saranirad, Vahid
    McGinnity, T. M.
    Dora, Shirin
    Coyle, Damien
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [7] A spiking neural network (SNN) for detecting high frequency oscillations (HFOs) in the intraoperative ECoG
    Burelo, Karla
    Sharifshazileh, Mohammadali
    Krayenbuehl, Niklaus
    Ramantani, Georgia
    Indiveri, Giacomo
    Sarnthein, Johannes
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [8] A spiking neural network (SNN) for detecting high frequency oscillations (HFOs) in the intraoperative ECoG
    Karla Burelo
    Mohammadali Sharifshazileh
    Niklaus Krayenbühl
    Georgia Ramantani
    Giacomo Indiveri
    Johannes Sarnthein
    Scientific Reports, 11
  • [9] A Self-Calibratable Spiking Neuron based on Dual-mode Memritor for High-Accuracy Spiking Neural Networks
    Gao, Jiajun
    Shan, Linbo
    Wang, Zongwei
    Ji, Yintong
    Ban, Chaoyi
    Qin, Yabo
    Cai, Yimao
    Huang, Ru
    2024 INTERNATIONAL VLSI SYMPOSIUM ON TECHNOLOGY, SYSTEMS AND APPLICATIONS, VLSI TSA, 2024,
  • [10] A universal ANN-to-SNN framework for achieving high accuracy and low latency deep Spiking Neural Networks
    Wang, Yuchen
    Liu, Hanwen
    Zhang, Malu
    Luo, Xiaoling
    Qu, Hong
    NEURAL NETWORKS, 2024, 174