Spiking neural networks with consistent mapping relations allow high-accuracy inference

被引:0
|
作者
Li, Yang [1 ,2 ]
He, Xiang [1 ,2 ]
Kong, Qingqun [1 ,3 ]
Zeng, Yi [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Inst Automat, Brain Inspired Cognit Intelligence Lab, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[3] Univ Chinese Acad Sci, Sch Future Technol, Beijing, Peoples R China
[4] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai, Peoples R China
关键词
Spiking neural network; Conversion; Consistency; Object detection;
D O I
10.1016/j.ins.2024.120822
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Spike-based neuromorphic hardware has demonstrated substantial potential in low energy consumption and efficient inference. However, the direct training of deep spiking neural networks is challenging, and conversion-based methods still require substantial time delay owing to unresolved conversion errors. We determine that the primary source of the conversion errors stems from the inconsistency between the mapping relationship of traditional activation functions and the input-output dynamics of spike neurons. To counter this, we introduce the Consistent ANN-SNN Conversion (CASC) framework. It includes the Consistent IF (CIF) neuron model, specifically contrived to minimize the influence of the stable point's upper bound, and the wakesleep conversion (WSC) method, synergistically ensuring the uniformity of neuron behavior. This method theoretically achieves a loss-free conversion, markedly diminishing time delays and improving inference performance in extensive classification and object detection tasks. Our approach offers a viable pathway toward more efficient and effective neuromorphic systems.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Highway Connection for Low-Latency and High-Accuracy Spiking Neural Networks
    Zhang, Anguo
    Wu, Junyi
    Li, Xiumin
    Li, Hung Chun
    Gao, Yueming
    Pun, Sio Hang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (12) : 4579 - 4583
  • [2] An Improved STBP for Training High-Accuracy and Low-Spike-Count Spiking Neural Networks
    Tan, Pai-Yu
    Wu, Cheng-Wen
    Lu, Juin-Ming
    PROCEEDINGS OF THE 2021 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2021), 2021, : 575 - 580
  • [3] A Self-Calibratable Spiking Neuron based on Dual-mode Memritor for High-Accuracy Spiking Neural Networks
    Gao, Jiajun
    Shan, Linbo
    Wang, Zongwei
    Ji, Yintong
    Ban, Chaoyi
    Qin, Yabo
    Cai, Yimao
    Huang, Ru
    2024 INTERNATIONAL VLSI SYMPOSIUM ON TECHNOLOGY, SYSTEMS AND APPLICATIONS, VLSI TSA, 2024,
  • [4] Energy-Efficient High-Accuracy Spiking Neural Network Inference Using Time-Domain Neurons
    Song, Joonghyun
    Shin, Jiwon
    Kim, Hanseok
    Choi, Woo-Seok
    2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2022): INTELLIGENT TECHNOLOGY IN THE POST-PANDEMIC ERA, 2022, : 5 - 8
  • [5] H2Learn: High-Efficiency Learning Accelerator for High-Accuracy Spiking Neural Networks
    Liang, Ling
    Qu, Zheng
    Chen, Zhaodong
    Tu, Fengbin
    Wu, Yujie
    Deng, Lei
    Li, Guoqi
    Li, Peng
    Xie, Yuan
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (11) : 4782 - 4796
  • [6] Toward High-Accuracy and Low-Latency Spiking Neural Networks With Two-Stage Optimization
    Wang, Ziming
    Zhang, Yuhao
    Lian, Shuang
    Cui, Xiaoxin
    Yan, Rui
    Tang, Huajin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 15
  • [7] High-Accuracy Gaussian Function Generator for Neural Networks
    Popa, Cosmin Radu
    ELECTRONICS, 2023, 12 (01)
  • [8] High-Accuracy Spiking Neural Network for Objective Recognition Based on Proportional Attenuating Neuron
    Li-Ye Niu
    Ying Wei
    Jun-Yu Long
    Wen-Bo Liu
    Neural Processing Letters, 2022, 54 : 1055 - 1073
  • [9] High-Accuracy Spiking Neural Network for Objective Recognition Based on Proportional Attenuating Neuron
    Niu, Li-Ye
    Wei, Ying
    Long, Jun-Yu
    Liu, Wen-Bo
    NEURAL PROCESSING LETTERS, 2022, 54 (02) : 1055 - 1073
  • [10] A High-Accuracy Implementation for Softmax Layer in Deep Neural Networks
    Alabassy, Bassma
    Safar, Mona
    El-Kharashi, M. Watheq
    2020 15TH IEEE INTERNATIONAL CONFERENCE ON DESIGN & TECHNOLOGY OF INTEGRATED SYSTEMS IN NANOSCALE ERA (DTIS 2020), 2020,