Spiking neural networks with consistent mapping relations allow high-accuracy inference

被引:0
|
作者
Li, Yang [1 ,2 ]
He, Xiang [1 ,2 ]
Kong, Qingqun [1 ,3 ]
Zeng, Yi [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Inst Automat, Brain Inspired Cognit Intelligence Lab, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[3] Univ Chinese Acad Sci, Sch Future Technol, Beijing, Peoples R China
[4] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai, Peoples R China
关键词
Spiking neural network; Conversion; Consistency; Object detection;
D O I
10.1016/j.ins.2024.120822
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Spike-based neuromorphic hardware has demonstrated substantial potential in low energy consumption and efficient inference. However, the direct training of deep spiking neural networks is challenging, and conversion-based methods still require substantial time delay owing to unresolved conversion errors. We determine that the primary source of the conversion errors stems from the inconsistency between the mapping relationship of traditional activation functions and the input-output dynamics of spike neurons. To counter this, we introduce the Consistent ANN-SNN Conversion (CASC) framework. It includes the Consistent IF (CIF) neuron model, specifically contrived to minimize the influence of the stable point's upper bound, and the wakesleep conversion (WSC) method, synergistically ensuring the uniformity of neuron behavior. This method theoretically achieves a loss-free conversion, markedly diminishing time delays and improving inference performance in extensive classification and object detection tasks. Our approach offers a viable pathway toward more efficient and effective neuromorphic systems.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] High-accuracy protein model quality assessment using attention graph neural networks
    Zhang, Peidong
    Xia, Chunqiu
    Shen, Hong-Bin
    BRIEFINGS IN BIOINFORMATICS, 2023, 24 (02)
  • [32] HIGH-ACCURACY OPTICAL CHARACTER-RECOGNITION USING NEURAL NETWORKS WITH CENTROID DITHERING
    AVIITZHAK, HI
    DIEP, TA
    GARLAND, H
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1995, 17 (02) : 218 - 224
  • [33] An analysis of high-accuracy tropospheric delay mapping functions
    Mendes, VB
    Langley, RB
    PHYSICS AND CHEMISTRY OF THE EARTH PART A-SOLID EARTH AND GEODESY, 2000, 25 (12): : 809 - 812
  • [34] Medium-format Cameras for High-accuracy Mapping
    Raizman, Yuri
    GIM INTERNATIONAL-THE WORLDWIDE MAGAZINE FOR GEOMATICS, 2018, 32 (01): : 32 - 33
  • [35] Accelerating spiking neural networks using quantum algorithm with high success probability and high calculation accuracy
    Chen, Yanhu
    Wang, Cen
    Guo, Hongxiang
    Gao, Xiong
    Wu, Jian
    NEUROCOMPUTING, 2022, 493 : 435 - 444
  • [36] Probabilistic Inference Using Stochastic Spiking Neural Networks on A Neurosynaptic Processor
    Ahmed, Khadeer
    Shrestha, Amar
    Qiu, Qinru
    Wu, Qing
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 4286 - 4293
  • [37] Simulation of Bayesian Learning and Inference on Distributed Stochastic Spiking Neural Networks
    Ahmed, Khadeer
    Shrestha, Amar
    Qiu, Qinru
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 1044 - 1051
  • [38] CyNAPSE: A Low-power Reconfigurable Neural Inference Accelerator for Spiking Neural Networks
    Saunak Saha
    Henry Duwe
    Joseph Zambreno
    Journal of Signal Processing Systems, 2020, 92 : 907 - 929
  • [39] CyNAPSE: A Low-power Reconfigurable Neural Inference Accelerator for Spiking Neural Networks
    Saha, Saunak
    Duwe, Henry
    Zambreno, Joseph
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2020, 92 (09): : 907 - 929
  • [40] Mapping Spiking Neural Networks onto a Manycore Neuromorphic Architecture
    Lin, Chit-Kwan
    Wild, Andreas
    Chinya, Gautham N.
    Lin, Tsung-Han
    Davies, Mike
    Wang, Hong
    ACM SIGPLAN NOTICES, 2018, 53 (04) : 78 - 89