Spiking neural networks with consistent mapping relations allow high-accuracy inference

被引:0
|
作者
Li, Yang [1 ,2 ]
He, Xiang [1 ,2 ]
Kong, Qingqun [1 ,3 ]
Zeng, Yi [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Inst Automat, Brain Inspired Cognit Intelligence Lab, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[3] Univ Chinese Acad Sci, Sch Future Technol, Beijing, Peoples R China
[4] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai, Peoples R China
关键词
Spiking neural network; Conversion; Consistency; Object detection;
D O I
10.1016/j.ins.2024.120822
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Spike-based neuromorphic hardware has demonstrated substantial potential in low energy consumption and efficient inference. However, the direct training of deep spiking neural networks is challenging, and conversion-based methods still require substantial time delay owing to unresolved conversion errors. We determine that the primary source of the conversion errors stems from the inconsistency between the mapping relationship of traditional activation functions and the input-output dynamics of spike neurons. To counter this, we introduce the Consistent ANN-SNN Conversion (CASC) framework. It includes the Consistent IF (CIF) neuron model, specifically contrived to minimize the influence of the stable point's upper bound, and the wakesleep conversion (WSC) method, synergistically ensuring the uniformity of neuron behavior. This method theoretically achieves a loss-free conversion, markedly diminishing time delays and improving inference performance in extensive classification and object detection tasks. Our approach offers a viable pathway toward more efficient and effective neuromorphic systems.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Mapping Complex, Large - Scale Spiking Networks on Neural VLSI
    Mayr, Christian
    Ehrlich, Matthias
    Henker, Stephan
    Wendt, Karsten
    Schuffny, Rene
    PROCEEDINGS OF WORLD ACADEMY OF SCIENCE, ENGINEERING AND TECHNOLOGY, VOL 19, 2007, 19 : 40 - 45
  • [42] Mapping Spiking Neural Networks onto a Manycore Neuromorphic Architecture
    Lin, Chit-Kwan
    Wild, Andreas
    Chinya, Gautham N.
    Lin, Tsung-Han
    Davies, Mike
    Wang, Hong
    PROCEEDINGS OF THE 39TH ACM SIGPLAN CONFERENCE ON PROGRAMMING LANGUAGE DESIGN AND IMPLEMENTATION, PLDI 2018, 2018, : 78 - 89
  • [43] ON DERIVING SELF-CONSISTENT, HIGH-ACCURACY MASS DENSITY MEASUREMENTS
    Mehta, Piyush M.
    SPACEFLIGHT MECHANICS 2019, VOL 168, PTS I-IV, 2019, 168 : 2275 - 2294
  • [44] Exploiting High Performance Spiking Neural Networks With Efficient Spiking Patterns
    Shen, Guobin
    Zhao, Dongcheng
    Zeng, Yi
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (02): : 1480 - 1489
  • [45] Learning Structured Inference Neural Networks with Label Relations
    Hu, Hexiang
    Zhou, Guang-Tong
    Deng, Zhiwei
    Liao, Zicheng
    Mori, Greg
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2960 - 2968
  • [46] Pushing the "Speed Limit": High-Accuracy US Traffic Sign Recognition With Convolutional Neural Networks
    Li, Yuan
    Mogelmose, Andreas
    Trivedi, Mohan Manubhai
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2016, 1 (02): : 167 - 176
  • [47] High-accuracy wire electrical discharge machining using artificial neural networks and optimization techniques
    Conde, A.
    Arriandiaga, A.
    Sanchez, J. A.
    Portillo, E.
    Plaza, S.
    Cabanes, I.
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2018, 49 : 24 - 38
  • [48] Benchmarking Local Robustness of High-Accuracy Binary Neural Networks for Enhanced Traffic Sign Recognition
    Postovan, Andreea
    Era, Madalina
    ELECTRONIC PROCEEDINGS IN THEORETICAL COMPUTER SCIENCE, 2023, 389 : 120 - 130
  • [49] A Fast and High-Accuracy Optical Fiber Design Technique using LNGO algorithm and Neural Networks
    Lin, Jianpei
    Shi, Chumin
    Zhang, Jingxing
    Mo, Shuqi
    Liu, Jie
    Yu, Siyuan
    2020 ASIA COMMUNICATIONS AND PHOTONICS CONFERENCE (ACP) AND INTERNATIONAL CONFERENCE ON INFORMATION PHOTONICS AND OPTICAL COMMUNICATIONS (IPOC), 2020,
  • [50] High-Accuracy Positioning for Indoor Wireless Sensor Networks
    Huang, Hongji
    Wang, Jin-Yuan
    Zhou, Xingzhou
    Xiang, Tong
    Zhang, Yu
    Wu, Hao
    Wang, Yongjin
    2017 IEEE 9TH INTERNATIONAL CONFERENCE ON COMMUNICATION SOFTWARE AND NETWORKS (ICCSN), 2017, : 311 - 316