BSNN: Towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons

被引:5
|
作者
Li, Yang [1 ,2 ]
Zhao, Dongcheng [1 ]
Zeng, Yi [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Inst Automat, Res Ctr Brain Inspired Intelligence, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[3] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai, Peoples R China
[4] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing, Peoples R China
关键词
spiking neural network; bistability; neuromorphic computing; image classification; conversion;
D O I
10.3389/fnins.2022.991851
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The spiking neural network (SNN) computes and communicates information through discrete binary events. Recent work has achieved essential progress on an excellent performance by converting ANN to SNN. Due to the difference in information processing, the converted deep SNN usually suffers serious performance loss and large time delay. In this paper, we analyze the reasons for the performance loss and propose a novel bistable spiking neural network (BSNN) that addresses the problem of the phase lead and phase lag. Also, we design synchronous neurons (SN) to help efficiently improve performance when ResNet structure-based ANNs are converted. BSNN significantly improves the performance of the converted SNN by enabling more accurate delivery of information to the next layer after one cycle. Experimental results show that the proposed method only needs 1/4-1/10 of the time steps compared to previous work to achieve nearly lossless conversion. We demonstrate better ANN-SNN conversion for VGG16, ResNet20, and ResNet34 on challenging datasets including CIFAR-10 (95.16% top-1), CIFAR-100 (78.12% top-1), and ImageNet (72.64% top-1).
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Direct Training for Spiking Neural Networks: Faster, Larger, Better
    Wu, Yujie
    Deng, Lei
    Li, Guoqi
    Zhu, Jun
    Xie, Yuan
    Shi, Luping
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 1311 - 1318
  • [2] SpikeConverter: An Efficient Conversion Framework Zipping the Gap between Artificial Neural Networks and Spiking Neural Networks
    Liu, Fangxin
    Zhao, Wenbo
    Chen, Yongbiao
    Wang, Zongwu
    Jiang, Li
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1692 - 1701
  • [3] Conversion of Artificial Recurrent Neural Networks to Spiking Neural Networks for Low-power Neuromorphic Hardware
    Diehl, Peter U.
    Zarrella, Guido
    Cassidy, Andrew
    Pedroni, Bruno U.
    Neftci, Emre
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON REBOOTING COMPUTING (ICRC), 2016,
  • [4] Dataset Conversion for Spiking Neural Networks
    Sadovsky, Erik
    Jakubec, Maros
    Jarinova, Darina
    Jarina, Roman
    [J]. 2023 33RD INTERNATIONAL CONFERENCE RADIOELEKTRONIKA, RADIOELEKTRONIKA, 2023,
  • [5] Learning spiking neuronal networks with artificial neural networks: neural oscillations
    Zhang, Ruilin
    Wang, Zhongyi
    Wu, Tianyi
    Cai, Yuhang
    Tao, Louis
    Xiao, Zhuo-Cheng
    Li, Yao
    [J]. JOURNAL OF MATHEMATICAL BIOLOGY, 2024, 88 (06)
  • [6] Artificial Tactile Perception System Based on Spiking Tactile Neurons and Spiking Neural Networks
    Wen, Juan
    Zhang, Le
    Wang, Yu-Zhe
    Guo, Xin
    [J]. ACS APPLIED MATERIALS & INTERFACES, 2023, 16 (01) : 998 - 1004
  • [7] Combining Spiking Neural Networks with Artificial Neural Networks for Enhanced Image Classification
    Muramatsu, Naoya
    Yu, Hai-Tao
    Satoh, Tetsuji
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2023, E106D (02) : 252 - 261
  • [8] Learning to Classify Faster Using Spiking Neural Networks
    Machingal, Pranav
    Thousif
    Dora, Shirin
    Sundaram, Suresh
    Meng, Qinggang
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [9] Improved Izhikevich neurons for spiking neural networks
    Kampakis, Stylianos
    [J]. SOFT COMPUTING, 2012, 16 (06) : 943 - 953
  • [10] Improved Izhikevich neurons for spiking neural networks
    Stylianos Kampakis
    [J]. Soft Computing, 2012, 16 : 943 - 953