SpykeTorch: Efficient Simulation of Convolutional Spiking Neural Networks With at Most One Spike per Neuron

被引:65
|
作者
Mozafari, Milad [1 ,2 ]
Ganjtabesh, Mohammad [1 ]
Nowzari-Dalini, Abbas [1 ]
Masquelier, Timothee [2 ]
机构
[1] Univ Tehran, Sch Math Stat & Comp Sci, Dept Comp Sci, Tehran, Iran
[2] Univ Toulouse 3, CNRS, CERCO UMR 5549, Toulouse, France
关键词
convolutional spiking neural networks; time-to-first-spike coding; one spike per neuron; STDP; reward-modulated STDP; tensor-based computing; GPU acceleration; VISUAL FEATURES;
D O I
10.3389/fnins.2019.00625
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Application of deep convolutional spiking neural networks (SNNs) to artificial intelligence (AI) tasks has recently gained a lot of interest since SNNs are hardware-friendly and energy-efficient. Unlike the non-spiking counterparts, most of the existing SNN simulation frameworks are not practically efficient enough for large-scale AI tasks. In this paper; we introduce SpykeTorch, an open-source high-speed simulation framework based on PyTorch. This framework simulates convolutional SNNs with at most one spike per neuron and the rank-order encoding scheme. In terms of learning rules, both spike-timing-dependent plasticity (STDP) and reward-modulated STDP (R-STDP) are implemented, but other rules could be implemented easily. Apart from the aforementioned properties, SpykeTorch is highly generic and capable of reproducing the results of various studies. Computations in the proposed framework are tensor-based and totally done by PyTorch functions, which in turn brings the ability of just-in-time optimization for running on CPUs, GPUs, or Multi-GPU platforms.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Spiking Neural Networks for Cortical Neuronal Spike Train Decoding
    Fang, Huijuan
    Wang, Yongji
    He, Jiping
    [J]. NEURAL COMPUTATION, 2010, 22 (04) : 1060 - 1085
  • [42] Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks
    Guo, Yufei
    Chen, Yuanpei
    Liu, Xiaode
    Peng, Weihang
    Zhang, Yuhan
    Huang, Xuhui
    Ma, Zhe
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 11, 2024, : 12244 - 12252
  • [43] Revealing the Secrets of Spiking Neural Networks: The Case of Izhikevich Neuron
    Garaffa, Luiza C.
    Aljuffri, Abdullah
    Reinbrecht, Cezar
    Hamdioui, Said
    Taouil, Mottaqiallah
    Sepulveda, Johanna
    [J]. 2021 24TH EUROMICRO CONFERENCE ON DIGITAL SYSTEM DESIGN (DSD 2021), 2021, : 514 - 518
  • [44] Extension of Neuron Machine Neurocomputing Architecture for Spiking Neural Networks
    Ahn, Jerry B.
    [J]. 2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [45] Identifying Efficient Dataflows for Spiking Neural Networks
    Sharma, Deepika
    Ankit, Aayush
    Roy, Kaushik
    [J]. 2022 ACM/IEEE INTERNATIONAL SYMPOSIUM ON LOW POWER ELECTRONICS AND DESIGN, ISLPED 2022, 2022,
  • [46] Efficient Structure Slimming for Spiking Neural Networks
    Li, Yaxin
    Fang, Xuanye
    Gao, Yuyuan
    Zhou, Dongdong
    Shen, Jiangrong
    Liu, Jian K.
    Pan, Gang
    Xu, Qi
    [J]. IEEE Transactions on Artificial Intelligence, 2024, 5 (08): : 3823 - 3831
  • [47] Efficient Spiking Neural Networks With Radix Encoding
    Wang, Zhehui
    Gu, Xiaozhe
    Goh, Rick Siow Mong
    Zhou, Joey Tianyi
    Luo, Tao
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 3689 - 3701
  • [48] Inter-neuron communication strategies for spiking neural networks
    Tuffy, F.
    McDaid, L. J.
    Kwan, V. W.
    Alderman, J.
    McGinnity, T. M.
    Santos, J. A.
    Kelly, P. M.
    Sayers, H.
    [J]. NEUROCOMPUTING, 2007, 71 (1-3) : 30 - 44
  • [49] EPILEPTIFORM SPIKE DETECTION VIA CONVOLUTIONAL NEURAL NETWORKS
    Johansen, Alexander Rosenberg
    Jin, Jing
    Maszczyk, Tomasz
    Dauwels, Justin
    Cash, Sydney S.
    Westover, M. Brandon
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 754 - 758
  • [50] Effective and Efficient Spiking Recurrent Neural Networks
    Yin, Bojian
    Corradi, Federico
    Bohte, Sander
    [J]. ERCIM NEWS, 2021, (125): : 9 - 10