SpykeTorch: Efficient Simulation of Convolutional Spiking Neural Networks With at Most One Spike per Neuron

被引:65
|
作者
Mozafari, Milad [1 ,2 ]
Ganjtabesh, Mohammad [1 ]
Nowzari-Dalini, Abbas [1 ]
Masquelier, Timothee [2 ]
机构
[1] Univ Tehran, Sch Math Stat & Comp Sci, Dept Comp Sci, Tehran, Iran
[2] Univ Toulouse 3, CNRS, CERCO UMR 5549, Toulouse, France
关键词
convolutional spiking neural networks; time-to-first-spike coding; one spike per neuron; STDP; reward-modulated STDP; tensor-based computing; GPU acceleration; VISUAL FEATURES;
D O I
10.3389/fnins.2019.00625
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Application of deep convolutional spiking neural networks (SNNs) to artificial intelligence (AI) tasks has recently gained a lot of interest since SNNs are hardware-friendly and energy-efficient. Unlike the non-spiking counterparts, most of the existing SNN simulation frameworks are not practically efficient enough for large-scale AI tasks. In this paper; we introduce SpykeTorch, an open-source high-speed simulation framework based on PyTorch. This framework simulates convolutional SNNs with at most one spike per neuron and the rank-order encoding scheme. In terms of learning rules, both spike-timing-dependent plasticity (STDP) and reward-modulated STDP (R-STDP) are implemented, but other rules could be implemented easily. Apart from the aforementioned properties, SpykeTorch is highly generic and capable of reproducing the results of various studies. Computations in the proposed framework are tensor-based and totally done by PyTorch functions, which in turn brings the ability of just-in-time optimization for running on CPUs, GPUs, or Multi-GPU platforms.
引用
收藏
页数:12
相关论文
共 50 条
  • [11] Spike time displacement-based error backpropagation in convolutional spiking neural networks
    Maryam Mirsadeghi
    Majid Shalchian
    Saeed Reza Kheradpisheh
    Timothée Masquelier
    [J]. Neural Computing and Applications, 2023, 35 : 15891 - 15906
  • [12] High-performance deep spiking neural networks with 0.3 spikes per neuron
    Stanojevic, Ana
    Wozniak, Stanislaw
    Bellec, Guillaume
    Cherubini, Giovanni
    Pantazi, Angeliki
    Gerstner, Wulfram
    [J]. NATURE COMMUNICATIONS, 2024, 15 (01)
  • [13] Deterministic conversion rule for CNNs to efficient spiking convolutional neural networks
    Xu Yang
    Zhongxing Zhang
    Wenping Zhu
    Shuangming Yu
    Liyuan Liu
    Nanjian Wu
    [J]. Science China Information Sciences, 2020, 63
  • [14] Efficient Hardware Acceleration of Sparsely Active Convolutional Spiking Neural Networks
    Sommer, Jan
    Ozkan, M. Akif
    Keszocze, Oliver
    Teich, Juergen
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (11) : 3767 - 3778
  • [15] Deterministic conversion rule for CNNs to efficient spiking convolutional neural networks
    Yang, Xu
    Zhang, Zhongxing
    Zhu, Wenping
    Yu, Shuangming
    Liu, Liyuan
    Wu, Nanjian
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (02)
  • [16] Sparsity Enables Data and Energy Efficient Spiking Convolutional Neural Networks
    Bhatt, Varun
    Ganguly, Udayan
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT I, 2018, 11139 : 263 - 272
  • [17] Deterministic conversion rule for CNNs to efficient spiking convolutional neural networks
    Xu YANG
    Zhongxing ZHANG
    Wenping ZHU
    Shuangming YU
    Liyuan LIU
    Nanjian WU
    [J]. Science China(Information Sciences), 2020, 63 (02) : 196 - 214
  • [18] SPA: An Efficient Adversarial Attack on Spiking Neural Networks using Spike Probabilistic
    Lin, Xuanwei
    Dong, Chen
    Liu, Ximeng
    Zhang, Yuanyuan
    [J]. 2022 22ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2022), 2022, : 366 - 375
  • [19] Spike Attention Coding for Spiking Neural Networks
    Liu, Jiawen
    Hu, Yifan
    Li, Guoqi
    Pei, Jing
    Deng, Lei
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (12) : 1 - 7
  • [20] Neuron Fault Tolerance in Spiking Neural Networks
    Spyrou, Theofilos
    El-Sayed, Sarah A.
    Afacan, Engin
    Camunas-Mesa, Luis A.
    Linares-Barranco, Bernabe
    Stratigopoulos, Haralampos-G
    [J]. PROCEEDINGS OF THE 2021 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2021), 2021, : 743 - 748