Efficient Spiking Neural Networks With Logarithmic Temporal Coding

被引:6
|
作者
Zhang, Ming [1 ]
Gu, Zonghua [2 ]
Zheng, Nenggan [3 ]
Ma, De [1 ,4 ]
Pan, Gang [1 ,4 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, Hangzhou 310027, Peoples R China
[2] Umea Univ, Dept Appl Phys & Elect, S-90187 Umea, Sweden
[3] Zhejiang Univ, Qiushi Acad Adv Studies, Hangzhou 310027, Peoples R China
[4] Zhejiang Lab, Hangzhou 311121, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷
关键词
Encoding; Training; Biological information theory; Biological neural networks; Computational modeling; Spiking neural networks; temporal coding; neuromorphic computing;
D O I
10.1109/ACCESS.2020.2994360
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A Spiking Neural Network (SNN) can be trained indirectly by first training an Artificial Neural Network (ANN) with the conventional backpropagation algorithm, then converting it into an equivalent SNN. To reduce the computational cost of the resulting SNN as measured by the number of spikes, we present Logarithmic Temporal Coding (LTC), where the number of spikes used to encode an activation grows logarithmically with the activation value; and the accompanying Exponentiate-and-Fire (EF) neuron model, which only involves efficient bit-shift and addition operations. Moreover, we improve the training process of ANN to compensate for approximation errors due to LTC. Experimental results indicate that the resulting SNN achieves competitive performance in terms of classification accuracy at significantly lower computational cost than related work.
引用
收藏
页码:98156 / 98167
页数:12
相关论文
共 50 条
  • [1] ATC: Approximate Temporal Coding for Efficient Implementations of Spiking Neural Networks
    Han, Ming
    Wang, Ye
    Dong, Jian
    Liu, Heng
    Wu, Jin
    Qu, Gang
    [J]. PROCEEDINGS OF THE GREAT LAKES SYMPOSIUM ON VLSI 2023, GLSVLSI 2023, 2023, : 527 - 532
  • [2] Temporal Pattern Coding in Deep Spiking Neural Networks
    Rueckauer, Bodo
    Liu, Shih-Chii
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [3] Supervised Learning Based on Temporal Coding in Spiking Neural Networks
    Mostafa, Hesham
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (07) : 3227 - 3235
  • [4] TEMPORAL CODING IN SPIKING NEURAL NETWORKS WITH ALPHA SYNAPTIC FUNCTION
    Comsa, Julia M.
    Potempa, Krzysztof
    Versari, Luca
    Fischbacher, Thomas
    Gesmundo, Andrea
    Alakuijala, Jyrki
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8529 - 8533
  • [5] Delay learning based on temporal coding in Spiking Neural Networks
    Sun, Pengfei
    Wu, Jibin
    Zhang, Malu
    Devos, Paul
    Botteldooren, Dick
    [J]. NEURAL NETWORKS, 2024, 180
  • [6] An Efficient Discrete Model for Implementing Temporal Coding Spiking Neural Network
    Charles, E. Y. Andrew
    [J]. 14TH INTERNATIONAL CONFERENCE ON ADVANCES IN ICT FOR EMERGING REGIONS (ICTER) 2014, 2014, : 74 - 77
  • [7] Composer Classification based on Temporal Coding in Adaptive Spiking Neural Networks
    Prasad, Chaitanya N.
    Saboo, Krishnakant
    Rajendran, Bipin
    [J]. 2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [8] Conversion of analog to spiking neural networks using sparse temporal coding
    Rueckauer, Bodo
    Liu, Shih-Chii
    [J]. 2018 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2018,
  • [9] Enhanced representation learning with temporal coding in sparsely spiking neural networks
    Fois, Adrien
    Girau, Bernard
    [J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2023, 17
  • [10] Temporal Coding in Spiking Neural Networks With Alpha Synaptic Function: Learning With Backpropagation
    Comsa, Iulia-Maria
    Potempa, Krzysztof
    Versari, Luca
    Fischbacher, Thomas
    Gesmundo, Andrea
    Alakuijala, Jyrki
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5939 - 5952