Towards Efficient and Stable Time Parameter Optimization in Spiking Neural Networks

被引:0
|
作者
Huang, Jie [1 ]
Liu, Chengzhi [1 ]
Li, Longyue [1 ]
Liu, Xu [2 ]
Xia, Na [2 ]
机构
[1] State Grid Anhui Elect Power Co, 9 Huangshan Rd, Hefei, Anhui, Peoples R China
[2] Hefei Univ Technol, 485 Danxia Rd, Hefei, Anhui, Peoples R China
关键词
Spiking Neural Networks; Momentum Performance Queue; Time Parameter Optimization;
D O I
10.1007/978-981-97-5591-2_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, Spiking Neural Networks (SNNs) have attracted widespread attention in research due to their energy-saving characteristics and ease of deployment. However, the inference performance of SNNs is closely related to the number of time steps, which leads to a trade-off between accuracy and efficiency. Currently, there is still a lack of research on optimizing the time parameters in SNNs. Therefore, this study is dedicated to achieving a balance between time efficiency and performance optimization in SNNs. To this end, we propose an innovative Momentum Performance Queue (MPQ) strategy for optimizing time parameters. MPQ dynamically adjusts the time parameter T during training based on historical performance to maintain or even improve network performance while reducing computational resource consumption. We have validated this method on multiple standard datasets and achieved good results. For example, we achieved an accuracy of 96.07% on the CIFAR-10 dataset using only 1 time step.
引用
下载
收藏
页码:293 / 300
页数:8
相关论文
共 50 条
  • [21] Improving the Multimodal Classification Performance of Spiking Neural Networks Through Hyper-Parameter Optimization
    Park, Jin Seon
    Hong, Choong Seon
    38TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING, ICOIN 2024, 2024, : 182 - 186
  • [22] Towards understanding the effect of leak in Spiking Neural Networks
    Chowdhury, Sayeed Shafayet
    Lee, Chankyu
    Roy, Kaushik
    NEUROCOMPUTING, 2021, 464 : 83 - 94
  • [23] Towards Automated FPGA Compilation of Spiking Neural Networks
    Shymyrbay, Ayan
    Fouda, Mohammed E.
    Eltawil, Ahmed
    2024 IEEE 6TH INTERNATIONAL CONFERENCE ON AI CIRCUITS AND SYSTEMS, AICAS 2024, 2024, : 223 - 227
  • [24] Spiking neural networks modelled as timed automata: with parameter learning
    Elisabetta De Maria
    Cinzia Di Giusto
    Laetitia Laversa
    Natural Computing, 2020, 19 : 135 - 155
  • [25] Accurate and efficient time-domain classification with adaptive spiking recurrent neural networks
    Yin, Bojian
    Corradi, Federico
    Bohte, Sander M.
    NATURE MACHINE INTELLIGENCE, 2021, 3 (10) : 905 - +
  • [26] Integrated Feature and Parameter Optimization for an Evolving Spiking Neural Network
    Schliebs, Stefan
    Defoin-Platel, Michael
    Kasabov, Nikola
    ADVANCES IN NEURO-INFORMATION PROCESSING, PT I, 2009, 5506 : 1229 - +
  • [27] Accurate and efficient time-domain classification with adaptive spiking recurrent neural networks
    Bojian Yin
    Federico Corradi
    Sander M. Bohté
    Nature Machine Intelligence, 2021, 3 : 905 - 913
  • [28] Spiking neural networks modelled as timed automata: with parameter learning
    De Maria, Elisabetta
    Di Giusto, Cinzia
    Laversa, Laetitia
    NATURAL COMPUTING, 2020, 19 (01) : 135 - 155
  • [29] Efficient Spiking Neural Networks With Logarithmic Temporal Coding
    Zhang, Ming
    Gu, Zonghua
    Zheng, Nenggan
    Ma, De
    Pan, Gang
    IEEE ACCESS, 2020, 8 : 98156 - 98167
  • [30] An Efficient Hardware Architecture for Multilayer Spiking Neural Networks
    Luo, Yuling
    Wan, Lei
    Liu, Junxiu
    Zhang, Jinlei
    Cao, Yi
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT VI, 2017, 10639 : 786 - 795