Towards Efficient and Stable Time Parameter Optimization in Spiking Neural Networks

被引:0
|
作者
Huang, Jie [1 ]
Liu, Chengzhi [1 ]
Li, Longyue [1 ]
Liu, Xu [2 ]
Xia, Na [2 ]
机构
[1] State Grid Anhui Elect Power Co, 9 Huangshan Rd, Hefei, Anhui, Peoples R China
[2] Hefei Univ Technol, 485 Danxia Rd, Hefei, Anhui, Peoples R China
关键词
Spiking Neural Networks; Momentum Performance Queue; Time Parameter Optimization;
D O I
10.1007/978-981-97-5591-2_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, Spiking Neural Networks (SNNs) have attracted widespread attention in research due to their energy-saving characteristics and ease of deployment. However, the inference performance of SNNs is closely related to the number of time steps, which leads to a trade-off between accuracy and efficiency. Currently, there is still a lack of research on optimizing the time parameters in SNNs. Therefore, this study is dedicated to achieving a balance between time efficiency and performance optimization in SNNs. To this end, we propose an innovative Momentum Performance Queue (MPQ) strategy for optimizing time parameters. MPQ dynamically adjusts the time parameter T during training based on historical performance to maintain or even improve network performance while reducing computational resource consumption. We have validated this method on multiple standard datasets and achieved good results. For example, we achieved an accuracy of 96.07% on the CIFAR-10 dataset using only 1 time step.
引用
收藏
页码:293 / 300
页数:8
相关论文
共 50 条
  • [1] EXODUS: Stable and efficient training of spiking neural networks
    Bauer, Felix C.
    Lenz, Gregor
    Haghighatshoar, Saeid
    Sheik, Sadique
    [J]. FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [2] An efficient automated parameter tuning framework for spiking neural networks
    Carlson, Kristofor D.
    Nageswaran, Jayram Moorkanikara
    Dutt, Nikil
    Krichmar, Jeffrey L.
    [J]. FRONTIERS IN NEUROSCIENCE, 2014, 8
  • [3] Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks
    Meng, Qingyan
    Xiao, Mingqing
    Yan, Shen
    Wang, Yisen
    Lin, Zhouchen
    Luo, Zhi-Quan
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6143 - 6153
  • [4] AutoSNN: Towards Energy-Efficient Spiking Neural Networks
    Na, Byunggook
    Mok, Jisoo
    Park, Seongsik
    Lee, Dongjin
    Choe, Hyeokjun
    Yoon, Sungroh
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [5] Evolutionary Features and Parameter Optimization of Spiking Neural Networks for Unsupervised Learning
    Silva, Marco
    Koshiyama, Adriano
    Vellasco, Marley
    Cataldo, Edson
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 2391 - 2398
  • [6] Towards Energy-Efficient Sentiment Classification with Spiking Neural Networks
    Chen, Junhao
    Ye, Xiaojun
    Sun, Jingbo
    Li, Chao
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PART X, 2023, 14263 : 518 - 529
  • [7] Efficient learning in spiking neural networks
    Rast, Alexander
    Aoun, Mario Antoine
    Elia, Eleni G.
    Crook, Nigel
    [J]. NEUROCOMPUTING, 2024, 597
  • [8] ON THE PROBABILISTIC OPTIMIZATION OF SPIKING NEURAL NETWORKS
    Schliebs, Stefan
    Kasabov, Nikola
    Defoin-Platel, Michael
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2010, 20 (06) : 481 - 500
  • [9] Efficient parameter calibration and real-time simulation of large-scale spiking neural networks with GeNN and NEST
    Schmitt, Felix Johannes
    Rostami, Vahid
    Nawrot, Martin Paul
    [J]. FRONTIERS IN NEUROINFORMATICS, 2023, 17
  • [10] FSpiNN: An Optimization Framework for Memory-Efficient and Energy-Efficient Spiking Neural Networks
    Putra, Rachmad Vidya Wicaksana
    Shafique, Muhammad
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2020, 39 (11) : 3601 - 3613