Towards Efficient and Stable Time Parameter Optimization in Spiking Neural Networks

被引:0
|
作者
Huang, Jie [1 ]
Liu, Chengzhi [1 ]
Li, Longyue [1 ]
Liu, Xu [2 ]
Xia, Na [2 ]
机构
[1] State Grid Anhui Elect Power Co, 9 Huangshan Rd, Hefei, Anhui, Peoples R China
[2] Hefei Univ Technol, 485 Danxia Rd, Hefei, Anhui, Peoples R China
关键词
Spiking Neural Networks; Momentum Performance Queue; Time Parameter Optimization;
D O I
10.1007/978-981-97-5591-2_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, Spiking Neural Networks (SNNs) have attracted widespread attention in research due to their energy-saving characteristics and ease of deployment. However, the inference performance of SNNs is closely related to the number of time steps, which leads to a trade-off between accuracy and efficiency. Currently, there is still a lack of research on optimizing the time parameters in SNNs. Therefore, this study is dedicated to achieving a balance between time efficiency and performance optimization in SNNs. To this end, we propose an innovative Momentum Performance Queue (MPQ) strategy for optimizing time parameters. MPQ dynamically adjusts the time parameter T during training based on historical performance to maintain or even improve network performance while reducing computational resource consumption. We have validated this method on multiple standard datasets and achieved good results. For example, we achieved an accuracy of 96.07% on the CIFAR-10 dataset using only 1 time step.
引用
下载
收藏
页码:293 / 300
页数:8
相关论文
共 50 条
  • [31] Memory-Efficient Reversible Spiking Neural Networks
    Zhang, Hong
    Zhang, Yu
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16759 - 16767
  • [32] Integrated Feature Selection and Parameter Optimization for Evolving Spiking Neural Networks using Quantum Inspired Particle Swarm Optimization
    Hamed, Haza Nuzly Abdull
    Kasabov, Nikola
    Shamsuddin, Siti Mariyam
    2009 INTERNATIONAL CONFERENCE OF SOFT COMPUTING AND PATTERN RECOGNITION, 2009, : 695 - +
  • [33] Quantum-Inspired Features and Parameter Optimization of Spiking Neural Networks for a Case Study from Atmospheric
    Cardoso, Marcelo C.
    Silva, Marco
    Vellasco, Marley M. B. R.
    Cataldo, Edson
    INNS CONFERENCE ON BIG DATA 2015 PROGRAM, 2015, 53 : 74 - 81
  • [34] Surrogate Gradient Learning in Spiking Neural Networks: Bringing the Power of Gradient-based optimization to spiking neural networks
    Neftci, Emre O.
    Mostafa, Hesham
    Zenke, Friedemann
    IEEE SIGNAL PROCESSING MAGAZINE, 2019, 36 (06) : 51 - 63
  • [35] Towards Grasping with Spiking Neural Networks for Anthropomorphic Robot Hands
    Tieck, J. Camilo Vasquez
    Donat, Heiko
    Kaiser, Jacques
    Peric, Igor
    Ulbrich, Stefan
    Roennau, Arne
    Zoellner, Marius
    Dillmann, Ruediger
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2017, PT I, 2017, 10613 : 43 - 51
  • [36] Towards Energy-Efficient Spiking Neural Networks: A Robust Hybrid CMOS-Memristive Accelerator
    Nowshin, Fabiha
    An, Hongyu
    Yi, Yang
    ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2024, 20 (01)
  • [37] SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks
    Branquinho, Henrique
    Lourenco, Nuno
    Costa, Ernesto
    PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE COMPANION, GECCO 2023 COMPANION, 2023, : 2115 - 2122
  • [38] Efficient training of spiking neural networks with temporally-truncated local backpropagation through time
    Guo, Wenzhe
    Fouda, Mohammed E.
    Eltawil, Ahmed M.
    Salama, Khaled Nabil
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [39] A TIME ENCODING APPROACH TO TRAINING SPIKING NEURAL NETWORKS
    Adam, Karen
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5957 - 5961
  • [40] Online Training Through Time for Spiking Neural Networks
    Xiao, Mingqing
    Meng, Qingyan
    Zhang, Zongpeng
    He, Di
    Lin, Zhouchen
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,