Robustness to Noisy Synaptic Weights in Spiking Neural Networks

被引:5
|
作者
Li, Chen [1 ]
Chen, Runze [1 ]
Moutafis, Christoforos [1 ]
Furber, Steve [1 ]
机构
[1] Univ Manchester, Dept Comp Sci, Manchester, Lancs, England
基金
欧盟地平线“2020”;
关键词
spiking neural networks; artificial neural networks; noisy weights; Gaussian noise;
D O I
10.1109/ijcnn48605.2020.9207019
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking neural networks (SNNs) are promising neural network models to achieve power-efficient and event-based computing on neuromorphic hardware. SNNs inherently contain noise and are robust to noisy inputs as well as noise related to the discrete 1-bit spike. In this paper, we find that SNNs are more robust to Gaussian noise in synaptic weights than artificial neural networks (ANNs) under some conditions. This finding will enhance our understanding of the neural dynamics in SNNs and of the advantages of SNNs compared with ANNs. Our results imply the possibility of using high-performance cutting-edge materials with intrinsic noise as an information storage medium in SNNs.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Co-learning synaptic delays, weights and adaptation in spiking neural networks
    Deckers, Lucas
    Van Damme, Laurens
    Van Leekwijck, Werner
    Tsang, Ing Jyh
    Latre, Steven
    [J]. FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [2] The geometry of robustness in spiking neural networks
    Calaim, Nuno
    Dehmelt, Florian A.
    Goncalves, Pedro J.
    Machens, Christian K.
    [J]. ELIFE, 2022, 11
  • [3] Stochasticity and robustness in spiking neural networks
    Olin-Ammentorp, Wilkie
    Beckmann, Karsten
    Schuman, Catherine D.
    Plank, James S.
    Cady, Nathaniel C.
    [J]. NEUROCOMPUTING, 2021, 419 : 23 - 36
  • [4] Training multi-layer spiking neural networks with plastic synaptic weights and delays
    Wang, Jing
    [J]. FRONTIERS IN NEUROSCIENCE, 2024, 17
  • [5] Robustness of classification ability of spiking neural networks
    Jie Yang
    Pingping Zhang
    Yan Liu
    [J]. Nonlinear Dynamics, 2015, 82 : 723 - 730
  • [6] Robustness of classification ability of spiking neural networks
    Yang, Jie
    Zhang, Pingping
    Liu, Yan
    [J]. NONLINEAR DYNAMICS, 2015, 82 (1-2) : 723 - 730
  • [7] Synaptic Sampling in Hardware Spiking Neural Networks
    Sheik, Sadique
    Paul, Somnath
    Augustine, Charles
    Kothapalli, Chinnikrishna
    Khellah, Muhammad M.
    Cauwenberghs, Gert
    Neftci, Emre
    [J]. 2016 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2016, : 2090 - 2093
  • [8] Resilience and Robustness of Spiking Neural Networks for Neuromorphic Systems
    Schuman, Catherine D.
    Mitchell, J. Parker
    Johnston, J. Travis
    Parsa, Maryam
    Kay, Bill
    Date, Prasanna
    Patton, Robert M.
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [9] A Comprehensive Analysis on Adversarial Robustness of Spiking Neural Networks
    Sharmin, Saima
    Panda, Priyadarshini
    Sarwar, Syed Shakib
    Lee, Chankyu
    Ponghiran, Wachirawit
    Roy, Kaushik
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [10] Adaptive Synaptic Scaling in Spiking Networks for Continual Learning and Enhanced Robustness
    Xu, Mingkun
    Liu, Faqiang
    Hu, Yifan
    Li, Hongyi
    Wei, Yuanyuan
    Zhong, Shuai
    Pei, Jing
    Deng, Lei
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 15