Enhancing the Robustness of Spiking Neural Networks with Stochastic Gating Mechanisms

被引:0
|
作者
Ding, Jianhao [1 ]
Yu, Zhaofei [1 ,2 ]
Huang, Tiejun [1 ]
Liu, Jian K. [3 ]
机构
[1] Peking Univ, Sch Comp Sci, Beijing, Peoples R China
[2] Peking Univ, Inst Artificial Intelligence, Beijing, Peoples R China
[3] Univ Birmingham, Sch Comp Sci, Birmingham, W Midlands, England
基金
中国国家自然科学基金;
关键词
NEURONS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking neural networks (SNNs) exploit neural spikes to provide solutions for low-power intelligent applications on neuromorphic hardware. Although SNNs have high computational efficiency due to spiking communication, they still lack resistance to adversarial attacks and noise perturbations. In the brain, neuronal responses generally possess stochasticity induced by ion channels and synapses, while the role of stochasticity in computing tasks is poorly understood. Inspired by this, we elaborate a stochastic gating spiking neural model for layer-by-layer spike communication, introducing stochasticity to SNNs. Through theoretical analysis, our gating model can be viewed as a regularizer that prevents error amplification under attacks. Meanwhile, our work can explain the robustness of Poisson coding. Experimental results prove that our method can be used alone or with existing robust enhancement algorithms to improve SNN robustness and reduce SNN energy consumption. We hope our work will shed new light on the role of stochasticity in the computation of SNNs. Our code is available at https://github.com/DingJianhao/StoG-meets-SNN/.
引用
收藏
页码:492 / 502
页数:11
相关论文
共 50 条
  • [1] BrainQN: Enhancing the Robustness of Deep Reinforcement Learning with Spiking Neural Networks
    Feng, Shuo
    Cao, Jian
    Ou, Zehong
    Chen, Guang
    Zhong, Yi
    Wang, Zilin
    Yan, Juntong
    Chen, Jue
    Wang, Bingsen
    Zou, Chenglong
    Feng, Zebang
    Wang, Yuan
    [J]. ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (09)
  • [2] The geometry of robustness in spiking neural networks
    Calaim, Nuno
    Dehmelt, Florian A.
    Goncalves, Pedro J.
    Machens, Christian K.
    [J]. ELIFE, 2022, 11
  • [3] Stochasticity and robustness in spiking neural networks
    Olin-Ammentorp, Wilkie
    Beckmann, Karsten
    Schuman, Catherine D.
    Plank, James S.
    Cady, Nathaniel C.
    [J]. NEUROCOMPUTING, 2021, 419 : 23 - 36
  • [4] Robustness of classification ability of spiking neural networks
    Jie Yang
    Pingping Zhang
    Yan Liu
    [J]. Nonlinear Dynamics, 2015, 82 : 723 - 730
  • [5] Robustness of classification ability of spiking neural networks
    Yang, Jie
    Zhang, Pingping
    Liu, Yan
    [J]. NONLINEAR DYNAMICS, 2015, 82 (1-2) : 723 - 730
  • [6] On Robustness of Spin-Orbit-Torque Based Stochastic Sigmoid Neurons for Spiking Neural Networks
    Jaiswal, Akhilesh
    Agrawal, Amogh
    Chakraborty, Indranil
    Roy, Deboleena
    Roy, Kaushik
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [7] Robustness to Noisy Synaptic Weights in Spiking Neural Networks
    Li, Chen
    Chen, Runze
    Moutafis, Christoforos
    Furber, Steve
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [8] Resilience and Robustness of Spiking Neural Networks for Neuromorphic Systems
    Schuman, Catherine D.
    Mitchell, J. Parker
    Johnston, J. Travis
    Parsa, Maryam
    Kay, Bill
    Date, Prasanna
    Patton, Robert M.
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [9] A Comprehensive Analysis on Adversarial Robustness of Spiking Neural Networks
    Sharmin, Saima
    Panda, Priyadarshini
    Sarwar, Syed Shakib
    Lee, Chankyu
    Ponghiran, Wachirawit
    Roy, Kaushik
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [10] Enhancing Training of Spiking Neural Network with Stochastic Latency
    Anumasa, Srinivas
    Mukhoty, Bhaskar
    Bojkovic, Velibor
    De Masi, Giulia
    Xiong, Huan
    Gu, Bin
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 10, 2024, : 10900 - 10908