Spiking CapsNet: A spiking neural network with a biologically plausible routing rule between capsules

被引:14
|
作者
Zhao, Dongcheng [1 ,3 ]
Li, Yang [1 ,2 ,3 ]
Zeng, Yi [1 ,2 ,3 ,4 ,5 ]
Wang, Jihang [1 ,2 ,3 ]
Zhang, Qian [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci CASIA, Inst Automat, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[3] CASIA, Res Ctr Brain Inspired Intelligence, Beijing, Peoples R China
[4] CASIA, Natl Lab Pattern Recognit, Beijing, Peoples R China
[5] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai, Peoples R China
关键词
Spiking Neural Network; Capsual Neural Netowrk; Biologically Plausible Routing; Noise Robustness; Affine Transformation Robustness; INTELLIGENCE;
D O I
10.1016/j.ins.2022.07.152
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Spiking neural network (SNN) has attracted much attention due to its powerful spatiotemporal information representation ability. Capsule Neural Network (CapsNet) does well in assembling and coupling features of different network layers. Here, we propose Spiking CapsNet by combining spiking neurons and capsule structures. In addition, we propose a more biologically plausible Spike Timing Dependent Plasticity routing mechanism. The coupling ability is further improved by fully considering the spatio-temporal relationship between spiking capsules of the low layer and the high layer. We have verified experiments on the MNIST, FashionMNIST, and CIFAR10 datasets. Our algorithm still shows comparable performance concerning other excellent SNNs with typical structures (convolutional, fully-connected) on these classification tasks. Our Spiking CapsNet combines SNN and CapsNet's strengths and shows strong robustness to noise and affine transformation. By adding different Salt-Pepper and Gaussian noise to the test dataset, the experimental results demonstrate that our algorithm is more resistant to noise than other approaches. As well, our Spiking CapsNet shows strong generalization to affine transformation on the AffNIST dataset. Our code is available at https://github.com/BrainCog-X/Brain-Cog. (C) 2022 The Author(s). Published by Elsevier Inc.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [1] Tuning Convolutional Spiking Neural Network With Biologically Plausible Reward Propagation
    Zhang, Tielin
    Jia, Shuncheng
    Cheng, Xiang
    Xu, Bo
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (12) : 7621 - 7631
  • [2] A review of learning in biologically plausible spiking neural networks
    Taherkhani, Aboozar
    Belatreche, Ammar
    Li, Yuhua
    Cosma, Georgina
    Maguire, Liam P.
    McGinnity, T. M.
    [J]. NEURAL NETWORKS, 2020, 122 (122) : 253 - 272
  • [3] Biologically Plausible Sequence Learning with Spiking Neural Networks
    Liu, Zuozhu
    Chotibut, Thiparat
    Hillar, Christopher
    Lin, Shaowei
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 1316 - 1323
  • [4] A Biologically Plausible Spiking Neural Network for Decoding Kinematics in the Hippocampus and Premotor Cortex
    Taeckens, Elijah
    Dong, Ryan
    Shah, Sahil
    [J]. 2023 11TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING, NER, 2023,
  • [5] A biologically plausible supervised learning method for spiking neural networks using the symmetric STDP rule
    Hao, Yunzhe
    Huang, Xuhui
    Dong, Meng
    Xu, Bo
    [J]. NEURAL NETWORKS, 2020, 121 : 387 - 395
  • [6] FPGA Accelerated Simulation of Biologically Plausible Spiking Neural Networks
    Thomas, David B.
    Luk, Wayne
    [J]. PROCEEDINGS OF THE 2009 17TH IEEE SYMPOSIUM ON FIELD PROGRAMMABLE CUSTOM COMPUTING MACHINES, 2009, : 45 - 52
  • [7] BIOLOGICALLY PLAUSIBLE ILLUSIONARY CONTRAST PERCEPTION WITH SPIKING NEURAL NETWORKS
    Cohen-Duwek, Hadar
    Tsur, Elishai Ezra
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1586 - 1590
  • [8] A Piezoelectric Biologically Plausible Spiking Neuron
    Simmich, Sebastian
    Yilmaz, Mustafa
    Ashkrizzadeh, Rafael
    Petraru, Adrian
    Rieger, Robert
    [J]. 2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS, 2023,
  • [9] Implementation of biologically plausible spiking neural networks models on the POEtic tissue
    Moreno, JM
    Eriksson, J
    Iglesias, J
    Villa, AEP
    [J]. EVOLVABLE SYSTEMS: FROM BIOLOGY TO HARDWARE, 2005, 3637 : 188 - 197
  • [10] A Comparison of Encoding Schemes for Haptic Object Recognition using a Biologically Plausible Spiking Neural Network
    Ratnasingam, Sivalogeswaran
    McGinnity, T. M.
    [J]. 2011 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2011, : 3446 - 3453