DSNNs: learning transfer from deep neural networks to spiking neural networks

被引:0
|
作者
Zhang L. [1 ,2 ,3 ]
Du Z. [1 ,2 ,3 ]
Li L. [4 ]
Chen Y. [1 ,2 ]
机构
[1] State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences, Beijing
[2] Institute of Computing Technology, Chinese Academy of Sciences, Beijing
[3] Cambricon Tech. Ltd, Beijing
[4] Institute of Software, Chinese Academy of Sciences, Beijing
来源
High Technology Letters | 2020年 / 26卷 / 02期
基金
中国国家自然科学基金;
关键词
Convert method; Deep leaning; Spatially folded network; Spiking neural network (SNN);
D O I
10.3772/j.issn.1006-6748.2020.02.002
中图分类号
学科分类号
摘要
Deep neural networks (DNNs) have drawn great attention as they perform the state-of-the-art results on many tasks. Compared to DNNs, spiking neural networks (SNNs), which are considered as the new generation of neural networks, fail to achieve comparable performance especially on tasks with large problem sizes. Many previous work tried to close the gap between DNNs and SNNs but used small networks on simple tasks. This work proposes a simple but effective way to construct deep spiking neural networks (DSNNs) by transferring the learned ability of DNNs to SNNs. DSNNs achieve comparable accuracy on large networks and complex datasets. Copyright © by HIGH TECHNOLOGY LETTERS PRESS.
引用
下载
收藏
页码:136 / 144
页数:8
相关论文
共 50 条
  • [31] Third Generation Neural Networks: Spiking Neural Networks
    Ghosh-Dastidar, Samanwoy
    Adeli, Hojjat
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, 2009, 61 : 167 - +
  • [32] Autonomous Learning Paradigm for Spiking Neural Networks
    Liu, Junxiu
    McDaid, Liam J.
    Harkin, Jim
    Karim, Shvan
    Johnson, Anju P.
    Halliday, David M.
    Tyrrell, Andy M.
    Timmis, Jon
    Millard, Alan G.
    Hilder, James
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: THEORETICAL NEURAL COMPUTATION, PT I, 2019, 11727 : 737 - 744
  • [33] Comparison of learning methods for spiking neural networks
    Kukin K.
    Sboev A.
    Optical Memory and Neural Networks (Information Optics), 2015, 24 (02): : 123 - 129
  • [34] Learning long sequences in spiking neural networks
    Stan, Matei-Ioan
    Rhodes, Oliver
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [35] A reinforcement learning algorithm for spiking neural networks
    Florian, RV
    Seventh International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, Proceedings, 2005, : 299 - 306
  • [36] Learning rules in spiking neural networks: A survey
    Yi, Zexiang
    Lian, Jing
    Liu, Qidong
    Zhu, Hegui
    Liang, Dong
    Liu, Jizhao
    NEUROCOMPUTING, 2023, 531 : 163 - 179
  • [37] Supervised Learning in Multilayer Spiking Neural Networks
    Sporea, Ioana
    Gruening, Andre
    NEURAL COMPUTATION, 2013, 25 (02) : 473 - 509
  • [38] Learning in neural networks by reinforcement of irregular spiking
    Xie, XH
    Seung, HS
    PHYSICAL REVIEW E, 2004, 69 (04): : 10
  • [39] A Learning Framework for Controlling Spiking Neural Networks
    Narayanan, Vignesh
    Ritt, Jason T.
    Li, Jr-Shin
    Ching, ShiNung
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 211 - 216
  • [40] Evolutionary spiking neural networks: a survey: Evolutionary spiking neural networks: a survey
    Shen, Shuaijie
    Zhang, Rui
    Wang, Chao
    Huang, Renzhuo
    Tuerhong, Aiersi
    Guo, Qinghai
    Lu, Zhichao
    Zhang, Jianguo
    Leng, Luziwei
    Journal of Membrane Computing, 2024, 6 (04) : 335 - 346