Smooth Exact Gradient Descent Learning in Spiking Neural Networks

被引:0
|
作者
Klos, Christian [1 ]
Memmesheimer, Raoul-Martin [1 ]
机构
[1] Neural Network Dynamics and Computation, Institute of Genetics, University of Bonn, Bonn,53115, Germany
关键词
D O I
10.1103/PhysRevLett.134.027301
中图分类号
学科分类号
摘要
Recurrent neural networks
引用
收藏
相关论文
共 50 条
  • [21] ANALYSIS OF GRADIENT DESCENT LEARNING ALGORITHMS FOR MULTILAYER FEEDFORWARD NEURAL NETWORKS
    GUO, H
    GELFAND, SB
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS, 1991, 38 (08): : 883 - 894
  • [22] Dynamics of on-line gradient descent learning for multilayer neural networks
    Saad, D
    Solla, SA
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 8: PROCEEDINGS OF THE 1995 CONFERENCE, 1996, 8 : 302 - 308
  • [23] Sparse Spiking Gradient Descent
    Perez-Nieves, Nicolas
    Goodman, Dan F. M.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [24] Contrastive Learning in Random Neural Networks and its Relation to Gradient-Descent Learning
    Romariz, Alexandre
    Gelenbe, Erol
    [J]. COMPUTER AND INFORMATION SCIENCES II, 2012, : 511 - 517
  • [25] An exact mapping from ReLU networks to spiking neural networks
    Stanojevic, Ana
    Wozniak, Stanislaw
    Bellec, Guillaume
    Cherubini, Giovanni
    Pantazi, Angeliki
    Gerstner, Wulfram
    [J]. NEURAL NETWORKS, 2023, 168 : 74 - 88
  • [26] Phonetic classification with spiking neural network using a gradient descent rule
    Ourdighi, A.
    Lacheheb, S. E.
    Benyettou, A.
    [J]. SECOND INTERNATIONAL CONFERENCE ON COMPUTER AND ELECTRICAL ENGINEERING, VOL 2, PROCEEDINGS, 2009, : 36 - 40
  • [27] Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data
    Li, Yuanzhi
    Liang, Yingyu
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [28] LEARNING SHALLOW NEURAL NETWORKS VIA PROVABLE GRADIENT DESCENT WITH RANDOM INITIALIZATION
    Xia, Shuhao
    Shi, Yuanming
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 5616 - 5620
  • [29] Crossprop: Learning Representations by Stochastic Meta-Gradient Descent in Neural Networks
    Veeriah, Vivek
    Zhang, Shangtong
    Sutton, Richard S.
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2017, PT I, 2017, 10534 : 445 - 459
  • [30] Applying Gradient Descent in Convolutional Neural Networks
    Cui, Nan
    [J]. 2ND INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2018), 2018, 1004