Event-Based Update of Synapses in Voltage-Based Learning Rules

被引:2
|
作者
Stapmanns, Jonas [1 ,2 ]
Hahne, Jan [3 ]
Helias, Moritz [1 ,2 ]
Bolten, Matthias [3 ]
Diesmann, Markus [1 ,4 ,5 ]
Dahmen, David [1 ]
机构
[1] Julich Res Ctr, Inst Adv Simulat IAS 6, Inst Neurosci & Med INM 6, JARA Inst Brain Struct Funct Relationship INM 10, Julich, Germany
[2] Rhein Westfal TH Aachen, Inst Theoret Solid State Phys, Dept Phys, Aachen, Germany
[3] Berg Univ Wuppertal, Sch Math & Nat Sci, Wuppertal, Germany
[4] Rhein Westfal TH Aachen, Fac 1, Dept Phys, Aachen, Germany
[5] Rhein Westfal TH Aachen, Med Fac, Dept Psychiat Psychotherapy & Psychosomat, Aachen, Germany
关键词
event-based simulation; voltage-based plasticity rules; spiking neural network simulator; NEST; Clopath rule; Urbanczik-Senn rule; NETWORK SIMULATION; NEURAL-NETWORK; SPIKING; CONNECTIVITY; PLASTICITY; NEURONS; MODELS; INTEGRATION; PROCESSORS; FRAMEWORK;
D O I
10.3389/fninf.2021.609147
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike times. In some learning rules membrane potentials not only influence synaptic weight changes at the time points of spike events but in a continuous manner. In these cases, synapses therefore require information on the full time course of membrane potentials to update their strength which a priori suggests a continuous update in a time-driven manner. The latter hinders scaling of simulations to realistic cortical network sizes and relevant time scales for learning. Here, we derive two efficient algorithms for archiving postsynaptic membrane potentials, both compatible with modern simulation engines based on event-based synapse updates. We theoretically contrast the two algorithms with a time-driven synapse update scheme to analyze advantages in terms of memory and computations. We further present a reference implementation in the spiking neural network simulator NEST for two prototypical voltage-based plasticity rules: the Clopath rule and the Urbanczik-Senn rule. For both rules, the two event-based algorithms significantly outperform the time-driven scheme. Depending on the amount of data to be stored for plasticity, which heavily differs between the rules, a strong performance increase can be achieved by compressing or sampling of information on membrane potentials. Our results on computational efficiency related to archiving of information provide guidelines for the design of learning rules in order to make them practically usable in large-scale networks.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] Learning Event-Based Motion Deblurring
    Jiang, Zhe
    Zhang, Yu
    Zou, Dongqing
    Ren, Jimmy
    Lv, Jiancheng
    Liu, Yebin
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3317 - 3326
  • [2] Event-based stochastic learning and optimization
    Cao, Xi-Ren
    WODES 2006: Eighth International Workshop on Discrete Event Systems, Proceedings, 2006, : 398 - 398
  • [3] An Event-based Formal Framework for Dynamic Software Update
    An, Shengwei
    Ma, Xiaoxing
    Cao, Chun
    Yu, Ping
    Xu, Chang
    2015 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE SECURITY AND RELIABILITY (QRS 2015), 2015, : 173 - 182
  • [4] Event-Based Estimation With Information-Based Triggering and Adaptive Update
    Mohammadi, Arash
    Plataniotis, Konstantinos N.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (18) : 4924 - 4939
  • [5] Efficient Learning of Event-Based Dense Representation Using Hierarchical Memories with Adaptive Update
    Kamal, Uday
    Mukhopadhyay, Saibal
    COMPUTER VISION-ECCV 2024, PT LXXXII, 2025, 15140 : 74 - 89
  • [6] Representation learning using event-based STDP
    Tavanaei, Amirhossein
    Masquelier, Timothee
    Maida, Anthony
    NEURAL NETWORKS, 2018, 105 : 294 - 303
  • [7] Representation Learning for Event-based Visuomotor Policies
    Vemprala, Sai
    Mian, Sami
    Kapoor, Ashish
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [8] Event-based Viewing Tool for Learning Illustrations
    Misue, Kazuo
    Kowata, Yukino
    2020 24TH INTERNATIONAL CONFERENCE INFORMATION VISUALISATION (IV 2020), 2020, : 473 - 479
  • [9] Event-based neural learning for quadrotor control
    Estéban Carvalho
    Pierre Susbielle
    Nicolas Marchand
    Ahmad Hably
    Jilles S. Dibangoye
    Autonomous Robots, 2023, 47 : 1213 - 1228
  • [10] Event-based knowledge acquisition for ontology learning
    Zhou Wen
    Liu Zongtian
    Liu Ying
    Zhao Yan
    PROCEEDINGS OF THE SIXTH IEEE INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS, 2007, : 498 - +