Noise and spike-time-dependent plasticity drive self-organized criticality in spiking neural network: Toward neuromorphic computing

被引:1
|
作者
Ikeda, Narumitsu [1 ]
Akita, Dai [1 ]
Takahashi, Hirokazu [1 ]
机构
[1] Univ Tokyo, Grad Sch Informat Sci & Technol, Tokyo 1138656, Japan
关键词
NEURONAL AVALANCHES; CORTICAL NETWORKS; ACTIVITY PATTERNS; CHAOS; DYNAMICS; COMPUTATION; PRINCIPLES; EMERGENCE; CAPACITY; CULTURES;
D O I
10.1063/5.0152633
中图分类号
O59 [应用物理学];
学科分类号
摘要
Self-organized criticality (SoC) may optimize information transmission, encoding, and storage in the brain. Therefore, the underlying mechanism of the SoC provides significant insight for large-scale neuromorphic computing. We hypothesized that noise and stochastic spiking plays an essential role in SoC development in spiking neural networks (SNNs). We demonstrated that under appropriate noise levels and spike-time-dependent plasticity (STDP) parameters, an SNN evolves a SoC-like state characterized by a power-law distribution of neuronal avalanche size in a self-organized manner. Consistent with the physiological findings, the development of SNN was characterized by a transition from a subcritical state to a supercritical state and then to a critical state. Excitatory STDP with an asymmetric time window dominated the early phase of development; however, it destabilized the network and transitioned to the supercritical state. Synchronized bursts in the supercritical state enable inhibitory STDP with a symmetric time window, induce the development of inhibitory synapses, and stabilize the network toward the critical state. This sequence of transitions was observed when the appropriate noise level and STDP parameters were set to the initial conditions. Our results suggest that noise or stochastic spiking plays an essential role in SoC development and self-optimizes SNN for computation. Such neural mechanisms of noise harnessing would offer insight into the development of energy-efficient neuromorphic computing.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] A Spiking Neural Network with a Global Self-Controller for Unsupervised Learning Based on Spike-Timing-Dependent Plasticity Using Flash Memory Synaptic Devices
    Kang, Won-Mook
    Kim, Chul-Heung
    Lee, Soochang
    Woo, Sung Yun
    Bae, Jong-Ho
    Park, Byung-Gook
    Lee, Jong-Ho
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [42] Fusing Self-Organized Neural Network and Keypoint Clustering for Localized Real-Time Background Subtraction
    Avola, Danilo
    Bernardi, Marco
    Cinque, Luigi
    Massaroni, Cristiano
    Foresti, Gian Luca
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2020, 30 (04)
  • [43] Regularized dynamic self-organized neural network inspired by the immune algorithm for financial time series prediction
    Hussain, Abir Jaafar
    Al-Jumeily, Dhiya
    Al-Askar, Haya
    Radi, Naeem
    NEUROCOMPUTING, 2016, 188 : 23 - 30
  • [44] Spike time dependent plasticity (STDP) enabled learning in spiking neural networks using domain wall based synapses and neurons
    Sahu, Upasana
    Pandey, Aadit
    Goyal, Kushaagra
    Bhowmik, Debanjan
    AIP ADVANCES, 2019, 9 (12)
  • [45] Self-organized and time-delayed hybrid neural network model and its application to the occluded object recognition
    Li, Yaoyong
    Zheng, Nanning
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 10 (04): : 317 - 325
  • [46] Neural information coding on small-world spiking neuronal networks modulated by spike-timing-dependent plasticity under external noise stimulation
    Guo, Lei
    Zhang, Wei
    Zhang, Jialei
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 3): : S5217 - S5231
  • [47] Neural information coding on small-world spiking neuronal networks modulated by spike-timing-dependent plasticity under external noise stimulation
    Lei Guo
    Wei Zhang
    Jialei Zhang
    Cluster Computing, 2019, 22 : 5217 - 5231
  • [48] An analysis of the use of Hebbian and Anti-Hebbian spike time dependent plasticity learning functions within the context of recurrent spiking neural networks
    Carnell, Andrew
    NEUROCOMPUTING, 2009, 72 (4-6) : 685 - 692
  • [49] A Spiking Neural Network with Resistively Coupled Synapses Using Time-to-First-Spike Coding Towards Efficient Charge-Domain Computing
    Sakemi, Yusuke
    Morino, Kai
    Morie, Takashi
    Hosomi, Takeo
    Aihara, Kazuyuki
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 2152 - 2156
  • [50] Complex Noise-Resistant Zeroing Neural Network for Computing Complex Time-Dependent Lyapunov Equation
    Liao, Bolin
    Hua, Cheng
    Cao, Xinwei
    Katsikis, Vasilios N.
    Li, Shuai
    MATHEMATICS, 2022, 10 (15)