Noise and spike-time-dependent plasticity drive self-organized criticality in spiking neural network: Toward neuromorphic computing

被引:1
|
作者
Ikeda, Narumitsu [1 ]
Akita, Dai [1 ]
Takahashi, Hirokazu [1 ]
机构
[1] Univ Tokyo, Grad Sch Informat Sci & Technol, Tokyo 1138656, Japan
关键词
NEURONAL AVALANCHES; CORTICAL NETWORKS; ACTIVITY PATTERNS; CHAOS; DYNAMICS; COMPUTATION; PRINCIPLES; EMERGENCE; CAPACITY; CULTURES;
D O I
10.1063/5.0152633
中图分类号
O59 [应用物理学];
学科分类号
摘要
Self-organized criticality (SoC) may optimize information transmission, encoding, and storage in the brain. Therefore, the underlying mechanism of the SoC provides significant insight for large-scale neuromorphic computing. We hypothesized that noise and stochastic spiking plays an essential role in SoC development in spiking neural networks (SNNs). We demonstrated that under appropriate noise levels and spike-time-dependent plasticity (STDP) parameters, an SNN evolves a SoC-like state characterized by a power-law distribution of neuronal avalanche size in a self-organized manner. Consistent with the physiological findings, the development of SNN was characterized by a transition from a subcritical state to a supercritical state and then to a critical state. Excitatory STDP with an asymmetric time window dominated the early phase of development; however, it destabilized the network and transitioned to the supercritical state. Synchronized bursts in the supercritical state enable inhibitory STDP with a symmetric time window, induce the development of inhibitory synapses, and stabilize the network toward the critical state. This sequence of transitions was observed when the appropriate noise level and STDP parameters were set to the initial conditions. Our results suggest that noise or stochastic spiking plays an essential role in SoC development and self-optimizes SNN for computation. Such neural mechanisms of noise harnessing would offer insight into the development of energy-efficient neuromorphic computing.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Self-Organized Near-Zero-Lag Synchronization Induced by Spike-Timing Dependent Plasticity in Cortical Populations
    Matias, Fernanda S.
    Carelli, Pedro V.
    Mirasso, Claudio R.
    Copelli, Mauro
    PLOS ONE, 2015, 10 (10):
  • [32] Quantized Weight Transfer Method Using Spike-Timing-Dependent Plasticity for Hardware Spiking Neural Network
    Hwang, Sungmin
    Kim, Hyungjin
    Park, Byung-Gook
    APPLIED SCIENCES-BASEL, 2021, 11 (05): : 1 - 10
  • [33] A spiking neural network model of the medial superior olive using spike timing dependent plasticity for sound localization
    Glackin, Brendan
    Wall, Julie A.
    McGinnity, Thomas M.
    Maguire, Liam P.
    McDaid, Liam J.
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2010, 4
  • [34] Digital Implementation of a Spiking Neural Network (SNN) Capable of Spike-Timing-Dependent Plasticity (STDP) Learning
    Ru, Di
    Zhang, Xu
    Xu, Ziye
    Ferrari, Silvia
    Mazumder, Pinaki
    2014 IEEE 14TH INTERNATIONAL CONFERENCE ON NANOTECHNOLOGY (IEEE-NANO), 2014, : 873 - 876
  • [35] Indirect Training of a Spiking Neural Network for Flight Control via Spike-Timing-Dependent Synaptic Plasticity
    Foderaro, Greg
    Henriquez, Craig
    Ferrari, Silvia
    49TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2010, : 911 - 917
  • [36] A Neuromorphic Spiking Neural Network Using Time-to-First-Spike Coding Scheme and Analog Computing in Low-Leakage 8T SRAM
    Chen, Chao-Yu
    Dai, Yan-Siou
    Hong, Hao-Chiao
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2024, 32 (05) : 848 - 859
  • [37] Correlation Encoding of Input Data for Solving a Classification Task by a Spiking Neural Network with Spike-Timing-Dependent Plasticity
    Sboev, Alexander
    Serenko, Alexey
    Rybka, Roman
    BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES 2021, 2022, 1032 : 457 - 462
  • [38] Improving Robustness of ReRAM-based Spiking Neural Network Accelerator with Stochastic Spike-timing-dependent-plasticity
    She, Xueyuan
    Long, Yun
    Mukhopadhyay, Saibal
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [39] Spike Timing Dependent Plasticity Based Enhanced Self-Learning for Efficient Pattern Recognition in Spiking Neural Networks
    Srinivasan, Gopalakrishnan
    Roy, Sourjya
    Raghunathan, Vijay
    Roy, Kaushik
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 1847 - 1854
  • [40] Intralayer-Connected Spiking Neural Network with Hybrid Training Using Backpropagation and Probabilistic Spike-Timing Dependent Plasticity
    Chen, Long
    Li, Xuhang
    Zhu, Yaqin
    Wang, Haitao
    Li, Jiayong
    Liu, Yu
    Wang, Zijian
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2023, 2023