Noise and spike-time-dependent plasticity drive self-organized criticality in spiking neural network: Toward neuromorphic computing

被引:1
|
作者
Ikeda, Narumitsu [1 ]
Akita, Dai [1 ]
Takahashi, Hirokazu [1 ]
机构
[1] Univ Tokyo, Grad Sch Informat Sci & Technol, Tokyo 1138656, Japan
关键词
NEURONAL AVALANCHES; CORTICAL NETWORKS; ACTIVITY PATTERNS; CHAOS; DYNAMICS; COMPUTATION; PRINCIPLES; EMERGENCE; CAPACITY; CULTURES;
D O I
10.1063/5.0152633
中图分类号
O59 [应用物理学];
学科分类号
摘要
Self-organized criticality (SoC) may optimize information transmission, encoding, and storage in the brain. Therefore, the underlying mechanism of the SoC provides significant insight for large-scale neuromorphic computing. We hypothesized that noise and stochastic spiking plays an essential role in SoC development in spiking neural networks (SNNs). We demonstrated that under appropriate noise levels and spike-time-dependent plasticity (STDP) parameters, an SNN evolves a SoC-like state characterized by a power-law distribution of neuronal avalanche size in a self-organized manner. Consistent with the physiological findings, the development of SNN was characterized by a transition from a subcritical state to a supercritical state and then to a critical state. Excitatory STDP with an asymmetric time window dominated the early phase of development; however, it destabilized the network and transitioned to the supercritical state. Synchronized bursts in the supercritical state enable inhibitory STDP with a symmetric time window, induce the development of inhibitory synapses, and stabilize the network toward the critical state. This sequence of transitions was observed when the appropriate noise level and STDP parameters were set to the initial conditions. Our results suggest that noise or stochastic spiking plays an essential role in SoC development and self-optimizes SNN for computation. Such neural mechanisms of noise harnessing would offer insight into the development of energy-efficient neuromorphic computing.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Self-organized noise resistance of oscillatory neural networks with spike timing-dependent plasticity
    Oleksandr V. Popovych
    Serhiy Yanchuk
    Peter A. Tass
    Scientific Reports, 3
  • [2] Self-organized noise resistance of oscillatory neural networks with spike timing-dependent plasticity
    Popovych, Oleksandr V.
    Yanchuk, Serhiy
    Tass, Peter A.
    SCIENTIFIC REPORTS, 2013, 3
  • [3] Self-Organized Criticality in Neural Network Models
    Rybarsch, Matthias
    Bornholdt, Stefan
    CRITICALITY IN NEURAL SYSTEMS, 2014, : 227 - 254
  • [4] Self-organized criticality in a model based on neural network
    Zhao, XW
    Chen, TL
    COMMUNICATIONS IN THEORETICAL PHYSICS, 2001, 36 (03) : 351 - 356
  • [5] PATTERN CLASSIFICATION BY SPIKING NEURAL NETWORKS COMBINING SELF-ORGANIZED AND REWARD-RELATED SPIKE-TIMING-DEPENDENT PLASTICITY
    Nobukawa, Sou
    Nishimura, Haruhiko
    Yamanishi, Teruya
    JOURNAL OF ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING RESEARCH, 2019, 9 (04) : 283 - 291
  • [6] DEVELOPMENT OF NEURAL POPULATION ACTIVITY TOWARD SELF-ORGANIZED CRITICALITY
    Yada, Yuichiro
    Mita, Takeshi
    Sanada, Akihiro
    Yano, Ryuichi
    Kanzaki, Ryohei
    Bakkum, Douglas J.
    Hierlemann, Andreas
    Takahashi, Hirokazu
    NEUROSCIENCE, 2017, 343 : 55 - 65
  • [7] All-optical spiking neural network and optical spike-time-dependent plasticity based on the self-pulsing effect within a micro-ring resonator
    Wen, Jin
    Zhang, Hui
    Wu, Zhengwei
    Wang, Qian
    Yu, Huimin
    Sun, Wei
    Liang, Bozhi
    He, Chenyao
    Xiong, Keyu
    Pan, Yu
    Zhang, Ying
    Liu, Zhanzhi
    APPLIED OPTICS, 2023, 62 (20) : 5459 - 5466
  • [8] A kind of neural network model displaying self-organized criticality
    Huang, J
    Chen, TL
    COMMUNICATIONS IN THEORETICAL PHYSICS, 2000, 33 (03) : 365 - 370
  • [9] Self-organizing dual coding based on spike-time-dependent plasticity
    Masuda, N
    Aihara, K
    NEURAL COMPUTATION, 2004, 16 (03) : 627 - 663
  • [10] Self-organized Spiking Neural Network Recognizing Phase/Frequency Correlations
    Kiselev, M. V.
    IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 15 - 21