Quantized Context Based LIF Neurons for Recurrent Spiking Neural Networks in 45nm

被引:0
|
作者
Bezugam, Sai Sukruth [1 ]
Wu, Yihao [1 ]
Yoo, JaeBum [1 ]
Strukov, Dmitri [1 ]
Kim, Bongjin [1 ]
机构
[1] Univ Calif Santa Barbara, Dept Elect & Comp Engn, Santa Barbara, CA 93106 USA
基金
美国国家科学基金会;
关键词
Spiking neural network accelerator; hardware software codesign; neocortical neurons; CLIF neurons;
D O I
10.1109/NICE61972.2024.10548306
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this study, we propose the first hardware implementation of a context-based recurrent spiking neural network (RSNN) emphasizing on integrating dual information streams within the neocortical pyramidal neurons specifically Context-Dependent Leaky Integrate and Fire (CLIF) neuron models, essential element in RSNN. We present a quantized version of the CLIF neuron (qCLIF), developed through a hardware-software codesign approach utilizing the sparse activity of RSNN. Implemented in a 45nm technology node, the qCLIF is compact (900um(2)) and achieves a high accuracy of 90% despite 8 bit quantization on DVS gesture classification dataset. Our analysis spans a network configuration from 10 to 200 qCLIF neurons, supporting up to 82k synapses within a 1.86 mm(2) footprint, demonstrating scalability and efficiency.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] Spontaneous dynamics of asymmetric random recurrent spiking neural networks
    Soula, H
    Beslon, G
    Mazet, O
    NEURAL COMPUTATION, 2006, 18 (01) : 60 - 79
  • [42] Multitask computation through dynamics in recurrent spiking neural networks
    Pugavko, Mechislav M.
    Maslennikov, Oleg V.
    Nekorkin, Vladimir I.
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [43] Information Bottleneck in Control Tasks with Recurrent Spiking Neural Networks
    Vasu, Madhavun Candadai
    Izquierdo, Eduardo J.
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2017, PT I, 2017, 10613 : 236 - 244
  • [44] Understanding Selection and Diversity for Evolution of Spiking Recurrent Neural Networks
    Schuman, Catherine D.
    Bruer, Grant
    Young, Aaron R.
    Dean, Mark
    Plank, James S.
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [45] Character Recognition from Trajectory by Recurrent Spiking Neural Networks
    Shen, Jiangrong
    Lin, Kang
    Wang, Yueming
    Pan, Gang
    2017 39TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2017, : 2900 - 2903
  • [46] Synaptic Weighting for Physiological Responses in Recurrent Spiking Neural Networks
    Herzfeld, David J.
    Beardsley, Scott A.
    2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2011, : 4187 - 4190
  • [47] An Unsupervised Learning Algorithm for Deep Recurrent Spiking Neural Networks
    Du, Pangao
    Lin, Xianghong
    Pi, Xiaomei
    Wang, Xiangwen
    2020 11TH IEEE ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2020, : 603 - 607
  • [48] Simple framework for constructing functional spiking recurrent neural networks
    Kim, Robert
    Li, Yinghao
    Sejnowski, Terrence J.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2019, 116 (45) : 22811 - 22820
  • [49] Improved Spiking Neural Networks with multiple neurons for digit recognition
    Chimmula, Vinay Kumar Reddy
    Zhang, Lei
    Palliath, Dhanya
    Kumar, Abhinay
    2020 11TH INTERNATIONAL CONFERENCE ON AWARENESS SCIENCE AND TECHNOLOGY (ICAST), 2020,
  • [50] Nonlinear dynamics and machine learning of recurrent spiking neural networks
    Maslennikov, O. V.
    Pugavko, M. M.
    Shchapin, D. S.
    Nekorkin, V. I.
    PHYSICS-USPEKHI, 2022, 65 (10) : 1020 - 1038