Quantized Context Based LIF Neurons for Recurrent Spiking Neural Networks in 45nm

被引:0
|
作者
Bezugam, Sai Sukruth [1 ]
Wu, Yihao [1 ]
Yoo, JaeBum [1 ]
Strukov, Dmitri [1 ]
Kim, Bongjin [1 ]
机构
[1] Univ Calif Santa Barbara, Dept Elect & Comp Engn, Santa Barbara, CA 93106 USA
基金
美国国家科学基金会;
关键词
Spiking neural network accelerator; hardware software codesign; neocortical neurons; CLIF neurons;
D O I
10.1109/NICE61972.2024.10548306
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this study, we propose the first hardware implementation of a context-based recurrent spiking neural network (RSNN) emphasizing on integrating dual information streams within the neocortical pyramidal neurons specifically Context-Dependent Leaky Integrate and Fire (CLIF) neuron models, essential element in RSNN. We present a quantized version of the CLIF neuron (qCLIF), developed through a hardware-software codesign approach utilizing the sparse activity of RSNN. Implemented in a 45nm technology node, the qCLIF is compact (900um(2)) and achieves a high accuracy of 90% despite 8 bit quantization on DVS gesture classification dataset. Our analysis spans a network configuration from 10 to 200 qCLIF neurons, supporting up to 82k synapses within a 1.86 mm(2) footprint, demonstrating scalability and efficiency.
引用
收藏
页数:7
相关论文
共 50 条
  • [21] A solution to the learning dilemma for recurrent networks of spiking neurons
    Bellec, Guillaume
    Scherr, Franz
    Subramoney, Anand
    Hajek, Elias
    Salaj, Darjan
    Legenstein, Robert
    Maass, Wolfgang
    NATURE COMMUNICATIONS, 2020, 11 (01)
  • [22] Short term memory in recurrent networks of spiking neurons
    Daucé E.
    Natural Computing, 2004, 3 (2) : 135 - 157
  • [23] A solution to the learning dilemma for recurrent networks of spiking neurons
    Guillaume Bellec
    Franz Scherr
    Anand Subramoney
    Elias Hajek
    Darjan Salaj
    Robert Legenstein
    Wolfgang Maass
    Nature Communications, 11
  • [24] Photonic Spiking Neural Networks and Graphene-on-Silicon Spiking Neurons
    Jha, Aashu
    Huang, Chaoran
    Peng, Hsuan-Tung
    Shastri, Bhavin
    Prucnal, Paul R.
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2022, 40 (09) : 2901 - 2914
  • [25] NOVEL MEMTRANSISTOR-BASED LIF NEURON WITH TUNABLE IONIC DYNAMICS FOR SPIKING NEURAL NETWORKS
    Yang, Zhen
    Zhang, Teng
    Yang, Yuchao
    Huang, Ru
    CONFERENCE OF SCIENCE & TECHNOLOGY FOR INTEGRATED CIRCUITS, 2024 CSTIC, 2024,
  • [26] Learning Methods of Recurrent Spiking Neural Networks Based on Adjoint Equations Approach
    Kuroe, Yasuaki
    Ueyama, Tomokazu
    2010 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS IJCNN 2010, 2010,
  • [27] Dynamic Action Inference with Recurrent Spiking Neural Networks
    Traub, Manuel
    Butz, Martin, V
    Legenstein, Robert
    Otte, Sebastian
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2021, PT V, 2021, 12895 : 233 - 244
  • [28] Learning beyond finite memory in recurrent networks of spiking neurons
    Tino, P
    Mills, AJS
    NEURAL COMPUTATION, 2006, 18 (03) : 591 - 613
  • [29] Learning beyond finite memory in recurrent networks of spiking neurons
    Tino, P
    Mills, A
    ADVANCES IN NATURAL COMPUTATION, PT 2, PROCEEDINGS, 2005, 3611 : 666 - 675
  • [30] Balanced Networks of Spiking Neurons with Spatially Dependent Recurrent Connections
    Rosenbaum, Robert
    Doiron, Brent
    PHYSICAL REVIEW X, 2014, 4 (02):