An On-Chip Learning Accelerator for Spiking Neural Networks using STT-RAM Crossbar Arrays

被引:0
|
作者
Kulkarni, Shruti R. [1 ]
Yin, Shihui [2 ]
Seo, Jae-sun [2 ]
Rajendran, Bipin [3 ]
机构
[1] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[2] Arizona State Univ, Sch Elect Comp & Energy Engn, Tempe, AZ 85287 USA
[3] Kings Coll London, Dept Engn, London WC2R 2LS, England
关键词
Neuromorphic hardware; Spiking Neural Networks; crossbar arrays; STT-RAM;
D O I
10.23919/date48585.2020.9116226
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this work, we present a scheme for implementing learning on a digital non-volatile memory (NVM) based hardware accelerator for Spiking Neural Networks (SNNs). Our design estimates across three prominent non-volatile memories - Phase Change Memory (PCM), Resistive RAM (RRAM), and Spin Transfer Torque RAM (STT-RAM) show that the STT-RAM arrays enable at least 2 x higher throughput compared to the other two memory technologies. We discuss the design and the signal communication framework through the STT-RAM crossbar array for training and inference in SNNs. Each STTRAM cell in the array stores a single bit value. Our neurosynaptic computational core consists of the memory crossbar array and its read/write peripheral circuitry and the digital logic for the spiking neurons, weight update computations, spike router, and decoder for incoming spike packets. Our STT-RAM based design shows similar to 20 x higher performance per unit Watt per unit area compared to conventional SRAM based design, making it a promising learning platform for realizing systems with significant area and power limitations.
引用
收藏
页码:1019 / 1024
页数:6
相关论文
共 50 条
  • [21] On-chip training of memristor crossbar based multi-layer neural networks
    Hasan, Raqibul
    Taha, Tarek M.
    Yakopcic, Chris
    [J]. MICROELECTRONICS JOURNAL, 2017, 66 : 31 - 40
  • [22] Neuromorphic Accelerator for Spiking Neural Network Using SOT-MRAM Crossbar Array
    Verma, Gaurav
    Nisar, Arshid
    Dhull, Seema
    Kaushik, Brajesh Kumar
    [J]. IEEE TRANSACTIONS ON ELECTRON DEVICES, 2023, 70 (11) : 6012 - 6020
  • [23] On-chip learning in pulsed silicon neural networks
    Lehmann, T
    Woodburn, R
    Murray, AF
    [J]. ISCAS '97 - PROCEEDINGS OF 1997 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS I - IV: CIRCUITS AND SYSTEMS IN THE INFORMATION AGE, 1997, : 693 - 696
  • [24] Analysis of on-chip communication properties in accelerator architectures for Deep Neural Networks
    Krichene, Hana
    Philippe, Jean-Marc
    [J]. 2021 15TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON NETWORKS-ON-CHIP (NOCS 2021), 2021, : 9 - 14
  • [25] On-Chip Supervised Learning Rule for Ultra High Density Neural Crossbar using Memristor for Synapse and Neuron
    Chabi, Djaafar
    Wang, Zhaohao
    Zhao, Weisheng
    Klein, Jacques-Olivier
    [J]. 2014 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH), 2014, : 7 - 12
  • [26] An On-Chip Trainable Neuron Circuit for SFQ-Based Spiking Neural Networks
    Ucpinar, Beyza Zeynep
    Karamuftuoglu, Mustafa Altay
    Razmkhah, Sasan
    Pedram, Massoud
    [J]. IEEE TRANSACTIONS ON APPLIED SUPERCONDUCTIVITY, 2024, 34 (03) : 1 - 6
  • [27] Architecture and algorithms for syntetizable neural networks with on-chip learning
    Tisan, Alin
    Oniga, Stefan
    Attila, Buchman
    Ciprian, Gavrincea
    [J]. ISSCS 2007: INTERNATIONAL SYMPOSIUM ON SIGNALS, CIRCUITS AND SYSTEMS, VOLS 1 AND 2, 2007, : 265 - +
  • [28] An FPGA-Based Co-Processor for Spiking Neural Networks with On-Chip STDP-Based Learning
    Nguyen, Thao N. N.
    Veeravalli, Bharadwaj
    Fong, Xuanyao
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 2157 - 2161
  • [29] On-chip unsupervised learning in Winner-Take-All networks of spiking neurons
    Kreiser, Raphaela
    Moraitis, Timoleon
    Sandamirskaya, Yulia
    Indiveri, Giacomo
    [J]. 2017 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS), 2017,
  • [30] On-Chip Memory Optimization of High Efficiency Accelerator for Deep Convolutional Neural Networks
    Lai, Tzu-Yi
    Chen, Kuan-Hung
    [J]. 2018 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2018, : 82 - 83