An On-Chip Learning Accelerator for Spiking Neural Networks using STT-RAM Crossbar Arrays

被引:0
|
作者
Kulkarni, Shruti R. [1 ]
Yin, Shihui [2 ]
Seo, Jae-sun [2 ]
Rajendran, Bipin [3 ]
机构
[1] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[2] Arizona State Univ, Sch Elect Comp & Energy Engn, Tempe, AZ 85287 USA
[3] Kings Coll London, Dept Engn, London WC2R 2LS, England
关键词
Neuromorphic hardware; Spiking Neural Networks; crossbar arrays; STT-RAM;
D O I
10.23919/date48585.2020.9116226
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this work, we present a scheme for implementing learning on a digital non-volatile memory (NVM) based hardware accelerator for Spiking Neural Networks (SNNs). Our design estimates across three prominent non-volatile memories - Phase Change Memory (PCM), Resistive RAM (RRAM), and Spin Transfer Torque RAM (STT-RAM) show that the STT-RAM arrays enable at least 2 x higher throughput compared to the other two memory technologies. We discuss the design and the signal communication framework through the STT-RAM crossbar array for training and inference in SNNs. Each STTRAM cell in the array stores a single bit value. Our neurosynaptic computational core consists of the memory crossbar array and its read/write peripheral circuitry and the digital logic for the spiking neurons, weight update computations, spike router, and decoder for incoming spike packets. Our STT-RAM based design shows similar to 20 x higher performance per unit Watt per unit area compared to conventional SRAM based design, making it a promising learning platform for realizing systems with significant area and power limitations.
引用
收藏
页码:1019 / 1024
页数:6
相关论文
共 50 条
  • [1] Neuromorphic Hardware Accelerator for SNN Inference based on STT-RAM Crossbar Arrays
    Kulkarni, Shruti R.
    Kadetotad, Deepak Vinayak
    Yin, Shihui
    Seo, Jae-sun
    Rajendran, Bipin
    [J]. 2019 26TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2019, : 438 - 441
  • [2] Accelerating Spiking Neural Networks using Memristive Crossbar Arrays
    Bohnstingl, Thomas
    Pantazi, Angeliki
    Eleftheriou, Evangelos
    [J]. 2020 27TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2020,
  • [3] Architecting On-Chip Interconnects for Stacked 3D STT-RAM Caches in CMPs
    Mishra, Asit K.
    Dong, Xiangyu
    Sun, Guangyu
    Xie, Yuan
    Vijaykrishnan, N.
    Das, Chita R.
    [J]. ISCA 2011: PROCEEDINGS OF THE 38TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE, 2011, : 69 - 80
  • [4] Memory Organization and Structures for On-Chip Learning in Spiking Neural Networks
    Schaefer, Clemens J. S.
    Joshi, Siddharth
    [J]. 2020 IEEE 63RD INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2020, : 599 - 602
  • [5] Architectural Exploration for On-chip, Online Learning in Spiking Neural Networks
    Roy, Subhrajit
    Kar, Sougata Kumar
    Basu, Arindam
    [J]. 2014 14TH INTERNATIONAL SYMPOSIUM ON INTEGRATED CIRCUITS (ISIC), 2014, : 128 - 131
  • [6] On-Chip Unsupervised Learning Using STDP in a Spiking Neural Network
    Gupta, Abhinav
    Saurabh, Sneh
    [J]. IEEE TRANSACTIONS ON NANOTECHNOLOGY, 2023, 22 : 365 - 376
  • [7] STT-RAM Buffer Design for Precision-Tunable General-Purpose Neural Network Accelerator
    Song, Lili
    Wang, Ying
    Han, Yinhe
    Li, Huawei
    Cheng, Yuanqing
    Li, Xiaowei
    [J]. IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2017, 25 (04) : 1285 - 1296
  • [8] Ziksa: On-Chip Learning Accelerator with Memristor Crossbars for Multilevel Neural Networks
    Zyarah, Abdullah M.
    Soures, Nicholas
    Hays, Lydia
    Jacobs-Gedrim, Robin B.
    Agarwal, Sapan
    Marinella, Matthew
    Kudithipudi, Dhireesha
    [J]. 2017 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2017,
  • [9] SCART: Predicting STT-RAM Cache Retention Times Using Machine Learning
    Gajaria, Dhruv
    Kuan, Kyle
    Adegbija, Tosiron
    [J]. 2019 TENTH INTERNATIONAL GREEN AND SUSTAINABLE COMPUTING CONFERENCE (IGSC), 2019,
  • [10] Using STT-RAM to Enable Energy-Efficient Near-Threshold Chip Multiprocessors
    Pan, Xiang
    Teodorescu, Radu
    [J]. PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES AND COMPILATION TECHNIQUES (PACT'14), 2014, : 485 - 486