Ziksa: On-Chip Learning Accelerator with Memristor Crossbars for Multilevel Neural Networks

被引:0
|
作者
Zyarah, Abdullah M. [1 ,2 ]
Soures, Nicholas [1 ,2 ]
Hays, Lydia [1 ,2 ]
Jacobs-Gedrim, Robin B. [2 ]
Agarwal, Sapan [2 ]
Marinella, Matthew [2 ]
Kudithipudi, Dhireesha [1 ,2 ]
机构
[1] Rochester Inst Technol, Rochester, NY 14623 USA
[2] Sandia Natl Labs, Livermore, CA 94550 USA
关键词
CIRCUIT;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Memristor crossbars support efficient realizations of spiking and non-spiking neural networks designs. In most of these designs off-chip/ex-situ training is used to set/update the state of the memrisitve devices. However, there is a growing need to design an efficient on-chip/in-situ learning for mobile autonomous systems. In this research, we propose an on-chip learning accelerator, known as Ziksa, that is integrated with the memristor crossbars. We demonstrate how regression and back-propagation in multi-level networks can be realized through Ziksa. The proposed accelerator is evaluated on a fabricated TiN-TaOx-TaTiN memristor crossbar. A 3-layer feedforward network was tested using Ziksa for classification. An accuracy of 95.3% was achieved on Wisconsin breast cancer dataset. The proposed learning accelerator can be envisioned as a core building block in a wide-range of cognitive algorithms that rely on on-chip online learning.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] On-chip Training of Memristor Based Deep Neural Networks
    Hasan, Raqibul
    Taha, Tarek M.
    Yakopcic, Chris
    [J]. 2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 3527 - 3534
  • [2] Ultrahigh Density Memristor Neural Crossbar for On-Chip Supervised Learning
    Chabi, Djaafar
    Wang, Zhaohao
    Bennett, Christopher
    Klein, Jacques-Olivier
    Zhao, Weisheng
    [J]. IEEE TRANSACTIONS ON NANOTECHNOLOGY, 2015, 14 (06) : 954 - 962
  • [3] On-chip learning in pulsed silicon neural networks
    Lehmann, T
    Woodburn, R
    Murray, AF
    [J]. ISCAS '97 - PROCEEDINGS OF 1997 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS I - IV: CIRCUITS AND SYSTEMS IN THE INFORMATION AGE, 1997, : 693 - 696
  • [4] An On-Chip Learning Accelerator for Spiking Neural Networks using STT-RAM Crossbar Arrays
    Kulkarni, Shruti R.
    Yin, Shihui
    Seo, Jae-sun
    Rajendran, Bipin
    [J]. PROCEEDINGS OF THE 2020 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2020), 2020, : 1019 - 1024
  • [5] Impact of On-Chip Interconnection in a Large-Scale Memristor Crossbar Array for Neural Network Accelerator and Neuromorphic Chip
    Shin, Taein
    Son, Kyungjune
    Kim, Seongguk
    Cho, Kyungjun
    Park, Shinyoung
    Kim, Subin
    Park, Gapyeol
    Sim, Boogyo
    Kim, Joungho
    [J]. 2019 IEEE 28TH CONFERENCE ON ELECTRICAL PERFORMANCE OF ELECTRONIC PACKAGING AND SYSTEMS (EPEPS 2019), 2019,
  • [6] Analysis of on-chip communication properties in accelerator architectures for Deep Neural Networks
    Krichene, Hana
    Philippe, Jean-Marc
    [J]. 2021 15TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON NETWORKS-ON-CHIP (NOCS 2021), 2021, : 9 - 14
  • [7] On-chip training of memristor crossbar based multi-layer neural networks
    Hasan, Raqibul
    Taha, Tarek M.
    Yakopcic, Chris
    [J]. MICROELECTRONICS JOURNAL, 2017, 66 : 31 - 40
  • [8] Architecture and algorithms for syntetizable neural networks with on-chip learning
    Tisan, Alin
    Oniga, Stefan
    Attila, Buchman
    Ciprian, Gavrincea
    [J]. ISSCS 2007: INTERNATIONAL SYMPOSIUM ON SIGNALS, CIRCUITS AND SYSTEMS, VOLS 1 AND 2, 2007, : 265 - +
  • [9] Efficient Identification of Critical Faults in Memristor Crossbars for Deep Neural Networks
    Chen, Ching-Yuan
    Chakrabarty, Krishnendu
    [J]. PROCEEDINGS OF THE 2021 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2021), 2021, : 1074 - 1077
  • [10] On-Chip Memory Optimization of High Efficiency Accelerator for Deep Convolutional Neural Networks
    Lai, Tzu-Yi
    Chen, Kuan-Hung
    [J]. 2018 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2018, : 82 - 83