Ex-situ training of large memristor crossbars for neural network applications

被引:9
|
作者
Hasan, Raqibul [1 ]
Yakopcic, Chris [1 ]
Taha, Tarek M. [1 ]
机构
[1] Univ Dayton, Dept Elect & Comp Engn, Dayton, OH 45469 USA
基金
美国国家科学基金会;
关键词
Memristor crossbars; Neural networks; Training; Ex-situ training; Sneak paths; Low power pattern recognition system;
D O I
10.1007/s10470-018-1303-5
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Memristor crossbar arrays carry out multiply-add operations in parallel in the analog domain, and can enable neuromorphic systems with high throughput at low energy and area consumption. Neural networks need to be trained prior to use. This work considers ex-situ training where the weights pre-trained by a software implementation are then programmed into the hardware. Existing ex-situ training approaches for memristor crossbars do not consider sneak path currents, and they may work only for neural networks implemented using small crossbars. Ex-situ training in large crossbars, without considering sneak paths, reduces the application recognition accuracy significantly due to the increased number of sneak current paths. This paper proposes ex-situ training approaches for both 0T1M and 1T1M crossbars that account for crossbar sneak paths and the stochasticity inherent in memristor switching. To carry out the simulation of these training approaches, a framework for fast and accurate simulation of large memristor crossbars was developed. The results in this work show that 0T1M crossbar based systems can be 17-83% smaller in area than 1T1M crossbar based systems.
引用
收藏
页码:1 / 10
页数:10
相关论文
共 50 条
  • [1] Ex-situ training of large memristor crossbars for neural network applications
    Raqibul Hasan
    Chris Yakopcic
    Tarek M. Taha
    [J]. Analog Integrated Circuits and Signal Processing, 2019, 99 : 1 - 10
  • [2] Ex-situ Training of Dense Memristor Crossbar for Neuromorphic Applications
    Hasan, Raqibul
    Yakopcic, Chris
    Taha, Tarek M.
    [J]. PROCEEDINGS OF THE 2015 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH 15), 2015, : 75 - 81
  • [3] Learning Method for Ex-situ Training of Memristor Crossbar based Multi-Layer Neural Network
    Bala, Anu
    Adeyemo, Adedotun
    Yang, Xiaohan
    Jabir, Abusaleh
    [J]. 2017 9TH INTERNATIONAL CONGRESS ON ULTRA MODERN TELECOMMUNICATIONS AND CONTROL SYSTEMS AND WORKSHOPS (ICUMT), 2017, : 305 - 310
  • [4] Memristor Based Neuromorphic Circuit for Ex-Situ Training of Multi-Layer Neural Network Algorithms
    Yakopcic, Chris
    Hasan, Raqibul
    Taha, Tarek M.
    [J]. 2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [5] Issues of Implementing Neural Network Algorithms on Memristor Crossbars
    Morozov A.Y.
    Abgaryan K.K.
    Reviznikov D.L.
    [J]. Russian Microelectronics, 2020, 49 (8) : 568 - 573
  • [6] Ex-Situ Programming in a Neuromorphic Memristor Based Crossbar Circuit
    Yakopcic, Chris
    Taha, Tarek M.
    [J]. PROCEEDINGS OF THE 2015 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON), 2015, : 300 - 304
  • [7] Efficient Implementation of Spiking Neural Networks for Inference Using Ex-Situ Training
    Jurj, Sorin Liviu
    [J]. IEEE Access, 2024, 12 : 135014 - 135027
  • [8] Circuit Optimization Techniques for Efficient Ex-Situ Training of Robust Memristor Based Liquid State Machine
    Henderson, Alex
    Yakopcic, Chris
    Merkel, Cory
    Harbour, Steven
    Taha, Tarek M.
    Hazan, Hananel
    [J]. PROCEEDINGS OF THE 17TH ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES, NANOARCH 2022, 2022,
  • [9] Method for ex-situ training in memristor-based neuromorphic circuit using robust weight programming method
    Yakopcic, C.
    Taha, T. M.
    McLean, M.
    [J]. ELECTRONICS LETTERS, 2015, 51 (12) : 899 - 900
  • [10] Activity-difference training of deep neural networks using memristor crossbars
    Su-in Yi
    Jack D. Kendall
    R. Stanley Williams
    Suhas Kumar
    [J]. Nature Electronics, 2023, 6 : 45 - 51