Memristor Bridge Synapse-Based Neural Network and Its Learning

被引:287
|
作者
Adhikari, Shyam Prasad [1 ]
Yang, Changju [1 ]
Kim, Hyongsuk [1 ]
Chua, Leon O. [2 ]
机构
[1] Chonbuk Natl Univ, Div Elect Engn, Jeonju 561756, South Korea
[2] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
基金
新加坡国家研究基金会;
关键词
Chip-in-the-loop; memristor; memristor bridge synapse; neural network; HARDWARE; IMPLEMENTATION; CHIP; PERTURBATION; CIRCUIT;
D O I
10.1109/TNNLS.2012.2204770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Analog hardware architecture of a memristor bridge synapse-based multilayer neural network and its learning scheme is proposed. The use of memristor bridge synapse in the proposed architecture solves one of the major problems, regarding nonvolatile weight storage in analog neural network implementations. To compensate for the spatial nonuniformity and nonideal response of the memristor bridge synapse, a modified chip-in-the-loop learning scheme suitable for the proposed neural network architecture is also proposed. In the proposed method, the initial learning is conducted in software, and the behavior of the software-trained network is learned by the hardware network by learning each of the single-layered neurons of the network independently. The forward calculation of the single-layered neuron learning is implemented on circuit hardware, and followed by a weight updating phase assisted by a host computer. Unlike conventional chip-in-the-loop learning, the need for the readout of synaptic weights for calculating weight updates in each epoch is eliminated by virtue of the memristor bridge synapse and the proposed learning scheme. The hardware architecture along with the successful implementation of proposed learning on a three-bit parity network, and on a car detection network is also presented.
引用
收藏
页码:1426 / 1435
页数:10
相关论文
共 50 条
  • [21] Silent Synapse-based Circuitry Reorganization in Cocaine Craving
    Dong, Yan
    NEUROPSYCHOPHARMACOLOGY, 2013, 38 : S48 - S48
  • [22] The LSTM Neural Network Based on Memristor
    Chu, Ziqi
    Xu, Hui
    Liu, Haijun
    2020 3RD INTERNATIONAL CONFERENCE ON COMPUTER INFORMATION SCIENCE AND APPLICATION TECHNOLOGY (CISAT) 2020, 2020, 1634
  • [23] Silent Synapse-Based Mechanisms of Critical Period Plasticity
    Xu, Weifeng
    Loewel, Siegrid
    Schlueter, Oliver M.
    FRONTIERS IN CELLULAR NEUROSCIENCE, 2020, 14
  • [24] A Circuit-Based Learning Architecture for Multilayer Neural Networks With Memristor Bridge Synapses
    Adhikari, Shyam Prasad
    Kim, Hyongsuk
    Budhathoki, Ram Kaji
    Yang, Changju
    Chua, Leon O.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2015, 62 (01) : 215 - 223
  • [25] Initial Sensitive Dynamics in Memristor Synapse-coupled Hopfield Neural Network
    Chen, Mo
    Chen Chengjie
    Bao Bocheng
    Xu Quan
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (04) : 870 - 877
  • [26] Memristor bridge synapse for better artificial neuron perceptron
    Wang, Nuo
    Li, Lei
    Chen, Yulong
    Wang, Hongyu
    Yang, Zheming
    Long, Dingyu
    AIP ADVANCES, 2023, 13 (05)
  • [27] A Compact Memristor-Based Dynamic Synapse for Spiking Neural Networks
    Hu, Miao
    Chen, Yiran
    Yang, J. Joshua
    Wang, Yu
    Li, Hai
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2017, 36 (08) : 1353 - 1366
  • [28] Comparison of Two Memristor Based Neural Network Learning Schemes for Crossbar Architecture
    Starzyk, Janusz A.
    Basawaraj
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, PT I, 2013, 7902 : 492 - 499
  • [29] A Memristor-Based Spiking Neural Network With High Scalability and Learning Efficiency
    Zhao, Zhenyu
    Qu, Lianhua
    Wang, Lei
    Deng, Quan
    Li, Nan
    Kang, Ziyang
    Guo, Shasha
    Xu, Weixia
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2020, 67 (05) : 931 - 935
  • [30] Performance Improvement of Degrading Memristor-Bridge-Based Multilayer Neural Network with Refresh Pulses
    Kausani A.A.
    Ding C.
    Anwar M.
    International Journal of High Speed Electronics and Systems, 2024, 33 (2-3)