Memristor Neural Network Training with Clock Synchronous Neuromorphic System

被引:12
|
作者
Jo, Sumin [1 ]
Sun, Wookyung [1 ]
Kim, Bokyung [1 ]
Kim, Sunhee [2 ]
Park, Junhee [1 ]
Shin, Hyungsoon [1 ]
机构
[1] Ewha Womans Univ, Dept Elect & Elect Engn, Seoul 03760, South Korea
[2] Sangmyung Univ, Dept Syst Semicond Engn, Cheonan 31066, South Korea
基金
新加坡国家研究基金会;
关键词
neuromorphic system; Hebbian training; guide training; memristor; image classification; CIRCUIT; DEVICE; BRAIN; MODEL;
D O I
10.3390/mi10060384
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Memristor devices are considered to have the potential to implement unsupervised learning, especially spike timing-dependent plasticity (STDP), in the field of neuromorphic hardware research. In this study, a neuromorphic hardware system for multilayer unsupervised learning was designed, and unsupervised learning was performed with a memristor neural network. We showed that the nonlinear characteristic memristor neural network can be trained by unsupervised learning only with the correlation between inputs and outputs. Moreover, a method to train nonlinear memristor devices in a supervised manner, named guide training, was devised. Memristor devices have a nonlinear characteristic, which makes implementing machine learning algorithms, such as backpropagation, difficult. The guide-training algorithm devised in this paper updates the synaptic weights by only using the correlations between inputs and outputs, and therefore, neither complex mathematical formulas nor computations are required during the training. Thus, it is considered appropriate to train a nonlinear memristor neural network. All training and inference simulations were performed using the designed neuromorphic hardware system. With the system and memristor neural network, the image classification was successfully done using both the Hebbian unsupervised training and guide supervised training methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Cascaded Neural Network for Memristor based Neuromorphic Computing
    Sun, Sheng-Yang
    Xu, Hui
    Li, Jiwei
    Liu, Haijun
    Li, Qingjiang
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [2] Flexible memristor based neuromorphic system for implementing multi-layer neural network algorithms
    Yakopcic, Chris
    Hasan, Raqibul
    Taha, Tarek M.
    INTERNATIONAL JOURNAL OF PARALLEL EMERGENT AND DISTRIBUTED SYSTEMS, 2018, 33 (04) : 408 - 429
  • [3] Forgetting memristor based neuromorphic system for pattern training and recognition
    Zhang, Peijian
    Li, Chuandong
    Huang, Tingwen
    Chen, Ling
    Chen, Yiran
    NEUROCOMPUTING, 2017, 222 : 47 - 53
  • [4] Memristor Based Neuromorphic Circuit for Ex-Situ Training of Multi-Layer Neural Network Algorithms
    Yakopcic, Chris
    Hasan, Raqibul
    Taha, Tarek M.
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [5] Optimization of Deep Neural Network for Neuromorphic System
    Lee, Jae Eun
    Lee, Chul Jun
    Lee, Dae Seok
    Kim, Dong Wook
    Seo, Young Ho
    2019 34TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2019), 2019, : 430 - 431
  • [6] A memristor-based neural network circuit with synchronous weight adjustment
    Yang, Le
    Zeng, Zhigang
    Shi, Xinming
    NEUROCOMPUTING, 2019, 363 : 114 - 124
  • [7] A Neural Network Circuit with Associative Learning and Forgetting Process Based on Memristor Neuromorphic Device
    Lv, Xiaoqiang
    Cai, Yimao
    Yang, Yuchao
    Yu, Zhizhen
    Fang, Yichen
    Wang, Zongwei
    Wu, Lindong
    Liu, Jianfeng
    Zhang, Wanrong
    Huang, Ru
    2017 IEEE 12TH INTERNATIONAL CONFERENCE ON ASIC (ASICON), 2017, : 211 - 214
  • [8] A Memristor-based Neuromorphic Engine with a Current Sensing Scheme for Artificial Neural Network Applications
    Liu, Chenchen
    Yang, Qing
    Zhang, Chi
    Jiang, Hao
    Wu, Qing
    Li, Hai
    2017 22ND ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2017, : 647 - 652
  • [9] Challenges of memristor based neuromorphic computing system
    Bonan Yan
    Yiran Chen
    Hai Li
    Science China Information Sciences, 2018, 61
  • [10] Challenges of memristor based neuromorphic computing system
    Yan, Bonan
    Chen, Yiran
    Li, Hai
    SCIENCE CHINA-INFORMATION SCIENCES, 2018, 61 (06)