Memristor Neural Network Training with Clock Synchronous Neuromorphic System

被引:12
|
作者
Jo, Sumin [1 ]
Sun, Wookyung [1 ]
Kim, Bokyung [1 ]
Kim, Sunhee [2 ]
Park, Junhee [1 ]
Shin, Hyungsoon [1 ]
机构
[1] Ewha Womans Univ, Dept Elect & Elect Engn, Seoul 03760, South Korea
[2] Sangmyung Univ, Dept Syst Semicond Engn, Cheonan 31066, South Korea
基金
新加坡国家研究基金会;
关键词
neuromorphic system; Hebbian training; guide training; memristor; image classification; CIRCUIT; DEVICE; BRAIN; MODEL;
D O I
10.3390/mi10060384
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Memristor devices are considered to have the potential to implement unsupervised learning, especially spike timing-dependent plasticity (STDP), in the field of neuromorphic hardware research. In this study, a neuromorphic hardware system for multilayer unsupervised learning was designed, and unsupervised learning was performed with a memristor neural network. We showed that the nonlinear characteristic memristor neural network can be trained by unsupervised learning only with the correlation between inputs and outputs. Moreover, a method to train nonlinear memristor devices in a supervised manner, named guide training, was devised. Memristor devices have a nonlinear characteristic, which makes implementing machine learning algorithms, such as backpropagation, difficult. The guide-training algorithm devised in this paper updates the synaptic weights by only using the correlations between inputs and outputs, and therefore, neither complex mathematical formulas nor computations are required during the training. Thus, it is considered appropriate to train a nonlinear memristor neural network. All training and inference simulations were performed using the designed neuromorphic hardware system. With the system and memristor neural network, the image classification was successfully done using both the Hebbian unsupervised training and guide supervised training methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Dynamic memristor array with multiple reservoir states for training efficient neuromorphic computing
    Noh, Minseo
    Ju, Dongyeol
    Kim, Sungjun
    JOURNAL OF MATERIALS CHEMISTRY C, 2024, 12 (34) : 13516 - 13524
  • [32] Memristor-based Synapse Design and Training Scheme for Neuromorphic Computing Architecture
    Wang, Hui
    Li, Hai
    Pino, Robinson E.
    2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2012,
  • [33] Low-Consumption Neuromorphic Memristor Architecture Based on Convolutional Neural Networks
    Sun, Shengyang
    Li, Jiwei
    Li, Zhiwei
    Liu, Haijun
    Li, Qingjiang
    Xu, Hui
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [34] Neural Network Training System for Marker Encoding
    L. P. Wang
    O. V. Grinchuk
    V. I. Tsurkov
    Journal of Computer and Systems Sciences International, 2019, 58 : 434 - 440
  • [35] Neural Network Training System for Marker Encoding
    Wang, L. P.
    Grinchuk, O. V.
    Tsurkov, V. I.
    JOURNAL OF COMPUTER AND SYSTEMS SCIENCES INTERNATIONAL, 2019, 58 (03) : 434 - 440
  • [36] Neuromorphic Energy Efficient Stress Detection System using Spiking Neural Network
    Ajay, B. S.
    Rao, Madhav
    Pavan, Phani K.
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [37] TraNNsformer: Neural Network Transformation for Memristive Crossbar based Neuromorphic System Design
    Ankit, Aayush
    Sengupta, Abhronil
    Roy, Kaushik
    2017 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN (ICCAD), 2017, : 533 - 540
  • [38] Parallel Evolutionary Optimization for Neuromorphic Network Training
    Schuman, Catherine D.
    Disney, Adam
    Singh, Susheela P.
    Bruer, Grant
    Mitchell, J. Parker
    Klibisz, Aleksander
    Plank, James S.
    PROCEEDINGS OF 2016 2ND WORKSHOP ON MACHINE LEARNING IN HPC ENVIRONMENTS (MLHPC), 2016, : 36 - 46
  • [39] Classifying Beers With Memristor Neural Network Algorithm in a Portable Electronic Nose System
    Zafar, Imran
    Cui, Yuanhui
    Bai, Qinghao
    Yang, Yanqing
    FRONTIERS IN PHYSICS, 2022, 10
  • [40] Fluoropolymer-based organic memristor with multifunctionality for flexible neural network system
    Kim, Min-Hwi
    Park, Hea-Lim
    Kim, Min-Hoi
    Jang, Jaewon
    Bae, Jin-Hyuk
    Kang, In Man
    Lee, Sin-Hyung
    NPJ FLEXIBLE ELECTRONICS, 2021, 5 (01)