Memristor Neural Network Training with Clock Synchronous Neuromorphic System

被引:12
|
作者
Jo, Sumin [1 ]
Sun, Wookyung [1 ]
Kim, Bokyung [1 ]
Kim, Sunhee [2 ]
Park, Junhee [1 ]
Shin, Hyungsoon [1 ]
机构
[1] Ewha Womans Univ, Dept Elect & Elect Engn, Seoul 03760, South Korea
[2] Sangmyung Univ, Dept Syst Semicond Engn, Cheonan 31066, South Korea
基金
新加坡国家研究基金会;
关键词
neuromorphic system; Hebbian training; guide training; memristor; image classification; CIRCUIT; DEVICE; BRAIN; MODEL;
D O I
10.3390/mi10060384
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Memristor devices are considered to have the potential to implement unsupervised learning, especially spike timing-dependent plasticity (STDP), in the field of neuromorphic hardware research. In this study, a neuromorphic hardware system for multilayer unsupervised learning was designed, and unsupervised learning was performed with a memristor neural network. We showed that the nonlinear characteristic memristor neural network can be trained by unsupervised learning only with the correlation between inputs and outputs. Moreover, a method to train nonlinear memristor devices in a supervised manner, named guide training, was devised. Memristor devices have a nonlinear characteristic, which makes implementing machine learning algorithms, such as backpropagation, difficult. The guide-training algorithm devised in this paper updates the synaptic weights by only using the correlations between inputs and outputs, and therefore, neither complex mathematical formulas nor computations are required during the training. Thus, it is considered appropriate to train a nonlinear memristor neural network. All training and inference simulations were performed using the designed neuromorphic hardware system. With the system and memristor neural network, the image classification was successfully done using both the Hebbian unsupervised training and guide supervised training methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Ex-situ training of large memristor crossbars for neural network applications
    Hasan, Raqibul
    Yakopcic, Chris
    Taha, Tarek M.
    ANALOG INTEGRATED CIRCUITS AND SIGNAL PROCESSING, 2019, 99 (01) : 1 - 10
  • [22] Ex-situ Training of Dense Memristor Crossbar for Neuromorphic Applications
    Hasan, Raqibul
    Yakopcic, Chris
    Taha, Tarek M.
    PROCEEDINGS OF THE 2015 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH 15), 2015, : 75 - 81
  • [23] An Associative-Memory-Based Reconfigurable Memristive Neuromorphic System With Synchronous Weight Training
    Yang, Le
    Zeng, Zhigang
    Huang, Yi
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2020, 12 (03) : 529 - 540
  • [24] Signal Integrity Modeling and Analysis of Large-Scale Memristor Crossbar Array in a High-Speed Neuromorphic System for Deep Neural Network
    Shin, Taein
    Park, Shinyoung
    Kim, Seongguk
    Kim, Subin
    Son, Kyungjune
    Park, Hyunwook
    Lho, Daehwan
    Cho, Kyungjun
    Park, Gapyeol
    Gong, Kyubong
    Jung, Seongtaek
    Kim, Joungho
    IEEE TRANSACTIONS ON COMPONENTS PACKAGING AND MANUFACTURING TECHNOLOGY, 2021, 11 (07): : 1122 - 1136
  • [25] Neuromorphic Spiking Neural Networks and Their Memristor-CMOS Hardware Implementations
    Camunas-Mesa, Luis A.
    Linares-Barranco, Bernabe
    Serrano-Gotarredona, Teresa
    MATERIALS, 2019, 12 (17)
  • [26] Memristor-Based Neuromorphic System for Unsupervised Online Learning and Network Anomaly Detection on Edge Devices
    Alam, Md Shahanur
    Yakopcic, Chris
    Hasan, Raqibul
    Taha, Tarek M.
    Information (Switzerland), 2025, 16 (03)
  • [27] Reconfigurable Neuromorphic Neural Network Architecture
    Sharma, Kapil
    Sarangi, Pradeepta Kumar
    Sharma, Parth
    Nayak, Soumya Ranjan
    Aluvala, Srinivas
    Swain, Santosh Kumar
    APPLIED COMPUTATIONAL INTELLIGENCE AND SOFT COMPUTING, 2024, 2024
  • [28] A Heterogeneous Computing System with Memristor-Based Neuromorphic Accelerators
    Liu, Xiaoxiao
    Mao, Mengjie
    Li, Hai
    Chen, Yiran
    Jiang, Hao
    Yang, J. Joshua
    Wu, Qing
    Barnell, Mark
    2014 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE (HPEC), 2014,
  • [29] The LSTM Neural Network Based on Memristor
    Chu, Ziqi
    Xu, Hui
    Liu, Haijun
    2020 3RD INTERNATIONAL CONFERENCE ON COMPUTER INFORMATION SCIENCE AND APPLICATION TECHNOLOGY (CISAT) 2020, 2020, 1634
  • [30] Impact of On-Chip Interconnection in a Large-Scale Memristor Crossbar Array for Neural Network Accelerator and Neuromorphic Chip
    Shin, Taein
    Son, Kyungjune
    Kim, Seongguk
    Cho, Kyungjun
    Park, Shinyoung
    Kim, Subin
    Park, Gapyeol
    Sim, Boogyo
    Kim, Joungho
    2019 IEEE 28TH CONFERENCE ON ELECTRICAL PERFORMANCE OF ELECTRONIC PACKAGING AND SYSTEMS (EPEPS 2019), 2019,