An On-Chip Learning Method for Neuromorphic Systems Based on Non-Ideal Synapse Devices

被引:4
|
作者
Lee, Jae-Eun [1 ]
Lee, Chuljun [2 ]
Kim, Dong-Wook [1 ]
Lee, Daeseok [1 ]
Seo, Young-Ho [1 ]
机构
[1] Kwangwoon Univ, Dept Elect Mat Engn, 20 Gwangun Ro, Seoul 01897, South Korea
[2] Pohang Univ Sci & Technol POSTECH, Dept Mat Sci & Engn, 77 Cheongam Ro, Pohang 37673, Gyeongbuk, South Korea
基金
新加坡国家研究基金会;
关键词
neuromorphic; neural network; synapse device; quantization; on-chip training; MEMORY; QUANTIZATION;
D O I
10.3390/electronics9111946
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose an on-chip learning method that can overcome the poor characteristics of pre-developed practical synaptic devices, thereby increasing the accuracy of the neural network based on the neuromorphic system. The fabricated synaptic devices, based on Pr1-xCaxMnO3, LiCoO2, and TiOx, inherently suffer from undesirable characteristics, such as nonlinearity, discontinuities, and asymmetric conductance responses, which degrade the neuromorphic system performance. To address these limitations, we have proposed a conductance-based linear weighted quantization method, which controls conductance changes, and trained a neural network to predict the handwritten digits from the standard database MNIST. Furthermore, we quantitatively considered the non-ideal case, to ensure reliability by limiting the conductance level to that which synaptic devices can practically accept. Based on this proposed learning method, we significantly improved the neuromorphic system, without any hardware modifications to the synaptic devices or neuromorphic systems. Thus, the results emphatically show that, even for devices with poor synaptic characteristics, the neuromorphic system performance can be improved.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [21] An Efficient Neuromorphic Implementation of Temporal Coding-Based On-Chip STDP Learning
    Zhong, Yi
    Wang, Zilin
    Cui, Xiaoxin
    Cao, Jian
    Wang, Yuan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (11) : 4241 - 4245
  • [22] CVNS Synapse Multiplier for Robust Neurochips With On-Chip Learning
    Zamanlooy, Babak
    Mirhassani, Mitra
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2015, 23 (11) : 2540 - 2551
  • [23] Non-ideal behavior of DR systems
    Willis, C.
    MEDICAL PHYSICS, 2006, 33 (06) : 2242 - 2242
  • [24] On the Stability of a Class of Non-Ideal Systems
    Chiroiu, Veturia
    Munteanu, Ligia
    Dumitriu, Dan
    Brisan, Cornel
    Ioan, Rodica
    ROMANIAN JOURNAL OF ACOUSTICS AND VIBRATION, 2014, 11 (02): : 88 - 93
  • [25] On-chip learning for domain wall synapse based Fully Connected Neural Network
    Bhowmik, Debanjan
    Saxena, Utkarsh
    Dankar, Apoory
    Verma, Anand
    Kaushik, Divya
    Chatterjee, Shouri
    Singh, Utkarsh
    JOURNAL OF MAGNETISM AND MAGNETIC MATERIALS, 2019, 489
  • [26] A comprehensive review of advanced trends: from artificial synapses to neuromorphic systems with consideration of non-ideal effects
    Kim, Kyuree
    Song, Min Suk
    Hwang, Hwiho
    Hwang, Sungmin
    Kim, Hyungjin
    FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [27] Chaos-based communication systems in non-ideal channels
    Eisencraft, M.
    Fanganiello, R. D.
    Grzybowski, J. M. V.
    Soriano, D. C.
    Attux, R.
    Batista, A. M.
    Macau, E. E. N.
    Monteiro, L. H. A.
    Romano, J. M. T.
    Suyama, R.
    Yoneyama, T.
    COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2012, 17 (12) : 4707 - 4718
  • [28] Recursive method for modeling flexible multibody systems with non-ideal constraints
    State Key Laboratory of Structural Analysis for Industrial Equipment, Dalian University of Technology, Dalian 116023, China
    Lixue Xuebao, 2008, 5 (684-694):
  • [29] Simulation of semiconductor devices with non-ideal metallic contacts
    TU Hamburg-Harburg, Hamburg, Germany
    IEEE Trans Electron Devices, 4 (679-681):
  • [30] Simulation of semiconductor devices with non-ideal metallic contacts
    Schroeder, D
    Witkowski, U
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 1997, 44 (04) : 679 - 681