An On-Chip Learning Method for Neuromorphic Systems Based on Non-Ideal Synapse Devices

被引:4
|
作者
Lee, Jae-Eun [1 ]
Lee, Chuljun [2 ]
Kim, Dong-Wook [1 ]
Lee, Daeseok [1 ]
Seo, Young-Ho [1 ]
机构
[1] Kwangwoon Univ, Dept Elect Mat Engn, 20 Gwangun Ro, Seoul 01897, South Korea
[2] Pohang Univ Sci & Technol POSTECH, Dept Mat Sci & Engn, 77 Cheongam Ro, Pohang 37673, Gyeongbuk, South Korea
基金
新加坡国家研究基金会;
关键词
neuromorphic; neural network; synapse device; quantization; on-chip training; MEMORY; QUANTIZATION;
D O I
10.3390/electronics9111946
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose an on-chip learning method that can overcome the poor characteristics of pre-developed practical synaptic devices, thereby increasing the accuracy of the neural network based on the neuromorphic system. The fabricated synaptic devices, based on Pr1-xCaxMnO3, LiCoO2, and TiOx, inherently suffer from undesirable characteristics, such as nonlinearity, discontinuities, and asymmetric conductance responses, which degrade the neuromorphic system performance. To address these limitations, we have proposed a conductance-based linear weighted quantization method, which controls conductance changes, and trained a neural network to predict the handwritten digits from the standard database MNIST. Furthermore, we quantitatively considered the non-ideal case, to ensure reliability by limiting the conductance level to that which synaptic devices can practically accept. Based on this proposed learning method, we significantly improved the neuromorphic system, without any hardware modifications to the synaptic devices or neuromorphic systems. Thus, the results emphatically show that, even for devices with poor synaptic characteristics, the neuromorphic system performance can be improved.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [31] On the SNR Penalties of Ideal and Non-ideal Subset Diversity Systems
    Gifford, Wesley M.
    Conti, Andrea
    Chiani, Marco
    Win, Moe Z.
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2012, 58 (06) : 3708 - 3724
  • [32] Singularities in the dynamics of systems with non-ideal constraints
    Ivanov, AP
    PMM JOURNAL OF APPLIED MATHEMATICS AND MECHANICS, 2003, 67 (02): : 185 - 192
  • [33] Structure characterisation method for ideal and non-ideal twisted plywoods
    Gutierrez, Oscar F. Aguilar
    Rey, Alejandro D.
    SOFT MATTER, 2014, 10 (47) : 9446 - 9453
  • [34] Dynamics of the non-ideal mechanical systems: A review
    Cveticanin, L.
    JOURNAL OF THE SERBIAN SOCIETY FOR COMPUTATIONAL MECHANICS, 2010, 4 (02) : 75 - 86
  • [35] APPLICABLE GRANULARITY THEORY FOR NON-IDEAL SYSTEMS
    SAUNDERS, AE
    JOURNAL OF PHOTOGRAPHIC SCIENCE, 1981, 29 (02): : 51 - 55
  • [36] DETERMINATION OF PARAMETERS OF NON-IDEAL ASSOCIATING SYSTEMS
    HOLLADAY, LA
    SOPHIANO.AJ
    FEDERATION PROCEEDINGS, 1971, 30 (03) : 1304 - &
  • [37] Singularities in mechanical systems with non-ideal constraints
    Ivanov, A.P.
    Prikladnaya Matematika i Mekhanika, 2003, 67 (02): : 212 - 221
  • [38] Channel Estimation for Non-Ideal OFDM Systems
    Montojo, Juan I.
    Milstein, Laurence B.
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2010, 58 (01) : 146 - 156
  • [39] THERMAL PROPERTIES OF SIMULATED NON-IDEAL SYSTEMS
    Khrustalyov, Yu. V.
    Vaulina, O. S.
    Petrov, O. F.
    Fortov, V. E.
    UKRAINIAN JOURNAL OF PHYSICS, 2011, 56 (12): : 1287 - 1289
  • [40] RRAM-based synapse devices for neuromorphic systems (vol 213, pg 421, 2019)
    Moon, K.
    Lim, S.
    Park, J.
    Sung, C.
    Oh, S.
    Woo, J.
    Lee, J.
    Hwang, H.
    FARADAY DISCUSSIONS, 2019, 213 : 589 - 589