An On-Chip Learning Method for Neuromorphic Systems Based on Non-Ideal Synapse Devices

被引:4
|
作者
Lee, Jae-Eun [1 ]
Lee, Chuljun [2 ]
Kim, Dong-Wook [1 ]
Lee, Daeseok [1 ]
Seo, Young-Ho [1 ]
机构
[1] Kwangwoon Univ, Dept Elect Mat Engn, 20 Gwangun Ro, Seoul 01897, South Korea
[2] Pohang Univ Sci & Technol POSTECH, Dept Mat Sci & Engn, 77 Cheongam Ro, Pohang 37673, Gyeongbuk, South Korea
基金
新加坡国家研究基金会;
关键词
neuromorphic; neural network; synapse device; quantization; on-chip training; MEMORY; QUANTIZATION;
D O I
10.3390/electronics9111946
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose an on-chip learning method that can overcome the poor characteristics of pre-developed practical synaptic devices, thereby increasing the accuracy of the neural network based on the neuromorphic system. The fabricated synaptic devices, based on Pr1-xCaxMnO3, LiCoO2, and TiOx, inherently suffer from undesirable characteristics, such as nonlinearity, discontinuities, and asymmetric conductance responses, which degrade the neuromorphic system performance. To address these limitations, we have proposed a conductance-based linear weighted quantization method, which controls conductance changes, and trained a neural network to predict the handwritten digits from the standard database MNIST. Furthermore, we quantitatively considered the non-ideal case, to ensure reliability by limiting the conductance level to that which synaptic devices can practically accept. Based on this proposed learning method, we significantly improved the neuromorphic system, without any hardware modifications to the synaptic devices or neuromorphic systems. Thus, the results emphatically show that, even for devices with poor synaptic characteristics, the neuromorphic system performance can be improved.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [1] Mitigating Effects of Non-ideal Synaptic Device Characteristics for On-chip Learning
    Chen, Pai-Yu
    Lin, Binbin
    Wang, I-Ting
    Hou, Tuo-Hung
    Ye, Jieping
    Vrudhula, Sarma
    Seo, Jae-sun
    Cao, Yu
    Yu, Shimeng
    2015 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN (ICCAD), 2015, : 194 - 199
  • [2] Verification of neuromorphic processing accuracy against non-ideal errors in synapse-based neural network systems
    Jo, Hwi Jeong
    Kang, Minil
    Um, Minseong
    Kim, Juhee
    Kwon, Kon-Woo
    Kim, Seyoung
    Lee, Hyung-Min
    INTERNATIONAL JOURNAL OF CIRCUIT THEORY AND APPLICATIONS, 2025, 53 (01) : 453 - 465
  • [3] Pointer Based Routing Scheme for On-chip Learning in Neuromorphic Systems
    Kornijcuk, Vladimir
    Jeong, Doo Seok
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018, : 451 - 456
  • [4] RRAM-based synapse devices for neuromorphic systems
    Moon, K.
    Lim, S.
    Park, J.
    Sung, C.
    Oh, S.
    Woo, J.
    Lee, J.
    Hwang, H.
    FARADAY DISCUSSIONS, 2019, 213 : 421 - 451
  • [5] A neuromorphic systems approach to in-memory computing with non-ideal memristive devices: from mitigation to exploitation
    Payvand, Melika
    Nair, Manu V.
    Mueller, Lorenz K.
    Indiveri, Giacomo
    FARADAY DISCUSSIONS, 2019, 213 : 487 - 510
  • [6] A Bi-Memristor Synapse with Spike-Timing-Dependent Plasticity for On-Chip Learning in Memristive Neuromorphic Systems
    Sayyaparaju, Sagarvarma
    Amer, Sherif
    Rose, Garrett S.
    2018 19TH INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN (ISQED), 2018, : 69 - 74
  • [7] Efficient On-chip Communication for Neuromorphic Systems
    Kumar, Shobhit
    Das, Shirshendu
    Jamadar, Manaal Mukhtar
    Kaur, Jaspinder
    2021 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, INTERNET OF PEOPLE, AND SMART CITY INNOVATIONS (SMARTWORLD/SCALCOM/UIC/ATC/IOP/SCI 2021), 2021, : 234 - 239
  • [8] Reconfigurable Spike Routing Architectures for On-Chip Local Learning in Neuromorphic Systems
    Kornijcuk, Vladimir
    Park, Jongkil
    Kim, Guhyun
    Kim, Dohun
    Kim, Inho
    Kim, Jaewook
    Kwak, Joon Young
    Jeong, Doo Seok
    ADVANCED MATERIALS TECHNOLOGIES, 2019, 4 (01)
  • [9] Loihi: A Neuromorphic Manycore Processor with On-Chip Learning
    Davies, Mike
    Srinivasa, Narayan
    Lin, Tsung-Han
    Chinya, Gautham
    Cao, Yongqiang
    Choday, Sri Harsha
    Dimou, Georgios
    Joshi, Prasad
    Imam, Nabil
    Jain, Shweta
    Liao, Yuyun
    Lin, Chit-Kwan
    Lines, Andrew
    Liu, Ruokun
    Mathaikutty, Deepak
    Mccoy, Steve
    Paul, Arnab
    Tse, Jonathan
    Venkataramanan, Guruguhanathan
    Weng, Yi-Hsin
    Wild, Andreas
    Yang, Yoonseok
    Wang, Hong
    IEEE MICRO, 2018, 38 (01) : 82 - 99
  • [10] A retrainable neuromorphic biosensor for on-chip learning and classification
    van Doremaele, E. R. W.
    Ji, X.
    Rivnay, J.
    van de Burgt, Y.
    NATURE ELECTRONICS, 2023, 6 (10) : 765 - +