Neuromorphic Computing Using Random Synaptic Feedback Weights for Error Backpropagation in NAND Flash Memory-Based Synaptic Devices

被引:10
|
作者
Lee, Sung-Tae [1 ]
Lee, Jong-Ho [2 ,3 ]
机构
[1] Hongik Univ, Sch Elect & Elect Engn, Seoul 04066, South Korea
[2] Seoul Natl Univ, Dept Elect & Comp Engn, Seoul 08826, South Korea
[3] Seoul Natl Univ, Interuniv Semicond Res Ctr ISRC, Seoul 08826, South Korea
基金
新加坡国家研究基金会;
关键词
Backpropagation; Flash memories; Computer architecture; System-on-chip; Neural networks; Standards; Transistors; Hardware neural networks; in-memory computing; NAND flash memory; neuromorphic; on-chip learning; synaptic device;
D O I
10.1109/TED.2023.3237670
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This work proposes utilizing separate synaptic string array for error backpropagation in NAND flash memory-based synaptic architecture with random synaptic feedback weight. To enable error backpropagation, forward and backward propagations are processed in separate synaptic devices in forward and backward synaptic arrays, respectively. In addition, synaptic weights in forward synaptic array are updated at each iteration, while those in backward synaptic array are fixed to reduce burden of peripheral circuits and power consumption. The optimal conductance response is investigated considering the linearity of the conductance response and the ratio of maximum and minimum currents. Reliability characteristics are verified by retention, endurance, and pass bias disturbance measurement results. Hardware-based neural networks with random synaptic weight achieve an inference accuracy of 95.41% which is comparable to that of 95.58% obtained with transposed weight. Hardware-based neural network simulations demonstrate that the inference accuracy of the proposed on-chip learning scheme hardly decreases compared to that of the off-chip learning even with increasing device variation.
引用
收藏
页码:1019 / 1024
页数:6
相关论文
共 50 条
  • [21] Compact Model of HfOX-Based Electronic Synaptic Devices for Neuromorphic Computing
    Huang, Peng
    Zhu, Dongbin
    Chen, Sijie
    Zhou, Zheng
    Chen, Zhe
    Gao, Bin
    Liu, Lifeng
    Liu, Xiaoyan
    Kang, Jinfeng
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2017, 64 (02) : 614 - 621
  • [22] Enhancing Long-Term Memory in Carbon-Nanotube-Based Optoelectronic Synaptic Devices for Neuromorphic Computing
    Lee, Seung Hun
    Lee, Hye Jin
    Jeon, Dabin
    Kim, Hee-Jin
    Lee, Sung-Nam
    NANOMATERIALS, 2024, 14 (18)
  • [23] Enhanced Long-Term Memory Properties of ZnO Nanoparticle-Based Optical Synaptic Devices for Neuromorphic Computing
    Oh, Jae-Hyeok
    Kim, Jeong-Hyeon
    Kim, Hee-Jin
    Kim, Young-Hyeun
    Kim, Kyoung-Kook
    Lee, Sung-Nam
    ADVANCED INTELLIGENT SYSTEMS, 2023, 5 (11)
  • [24] Operation Scheme of Multi-Layer Neural Networks Using NAND Flash Memory as High-Density Synaptic Devices
    Lee, Sung-Tae
    Lim, Suhwan
    Choi, Nag Yong
    Bae, Jong-Ho
    Kwon, Dongseok
    Park, Byung-Gook
    Lee, Jong-Ho
    IEEE JOURNAL OF THE ELECTRON DEVICES SOCIETY, 2019, 7 (01) : 1085 - 1093
  • [25] High-Density and Highly-Reliable Binary Neural Networks Using NAND Flash Memory Cells as Synaptic Devices
    Lee, Sung-Tae
    Kim, Hyeongsu
    Bae, Jong-Ho
    Yoo, Honam
    Choi, Nag Yong
    Kwon, Dongseok
    Lim, Suhwan
    Park, Byung-Gook
    Lee, Jong-Ho
    2019 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2019,
  • [26] Enhanced Long-Term Memory Properties of ZnO Nanoparticle-Based Optical Synaptic Devices for Neuromorphic Computing
    Oh, Jae-Hyeok
    Kim, Jeong-Hyeon
    Kim, Hee-Jin
    Kim, Young-Hyeun
    Kim, Kyoung-Kook
    Lee, Sung-Nam
    ADVANCED INTELLIGENT SYSTEMS, 2023,
  • [27] Metal oxide resistive random access memory based synaptic devices for brain-inspired computing
    Gao, Bin
    Kang, Jinfeng
    Zhou, Zheng
    Chen, Zhe
    Huang, Peng
    Liu, Lifeng
    Liu, Xiaoyan
    JAPANESE JOURNAL OF APPLIED PHYSICS, 2016, 55 (04)
  • [28] Study on the NAND flash memory-based failure recovery improvement using T*-tree
    Han, Seong-Soo
    Cho, Sung-Je
    International Journal of Control and Automation, 2015, 8 (06): : 339 - 348
  • [29] Ferroelectric synaptic devices based on CMOS-compatible HfAlOx for neuromorphic and reservoir computing applications
    Kim, Dahye
    Kim, Jihyung
    Yun, Seokyeon
    Lee, Jungwoo
    Seo, Euncho
    Kim, Sungjun
    NANOSCALE, 2023, 15 (18) : 8366 - 8376
  • [30] A Stepwise Rate-Compatible LDPC and Parity Management in NAND Flash Memory-Based Storage Devices
    Lim, Seung-Ho
    Lee, Jae-Bin
    Kim, Geon-Myeong
    Ahn, Woo Hyun
    IEEE ACCESS, 2020, 8 : 162491 - 162506