A High-Speed and High-Efficiency Diverse Error Margin Write-Verify Scheme for an RRAM-Based Neuromorphic Hardware Accelerator

被引:2
|
作者
Lin, Yudeng [1 ]
Tang, Jianshi [2 ,3 ]
Gao, Bin [2 ,3 ]
Qin, Qi [1 ]
Zhang, Qingtian [2 ,3 ]
Qian, He [2 ,3 ]
Wu, Huaqiang [2 ,3 ]
机构
[1] Tsinghua Univ, Beijing Innovat Ctr Future Chips ICFC, Sch Integrated Circuits, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Beijing Innovat Ctr Future Chips, Sch Integrated Circuits, Beijing 100084, Peoples R China
[3] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Neural networks; Hardware acceleration; Costs; Standards; Programming; Probabilistic logic; Resistive random access memory (RRAM); neuromorphic accelerator; write-verify; Bayesian method; ARRAY;
D O I
10.1109/TCSII.2022.3224470
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Resistive random access memory (RRAM)-based neuromorphic hardware accelerators are attractive platforms for neural network acceleration due to their high energy efficiency. However, the inherent variations of RRAM, arising from diffusion or recombination of oxygen vacancies, can cause significant conductance deviation from the target value, resulting in noticeable performance degradation. In practical ex situ training, write-verify methods are widely adopted to avoid this issue when transferring a trained network model. However, the intense reading and reprogramming operations make the conventional write-verify methods require extensive programming time and energy. In this brief, for the first time, we propose a novel write-verify scheme that can transfer each weight with a different acceptable error margin to achieve a high-speed and high-efficiency write-verify scheme while maintaining network performance. Our experimental results show that the speed and energy efficiency of the write-verify process can be improved significantly, by up to x3.4 similar to x9.0 and x4.1 similar to x14.1, respectively.
引用
收藏
页码:1366 / 1370
页数:5
相关论文
共 29 条
  • [1] Circuit Modeling for RRAM-Based Neuromorphic Chip Crossbar Array With and Without Write-Verify Scheme
    Tao, Tuomin
    Ma, Hanzhi
    Chen, Quankun
    Gu, Zhe-Ming
    Jin, Hang
    Ahmed, Manareldeen
    Tan, Shurun
    Wang, Aili
    Liu, En-Xiao
    Li, Er-Ping
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2021, 68 (05) : 1906 - 1916
  • [2] Two-step write-verify scheme and impact of the read noise in multilevel RRAM-based inference engine
    Shim, Wonbo
    Seo, Jae-sun
    Yu, Shimeng
    SEMICONDUCTOR SCIENCE AND TECHNOLOGY, 2020, 35 (11)
  • [3] A Parallel Multibit Programing Scheme With High Precision for RRAM-Based Neuromorphic Systems
    Chen, Junren
    Wu, Huaqiang
    Gao, Bin
    Tang, Jianshi
    Hu, Xiaobo Sharon
    Qian, He
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2020, 67 (05) : 2213 - 2217
  • [4] High-speed programming with threshold division for RRAM-based neural network accelerators
    Du, Xiangyu
    Chen, Taiping
    Su, Man
    Li, Zhen
    Tong, Peiwen
    Wang, Wei
    Cao, Rongrong
    AIP ADVANCES, 2024, 14 (12)
  • [5] Design of High-Speed Logic Circuits with Four-Step RRAM-Based Logic Gates
    Xiaole Cui
    Xiao Ma
    Qiujun Lin
    Xiang Li
    Hang Zhou
    Xiaoxin Cui
    Circuits, Systems, and Signal Processing, 2020, 39 : 2822 - 2840
  • [6] Design of High-Speed Logic Circuits with Four-Step RRAM-Based Logic Gates
    Cui, Xiaole
    Ma, Xiao
    Lin, Qiujun
    Li, Xiang
    Zhou, Hang
    Cui, Xiaoxin
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2020, 39 (06) : 2822 - 2840
  • [7] High-Speed Hardware Architecture Based on Error Detection for KECCAK
    Mestiri, Hassen
    Barraj, Imen
    MICROMACHINES, 2023, 14 (06)
  • [8] High-speed hardware accelerator based on brightness improved by Light-DehazeNet
    Teng, Peiyi
    Du, Gaoming
    Li, Zhenmin
    Wang, Xiaolei
    Yin, Yongsheng
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (03)
  • [9] A Low-Cost High-Speed Neuromorphic Hardware Based on Spiking Neural Network
    Farsa, Edris Zaman
    Ahmadi, Arash
    Maleki, Mohammad Ali
    Gholami, Morteza
    Rad, Hima Nikafshan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2019, 66 (09) : 1582 - 1586
  • [10] High-efficiency, high-speed VCSELs with 35Gbit/s error-free operation
    Chang, Y.-C.
    Wang, C. S.
    Coldren, L. A.
    ELECTRONICS LETTERS, 2007, 43 (19) : 1022 - 1024