High-speed programming with threshold division for RRAM-based neural network accelerators

被引:0
|
作者
Du, Xiangyu [1 ]
Chen, Taiping [1 ]
Su, Man [2 ]
Li, Zhen [1 ]
Tong, Peiwen [1 ]
Wang, Wei [1 ]
Cao, Rongrong [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha 410073, Peoples R China
[2] Beijing Inst Tracking & Telecommun Technol, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
WRITE-VERIFY; PRECISION;
D O I
10.1063/5.0243471
中图分类号
TB3 [工程材料学];
学科分类号
0805 ; 080502 ;
摘要
RRAM-based neural network accelerators offer significant improvements in energy efficiency and throughput for machine learning and artificial intelligence. However, it is challenging to transfer trained neural network weights to RRAM arrays precisely due to non-ideal characteristics such as read noise and write variability. A write-verify strategy is commonly employed to adjust the RRAM cells within acceptable error margins. However, this process is time-consuming and resource-intensive. In this work, a high-speed programming strategy based on threshold division is proposed, inspired by magnitude-based network pruning. The relationship between threshold conductance and programming error is systematically investigated by allowing a larger programming error for cells below the threshold. Results of experiments on MLP and LeNet-5 networks demonstrate that the programming speed is enhanced by 3.41 times and 2.39 times, respectively. This strategy provides a novel method for fast transfer of weights in large-scale RRAM-based neural network accelerators.
引用
收藏
页数:7
相关论文
共 50 条
  • [21] Switched by Input: Power Efficient Structure for RRAM-based Convolutional Neural Network
    Xia, Lixue
    Tang, Tianqi
    Huangfu, Wenqin
    Cheng, Ming
    Yin, Xiling
    Li, Boxun
    Wang, Yu
    Yang, Huazhong
    2016 ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2016,
  • [22] A Coordinated Model Pruning and Mapping Framework for RRAM-Based DNN Accelerators
    Qu, Songyun
    Li, Bing
    Zhao, Shixin
    Zhang, Lei
    Wang, Ying
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2023, 42 (07) : 2364 - 2376
  • [23] Write or Not: Programming Scheme Optimization for RRAM-based Neuromorphic Computing
    Meng, Ziqi
    Sun, Yanan
    Qian, Weikang
    PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 985 - 990
  • [24] High-speed photopolarimeter based on a linear neural network
    Department of Automatic Measurement and Control, Harbin Institute of Technology, Harbin 150001, China
    不详
    Guangxue Jingmi Gongcheng, 2006, 5 (781-785):
  • [25] An Improved RRAM-Based Binarized Neural Network With High Variation-Tolerated Forward/Backward Propagation Module
    Zhang, Yizhou
    Zhou, Zheng
    Huang, Peng
    Fan, Mengqi
    Han, Runze
    Shen, Wensheng
    Liu, Lifeng
    Liu, Xiaoyan
    Gao, Bin
    Wu, Huaqiang
    Qian, He
    Kang, Jinfeng
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2020, 67 (02) : 469 - 473
  • [26] A High-Speed and High-Efficiency Diverse Error Margin Write-Verify Scheme for an RRAM-Based Neuromorphic Hardware Accelerator
    Lin, Yudeng
    Tang, Jianshi
    Gao, Bin
    Qin, Qi
    Zhang, Qingtian
    Qian, He
    Wu, Huaqiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (04) : 1366 - 1370
  • [27] Network processor for high-speed network and quick programming
    Murooka, Takahiro
    Nagoya, Akira
    Miyazaki, Toshiaki
    Ochi, Hiroyuki
    Nakamura, Yukihiro
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2007, 16 (01) : 65 - 79
  • [28] PRIVE: Efficient RRAM Programming with Chip Verification for RRAM-based In-Memory Computing Acceleration
    He, Wangxin
    Meng, Jian
    Gonugondla, Sujan Kumar
    Yu, Shimeng
    Shanbhag, Naresh R.
    Seo, Jae-sun
    2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,
  • [29] HIGH-SPEED OPTOELECTRONIC NEURAL NETWORK
    BARNES, NM
    HEALEY, P
    MCKEE, P
    ONEILL, AW
    REJMANGREENE, MAZ
    SCOTT, EG
    WEBB, RP
    WOOD, D
    ELECTRONICS LETTERS, 1990, 26 (15) : 1110 - 1112
  • [30] Challenges and Opportunities toward Online Training Acceleration using RRAM-based Hardware Neural Network
    Chang, Chih-Cheng
    Liu, Jen-Chieh
    Shen, Yu-Lin
    Chou, Teyuh
    Chen, Pin-Chun
    Wang, I-Ting
    Su, Chih-Chun
    Wu, Ming-Hong
    Hudec, Boris
    Chang, Che-Chia
    Tsai, Chia-Ming
    Chang, Tian-Sheuan
    Wong, H-S Philip
    Hou, Tuo-Hung
    2017 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2017,