High-speed programming with threshold division for RRAM-based neural network accelerators

被引:0
|
作者
Du, Xiangyu [1 ]
Chen, Taiping [1 ]
Su, Man [2 ]
Li, Zhen [1 ]
Tong, Peiwen [1 ]
Wang, Wei [1 ]
Cao, Rongrong [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha 410073, Peoples R China
[2] Beijing Inst Tracking & Telecommun Technol, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
WRITE-VERIFY; PRECISION;
D O I
10.1063/5.0243471
中图分类号
TB3 [工程材料学];
学科分类号
0805 ; 080502 ;
摘要
RRAM-based neural network accelerators offer significant improvements in energy efficiency and throughput for machine learning and artificial intelligence. However, it is challenging to transfer trained neural network weights to RRAM arrays precisely due to non-ideal characteristics such as read noise and write variability. A write-verify strategy is commonly employed to adjust the RRAM cells within acceptable error margins. However, this process is time-consuming and resource-intensive. In this work, a high-speed programming strategy based on threshold division is proposed, inspired by magnitude-based network pruning. The relationship between threshold conductance and programming error is systematically investigated by allowing a larger programming error for cells below the threshold. Results of experiments on MLP and LeNet-5 networks demonstrate that the programming speed is enhanced by 3.41 times and 2.39 times, respectively. This strategy provides a novel method for fast transfer of weights in large-scale RRAM-based neural network accelerators.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] A RRAM-based Coarse Grain Reconfigurable Array for Neural Network Accelerators
    Chen, Zhengyu
    Zhou, Hai
    Gu, Jie
    2018 IEEE SOI-3D-SUBTHRESHOLD MICROELECTRONICS TECHNOLOGY UNIFIED CONFERENCE (S3S), 2018,
  • [2] NAS4RRAM: neural network architecture search for inference on RRAM-based accelerators
    Zhihang Yuan
    Jingze Liu
    Xingchen Li
    Longhao Yan
    Haoxiang Chen
    Bingzhe Wu
    Yuchao Yang
    Guangyu Sun
    Science China Information Sciences, 2021, 64
  • [3] NAS4RRAM: neural network architecture search for inference on RRAM-based accelerators
    Zhihang YUAN
    Jingze LIU
    Xingchen LI
    Longhao YAN
    Haoxiang CHEN
    Bingzhe WU
    Yuchao YANG
    Guangyu SUN
    Science China(Information Sciences), 2021, 64 (06) : 89 - 99
  • [4] NAS4RRAM: neural network architecture search for inference on RRAM-based accelerators
    Yuan, Zhihang
    Liu, Jingze
    Li, Xingchen
    Yan, Longhao
    Chen, Haoxiang
    Wu, Bingzhe
    Yang, Yuchao
    Sun, Guangyu
    SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (06)
  • [5] An RRAM-Based Oscillatory Neural Network
    Jackson, Thomas C.
    Sharma, Abhishek A.
    Bain, James A.
    Weldon, Jeffrey A.
    Pileggi, Lawrence
    2015 IEEE 6TH LATIN AMERICAN SYMPOSIUM ON CIRCUITS & SYSTEMS (LASCAS), 2015,
  • [6] WRAP: Weight RemApping and Processing in RRAM-based Neural Network Accelerators Considering Thermal Effect
    Chen, Po-Yuan
    Gu, Fang-Yi
    Huang, Yu-Hong
    Lin, Ing-Chao
    PROCEEDINGS OF THE 2022 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2022), 2022, : 1245 - 1250
  • [7] Drop-Connect as a Fault-Tolerance Approach for RRAM-based Deep Neural Network Accelerators
    Xiang, Mingyuan
    Xie, Xuhan
    Savarese, Pedro
    Yuan, Xin
    Maire, Michael
    Li, Yanjing
    2024 IEEE 42ND VLSI TEST SYMPOSIUM, VTS 2024, 2024,
  • [8] BRAHMS: Beyond Conventional RRAM-based Neural Network Accelerators Using Hybrid Analog Memory System
    Song, Tao
    Chen, Xiaoming
    Zhang, Xiaoyu
    Han, Yinhe
    2021 58TH ACM/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2021, : 1033 - 1038
  • [9] Energy-efficient analog-domain aggregator circuit for RRAM-based neural network accelerators
    Humood, Khaled
    Pan, Yihan
    Wang, Shiwei
    Serb, Alexander
    Prodromakis, Themis
    FRONTIERS IN ELECTRONICS, 2025, 6
  • [10] Mitigating read-program variation and IR drop by circuit architecture in RRAM-based neural network accelerators
    Lepri, Nicola
    Glukhov, Artem
    Ielmini, Daniele
    2022 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2022,