PRIVE: Efficient RRAM Programming with Chip Verification for RRAM-based In-Memory Computing Acceleration

被引:0
|
作者
He, Wangxin [1 ]
Meng, Jian [1 ]
Gonugondla, Sujan Kumar [2 ]
Yu, Shimeng [3 ]
Shanbhag, Naresh R. [4 ]
Seo, Jae-sun [1 ]
机构
[1] Arizona State Univ, Tempe, AZ 85281 USA
[2] Amazon, New York, NY USA
[3] Georgia Inst Technol, Atlanta, GA 30332 USA
[4] Univ Illinois, Urbana, IL USA
关键词
Deep neural network; resistive RAM (RRAM); in-memory computing; RRAM programming; write-verify;
D O I
10.23919/DATE56975.2023.10137266
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As deep neural networks (DNNs) have been successfully developed in many applications with continuously increasing complexity, the number of weights in DNNs surges, leading to consistent demands for denser memories than SRAMs. RRAM-based in-memory computing (IMC) achieves high density and energy-efficiency for DNN inference, but RRAM programming remains to be a bottleneck due to high write latency and energy consumption. In this work, we present the Progressive-wRite In-memory program-VErify (PRIVE) scheme, which we verify with an RRAM testchip for IMC-based hardware acceleration for DNNs. We optimize the progressive write operations on different bit positions of RRAM weights to enable error compensation and reduce programming latency/energy, while achieving high DNN accuracy. For 5-bit precision DNNs, PRIVE reduces the RRAM programming energy by 1.82x, while maintaining high accuracy of 91.91% (VGG-7) and 71.47% (ResNet-18) on CIFAR-10 and CIFAR-100 datasets, respectively.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Rescuing RRAM-Based Computing From Static and Dynamic Faults
    Lin, Jilan
    Wen, Cheng-Da
    Hu, Xing
    Tang, Tianqi
    Lin, Ing-Chao
    Wang, Yu
    Xie, Yuan
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2021, 40 (10) : 2049 - 2062
  • [42] Fault Modeling and Testing of RRAM-based Computing-In Memories
    Yang, Yu Cheng
    Li, Jin-Fu
    [J]. 2022 IEEE INTERNATIONAL TEST CONFERENCE IN ASIA (ITC-ASIA 2022), 2022, : 7 - 12
  • [43] Monolithically Integrated RRAM- and CMOS-Based In-Memory Computing Optimizations for Efficient Deep Learning
    Yin, Shihui
    Kim, Yulhwa
    Han, Xu
    Barnaby, Hugh
    Yu, Shimeng
    Luo, Yandong
    He, Wangxin
    Sun, Xiaoyu
    Kim, Jae-Joon
    Seo, Jae-sun
    [J]. IEEE MICRO, 2019, 39 (06) : 54 - 63
  • [44] One-Transistor-Multiple-RRAM Cells for Energy-Efficient In-Memory Computing
    Uhlmann, Max
    Quesada, Emilio Perez-Bosch
    Fritscher, Markus
    Perez, Eduardo
    Schubert, Markus Andreas
    Reichenbach, Marc
    Ostrovskyy, Philip
    Wenger, Christian
    Kahmen, Gerhard
    [J]. 2023 21ST IEEE INTERREGIONAL NEWCAS CONFERENCE, NEWCAS, 2023,
  • [45] An ADC-Less RRAM-Based Computing-in-Memory Macro With Binary CNN for Efficient Edge AI
    Li, Yi
    Chen, Jia
    Wang, Linfang
    Zhang, Woyu
    Guo, Zeyu
    Wang, Jun
    Han, Yongkang
    Li, Zhi
    Wang, Fei
    Dou, Chunmeng
    Xu, Xiaoxin
    Yang, Jianguo
    Wang, Zhongrui
    Shang, Dashan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (06) : 1871 - 1875
  • [46] 2T2R RRAM-Based In-Memory Hyperdimensional Computing Encoder for Spatio-Temporal Signal Processing
    Li, Zhi
    Bao, Rui
    Zhang, Woyu
    Wang, Fei
    Wang, Jun
    Fang, Renrui
    Ren, Haoxiong
    Lin, Ning
    Yue, Jinshan
    Dou, Chunmeng
    Wang, Zhongrui
    Shang, Dashan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (05) : 2614 - 2618
  • [47] An RRAM-Based Computing-in-Memory Architecture and Its Application in Accelerating Transformer Inference
    Lu, Zhaojun
    Wang, Xueyan
    Arafin, Md Tanvir
    Yang, Haoxiang
    Liu, Zhenglin
    Zhang, Jiliang
    Qu, Gang
    [J]. IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2024, 32 (03) : 485 - 496
  • [48] Fused RRAM-Based Shift-Add Architecture for Efficient Hyperdimensional Computing Paradigm
    Halawani, Yasmin
    Hassan, Eman
    Mohammad, Baker
    Saleh, Hani
    [J]. 2021 IEEE INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2021, : 179 - 182
  • [49] Exploring the Precision Limitation for RRAM-Based Analog Approximate Computing
    Li, Boxun
    Gu, Peng
    Wang, Yu
    Yang, Huazhong
    [J]. IEEE DESIGN & TEST, 2016, 33 (01) : 52 - 59
  • [50] SIMPLY: Design of a RRAM-Based Smart Logic-in-Memory Architecture using RRAM Compact Model
    Puglisi, Francesco Maria
    Zanotti, Tommaso
    Pavan, Paolo
    [J]. 49TH EUROPEAN SOLID-STATE DEVICE RESEARCH CONFERENCE (ESSDERC 2019), 2019, : 130 - 133