PRIVE: Efficient RRAM Programming with Chip Verification for RRAM-based In-Memory Computing Acceleration

被引:0
|
作者
He, Wangxin [1 ]
Meng, Jian [1 ]
Gonugondla, Sujan Kumar [2 ]
Yu, Shimeng [3 ]
Shanbhag, Naresh R. [4 ]
Seo, Jae-sun [1 ]
机构
[1] Arizona State Univ, Tempe, AZ 85281 USA
[2] Amazon, New York, NY USA
[3] Georgia Inst Technol, Atlanta, GA 30332 USA
[4] Univ Illinois, Urbana, IL USA
关键词
Deep neural network; resistive RAM (RRAM); in-memory computing; RRAM programming; write-verify;
D O I
10.23919/DATE56975.2023.10137266
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As deep neural networks (DNNs) have been successfully developed in many applications with continuously increasing complexity, the number of weights in DNNs surges, leading to consistent demands for denser memories than SRAMs. RRAM-based in-memory computing (IMC) achieves high density and energy-efficiency for DNN inference, but RRAM programming remains to be a bottleneck due to high write latency and energy consumption. In this work, we present the Progressive-wRite In-memory program-VErify (PRIVE) scheme, which we verify with an RRAM testchip for IMC-based hardware acceleration for DNNs. We optimize the progressive write operations on different bit positions of RRAM weights to enable error compensation and reduce programming latency/energy, while achieving high DNN accuracy. For 5-bit precision DNNs, PRIVE reduces the RRAM programming energy by 1.82x, while maintaining high accuracy of 91.91% (VGG-7) and 71.47% (ResNet-18) on CIFAR-10 and CIFAR-100 datasets, respectively.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] RRAM-based Analog In-Memory Computing
    Chen, Xiaoming
    Song, Tao
    Han, Yinhe
    [J]. 2021 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH), 2021,
  • [2] Logic Synthesis for RRAM-Based In-Memory Computing
    Shirinzadeh, Saeideh
    Soeken, Mathias
    Gaillardon, Pierre-Emmanuel
    Drechsler, Rolf
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2018, 37 (07) : 1422 - 1435
  • [3] Sparse and Robust RRAM-based Efficient In-memory Computing for DNN Inference
    Meng, Jian
    Yeo, Injune
    Shim, Wonbo
    Yang, Li
    Fan, Deliang
    Yu, Shimeng
    Seo, Jae-Sun
    [J]. 2022 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2022,
  • [4] Sparse and Robust RRAM-based Efficient In-memory Computing for DNN Inference
    Meng, Jian
    Yeo, Injune
    Yang, Li
    Fan, Deliang
    Seo, Jae-sun
    Yu, Shimeng
    Shim, Wonbo
    [J]. 2022 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2022,
  • [5] RRAM-based Reconfigurable In-Memory Computing Architecture with Hybrid Routing
    Zha, Yue
    Li, Jing
    [J]. 2017 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN (ICCAD), 2017, : 527 - 532
  • [6] RRAM-Based In-Memory Computing for Embedded Deep Neural Networks
    Bankman, D.
    Messner, J.
    Gural, A.
    Murmann, B.
    [J]. CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 1511 - 1515
  • [7] Robust RRAM-based In-Memory Computing in Light of Model Stability
    Krishnan, Gokul
    Sun, Jingbo
    Hazra, Jubin
    Du, Xiaocong
    Liehr, Maximilian
    Li, Zheng
    Beckmann, Karsten
    Joshi, Rajiv, V
    Cady, Nathaniel C.
    Cao, Yu
    [J]. 2021 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2021,
  • [8] Error Correction Scheme for Reliable RRAM-Based In-Memory Computing
    Hu, Yixuan
    Cheng, Kaili
    Zhang, Zuodong
    Wang, Runsheng
    Wang, Yuan
    Huang, Ru
    [J]. 2021 5TH IEEE ELECTRON DEVICES TECHNOLOGY & MANUFACTURING CONFERENCE (EDTM), 2021,
  • [9] RVComp: Analog Variation Compensation for RRAM-based In-Memory Computing
    He, Jingyu
    Lastras, Miguel
    Ye, Terry Tao
    Tsui, Chi-Ying
    Cheng, Kwang-Ting
    [J]. 2023 28TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC, 2023, : 246 - 251
  • [10] Improving the accuracy and robustness of RRAM-based in-memory computing against RRAM hardware noise and adversarial attacks
    Cherupally, Sai Kiran
    Meng, Jian
    Rakin, Adnan Siraj
    Yin, Shihui
    Yeo, Injune
    Yu, Shimeng
    Fan, Deliang
    Seo, Jae-Sun
    [J]. SEMICONDUCTOR SCIENCE AND TECHNOLOGY, 2022, 37 (03)