PRIVE: Efficient RRAM Programming with Chip Verification for RRAM-based In-Memory Computing Acceleration

被引:0
|
作者
He, Wangxin [1 ]
Meng, Jian [1 ]
Gonugondla, Sujan Kumar [2 ]
Yu, Shimeng [3 ]
Shanbhag, Naresh R. [4 ]
Seo, Jae-sun [1 ]
机构
[1] Arizona State Univ, Tempe, AZ 85281 USA
[2] Amazon, New York, NY USA
[3] Georgia Inst Technol, Atlanta, GA 30332 USA
[4] Univ Illinois, Urbana, IL USA
关键词
Deep neural network; resistive RAM (RRAM); in-memory computing; RRAM programming; write-verify;
D O I
10.23919/DATE56975.2023.10137266
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As deep neural networks (DNNs) have been successfully developed in many applications with continuously increasing complexity, the number of weights in DNNs surges, leading to consistent demands for denser memories than SRAMs. RRAM-based in-memory computing (IMC) achieves high density and energy-efficiency for DNN inference, but RRAM programming remains to be a bottleneck due to high write latency and energy consumption. In this work, we present the Progressive-wRite In-memory program-VErify (PRIVE) scheme, which we verify with an RRAM testchip for IMC-based hardware acceleration for DNNs. We optimize the progressive write operations on different bit positions of RRAM weights to enable error compensation and reduce programming latency/energy, while achieving high DNN accuracy. For 5-bit precision DNNs, PRIVE reduces the RRAM programming energy by 1.82x, while maintaining high accuracy of 91.91% (VGG-7) and 71.47% (ResNet-18) on CIFAR-10 and CIFAR-100 datasets, respectively.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Experimental Assessment of Multilevel RRAM-Based Vector-Matrix Multiplication Operations for In-Memory Computing
    Quesada, Emilio Perez-Bosch
    Mahadevaiah, Mamathamba Kalishettyhalli
    Rizzi, Tommaso
    Wen, Jianan
    Ulbricht, Markus
    Krstic, Milos
    Wenger, Christian
    Perez, Eduardo
    [J]. IEEE TRANSACTIONS ON ELECTRON DEVICES, 2023, 70 (04) : 2009 - 2014
  • [22] Characterization and Mitigation of IR-Drop in RRAM-based Compute In-Memory
    Crafton, Brian
    Talley, Connor
    Spetalnick, Samuel
    Yoon, Jong-Hyeok
    Raychowdhury, Arijit
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 70 - 74
  • [23] A RRAM-based FPGA for Energy-efficient Edge Computing
    Tang, Xifan
    Giacomin, Edouard
    Cadareanu, Patsy
    Gore, Ganesh
    Gaillardon, Pierre-Emmanuel
    [J]. PROCEEDINGS OF THE 2020 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2020), 2020,
  • [24] MINT: Mixed-precision RRAM-based IN-memory Training Architecture
    Jiang, Hongwu
    Huang, Shanshi
    Peng, Xiaochen
    Yu, Shimeng
    [J]. 2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [25] RRAM-Based Analog Approximate Computing
    Li, Boxun
    Gu, Peng
    Shan, Yi
    Wang, Yu
    Chen, Yiran
    Yang, Huazhong
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2015, 34 (12) : 1905 - 1917
  • [26] A RRAM-based Associative Memory Cell
    Pan, Yihan
    Foster, Patrick
    Serb, Alex
    Prodromakis, Themis
    [J]. 2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2021,
  • [27] RRAM-based Neuromorphic Computing: Data Representation, Architecture, Logic, and Programming
    Li Zhang, Grace
    Zhang, Shuhang
    Li, Hai
    Schlichtmann, Ulf
    [J]. 2022 25TH EUROMICRO CONFERENCE ON DIGITAL SYSTEM DESIGN (DSD), 2022, : 423 - 428
  • [28] 2-Bit-Per-Cell RRAM-Based In-Memory Computing for Area-/Energy-Efficient Deep Learning
    He, Wangxin
    Yin, Shihui
    Kim, Yulhwa
    Sun, Xiaoyu
    Kim, Jae-Joon
    Yu, Shimeng
    Seo, Jae-Sun
    [J]. IEEE SOLID-STATE CIRCUITS LETTERS, 2020, 3 : 194 - 197
  • [29] Distributed In-Memory Computing on Binary RRAM Crossbar
    Ni, Leibin
    Huang, Hantao
    Liu, Zichuan
    Joshi, Rajiv V.
    Yu, Hao
    [J]. ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2017, 13 (03)
  • [30] Scalable RRAM Based in-memory Computing Design for Embedded AI
    Lu, Wei D.
    [J]. 2021 INTERNATIONAL SYMPOSIUM ON VLSI DESIGN, AUTOMATION AND TEST (VLSI-DAT), 2021,