Reliability Improvement in RRAM-based DNN for Edge Computing

被引:2
|
作者
Oli-Uz-Zaman, Md [1 ]
Khan, Saleh Ahmad [1 ]
Yuan, Geng [2 ]
Wang, Yanzhi [2 ]
Liao, Zhiheng [3 ]
Fu, Jingyan [3 ]
Ding, Caiwen [4 ]
Wang, Jinhui [1 ]
机构
[1] Univ S Alabama, Elect & Comp Engn, Mobile, AL 36688 USA
[2] Northeastern Univ, Elect & Comp Engn, Boston, MA 02115 USA
[3] North Dakota State Univ, Elect & Comp Engn, Fargo, ND USA
[4] Univ Connecticut, Comp Sci & Engn, Storrs, CT USA
基金
美国国家科学基金会;
关键词
resistive random access memory (RRAM); deep neural network (DNN); edge computing stuck at fault (SAF); differential mapping method; power; latency;
D O I
10.1109/ISCAS48785.2022.9937260
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, the Resistive Random Access Memory (RRAM) has been paid more attention for edge computing applications in both academia and industry, because it offers power efficiency and low latency to perform the complex analog in-situ matrix-vector multiplication the most fundamental operation of Deep Neural Networks (DNNs). But the Stuck at Fault (SAF) defect makes the RRAM unreliable for the practical implementation. A differential mapping method (DMM) is proposed in this paper to improve reliability by mitigate SAF defects from RRAM-based DNNs. Firstly, the weight distribution for the VGG8 model with the CIFAR10 dataset is presented and analyzed. Then the DMM is used for recovering the inference accuracies at 0.1% to 50% SAFs. The experiment results show that the DMM can recover DNNs to their original inference accuracies (90%), when the ratio of SAFs is smaller than 7.5%. And even when the SAF is in the extreme condition 50%, it is still highly efficient to recover the inference accuracy to 80%. What is more, the DMM is a highly reliable regulator to avoid power and timing overhead generated by SAFs.
引用
收藏
页码:581 / 585
页数:5
相关论文
共 50 条
  • [1] Sparse and Robust RRAM-based Efficient In-memory Computing for DNN Inference
    Meng, Jian
    Yeo, Injune
    Shim, Wonbo
    Yang, Li
    Fan, Deliang
    Yu, Shimeng
    Seo, Jae-Sun
    2022 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2022,
  • [2] A RRAM-based FPGA for Energy-efficient Edge Computing
    Tang, Xifan
    Giacomin, Edouard
    Cadareanu, Patsy
    Gore, Ganesh
    Gaillardon, Pierre-Emmanuel
    PROCEEDINGS OF THE 2020 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2020), 2020,
  • [3] Temperature-Resilient RRAM-Based In-Memory Computing for DNN Inference
    Meng, Jian
    Shim, Wonbo
    Yang, Li
    Yeo, Injune
    Fan, Deliang
    Yu, Shimeng
    Seo, Jae-sun
    IEEE MICRO, 2022, 42 (01) : 89 - 98
  • [4] Sparse and Robust RRAM-based Efficient In-memory Computing for DNN Inference
    Meng, Jian
    Yeo, Injune
    Yang, Li
    Fan, Deliang
    Seo, Jae-sun
    Yu, Shimeng
    Shim, Wonbo
    2022 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2022,
  • [5] RRAM-Based STDP Network for Edge Computing in Wearable/Implantable Devices
    Shen, Yukai
    Wang, Shiwei
    Lopez, Carolina Mora
    18TH INTERNATIONAL SOC DESIGN CONFERENCE 2021 (ISOCC 2021), 2021, : 274 - 275
  • [6] On the Reliability of RRAM-Based Neural Networks
    Aziza, Hassen
    Zambelli, Cristian
    Hamdioui, Said
    Diware, Sumit
    Bishnoi, Rajendra
    Gebregiorgis, Anteneh
    2023 IFIP/IEEE 31ST INTERNATIONAL CONFERENCE ON VERY LARGE SCALE INTEGRATION, VLSI-SOC, 2023, : 13 - 20
  • [7] RRAM-Based Analog Approximate Computing
    Li, Boxun
    Gu, Peng
    Shan, Yi
    Wang, Yu
    Chen, Yiran
    Yang, Huazhong
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2015, 34 (12) : 1905 - 1917
  • [8] RRAM-based Analog In-Memory Computing
    Chen, Xiaoming
    Song, Tao
    Han, Yinhe
    2021 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH), 2021,
  • [9] A Coordinated Model Pruning and Mapping Framework for RRAM-Based DNN Accelerators
    Qu, Songyun
    Li, Bing
    Zhao, Shixin
    Zhang, Lei
    Wang, Ying
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2023, 42 (07) : 2364 - 2376
  • [10] RRAM-Based Neuromorphic Hardware Reliability Improvement by Self-Healing and Error Correction
    Hu, Jia-Yun
    Hou, Kuan-Wei
    Lo, Chih-Yen
    Chou, Yung-Fa
    Wu, Cheng-Wen
    2018 IEEE INTERNATIONAL TEST CONFERENCE IN ASIA (ITC-ASIA 2018), 2018, : 19 - 24