FARe: Fault-Aware GNN Training on ReRAM-based PIM Accelerators

被引:0
|
作者
Dhingra, Pratyush [1 ]
Ogbogu, Chukwufumnanya [1 ]
Joardar, Biresh Kumar [2 ]
Doppa, Janardhan Rao [1 ]
Kalyanaraman, Ananth [1 ]
Pande, Partha Pratim [1 ]
机构
[1] Washington State Univ, Pullman, WA 99164 USA
[2] Univ Houston, Houston, TX USA
基金
美国国家科学基金会;
关键词
ReRAM; PIM; Fault-Tolerant Training; GNNs;
D O I
10.23919/DATE58400.2024.10546762
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Resistive random-access memory (ReRAM)based processing-in-memory (PIM) architecture is an attractive solution for training Graph Neural Networks (GNNs) on edge platforms. However, the immature fabrication process and limited write endurance of ReRAMs make them prone to hardware faults, thereby limiting their widespread adoption for GNN training. Further, the existing fault-tolerant solutions prove inadequate for effectively training GNNs in the presence of faults. In this paper, we propose a fault-aware framework referred to as FARe that mitigates the effect of faults during GNN training. FARe outperforms existing approaches in terms of both accuracy and timing overhead. Experimental results demonstrate that FARe framework can restore GNN test accuracy by 47.6% on faulty ReRAM hardware with a similar to 1% timing overhead compared to the fault-free counterpart.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] HitM: High-Throughput ReRAM-based PIM for Multi-Modal Neural Networks
    Li, Bing
    Wang, Ying
    Chen, Yiran
    2020 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED-DESIGN (ICCAD), 2020,
  • [32] Re2fresh: A Framework for Mitigating Read Disturbance in ReRAM-based DNN Accelerators
    Shin, Hyein
    Kang, Myeonggu
    Kim, Lee-Sup
    2022 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2022,
  • [33] A Quantized Training Method to Enhance Accuracy of ReRAM-based Neuromorphic Systems
    Yang, Qing
    Li, Hai
    Wu, Qing
    2018 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2018,
  • [34] DL-RSIM: A Reliability and Deployment Strategy Simulation Framework for ReRAM-based CNN Accelerators
    Lin, Wei-Ting
    Cheng, Hsiang-Yun
    Yang, Chia-Lin
    Lin, Meng-Yao
    Lien, Kai
    Hu, Han-Wen
    Chang, Hung-Sheng
    Li, Hsiang-Pang
    Chang, Meng-Fan
    Tsou, Yen-Ting
    Nien, Chin-Fu
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2022, 21 (03)
  • [35] Runtime Row/Column Activation Pruning for ReRAM-based Processing-in-Memory DNN Accelerators
    Jiang, Xikun
    Shen, Zhaoyan
    Sun, Siqing
    Yin, Ping
    Jia, Zhiping
    Ju, Lei
    Zhang, Zhiyong
    Yu, Dongxiao
    2023 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2023,
  • [36] DL-RSIM: A Simulation Framework to Enable Reliable ReRAM-based Accelerators for Deep Learning
    Lin, Meng-Yao
    Cheng, Hsiang-Yun
    Lin, Wei-Ting
    Yang, Tzu-Hsien
    Tseng, I-Ching
    Yang, Chia-Lin
    Hu, Han-Wen
    Chang, Hung-Sheng
    Li, Hsiang-Pang
    Chang, Meng-Fan
    2018 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN (ICCAD) DIGEST OF TECHNICAL PAPERS, 2018,
  • [37] REC: REtime Convolutional Layers to Fully Exploit Harvested Energy for ReRAM-based CNN Accelerators
    Zhou, Kunyu
    Qiu, Keni
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2024, 23 (06) : 33 - 33
  • [38] Model Inference Optimization on ReRAM-Based Accelerators with Intra- and Inter-OU Similarity
    Li, Tao
    Zhao, Qinghang
    2024 INTERNATIONAL SYMPOSIUM OF ELECTRONICS DESIGN AUTOMATION, ISEDA 2024, 2024, : 666 - 671
  • [39] MaxTracker: Continuously Tracking the Maximum Computation Progress for Energy Harvesting ReRAM-based CNN Accelerators
    Qiu, Keni
    Jao, Nicholas
    Zhou, Kunyu
    Liu, Yongpan
    Sampson, Jack
    Kandemir, Mahmut Taylan
    Narayanan, Vijaykrishnan
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2021, 20 (05)
  • [40] A Framework for Area-efficient Multi-task BERT Execution on ReRAM-based Accelerators
    Kang, Myeonggu
    Shin, Hyein
    Shin, Jaekang
    Kim, Lee-Sup
    2021 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN (ICCAD), 2021,