Accelerating Graph Neural Network Training on ReRAM-Based PIM Architectures via Graph and Model Pruning

被引:5
|
作者
Ogbogu, Chukwufumnanya O. [1 ]
Arka, Aqeeb Iqbal [1 ]
Pfromm, Lukas [2 ]
Joardar, Biresh Kumar [3 ]
Doppa, Janardhan Rao [1 ]
Chakrabarty, Krishnendu [4 ]
Pande, Partha Pratim [1 ]
机构
[1] Washington State Univ, Sch Elect Engn & Comp Sci, Pullman, WA 99164 USA
[2] Oregon State Univ, Dept Elect & Comp Engn, Corvallis, OR 97331 USA
[3] Univ Houston, Dept Elect & Comp Engn, Houston, TX 77004 USA
[4] Duke Univ, Dept Elect & Comp Engn, Durham, NC 27708 USA
基金
美国国家科学基金会;
关键词
Data compression; graph neural network (GNN); PIM; pruning; resistive random-access memory (ReRAM);
D O I
10.1109/TCAD.2022.3227879
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Graph neural networks (GNNs) are used for predictive analytics on graph-structured data, and they have become very popular in diverse real-world applications. Resistive random-access memory (ReRAM)-based PIM architectures can accelerate GNN training. However, GNN training on ReRAMbased architectures is both compute- and data intensive in nature. In this work, we propose a framework called SlimGNN that synergistically combines both graph and model pruning to accelerate GNN training on ReRAM-based architectures. The proposed framework reduces the amount of redundant information in both the GNN model and input graph(s) to streamline the overall training process. This enables fast and energy-efficient GNN training on ReRAM-based architectures. Experimental results demonstrate that using this framework, we can accelerate GNN training by up to 4.5x while using 6.6x less energy compared to the unpruned counterparts.
引用
收藏
页码:2703 / 2716
页数:14
相关论文
共 50 条
  • [31] Accelerating Large-Scale Graph Neural Network Training on Crossbar Diet
    Ogbogu, Chukwufumnanya
    Arka, Aqeeb Iqbal
    Joardar, Biresh Kumar
    Doppa, Janardhan Rao
    Li, Hai
    Chakrabarty, Krishnendu
    Pande, Partha Pratim
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (11) : 3626 - 3637
  • [32] One-Shot Neural Network Pruning via Spectral Graph Sparsification
    Laenen, Steinar
    TOPOLOGICAL, ALGEBRAIC AND GEOMETRIC LEARNING WORKSHOPS 2023, VOL 221, 2023, 221
  • [33] One-Shot Neural Network Pruning via Spectral Graph Sparsification
    Laenen, Steinar
    Proceedings of Machine Learning Research, 2023, 221 : 60 - 71
  • [34] Accelerating Graph Computations on 3D NoC-Enabled PIM Architectures
    Choudhury, Dwaipayan
    Xiang, Lizhi
    Rajam, Aravind
    Kalyanaraman, Anantharaman
    Pande, Partha Pratim
    ACM TRANSACTIONS ON DESIGN AUTOMATION OF ELECTRONIC SYSTEMS, 2023, 28 (03)
  • [35] Survey on Graph Neural Network Acceleration Architectures
    Li H.
    Yan M.
    Lü Z.
    Li W.
    Ye X.
    Fan D.
    Tang Z.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (06): : 1204 - 1229
  • [36] A Cascaded ReRAM-based Crossbar Architecture for Transformer Neural Network Acceleration
    Xu, Jiahong
    Liu, Haikun
    Peng, Xiaoyang
    Duan, Zhuohui
    Liao, Xiaofei
    Jin, Hai
    ACM Transactions on Design Automation of Electronic Systems, 2024, 30 (01)
  • [37] ReaDy: A ReRAM-Based Processing-in-Memory Accelerator for Dynamic Graph Convolutional Networks
    Huang, Yu
    Zheng, Long
    Yao, Pengcheng
    Wang, Qinggang
    Liu, Haifeng
    Liao, Xiaofei
    Jin, Hai
    Xue, Jingling
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (11) : 3567 - 3578
  • [38] HitM: High-Throughput ReRAM-based PIM for Multi-Modal Neural Networks
    Li, Bing
    Wang, Ying
    Chen, Yiran
    2020 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED-DESIGN (ICCAD), 2020,
  • [39] GraphRSim: A Joint Device-Algorithm Reliability Analysis for ReRAM-based Graph Processing
    Nien, Chin-Fu
    Hsiao, Yi-Jou
    Cheng, Hsiang-Yun
    Wen, Cheng-Yu
    Ko, Ya-Cheng
    Lin, Che-Ching
    PROCEEDINGS OF THE 2020 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2020), 2020, : 1478 - 1483
  • [40] Spara: An Energy-Efficient ReRAM-Based Accelerator for Sparse Graph Analytics Applications
    Zheng, Long
    Zhao, Jieshan
    Huang, Yu
    Wang, Qinggang
    Zeng, Zhen
    Xue, Jingling
    Liao, Xiaofei
    Jin, Hai
    2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM IPDPS 2020, 2020, : 696 - 707