FP-GNN: Adaptive FPGA accelerator for Graph Neural Networks

被引:13
|
作者
Tian, Teng [1 ,2 ]
Zhao, Letian [1 ,2 ]
Wang, Xiaotian [1 ,2 ]
Wu, Qizhe [1 ,2 ]
Yuan, Wei [1 ,2 ]
Jin, Xi [1 ,2 ]
机构
[1] Univ Sci & Technol China, State Key Lab Particle Detect & Elect, Hefei 230026, Peoples R China
[2] Univ Sci & Technol China, Inst Microelect, Dept Phys, Hefei 230026, Peoples R China
关键词
Graph neural network; FPGA accelerator; Graph partition; Algorithm -hardware co -design; Performance efficiency; Energy efficiency;
D O I
10.1016/j.future.2022.06.010
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Graph Neural Networks (GNNs) exhibit great success in graph data analysis and promote the evolution of artificial intelligence. The computing procedure of GNNs can be categorized into two phases: Aggregation and Combination, which have irregular and regular computing characteristics respectively. In this work, we present an adaptive FPGA accelerator, FP-GNN, to enable flexible and efficient GNN acceleration. First, this paper presents quantitative analysis of the impact on performance when changing the order of Aggregation and Combination. Then we propose an Adaptive GNN Accelerator framework (AGA) that adopts a unified processing module to support these two phases simultaneously, and an Adaptive Graph Partition strategy (AGP) to alleviate memory bottleneck and eliminate graph repartition overhead between GNN layers. In addition, we also propose multiple workflow optimizations for both Aggregation and Combination phases to achieve workload balance and feature sparsity elimination. Finally, we implement the FP-GNN on a Xilinx VCU128 FPGA, and conduct comprehensive experiments on various GNN configurations and platforms. Results show that FP-GNN achieves on average 665x speedup with 3180x energy efficiency and average 24.9x speedup with 138x energy efficiency compared to CPU and GPU, respectively, and also achieves state-of-the-art performance efficiency and energy efficiency compared to prior works. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:294 / 310
页数:17
相关论文
共 50 条
  • [41] A-GNN: Anchors-Aware Graph Neural Networks for Node Embedding
    Liu, Chao
    Li, Xinchuan
    Zhao, Dongyang
    Guo, Shaolong
    Kang, Xiaojun
    Dong, Lijun
    Yao, Hong
    QUALITY, RELIABILITY, SECURITY AND ROBUSTNESS IN HETEROGENEOUS SYSTEMS, 2020, 300 : 141 - 153
  • [42] Imbalance Node Classification with Graph Neural Networks (GNN): A Study on a Twitter Dataset
    Kika, Alda
    Ceni, Arber
    Collaku, Denada
    Loka, Emiranda
    Bozo, Ledia
    Hoxha, Klesti
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (11) : 1374 - 1379
  • [43] EEG-GNN: Graph Neural Networks for Classification of Electroencephalogram (EEG) Signals
    Demir, Andac
    Koike-Akino, Toshiaki
    Wang, Ye
    Haruna, Masaki
    Erdogmus, Deniz
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 1061 - 1067
  • [44] Sketch-GNN: Scalable Graph Neural Networks with Sublinear Training Complexity
    Ding, Mucong
    Rabbani, Tahseen
    An, Bang
    Wang, Evan Z.
    Huang, Furong
    Advances in Neural Information Processing Systems, 2022, 35
  • [45] GNN-SubNet: disease subnetwork detection with explainable graph neural networks
    Pfeifer, Bastian
    Saranti, Anna
    Holzinger, Andreas
    BIOINFORMATICS, 2022, 38 : ii120 - ii126
  • [46] GNN-MgrPool: Enhanced graph neural networks with multi-granularity pooling for graph classification
    Sun, Haichao
    Wang, Guoyin
    Liu, Qun
    Guo, Yike
    INFORMATION SCIENCES, 2024, 680
  • [47] ReGNN: A Redundancy-Eliminated Graph Neural Networks Accelerator
    Chen, Cen
    Li, Kenli
    Li, Yangfan
    Zou, Xiaofeng
    2022 IEEE INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE COMPUTER ARCHITECTURE (HPCA 2022), 2022, : 429 - 443
  • [48] A FPGA-HBM-based Hardware Streaming Accelerator for GNN Sampling
    Gui, Yuchen
    Wu, Qizhe
    Yuan, Wei
    Liang, Huawen
    Wang, Xiaotian
    Jin, Xi
    2024 IEEE 35TH INTERNATIONAL CONFERENCE ON APPLICATION-SPECIFIC SYSTEMS, ARCHITECTURES AND PROCESSORS, ASAP 2024, 2024, : 77 - 78
  • [49] GRAPH-ADAPTIVE ACTIVATION FUNCTIONS FOR GRAPH NEURAL NETWORKS
    Iancu, Bianca
    Ruiz, Luana
    Ribeiro, Alejandro
    Isufi, Elvin
    PROCEEDINGS OF THE 2020 IEEE 30TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2020,
  • [50] Adaptive Parallel Training for Graph Neural Networks
    Ma, Kaihao
    Liu, Renjie
    Yan, Xiao
    Cai, Zhenkun
    Song, Xiang
    Wang, Minjie
    Li, Yichao
    Cheng, James
    PROCEEDINGS OF THE 2025 THE 30TH ACM SIGPLAN ANNUAL SYMPOSIUM ON PRINCIPLES AND PRACTICE OF PARALLEL PROGRAMMING, PPOPP 2025, 2025, : 29 - 42