FP-GNN: Adaptive FPGA accelerator for Graph Neural Networks

被引:13
|
作者
Tian, Teng [1 ,2 ]
Zhao, Letian [1 ,2 ]
Wang, Xiaotian [1 ,2 ]
Wu, Qizhe [1 ,2 ]
Yuan, Wei [1 ,2 ]
Jin, Xi [1 ,2 ]
机构
[1] Univ Sci & Technol China, State Key Lab Particle Detect & Elect, Hefei 230026, Peoples R China
[2] Univ Sci & Technol China, Inst Microelect, Dept Phys, Hefei 230026, Peoples R China
关键词
Graph neural network; FPGA accelerator; Graph partition; Algorithm -hardware co -design; Performance efficiency; Energy efficiency;
D O I
10.1016/j.future.2022.06.010
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Graph Neural Networks (GNNs) exhibit great success in graph data analysis and promote the evolution of artificial intelligence. The computing procedure of GNNs can be categorized into two phases: Aggregation and Combination, which have irregular and regular computing characteristics respectively. In this work, we present an adaptive FPGA accelerator, FP-GNN, to enable flexible and efficient GNN acceleration. First, this paper presents quantitative analysis of the impact on performance when changing the order of Aggregation and Combination. Then we propose an Adaptive GNN Accelerator framework (AGA) that adopts a unified processing module to support these two phases simultaneously, and an Adaptive Graph Partition strategy (AGP) to alleviate memory bottleneck and eliminate graph repartition overhead between GNN layers. In addition, we also propose multiple workflow optimizations for both Aggregation and Combination phases to achieve workload balance and feature sparsity elimination. Finally, we implement the FP-GNN on a Xilinx VCU128 FPGA, and conduct comprehensive experiments on various GNN configurations and platforms. Results show that FP-GNN achieves on average 665x speedup with 3180x energy efficiency and average 24.9x speedup with 138x energy efficiency compared to CPU and GPU, respectively, and also achieves state-of-the-art performance efficiency and energy efficiency compared to prior works. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:294 / 310
页数:17
相关论文
共 50 条
  • [1] GNN2GNN: Graph Neural Networks to Generate Neural Networks
    Agiollo, Andrea
    Omicini, Andrea
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, VOL 180, 2022, 180 : 32 - 42
  • [2] Customizable FPGA-based Accelerator for Binarized Graph Neural Networks
    Wang, Ziwei
    Que, Zhiqiang
    Luk, Wayne
    Fan, Hongxiang
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 1968 - 1972
  • [3] Customizable FPGA-based Accelerator for Binarized Graph Neural Networks
    Wang, Ziwei
    Que, Zhiqiang
    Luk, Wayne
    Fan, Hongxiang
    Proceedings - IEEE International Symposium on Circuits and Systems, 2022, 2022-May : 1968 - 1972
  • [4] FP-GNN: a versatile deep learning architecture for enhanced molecular property prediction
    Cai, Hanxuan
    Zhang, Huimin
    Zhao, Duancheng
    Wu, Jingxing
    Wang, Ling
    BRIEFINGS IN BIOINFORMATICS, 2022, 23 (06)
  • [5] Auto-GNN: Neural architecture search of graph neural networks
    Zhou, Kaixiong
    Huang, Xiao
    Song, Qingquan
    Chen, Rui
    Hu, Xia
    FRONTIERS IN BIG DATA, 2022, 5
  • [6] A multi-task FP-GNN framework enables accurate prediction of selective PARP inhibitors
    Ai, Daiqiao
    Wu, Jingxing
    Cai, Hanxuan
    Zhao, Duancheng
    Chen, Yihao
    Wei, Jiajia
    Xu, Jianrong
    Zhang, Jiquan
    Wang, Ling
    FRONTIERS IN PHARMACOLOGY, 2022, 13
  • [7] A Scalable FPGA Accelerator for Convolutional Neural Networks
    Xu, Ke
    Wang, Xiaoyun
    Fu, Shihang
    Wang, Dong
    ADVANCED COMPUTER ARCHITECTURE, 2018, 908 : 3 - 14
  • [8] HGK-GNN: Heterogeneous Graph Kernel based Graph Neural Networks
    Long, Qingqing
    Xu, Lingjun
    Fang, Zheng
    Song, Guojie
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 1129 - 1138
  • [9] Policy-GNN: Aggregation Optimization for Graph Neural Networks
    Lai, Kwei-Herng
    Zha, Daochen
    Zhou, Kaixiong
    Hu, Xia
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 461 - 471
  • [10] GNN-Retro: Retrosynthetic Planning with Graph Neural Networks
    Han, Peng
    Zhao, Peilin
    Lu, Chan
    Huang, Junzhou
    Wu, Jiaxiang
    Shang, Shuo
    Yao, Bin
    Zhang, Xiangliang
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 4014 - 4021