FP-GNN: Adaptive FPGA accelerator for Graph Neural Networks

被引:13
|
作者
Tian, Teng [1 ,2 ]
Zhao, Letian [1 ,2 ]
Wang, Xiaotian [1 ,2 ]
Wu, Qizhe [1 ,2 ]
Yuan, Wei [1 ,2 ]
Jin, Xi [1 ,2 ]
机构
[1] Univ Sci & Technol China, State Key Lab Particle Detect & Elect, Hefei 230026, Peoples R China
[2] Univ Sci & Technol China, Inst Microelect, Dept Phys, Hefei 230026, Peoples R China
关键词
Graph neural network; FPGA accelerator; Graph partition; Algorithm -hardware co -design; Performance efficiency; Energy efficiency;
D O I
10.1016/j.future.2022.06.010
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Graph Neural Networks (GNNs) exhibit great success in graph data analysis and promote the evolution of artificial intelligence. The computing procedure of GNNs can be categorized into two phases: Aggregation and Combination, which have irregular and regular computing characteristics respectively. In this work, we present an adaptive FPGA accelerator, FP-GNN, to enable flexible and efficient GNN acceleration. First, this paper presents quantitative analysis of the impact on performance when changing the order of Aggregation and Combination. Then we propose an Adaptive GNN Accelerator framework (AGA) that adopts a unified processing module to support these two phases simultaneously, and an Adaptive Graph Partition strategy (AGP) to alleviate memory bottleneck and eliminate graph repartition overhead between GNN layers. In addition, we also propose multiple workflow optimizations for both Aggregation and Combination phases to achieve workload balance and feature sparsity elimination. Finally, we implement the FP-GNN on a Xilinx VCU128 FPGA, and conduct comprehensive experiments on various GNN configurations and platforms. Results show that FP-GNN achieves on average 665x speedup with 3180x energy efficiency and average 24.9x speedup with 138x energy efficiency compared to CPU and GPU, respectively, and also achieves state-of-the-art performance efficiency and energy efficiency compared to prior works. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:294 / 310
页数:17
相关论文
共 50 条
  • [21] Tail-GNN: Tail-Node Graph Neural Networks
    Liu, Zemin
    Trung-Kien Nguyen
    Fang, Yuan
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 1109 - 1119
  • [22] Aurora: A Versatile and Flexible Accelerator for Graph Neural Networks
    Yang, Jiaqi
    Zheng, Hao
    Louri, Ahmed
    PROCEEDINGS 2024 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM, IPDPS 2024, 2024, : 890 - 902
  • [23] DRGN: a dynamically reconfigurable accelerator for graph neural networks
    Yang C.
    Huo K.-B.
    Geng L.-F.
    Mei K.-Z.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (07) : 8985 - 9000
  • [24] Automated Accelerator Optimization Aided by Graph Neural Networks
    Sohrabizadeh, Atefeh
    Bai, Yunsheng
    Sun, Yizhou
    Cong, Jason
    PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 55 - 60
  • [25] Graph Neural Networks with Adaptive Readouts
    Buterez, David
    Janet, Jon Paul
    Kiddle, Steven J.
    Oglic, Dino
    Lio, Pietro
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [26] Graph Neural Networks with Adaptive Residual
    Liu, Xiaorui
    Ding, Jiayuan
    Jin, Wei
    Xu, Han
    Ma, Yao
    Liu, Zitao
    Tang, Jiliang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [27] Graph Neural Networks With Adaptive Structures
    Zhang, Zepeng
    Lu, Songtao
    Huang, Zengfeng
    Zhao, Ziping
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2025, 19 (01) : 181 - 194
  • [28] Adaptive Graph Convolutional Neural Networks
    Li, Ruoyu
    Wang, Sheng
    Zhu, Feiyun
    Huang, Junzhou
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 3546 - 3553
  • [29] Adaptive Diffusion in Graph Neural Networks
    Zhao, Jialin
    Dong, Yuxiao
    Ding, Ming
    Kharlamov, Evgeny
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [30] NEM-GNN: DAC/ADC-less, Scalable, Reconfigurable, Graph and Sparsity-Aware Near-Memory Accelerator for Graph Neural Networks
    Raman, Siddhartha Raman Sundara
    John, Lizy
    Kulkarni, Jaydeep P.
    ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2024, 21 (02)