GNN Transformation Framework for Improving Efficiency and Scalability

被引:0
|
作者
Maekawa, Seiji [1 ]
Sasaki, Yuya [1 ]
Fletcher, George [2 ]
Onizuka, Makoto [1 ]
机构
[1] Osaka Univ, 1-5 Yamadaoka, Suita, Osaka, Japan
[2] Eindhoven Univ Technol, POB 513, NL-5600 MB Eindhoven, Netherlands
关键词
Graph Neural Networks; Large-scale graphs; Classification;
D O I
10.1007/978-3-031-26390-3_22
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a framework that automatically transforms non-scalable GNNs into precomputation-based GNNs which are efficient and scalable for large-scale graphs. The advantages of our framework are two-fold; 1) it transforms various non-scalable GNNs to scale well to large-scale graphs by separating local feature aggregation fromweight learning in their graph convolution, 2) it efficiently executes precomputation on GPU for large-scale graphs by decomposing their edges into small disjoint and balanced sets. Through extensive experiments with large-scale graphs, we demonstrate that the transformed GNNs run faster in training time than existing GNNs while achieving competitive accuracy to the state-of-the-art GNNs. Consequently, our transformation framework provides simple and efficient baselines for future research on scalable GNNs.
引用
收藏
页码:360 / 376
页数:17
相关论文
共 50 条
  • [31] FASTRAL: improving scalability of phylogenomic analysis
    Dibaeinia, Payam
    Tabe-Bordbar, Shayan
    Warnow, Tandy
    BIOINFORMATICS, 2021, 37 (16) : 2317 - 2324
  • [32] Improving scalability of ART neural networks
    Benites, Fernando
    Sapozhnikova, Elena
    NEUROCOMPUTING, 2017, 230 : 219 - 229
  • [33] Improving the Scalability of Performance Evaluation Tools
    Shende, Sameer Suresh
    Malony, Allen D.
    Morris, Alan
    APPLIED PARALLEL AND SCIENTIFIC COMPUTING, PT II, 2012, 7134 : 441 - 451
  • [34] Improving GNN Calibration with Discriminative Ability: Insights and Strategies
    Fang, Yujie
    Li, Xin
    Chen, Qianyu
    Wang, Mingzhong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 11, 2024, : 11953 - 11960
  • [35] Improving the Scalability of GPU Synchronization Primitives
    Dalmia, Preyesh
    Mahapatra, Rohan
    Intan, Jeremy
    Negrut, Dan
    Sinclair, Matthew D. D.
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2023, 34 (01) : 275 - 290
  • [36] Improving scalability on reliable multicast communications
    Villela, DAM
    Duarte, OCMB
    COMPUTER COMMUNICATIONS, 2001, 24 (5-6) : 548 - 562
  • [37] Improving Scalability of Software Engineering Courses
    Schefer-Wenzl, Sigrid
    Miladinovic, Igor
    INNOVATIVE APPROACHES TO TECHNOLOGY-ENHANCED LEARNING FOR THE WORKPLACE AND HIGHER EDUCATION, THE LEARNING IDEAS CONFERENCE 2022, 2023, 581 : 377 - 382
  • [38] Improving the Quality of Rule-Based GNN Explanations
    Kamal, Ataollah
    Vincent, Elouan
    Plantevit, Marc
    Robardet, Celine
    MACHINE LEARNING AND PRINCIPLES AND PRACTICE OF KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT I, 2023, 1752 : 467 - 482
  • [39] Further Improving the Scalability of the Scalasca Toolset
    Geimer, Markus
    Saviankou, Pavel
    Strube, Alexandre
    Szebenyi, Zoltan
    Wolf, Felix
    Wylie, Brian J. N.
    APPLIED PARALLEL AND SCIENTIFIC COMPUTING, PT II, 2012, 7134 : 463 - 473
  • [40] Improving objectivity and scalability in protein crystallization
    Jurisica, I
    Rogers, P
    Glasgow, JI
    Collins, RJ
    Wolfley, JR
    Luft, JR
    DeTitta, GT
    IEEE INTELLIGENT SYSTEMS, 2001, 16 (06): : 26 - 34