Learning Data-Driven Propagation Mechanism for Graph Neural Network

被引:0
|
作者
Wu, Yue [1 ]
Hu, Xidao [1 ]
Fan, Xiaolong [2 ]
Ma, Wenping [3 ]
Gao, Qiuyue [1 ]
机构
[1] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[3] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
graph neural network; propagation mechanism; data-driven method; deep learning; APPROXIMATE;
D O I
10.3390/electronics12010046
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A graph is a relational data structure suitable for representing non-Euclidean structured data. In recent years, graph neural networks (GNN) and their subsequent variants, which utilize deep neural networks to complete graph analysis and representation, have shown excellent performance in various application fields. However, the propagation mechanism of existing methods relies on hand-designed GNN layer connection architecture, which is prone to information redundancy and over-smoothing problems. To alleviate this problem, we propose a data-driven propagation mechanism to adaptively propagate information between layers. Specifically, we construct a bi-level optimization objective and use the gradient descent algorithm to learn the forward propagation architecture, which improves the efficiency of learning different layer combinations in multilayer networks. The experimental results of the model on seven benchmark datasets demonstrate the effectiveness of the proposed method. Furthermore, combining this data-driven propagation mechanism with models, such as Graph Attention Networks, can consistently improve the performance of these models.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Learning to Detect: A Data-driven Approach for Network Intrusion Detection
    Tauscher, Zachary
    Jiang, Yushan
    Zhang, Kai
    Wang, Jian
    Song, Houbing
    2021 IEEE INTERNATIONAL PERFORMANCE, COMPUTING, AND COMMUNICATIONS CONFERENCE (IPCCC), 2021,
  • [42] A Data-driven ADP with RBF Network and LSM Learning Algorithm
    Huang, Zhijian
    Li, Yudong
    Chen, Wentao
    Zhang, Qin
    Wu, Qili
    Tan, Qinmin
    Yang, Zhiyuan
    2017 6TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS (DDCLS), 2017, : 346 - 349
  • [43] Data-driven Adaptive Network Management with Deep Reinforcement Learning
    Ivoghlian, Ameer
    Wang, Kevin I-Kai
    Salcic, Zoran
    2021 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS DASC/PICOM/CBDCOM/CYBERSCITECH 2021, 2021, : 153 - 160
  • [44] Data-Driven Logic Synthesizer for Acceleration of Forward Propagation in Artificial Neural Networks
    Mahmoud, Khaled Z.
    Smith, William E.
    Fishkin, Mark
    Miller, Timothy N.
    2015 33RD IEEE INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD), 2015, : 435 - 438
  • [45] Optimised data-driven terminal iterative learning control based on neural network for distributed parameter systems
    Dai, Xisheng
    Liu, Lanlan
    Deng, Zhenping
    INTERNATIONAL JOURNAL OF AUTOMATION AND CONTROL, 2021, 15 (4-5) : 463 - 481
  • [46] Data-Driven Construction of Chemical Reaction Network Graph Using Constrained LASSO
    Tamba, Tua A.
    Nazaruddin, Yul Y.
    PROCEEDINGS OF THE 2019 6TH INTERNATIONAL CONFERENCE ON INSTRUMENTATION, CONTROL, AND AUTOMATION (ICA), 2019, : 226 - 230
  • [47] Data-driven network alignment
    Gu, Shawn
    Milenkovic, Tijana
    PLOS ONE, 2020, 15 (07):
  • [48] Data-driven network loading
    Tsanakas, N.
    Ekstrom, J.
    Gundlegard, D.
    Olstam, J.
    Rydergren, C.
    TRANSPORTMETRICA B-TRANSPORT DYNAMICS, 2021, 9 (01) : 237 - 265
  • [49] Data-driven recurrent neural network model to predict the rate of penetration
    Alkinani, Husam H.
    Al-Hameedi, Abo Taleb T.
    Dunn-Norman, Shari
    UPSTREAM OIL AND GAS TECHNOLOGY, 2021, 7
  • [50] Nucleus Neural Network: A Data-driven Self-organized Architecture
    Liu, Jia
    He, Haibo
    Gong, Maoguo
    Zhang, Wenhua
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,