Learning Data-Driven Propagation Mechanism for Graph Neural Network

被引:0
|
作者
Wu, Yue [1 ]
Hu, Xidao [1 ]
Fan, Xiaolong [2 ]
Ma, Wenping [3 ]
Gao, Qiuyue [1 ]
机构
[1] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[3] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
graph neural network; propagation mechanism; data-driven method; deep learning; APPROXIMATE;
D O I
10.3390/electronics12010046
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A graph is a relational data structure suitable for representing non-Euclidean structured data. In recent years, graph neural networks (GNN) and their subsequent variants, which utilize deep neural networks to complete graph analysis and representation, have shown excellent performance in various application fields. However, the propagation mechanism of existing methods relies on hand-designed GNN layer connection architecture, which is prone to information redundancy and over-smoothing problems. To alleviate this problem, we propose a data-driven propagation mechanism to adaptively propagate information between layers. Specifically, we construct a bi-level optimization objective and use the gradient descent algorithm to learn the forward propagation architecture, which improves the efficiency of learning different layer combinations in multilayer networks. The experimental results of the model on seven benchmark datasets demonstrate the effectiveness of the proposed method. Furthermore, combining this data-driven propagation mechanism with models, such as Graph Attention Networks, can consistently improve the performance of these models.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Learning Multi-Graph Neural Network for Data-Driven Job Skill Prediction
    Liu, Liting
    Zhang, Wenzheng
    Liu, Jie
    Shi, Wenxuan
    Huang, Yalou
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [2] Data-driven performance metrics for neural network learning
    Alessandri, Angelo
    Gaggero, Mauro
    Sanguineti, Marcello
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2023,
  • [3] Data-driven graph construction and graph learning: A review
    Qiao, Lishan
    Zhang, Limei
    Chen, Songcan
    Shen, Dinggang
    NEUROCOMPUTING, 2018, 312 : 336 - 351
  • [4] Data-Driven Morphological Feature Perception of Single Neuron With Graph Neural Network
    Zhu, Tianfang
    Yao, Gang
    Hu, Dongli
    Xie, Chuangchuang
    Li, Pengcheng
    Yang, Xiaoquan
    Gong, Hui
    Luo, Qingming
    Li, Anan
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (10) : 3069 - 3079
  • [5] A Data-Driven Spatial-Temporal Graph Neural Network for Docked Bike Prediction
    Li, Guanyao
    Wang, Xiaofeng
    Njoo, Gunarto Sindoro
    Zhong, Shuhan
    Chan, S-H Gary
    Hung, Chih-Chieh
    Peng, Wen-Chih
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 713 - 726
  • [6] Data-Driven Traffic Assignment: A Novel Approach for Learning Traffic Flow Patterns Using Graph Convolutional Neural Network
    Rezaur Rahman
    Samiul Hasan
    Data Science for Transportation, 2023, 5 (2):
  • [7] A Data-Driven Asynchronous Neural Network Accelerator
    Xiao, Shanlin
    Liu, Weikun
    Lin, Junshu
    Yu, Zhiyi
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2021, 40 (09) : 1874 - 1886
  • [8] A Data-Driven Collaborative Forecasting Method for Logistics Network Throughput Based on Graph Learning
    Hou, Yunhe
    Jia, Manman
    IEEE ACCESS, 2023, 11 : 61059 - 61069
  • [9] Data-Driven Neural Network-Based Learning For Regression Problems In Robotics
    Huu-Thiet Nguyen
    Cheah, Chien Chern
    IECON 2020: THE 46TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2020, : 581 - 586
  • [10] Data-Driven Student Learning Performance Prediction based on RBF Neural Network
    Mi C.
    International Journal of Performability Engineering, 2019, 15 (06) : 1560 - 1569