Transferable graph neural networks with deep alignment attention

被引:2
|
作者
Xie, Ying [1 ,2 ]
Xu, Rongbin [1 ,2 ]
Yang, Yun [3 ]
机构
[1] Putian Univ, Sch Mech Elect & Informat Engn, Putian, Peoples R China
[2] Fujian Key Lab Financial Informat Proc, Fujian, Peoples R China
[3] Swinburne Univ Technol, Dept Comp Technol, Melbourne, Australia
基金
中国国家自然科学基金;
关键词
GNNs; Transfer learning; Attention mechanism;
D O I
10.1016/j.ins.2023.119232
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
When analyzing graph-structured data, graph neural networks (GNNs) use well-designed propagation mechanism to extract node features. However, these methods only incorporate data from nodes' fixed neighborhoods or whole graph, not accounting for the influence of important nodes outside of the neighborhoods. We offer transferable graph neural networks with deep alignment attention (TGDAA), which is a novel neural network framework that designs aligned attention to assign different weights to related important nodes. In such a scenario, we concurrently remove a number of graph neural network obstacles and make TGDAA accessible for transfer learning issues. Extensive experiments in four aspects: traditional metrics, attention -related methods, varying label rates and ablation study show that the suggested TGDAA performs better than ten state-of-the-art techniques on ten benchmark network datasets.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Graph neural networks with multiple kernel ensemble attention
    Zhang, Haimin
    Xu, Min
    KNOWLEDGE-BASED SYSTEMS, 2021, 229
  • [42] Gated Graph Neural Attention Networks for abstractive summarization
    Liang, Zeyu
    Du, Junping
    Shao, Yingxia
    Ji, Houye
    NEUROCOMPUTING, 2021, 431 : 128 - 136
  • [43] Learning Transferable Policies with Improved Graph Neural Networks on Serial Robotic Structure
    Zhang, Fengyi
    Xiong, Fangzhou
    Yang, Xu
    Liu, Zhiyong
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT III, 2019, 11955 : 115 - 126
  • [44] Graph neural networks for deep portfolio optimization
    Ekmekcioglu, Omer
    Pinar, Mustafa C.
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (28): : 20663 - 20674
  • [45] Graph neural networks for deep portfolio optimization
    Ömer Ekmekcioğlu
    Mustafa Ç. Pınar
    Neural Computing and Applications, 2023, 35 : 20663 - 20674
  • [46] Deep Neural Networks for Learning Graph Representations
    Cao, Shaosheng
    Lu, Wei
    Xu, Qiongkai
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 1145 - 1152
  • [47] GRAPHNET: GRAPH CLUSTERING WITH DEEP NEURAL NETWORKS
    Zhang, Xianchao
    Mu, Jie
    Liu, Han
    Zhang, Xiaotong
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3800 - 3804
  • [48] Adaptive propagation deep graph neural networks
    Chen, Wei
    Yan, Wenxu
    Wang, Wenyuan
    PATTERN RECOGNITION, 2024, 154
  • [49] Galaxies and haloes on graph neural networks: Deep generative modelling scalar and vector quantities for intrinsic alignment
    Jagvaral, Yesukhei
    Lanusse, Francois
    Singh, Sukhdeep
    Mandelbaum, Rachel
    Ravanbakhsh, Siamak
    Campbell, Duncan
    MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY, 2022, 516 (02) : 2406 - 2419
  • [50] Transferable Dynamic Molecular Charge Assignment Using Deep Neural Networks
    Nebgen, Benjamin
    Lubbers, Nicholas
    Smith, Justin S.
    Sifain, Andrew E.
    Lokhov, Andrey
    Isayev, Olexandr
    Roitberg, Adrian E.
    Barros, Kipton
    Tretiak, Sergei
    JOURNAL OF CHEMICAL THEORY AND COMPUTATION, 2018, 14 (09) : 4687 - 4698