Attention-Aware Heterogeneous Graph Neural Network

被引:19
|
作者
Zhang, Jintao [1 ]
Xu, Quan [2 ]
机构
[1] Northeastern Univ, Coll Sci, Shenyang 110004, Peoples R China
[2] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110819, Peoples R China
关键词
Graph Neural Network (GNN); Heterogeneous Information Network (HIN); embedding;
D O I
10.26599/BDMA.2021.9020008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a powerful tool for elucidating the embedding representation of graph-structured data, Graph Neural Networks (GNNs), which are a series of powerful tools built on homogeneous networks, have been widely used in various data mining tasks. It is a huge challenge to apply a GNN to an embedding Heterogeneous Information Network (HIN). The main reason for this challenge is that HINs contain many different types of nodes and different types of relationships between nodes. HIN contains rich semantic and structural information, which requires a specially designed graph neural network. However, the existing HIN-based graph neural network models rarely consider the interactive information hidden between the meta-paths of HIN in the poor embedding of nodes in the HIN. In this paper, we propose an Attention-aware Heterogeneous graph Neural Network (AHNN) model to effectively extract useful information from HIN and use it to learn the embedding representation of nodes. Specifically, we first use node-level attention to aggregate and update the embedding representation of nodes, and then concatenate the embedding representation of the nodes on different meta-paths. Finally, the semantic-level neural network is proposed to extract the feature interaction relationships on different meta-paths and learn the final embedding of nodes. Experimental results on three widely used datasets showed that the AHNN model could significantly outperform the state-of-the-art models.
引用
收藏
页码:233 / 241
页数:9
相关论文
共 50 条
  • [1] Attention-Aware Heterogeneous Graph Neural Network
    Jintao Zhang
    Quan Xu
    [J]. Big Data Mining and Analytics, 2021, 4 (04) : 233 - 241
  • [2] Learning graph attention-aware knowledge graph embedding
    Li, Chen
    Peng, Xutan
    Niu, Yuhang
    Zhang, Shanghang
    Peng, Hao
    Zhou, Chuan
    Li, Jianxin
    [J]. NEUROCOMPUTING, 2021, 461 : 516 - 529
  • [3] A Heterogeneous Graph Neural Network With Attribute Enhancement and Structure-Aware Attention
    Fan, Shenghang
    Liu, Guanjun
    Li, Jian
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (01): : 829 - 838
  • [4] Attention-Aware Invertible Hashing Network
    Li, Shanshan
    Cai, Qiang
    Li, Zhuangzi
    Li, Haisheng
    Zhang, Naiguang
    Cao, Jian
    [J]. IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 409 - 420
  • [5] A2 CMHNE: Attention-Aware Collaborative Multimodal Heterogeneous Network Embedding
    Hu, Jun
    Qian, Shengsheng
    Fang, Quan
    Liu, Xueliang
    Xu, Changsheng
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2019, 15 (02)
  • [6] Attention-Aware Encoder-Decoder Neural Networks for Heterogeneous Graphs of Things
    Li, Yangfan
    Chen, Cen
    Duan, Mingxing
    Zeng, Zeng
    Li, Kenli
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (04) : 2890 - 2898
  • [7] Action Recognition by an Attention-Aware Temporal Weighted Convolutional Neural Network
    Wang, Le
    Zang, Jinliang
    Zhang, Qilin
    Niu, Zhenxing
    Hua, Gang
    Zheng, Nanning
    [J]. SENSORS, 2018, 18 (07)
  • [8] Meta-Graph Based Attention-Aware Recommendation over Heterogeneous Information Networks
    Dai, Feifei
    Gu, Xiaoyan
    Li, Bo
    Zhang, Jinchao
    Qian, Mingda
    Wang, Weiping
    [J]. COMPUTATIONAL SCIENCE - ICCS 2019, PT II, 2019, 11537 : 580 - 594
  • [9] Neural Attention-Aware Hierarchical Topic Model
    Jin, Yuan
    Zhao, He
    Liu, Ming
    Du, Lan
    Buntine, Wray
    [J]. 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 1042 - 1052
  • [10] Attention-aware temporal-spatial graph neural network with multi-sensor information fusion for fault diagnosis
    Wang, Zhe
    Wu, Zhiying
    Li, Xingqiu
    Shao, Haidong
    Han, Te
    Xie, Min
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 278