Inductive Embedding Learning on Attributed Heterogeneous Networks via Multi-task Sequence-to-Sequence Learning

被引:2
|
作者
Chu, Yunfei [1 ]
Guo, Caili [1 ,2 ]
He, Tongze [1 ]
Wang, Yaqing [1 ]
Hwang, Jenq-Neng [3 ]
Feng, Chunyan [1 ,2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Beijing Key Lab Network Syst Architecture & Conve, Beijing, Peoples R China
[2] Beijing Lab Adv Informat Networks, Beijing, Peoples R China
[3] Univ Washington, Dept Elect Engn, Seatle, WA USA
关键词
network embedding; graph embedding; inductive learning; attributed heterogeneous network;
D O I
10.1109/ICDM.2019.00116
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the paper, we study the problem of inductive embedding learning on attributed heterogeneous networks, and propose a Multi-task sequence-to-sequence learning based Inductive Network Embedding framework (MINE) capturing the attribute similarity, network proximity, and partial label information simultaneously. In particular, MINE trains an encoder function that aggregates information from a node's long-range scope of contexts, with the node attribute sequences generated by the proposed type-guided heterogeneous random walk as inputs. We present an one-to-many multi-task sequence-to-sequence model where the encoder is shared between two related tasks: an unsupervised node identity sequence generation task to learn context-aware embeddings, and a semi-supervised label prediction task to learn semantics-rich embeddings. Extensive experiments on real-world datasets demonstrate that the proposed method significantly outperforms several state-of-the-art methods.
引用
收藏
页码:1012 / 1017
页数:6
相关论文
共 50 条
  • [31] Sequence-to-sequence modeling for graph representation learning
    Aynaz Taheri
    Kevin Gimpel
    Tanya Berger-Wolf
    Applied Network Science, 4
  • [32] Towards Robust Knowledge Graph Embedding via Multi-Task Reinforcement Learning
    Zhang, Zhao
    Zhuang, Fuzhen
    Zhu, Hengshu
    Li, Chao
    Xiong, Hui
    He, Qing
    Xu, Yongjun
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) : 4321 - 4334
  • [33] Unified Voice Embedding through Multi-task Learning
    Rajenthiran, Jenarthanan
    Sithamaparanathan, Lakshikka
    Uthayakumar, Saranya
    Thayasivam, Uthayasanker
    2022 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2022), 2022, : 178 - 183
  • [34] Multi-view improved sequence behavior with adaptive multi-task learning in ranking
    Yingshuai Wang
    Dezheng Zhang
    Aziguli Wulamu
    Applied Intelligence, 2023, 53 : 13158 - 13177
  • [35] Agreement on target-bidirectional recurrent neural networks for sequence-to-sequence learning
    Liu, Lemao
    Finch, Andrew
    Utiyama, Masao
    Sumita, Eiichiro
    Journal of Artificial Intelligence Research, 2020, 67 : 581 - 606
  • [36] Agreement on Target-Bidirectional Recurrent Neural Networks for Sequence-to-Sequence Learning
    Liu, Lemao
    Finch, Andrew
    Utiyama, Masao
    Sumita, Eiichiro
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2020, 67 : 581 - 606
  • [37] Multi-view improved sequence behavior with adaptive multi-task learning in ranking
    Wang, Yingshuai
    Zhang, Dezheng
    Wulamu, Aziguli
    APPLIED INTELLIGENCE, 2023, 53 (11) : 13158 - 13177
  • [38] Smartphone Identification via Passive Traffic Fingerprinting: A Sequence-to-Sequence Learning Approach
    Meneghello, Francesca
    Rossi, Michele
    Bui, Nicola
    IEEE NETWORK, 2020, 34 (02): : 112 - 120
  • [39] An End-to-End Scalable Iterative Sequence Tagging with Multi-Task Learning
    Gui, Lin
    Du, Jiachen
    Zhao, Zhishan
    He, Yulan
    Xu, Ruifeng
    Fan, Chuang
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2018, PT II, 2018, 11109 : 288 - 298
  • [40] Sequence generation for multi-task scheduling in cloud manufacturing with deep reinforcement learning
    Ping, Yaoyao
    Liu, Yongkui
    Zhang, Lin
    Wang, Lihui
    Xu, Xun
    JOURNAL OF MANUFACTURING SYSTEMS, 2023, 67 : 315 - 337