Inductive Embedding Learning on Attributed Heterogeneous Networks via Multi-task Sequence-to-Sequence Learning

被引:2
|
作者
Chu, Yunfei [1 ]
Guo, Caili [1 ,2 ]
He, Tongze [1 ]
Wang, Yaqing [1 ]
Hwang, Jenq-Neng [3 ]
Feng, Chunyan [1 ,2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Beijing Key Lab Network Syst Architecture & Conve, Beijing, Peoples R China
[2] Beijing Lab Adv Informat Networks, Beijing, Peoples R China
[3] Univ Washington, Dept Elect Engn, Seatle, WA USA
关键词
network embedding; graph embedding; inductive learning; attributed heterogeneous network;
D O I
10.1109/ICDM.2019.00116
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the paper, we study the problem of inductive embedding learning on attributed heterogeneous networks, and propose a Multi-task sequence-to-sequence learning based Inductive Network Embedding framework (MINE) capturing the attribute similarity, network proximity, and partial label information simultaneously. In particular, MINE trains an encoder function that aggregates information from a node's long-range scope of contexts, with the node attribute sequences generated by the proposed type-guided heterogeneous random walk as inputs. We present an one-to-many multi-task sequence-to-sequence model where the encoder is shared between two related tasks: an unsupervised node identity sequence generation task to learn context-aware embeddings, and a semi-supervised label prediction task to learn semantics-rich embeddings. Extensive experiments on real-world datasets demonstrate that the proposed method significantly outperforms several state-of-the-art methods.
引用
收藏
页码:1012 / 1017
页数:6
相关论文
共 50 条
  • [1] Clustered Multi-Task Sequence-to-Sequence Learning for Autonomous Vehicle Repositioning
    Lee, Sangmin
    Lim, Dae-Eun
    Kang, Younkook
    Kim, Hae Joong
    IEEE ACCESS, 2021, 9 : 14504 - 14515
  • [2] Attributed graph clustering with multi-task embedding learning
    Zhang, Xiaotong
    Liu, Han
    Zhang, Xianchao
    Liu, Xinyue
    NEURAL NETWORKS, 2022, 152 : 224 - 233
  • [3] Multi-Task Learning with Sequence-Conditioned Transporter Networks
    Lim, Michael H.
    Zeng, Andy
    Ichter, Brian
    Bandari, Maryam
    Coumans, Erwin
    Tomlin, Claire
    Schaal, Stefan
    Faust, Aleksandra
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 2489 - 2496
  • [4] Sequence-to-sequence borehole formation property prediction via multi-task deep networks with sparse core calibration
    Ao, Yile
    Lu, Wenkai
    Hou, Qiuyuan
    Jiang, Bowu
    JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2022, 208
  • [5] Meta Multi-Task Learning for Sequence Modeling
    Chen, Junkun
    Qiu, Xipeng
    Liu, Pengfei
    Huang, Xuanjing
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 5070 - 5077
  • [6] Learning Multi-Task Communication with Message Passing for Sequence Learning
    Liu, Pengfei
    Fu, Jie
    Dong, Yue
    Qiu, Xipeng
    Cheung, Jackie Chi Kit
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 4360 - 4367
  • [7] Korean Morphological Analysis with Tied Sequence-to-Sequence Multi-Task Model
    Song, Hyun-Je
    Park, Seong-Bae
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 1436 - 1441
  • [8] Cross-Lingual Text Image Recognition via Multi-Task Sequence to Sequence Learning
    Chen, Zhuo
    Yin, Fei
    Zhang, Xu-Yao
    Yang, Qing
    Liu, Chena-Lin
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3122 - 3129
  • [9] Multi-task Contrastive Learning for Anomaly Detection on Attributed Networks
    Zhang, Junjie
    Ding, Yuxin
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT I, PAKDD 2024, 2024, 14645 : 15 - 26
  • [10] Cryptocurrency Price Prediction With Multi-task Multi-step Sequence-to-Sequence Modeling
    Kristensen, Jesper
    Madrigal-Cianci, Juan P.
    Felekis, Giorgos
    Liatsikou, Maria
    2022 IEEE INTERNATIONAL CONFERENCE ON BLOCKCHAIN (BLOCKCHAIN 2022), 2022, : 53 - 60