Multi-Task Learning Based Network Embedding

被引:5
|
作者
Wang, Shanfeng [1 ]
Wang, Qixiang [2 ]
Gong, Maoguo [2 ]
机构
[1] Xidian Univ, Sch Cyber Engn, Xian, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
network representation learning; multi-task learning; network embedding; high-order proximity; low-order proximity;
D O I
10.3389/fnins.2019.01387
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The goal of network representation learning, also called network embedding, is to encode the network structure information into a continuous low-dimensionality embedding space where geometric relationships among the vectors can reflect the relationships of nodes in the original network. The existing network representation learning methods are always single-task learning, in which case these methods focus on preserving the proximity of nodes from one aspect. However, the proximity of nodes is dependent on both the local and global structure, resulting in a limitation on the node embeddings learned by these methods. In order to solve this problem, in this paper, we propose a novel method, Multi-Task Learning-Based Network Embedding, termed MLNE. There are two tasks in this method so as to preserve the proximity of nodes. The aim of the first task is to preserve the high-order proximity between pairwise nodes in the whole network. The second task is to preserve the low-order proximity in the one-hop area of each node. By jointly learning these tasks in the supervised deep learning model, our method can obtain node embeddings that can sufficiently reflect the roles that nodes play in networks. In order to demonstrate the efficacy of our MLNE method over existing state-of-the-art methods, we conduct experiments on multi-label classification, link prediction, and visualization in five real-world networks. The experimental results show that our method performs competitively.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Multi-task Network Embedding
    Xu, Linchuan
    Wei, Xiaokai
    Cao, Jiannong
    Yu, Philip S.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2017, : 571 - 580
  • [2] Multi-task network embedding
    Linchuan Xu
    Xiaokai Wei
    Jiannong Cao
    Philip S. Yu
    [J]. International Journal of Data Science and Analytics, 2019, 8 : 183 - 198
  • [3] Multi-task network embedding
    Xu, Linchuan
    Wei, Xiaokai
    Cao, Jiannong
    Yu, Philip S.
    [J]. INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2019, 8 (02) : 183 - 198
  • [4] MTLAN: Multi-Task Learning and Auxiliary Network for Enhanced Sentence Embedding
    Liu, Gang
    Wang, Tongli
    Yang, Wenli
    Yan, Zhizheng
    Zhan, Kai
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2023, PT III, 2024, 14449 : 16 - 27
  • [5] Task Switching Network for Multi-task Learning
    Sun, Guolei
    Probst, Thomas
    Paudel, Danda Pani
    Popovic, Nikola
    Kanakis, Menelaos
    Patel, Jagruti
    Dai, Dengxin
    Van Gool, Luc
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8271 - 8280
  • [6] A Multi-task Text Classification Model Based on Label Embedding Learning
    Xu, Yuemei
    Fan, Zuwei
    Cao, Han
    [J]. CYBER SECURITY, CNCERT 2021, 2022, 1506 : 211 - 225
  • [7] SEBGM: Sentence Embedding Based on Generation Model with multi-task learning
    Wang, Qian
    Zhang, Weiqi
    Lei, Tianyi
    Cao, Yu
    Peng, Dezhong
    Wang, Xu
    [J]. COMPUTER SPEECH AND LANGUAGE, 2024, 87
  • [8] A novel embedding learning framework for relation completion and recommendation based on graph neural network and multi-task learning
    Zhao, Wenbin
    Li, Yahui
    Fan, Tongrang
    Wu, Feng
    [J]. SOFT COMPUTING, 2022,
  • [9] Multi-task Network Embedding with Adaptive Loss Weighting
    Rizi, Fatemeh Salehi
    Granitzer, Michael
    [J]. 2020 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING (ASONAM), 2020, : 1 - 5
  • [10] Unified Voice Embedding through Multi-task Learning
    Rajenthiran, Jenarthanan
    Sithamaparanathan, Lakshikka
    Uthayakumar, Saranya
    Thayasivam, Uthayasanker
    [J]. 2022 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2022), 2022, : 178 - 183