QUINT: Node Embedding Using Network Hashing

被引:4
|
作者
Bera, Debajyoti [1 ]
Pratap, Rameshwar [2 ]
Verma, Bhisham Dev [2 ,3 ]
Sen, Biswadeep
Chakraborty, Tanmoy [1 ]
机构
[1] IIT Delhi, New Delhi 110020, Delhi, India
[2] Indian Inst Technol, Mandi 175005, Himachal Prades, India
[3] Natl Univ Singapore, Dept Comp Sci, Singapore 119077, Singapore
关键词
Task analysis; Training; Sparse matrices; Optimization; Linear matrix inequalities; Statistical analysis; Standards; Network embedding; node classification; link prediction; sparse network; binary sketch; dimensionality reduction;
D O I
10.1109/TKDE.2021.3111997
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Representation learning using network embedding has received tremendous attention due to its efficacy to solve downstream tasks. Popular embedding methods (such as deepwalk, node2vec, LINE) are based on a neural architecture, thus unable to scale on large networks both in terms of time and space usage. Recently, we proposed BinSketch, a sketching technique for compressing binary vectors to binary vectors. In this paper, we show how to extend BinSketch and use it for network hashing. Our proposal named QUINT is built upon BinSketch, and it embeds nodes of a sparse network onto a low-dimensional space using simple bit-wise operations. QUINT is the first of its kind that provides tremendous gain in terms of speed and space usage without compromising much on the accuracy of the downstream tasks. Extensive experiments are conducted to compare QUINT with seven state-of-the-art network embedding methods for two end tasks - link prediction and node classification. We observe huge performance gain for QUINT in terms of speedup (up to 7000x) and space saving (up to 800x) due to its bit-wise nature to obtain node embedding. Moreover, QUINT is a consistent top-performer for both the tasks among the baselines across all the datasets. Our empirical observations are backed by rigorous theoretical analysis to justify the effectiveness of QUINT. In particular, we prove that QUINT retains enough structural information which can be used further to approximate many topological properties of networks with high confidence.
引用
收藏
页码:2987 / 3000
页数:14
相关论文
共 50 条
  • [31] Network Together: Node Classification via Cross-Network Deep Network Embedding
    Shen, Xiao
    Dai, Quanyu
    Mao, Sitong
    Chung, Fu-Lai
    Choi, Kup-Sze
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (05) : 1935 - 1948
  • [32] HYPERSPHERICAL EMBEDDING ITERATIVE QUANTIZATION HASHING
    Huang, Zhiqian
    Lv, Yueming
    Tian, Xing
    Ng, Wing W. Y.
    PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOL. 2, 2015, : 904 - 909
  • [33] MPSketch: Message Passing Networks via Randomized Hashing for Efficient Attributed Network Embedding
    Wu, Wei
    Li, Bin
    Luo, Chuan
    Nejdl, Wolfgang
    Tan, Xuan
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (05) : 2941 - 2954
  • [34] A novel random walk strategy for network embedding using community aware and node influence biasing
    Wang, Zhibin
    Chen, Xiaoliang
    Zhao, Mingfeng
    Li, Xianyong
    Du, Yajun
    20TH INT CONF ON UBIQUITOUS COMP AND COMMUNICAT (IUCC) / 20TH INT CONF ON COMP AND INFORMATION TECHNOLOGY (CIT) / 4TH INT CONF ON DATA SCIENCE AND COMPUTATIONAL INTELLIGENCE (DSCI) / 11TH INT CONF ON SMART COMPUTING, NETWORKING, AND SERV (SMARTCNS), 2021, : 309 - 315
  • [35] Joint network embedding of network structure and node attributes via deep autoencoder
    Pan, Yu
    Zou, Junhua
    Qiu, Junyang
    Wang, Shuaihui
    Hu, Guyu
    Pan, Zhisong
    NEUROCOMPUTING, 2022, 468 : 198 - 210
  • [36] Deep Supervised Hashing with Spherical Embedding
    Pidhorskyi, Stanislav
    Jones, Quinn
    Motiian, Saeid
    Adjeroh, Donald
    Doretto, Gianfranco
    COMPUTER VISION - ACCV 2018, PT IV, 2019, 11364 : 417 - 434
  • [37] Joint network embedding of network structure and node attributes via deep autoencoder
    Pan, Yu
    Zou, Junhua
    Qiu, Junyang
    Wang, Shuaihui
    Hu, Guyu
    Pan, Zhisong
    Neurocomputing, 2022, 468 : 198 - 210
  • [38] A Self-attention Network Based Node Embedding Model
    Nguyen, Dai Quoc
    Nguyen, Tu Dinh
    Phung, Dinh
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT III, 2021, 12459 : 364 - 377
  • [39] Generalized Recovery From Node Failure in Virtual Network Embedding
    Shahriar, Nashid
    Ahmed, Reaz
    Chowdhury, Shihabur Rahman
    Khan, Aimal
    Boutaba, Raouf
    Mitra, Jeebak
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2017, 14 (02): : 261 - 274
  • [40] Learning and Updating Node Embedding on Dynamic Heterogeneous Information Network
    Xie, Yuanzhen
    Ou, Zijing
    Chen, Liang
    Liu, Yang
    Xu, Kun
    Yang, Carl
    Zheng, Zibin
    WSDM '21: PROCEEDINGS OF THE 14TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2021, : 184 - 192