Efficient Compression on Real World Directed Graphs

被引:2
|
作者
Li, Guohua [1 ]
Rao, Weixiong [1 ]
Jin, Zhongxiao [2 ]
机构
[1] Tongji Univ, Sch Software Engn, Shanghai, Peoples R China
[2] SAIC Motor AI Lab, Shanghai, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Compression; Graph clustering; Graph computation algorithms; FRAMEWORK; WEB;
D O I
10.1007/978-3-319-63579-8_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Real world graphs typically exhibit power law degrees, and many of them are directed graphs. The growing scale of such graphs has made efficient execution of graph computation very challenging. Reducing graph size to fit in memory, for example by using the technique of lossless compression, is crucial in cutting the cost of large scale graph computation. Unfortunately, literature work on graph compression still suffers from issues including low compression ration and high decompression overhead. To address the above issue, in this paper, we propose a novel compression approach. The basic idea of our graph compression is to first cluster graph adjacency matrix via graph structure information, and then represent the clustered matrix by lists of encoded numbers. Our extensive evaluation on real data sets validates the tradeoff between space cost saving and graph computation time, and verifies the advantages of our work over state of art SlashRarn [ 1, 2] and Ligra+ [3].
引用
收藏
页码:116 / 131
页数:16
相关论文
共 50 条
  • [1] On Lossy Compression of Directed Graphs
    Bustin, Ronit
    Shayevitz, Ofer
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (04) : 2101 - 2122
  • [2] HotGraph: Efficient Asynchronous Processing for Real-World Graphs
    Zhang, Yu
    Liao, Xiaofei
    Jin, Hai
    Gu, Lin
    Tan, Guang
    Zhou, Bing Bing
    IEEE TRANSACTIONS ON COMPUTERS, 2017, 66 (05) : 799 - 809
  • [3] Directionality of real world networks as predicted by path length in directed and undirected graphs
    Rosen, Yonatan
    Louzoun, Yoram
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2014, 401 : 118 - 129
  • [4] Study on Partitioning Real-world Directed Graphs of Skewed Degree Distribution
    Yan, Jie
    Tan, Guangming
    Sun, Ninghui
    2015 44TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING (ICPP), 2015, : 699 - 708
  • [5] Efficient compression of Web graphs
    Asano, Yasuhito
    Miyawaki, Yuya
    Nishizeki, Takao
    COMPUTING AND COMBINATORICS, PROCEEDINGS, 2008, 5092 : 1 - +
  • [6] Efficient Compression of Web Graphs
    Asano, Yasuhito
    Miyawaki, Yuya
    Nishizeki, Takao
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2009, E92A (10) : 2454 - 2462
  • [7] XML Compression via Directed Acyclic Graphs
    Bousquet-Melou, Mireille
    Lohrey, Markus
    Maneth, Sebastian
    Noeth, Eric
    THEORY OF COMPUTING SYSTEMS, 2015, 57 (04) : 1322 - 1371
  • [8] XML Compression via Directed Acyclic Graphs
    Mireille Bousquet-Mélou
    Markus Lohrey
    Sebastian Maneth
    Eric Noeth
    Theory of Computing Systems, 2015, 57 : 1322 - 1371
  • [9] Efficient Bubble Enumeration in Directed Graphs
    Birmele, Etienne
    Crescenzi, Pierluigi
    Ferreira, Rui
    Grossi, Roberto
    Lacroix, Vincent
    Marino, Andrea
    Pisanti, Nadia
    Sacomoto, Gustavo
    Sagot, Marie-France
    STRING PROCESSING AND INFORMATION RETRIEVAL: 19TH INTERNATIONAL SYMPOSIUM, SPIRE 2012, 2012, 7608 : 118 - 129
  • [10] Efficient Exact Minimum.. -Core Search in Real-World Graphs
    Zhang, Qifan
    Liu, Shengxin
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 3391 - 3401