Reachability in Large Graphs using Bloom Filters

被引:1
|
作者
Saha, Arkaprava [1 ]
Sengupta, Neha [1 ]
Ramanath, Maya [1 ]
机构
[1] Indian Inst Technol Delhi, Delhi, India
来源
2019 IEEE 35TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDEW 2019) | 2019年
关键词
Reachability; Dynamic graphs; Large graphs; Bloom filters; Low memory footprint; ALGORITHM; INDEX;
D O I
10.1109/ICDEW.2019.000-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reachability queries are a fundamental graph operation with applications in several domains. There has been extensive research over several decades on answering reachability queries efficiently using sophisticated index structures. However, most of these methods are built for static graphs. For graphs that are updated very frequently and are massive in size, maintaining such index structures is often infeasible due to a large memory footprint and extremely slow updates. In this paper, we introduce a technique to compute reachability queries for very large and highly dynamic graphs that minimizes the memory footprint and update time. In particular, we enable a previously proposed, index-free, approximate method for reachability called ARROW on a compact graph representation called Bloom graphs. Bloom graphs use collections of the well known summary data structure called the Bloom filter to store the edges of the graph. In our experimental evaluation with real world graph datasets with up to millions of nodes and edges, we show that using ARROW with a Bloom graph achieves memory savings of up to 50%, while having accuracy close to 100% for all graphs.
引用
收藏
页码:217 / 224
页数:8
相关论文
共 50 条
  • [21] Utilizing Community Centers to Answer Reachability Queries for Large Graphs
    Zhang, Yifei
    Wang, Guoren
    Zhao, Changkuan
    Zhang, Ende
    2013 10TH WEB INFORMATION SYSTEM AND APPLICATION CONFERENCE (WISA 2013), 2013, : 205 - 210
  • [22] Reachability Queries on Large Dynamic Graphs: A Total Order Approach
    Zhu, Andy Diwen
    Lin, Wenqing
    Wang, Sibo
    Xiao, Xiaokui
    SIGMOD'14: PROCEEDINGS OF THE 2014 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2014, : 1323 - 1334
  • [23] Reachability indexing for large-scale graphs: Studies and forecasts
    Fu, Lizhen
    Meng, Xiaofeng
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2015, 52 (01): : 116 - 129
  • [24] GRAIL: a scalable index for reachability queries in very large graphs
    Yildirim, Hilmi
    Chaoji, Vineet
    Zaki, Mohammed J.
    VLDB JOURNAL, 2012, 21 (04): : 509 - 534
  • [25] Design and Evaluation of a Hierarchical Service Management Method using Bloom Filters for Large MANETs
    Bae, Ihn-Han
    Lee, Kyung-Sook
    2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31, 2008, : 2386 - 2390
  • [26] Fast SPARQL Join Processing between Distributed Streams and Stored RDF Graphs Using Bloom Filters
    Dia, Amadou Fall
    Aoul, Zakia Kazi
    Boly, Aliou
    Metais, Elisabeth
    2018 12TH INTERNATIONAL CONFERENCE ON RESEARCH CHALLENGES IN INFORMATION SCIENCE (RCIS), 2018,
  • [27] On reachability in graphs with obstacles
    Agarwal, Udit
    Kapoor, Kalpesh
    DISCRETE MATHEMATICS ALGORITHMS AND APPLICATIONS, 2015, 7 (04)
  • [28] BLOOM FILTERS
    WELLS, B
    DR DOBBS JOURNAL, 1995, 20 (01): : 12 - 12
  • [29] Path similarity evaluation using Bloom filters
    Donnet, Benoit
    Gueye, Bamba
    Kaafar, Mohamed All
    COMPUTER NETWORKS, 2012, 56 (02) : 858 - 869
  • [30] Jacobian sparsity detection using Bloom filters
    Hovland, Paul D.
    Optimization Methods and Software, 2024,