Reachability in Large Graphs using Bloom Filters

被引:1
|
作者
Saha, Arkaprava [1 ]
Sengupta, Neha [1 ]
Ramanath, Maya [1 ]
机构
[1] Indian Inst Technol Delhi, Delhi, India
来源
2019 IEEE 35TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDEW 2019) | 2019年
关键词
Reachability; Dynamic graphs; Large graphs; Bloom filters; Low memory footprint; ALGORITHM; INDEX;
D O I
10.1109/ICDEW.2019.000-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reachability queries are a fundamental graph operation with applications in several domains. There has been extensive research over several decades on answering reachability queries efficiently using sophisticated index structures. However, most of these methods are built for static graphs. For graphs that are updated very frequently and are massive in size, maintaining such index structures is often infeasible due to a large memory footprint and extremely slow updates. In this paper, we introduce a technique to compute reachability queries for very large and highly dynamic graphs that minimizes the memory footprint and update time. In particular, we enable a previously proposed, index-free, approximate method for reachability called ARROW on a compact graph representation called Bloom graphs. Bloom graphs use collections of the well known summary data structure called the Bloom filter to store the edges of the graph. In our experimental evaluation with real world graph datasets with up to millions of nodes and edges, we show that using ARROW with a Bloom graph achieves memory savings of up to 50%, while having accuracy close to 100% for all graphs.
引用
收藏
页码:217 / 224
页数:8
相关论文
共 50 条
  • [41] Efficient reachability test on directed graphs and its application to large XML data
    Nakamura, Yuusaku
    Maita, Tetsuya
    Sakamoto, Hiroshi
    2007 IEEE INTERNATIONAL WORKSHOP ON DATABASES FOR NEXT GENERATION RESEARCHERS, 2007, : 25 - +
  • [42] Extended high dimensional indexing approach for reachability queries on very large graphs
    da Silva, Rodrigo Ferreira
    Urrutia, Sebastian
    Hvattum, Lars Magnus
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 181
  • [43] Fast URL lookup using parallel bloom filters
    Zhou, Zhou
    Fu, Wen-Liang
    Song, Tian
    Liu, Qing-Yun
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2015, 43 (09): : 1833 - 1840
  • [44] Using the Power of Two Choices to Improve Bloom Filters
    Lumetta, Steve
    Mitzenmacher, Michael
    INTERNET MATHEMATICS, 2007, 4 (01) : 17 - 33
  • [45] Defect-tolerant nanocomputing using Bloom filters
    Wang, Gang
    Gong, Wenrui
    Kastner, Ryan
    FCCM 2006: 14TH ANNUAL IEEE SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES, PROCEEDINGS, 2006, : 277 - +
  • [46] Set Reconciliation Using Ternary and Invertible Bloom Filters
    Lee, Seungeun
    Byun, Hayoung
    Lim, Hyesook
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (11) : 11885 - 11898
  • [47] Optimizing Distributed Joins with Bloom Filters Using MapReduce
    Zhang, Changchun
    Wu, Lei
    Li, Jing
    COMPUTER APPLICATIONS FOR GRAPHICS, GRID COMPUTING, AND INDUSTRIAL ENVIRONMENT, 2012, 351 : 88 - 95
  • [48] Reachability on suffix tree graphs
    Higa, Yasuto
    Bannai, Hideo
    Inenaga, Shunsuke
    Takeda, Masayuki
    INTERNATIONAL JOURNAL OF FOUNDATIONS OF COMPUTER SCIENCE, 2008, 19 (01) : 147 - 162
  • [49] Error Detection in Ternary CAMs Using Bloom Filters
    Pontarelli, Salvatore
    Ottavi, Marco
    Evans, Adrian
    Wen, Shi-Jie
    DESIGN, AUTOMATION & TEST IN EUROPE, 2013, : 1474 - 1479
  • [50] Location Updates in cellular networks using Bloom Filters
    Subramaniam, Kamala
    Tharp, Alan L.
    Nilsson, Arne A.
    30TH ANNUAL INTERNATIONAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE, VOL 2, SHORT PAPERS/WORKSHOPS/FAST ABSTRACTS/DOCTORAL SYMPOSIUM, PROCEEDINGS, 2006, : 3 - +