Improving I/O Complexity of Triangle Enumeration

被引:0
|
作者
Cui, Yi [1 ]
Xiao, Di [1 ]
Cline, Daren B. H. [1 ]
Loguinov, Dmitri [1 ]
机构
[1] Texas A&M Univ, College Stn, TX 77843 USA
关键词
Random access memory; Image color analysis; Complexity theory; Partitioning algorithms; Runtime; Image edge detection; Big Data; External memory; graph algorithms; modeling;
D O I
10.1109/TKDE.2020.3003259
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the age of big data, many graph algorithms are now required to operate in external memory and deliver performance that does not significantly degrade with the scale of the problem. One particular area that frequently deals with graphs larger than RAM is triangle listing, where the algorithms must carefully piece together edges from multiple partitions to detect cycles. In recent literature, two competing proposals (i.e., Pagh and PCF) have emerged; however, neither one is universally better than the other. Since little is known about the I/O cost of PCF or how these methods compare to each other, we undertake an investigation into the properties of these algorithms, model their I/O cost, understand their shortcomings, and shed light on the conditions under which each method defeats the other. This insight leads us to develop a novel framework we call Trigon that surpasses the I/O performance of both previous techniques in all graphs and under all RAM conditions.
引用
收藏
页码:1815 / 1828
页数:14
相关论文
共 50 条
  • [11] An Efficient Parallel Triangle Enumeration on the MapReduce Framework
    Kim, Hongyeon
    Min, Jun-Ki
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2019, E102D (10) : 1902 - 1915
  • [12] Balanced parallel triangle enumeration with an adaptive algorithm
    Farouzi, Abir
    Zhou, Xiantian
    Bellatreche, Ladjel
    Malki, Mimoun
    Ordonez, Carlos
    DISTRIBUTED AND PARALLEL DATABASES, 2024, 42 (01) : 103 - 141
  • [13] COMPLEXITY OF ENUMERATION AND RELIABILITY PROBLEMS
    VALIANT, LG
    SIAM JOURNAL ON COMPUTING, 1979, 8 (03) : 410 - 421
  • [14] THE COMPLEXITY OF VERTEX ENUMERATION METHODS
    DYER, ME
    MATHEMATICS OF OPERATIONS RESEARCH, 1983, 8 (03) : 381 - 402
  • [15] ENUMERATION AND SOLVING COMPLEXITY OF PREDICATES
    KANOVICH, MI
    DOKLADY AKADEMII NAUK SSSR, 1970, 190 (01): : 23 - &
  • [16] On the Complexity of Hard Enumeration Problems
    Creignou, Nadia
    Kroell, Markus
    Pichler, Reinhard
    Skritek, Sebastian
    Vollmer, Heribert
    LANGUAGE AND AUTOMATA THEORY AND APPLICATIONS (LATA 2017), 2017, 10168 : 183 - 195
  • [17] Pascal triangle, complexity and automata
    Allouche, JP
    Berthe, V
    BULLETIN OF THE BELGIAN MATHEMATICAL SOCIETY-SIMON STEVIN, 1997, 4 (01) : 1 - 23
  • [18] Intersection Representation of Big Data Networks and Triangle Enumeration
    Abdullah, Wali Mohammad
    Awosoga, David
    Hossain, Shahadat
    COMPUTATIONAL SCIENCE - ICCS 2022, PT III, 2022, 13352 : 413 - 424
  • [19] PandaSQL: Parallel Randomized Triangle Enumeration with SQL Queries
    Farouzi, Abir
    Bellatreche, Ladjel
    Ordonez, Carlos
    Pandurangan, Gopal
    Malki, Mimoun
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 3377 - 3380
  • [20] I/O-Efficient Algorithms on Triangle Listing and Counting
    Hu, Xiaocheng
    Tao, Yufei
    Chung, Chin-Wan
    ACM TRANSACTIONS ON DATABASE SYSTEMS, 2014, 39 (04):