A NUMA-Aware Parallel Truss Decomposition Algorithm for Large Scale Graphs

被引:0
|
作者
Mou, Zhebin [1 ]
Xiao, Nong [1 ]
Chen, Zhiguang [1 ]
机构
[1] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Truss decomposition; Triangle counting; NUMA; Multithread; Graph analysis;
D O I
10.1007/978-3-030-95388-1_13
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Truss decomposition algorithm is to decompose a graph into a hierarchical subgraph structure. A k-truss (k >= 2) is a subgraph that each edge is in at least k - 2 triangles. The existing algorithm is to first compute the number of triangles for each edge, and then iteratively increase k to peel off the edges that are not in the (k + 1)-truss. Due to the scale of the data and the intensity of computations, truss decomposition algorithm on the billion-side graph may take more than hours on a commodity server. In addition, today, more servers adopt NUMA architecture, which also affects the scalability of the algorithm. Therefore, we propose a NUMA-aware shared-memory parallel algorithm to accelerate the truss decomposition for NUMA systems by (1) computing different levels of k-truss between each NUMA nodes (2) dividing the range of k heuristically to ensure load balance (3) optimizing data structure and triangle counting method to reduce remote memory access, data contention and data skew. Our experiments show that on real-world datasets our OpenMP implementation can accelerate truss decomposition effectively on NUMA systems.
引用
收藏
页码:193 / 212
页数:20
相关论文
共 50 条
  • [1] Massively Parallel NUMA-Aware Hash Joins
    Lang, Harald
    Leis, Viktor
    Albutiu, Martina-Cezara
    Neumann, Thomas
    Kemper, Alfons
    IN MEMORY DATA MANAGEMENT AND ANALYSIS, 2015, 8921 : 3 - 14
  • [2] Evaluation of NUMA-Aware Scheduling in Warehouse-Scale Clusters
    Wu, Richard
    Zhang, Xiao
    Kong, Xiangling
    Chen, Yangyi
    Jnagal, Rohit
    Hagmann, Robert
    2019 IEEE 12TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (IEEE CLOUD 2019), 2019, : 475 - 477
  • [3] NUMA-Aware Scalable and Efficient In-Memory Aggregation on Large Domains
    Wang, Li
    Zhou, Minqi
    Zhang, Zhenjie
    Shan, Ming-Chien
    Zhou, Aoying
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (04) : 1071 - 1084
  • [4] An Auto-Tuning Framework for a NUMA-Aware Hessenberg Reduction Algorithm
    Eljammaly, Mahmoud
    Karlsson, Lars
    Kagstrom, Bo
    COMPANION OF THE 2018 ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING (ICPE '18), 2018, : 5 - 8
  • [5] NUMA-aware Scheduling and Memory Allocation for data-flow task-parallel Applications
    Drebes, Andi
    Pop, Antoniu
    Heydemann, Karine
    Drach, Nathalie
    Cohen, Albert
    ACM SIGPLAN NOTICES, 2016, 51 (08) : 391 - 392
  • [6] A relax-and-round optimization algorithm for online NUMA-aware virtual machine placement
    Hu, Jianchen
    Liu, Kang
    Zhang, Yuexian
    Sun, Xunhang
    Zhai, Qiaozhu
    Cao, Xiaoyu
    Zhu, Lei
    Su, Li
    Zhou, Wenli
    Xia, Yi
    Gao, Feng
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 271
  • [7] ERIS Live: A NUMA-Aware In-Memory Storage Engine for Tera-Scale Multiprocessor Systems
    Kiefer, Tim
    Kissinger, Thomas
    Schlegel, Benjamin
    Habich, Dirk
    Molka, Daniel
    Lehner, Wolfgang
    SIGMOD'14: PROCEEDINGS OF THE 2014 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2014, : 689 - 692
  • [8] NUMA-Aware Virtual Machine Placement: New MMMK Model and Column Generation-Based Decomposition Approach
    Sun, Xunhang
    Cao, Xiaoyu
    Zhai, Qiaozhu
    Tan, Haisheng
    Hu, Jianchen
    Zhu, Lei
    Su, Li
    Zhou, Wenli
    Gao, Feng
    Guan, Xiaohong
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 1817 - 1832
  • [9] NUMA-Aware Virtual Machine Placement: New MMMK Model and Column Generation-Based Decomposition Approach
    Sun, Xunhang
    Cao, Xiaoyu
    Zhai, Qiaozhu
    Tan, Haisheng
    Hu, Jianchen
    Zhu, Lei
    Su, Li
    Zhou, Wenli
    Gao, Feng
    Guan, Xiaohong
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 1817 - 1832
  • [10] A NUMA-Aware Provably-Efficient Task-Parallel Platform Based on the Work-First Principle
    Deters, Justin
    Wu, Jiaye
    Xu, Yifan
    Lee, I-Ting Angelina
    2018 IEEE INTERNATIONAL SYMPOSIUM ON WORKLOAD CHARACTERIZATION (IISWC), 2018, : 59 - 70