A NUMA-Aware Parallel Truss Decomposition Algorithm for Large Scale Graphs

被引:0
|
作者
Mou, Zhebin [1 ]
Xiao, Nong [1 ]
Chen, Zhiguang [1 ]
机构
[1] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Truss decomposition; Triangle counting; NUMA; Multithread; Graph analysis;
D O I
10.1007/978-3-030-95388-1_13
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Truss decomposition algorithm is to decompose a graph into a hierarchical subgraph structure. A k-truss (k >= 2) is a subgraph that each edge is in at least k - 2 triangles. The existing algorithm is to first compute the number of triangles for each edge, and then iteratively increase k to peel off the edges that are not in the (k + 1)-truss. Due to the scale of the data and the intensity of computations, truss decomposition algorithm on the billion-side graph may take more than hours on a commodity server. In addition, today, more servers adopt NUMA architecture, which also affects the scalability of the algorithm. Therefore, we propose a NUMA-aware shared-memory parallel algorithm to accelerate the truss decomposition for NUMA systems by (1) computing different levels of k-truss between each NUMA nodes (2) dividing the range of k heuristically to ensure load balance (3) optimizing data structure and triangle counting method to reduce remote memory access, data contention and data skew. Our experiments show that on real-world datasets our OpenMP implementation can accelerate truss decomposition effectively on NUMA systems.
引用
收藏
页码:193 / 212
页数:20
相关论文
共 50 条
  • [31] Two-level Index for Truss Community Query in Large-Scale Graphs
    Lu, Zheng
    Feng, Yunhe
    Cao, Qing
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [32] A parallel maximum clique algorithm for large and massive sparse graphs
    San Segundo, Pablo
    Lopez, Alvaro
    Artieda, Jorge
    Pardalos, Panos M.
    OPTIMIZATION LETTERS, 2017, 11 (02) : 343 - 358
  • [33] A parallel fuzzy clustering algorithm for large graphs using Pregel
    Bhatia, Vandana
    Rani, Rinkle
    EXPERT SYSTEMS WITH APPLICATIONS, 2017, 78 : 135 - 144
  • [34] Parallel decomposition of large-scale stochastic nonlinear programs
    Birge, JR
    Rosa, CH
    ANNALS OF OPERATIONS RESEARCH, 1996, 64 : 39 - 65
  • [35] Large Scale Instance Selection by Means of a Parallel Algorithm
    de Haro-Garcia, Aida
    Antonio Romero del Castillo, Juan
    Garcia-Pedrajas, Nicolas
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2010, 2010, 6283 : 1 - 12
  • [36] A Parallel Rendering Algorithm for Large-scale Terrain
    Bing, He
    Lei, Sui
    2010 SECOND INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATIONS: ICCEA 2010, PROCEEDINGS, VOL 1, 2010, : 530 - 536
  • [37] Parallel SSLE algorithm for large scale constrained optimization
    Zheng, Fangying
    Han, Congying
    Wang, Yongli
    APPLIED MATHEMATICS AND COMPUTATION, 2011, 217 (12) : 5377 - 5384
  • [38] An efficient parallel clustering algorithm for large scale database
    School of Electronic Information, Wuhan University, Wuhan, Hubei, China
    不详
    不详
    J. Softw., 2009, 10 (1119-1126):
  • [39] A parallel algorithm for analysis of large-scale networks
    Alexander, AE
    Ali, AL
    COMPUTERS & INDUSTRIAL ENGINEERING, 1996, 31 (1-2) : 375 - 378
  • [40] A Simulation Research Method for Large-scale Parallel Truss Deployment Mechanism in Space
    Xie, Shaoming
    Li, Chuankun
    Liu, Xihui
    Bian, Yushu
    2019 WORLD ROBOT CONFERENCE SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION (WRC SARA 2019), 2019, : 347 - 353