iPregel: Strategies to Deal with an Extreme Form of Irregularity in Vertex-Centric Graph Processing

被引:1
|
作者
Capelli, Ludovic Anthony Richard [1 ]
Brown, Nick [2 ]
Bull, Jonathan Mark [2 ]
机构
[1] Univ Edinburgh, Sch Informat, Edinburgh, Midlothian, Scotland
[2] Univ Edinburgh, Edinburgh Parallel Comp Ctr, Edinburgh, Midlothian, Scotland
基金
英国工程与自然科学研究理事会;
关键词
vertex-centric; hybrid combiner; structure externalisation; edge-centric workload; load-balancing; cache efficiency;
D O I
10.1109/IA349570.2019.00013
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Over the last decade, the vertex-centric programming model has attracted significant attention in the world of graph processing, resulting in the emergence of a number of vertex-centric frameworks. Its simple programming interface, where computation is expressed from a vertex point of view, offers both ease of programming to the user and inherent parallelism for the underlying framework to leverage. However, vertex-centric programs represent an extreme form of irregularity, both inter and intra core. This is because they exhibit a variety of challenges from a workload that may greatly vary across supersteps, through fine-grain synchronisations, to memory accesses that are unpredictable both in terms of quantity and location. In this paper, we explore three optimisations which address these irregular challenges; a hybrid combiner carefully coupling lock-free and lock-based combinations, the partial externalisation of vertex structures to improve locality and the shift to an edge-centric representation of the workload. The optimisations were integrated into the iPregel vertex-centric framework, enabling the evaluation of each optimisation in the context of graph processing across three general purpose benchmarks common in the vertex-centric community, each run on four publicly available graphs covering all orders of magnitude from a million to a billion edges. The result of this work is a set of techniques which we believe not only provide a significant performance improvement in vertex-centric graph processing, but are also applicable more generally to irregular applications.
引用
收藏
页码:45 / 50
页数:6
相关论文
共 41 条