共 41 条
iPregel: Strategies to Deal with an Extreme Form of Irregularity in Vertex-Centric Graph Processing
被引:1
|作者:
Capelli, Ludovic Anthony Richard
[1
]
Brown, Nick
[2
]
Bull, Jonathan Mark
[2
]
机构:
[1] Univ Edinburgh, Sch Informat, Edinburgh, Midlothian, Scotland
[2] Univ Edinburgh, Edinburgh Parallel Comp Ctr, Edinburgh, Midlothian, Scotland
来源:
基金:
英国工程与自然科学研究理事会;
关键词:
vertex-centric;
hybrid combiner;
structure externalisation;
edge-centric workload;
load-balancing;
cache efficiency;
D O I:
10.1109/IA349570.2019.00013
中图分类号:
TP3 [计算技术、计算机技术];
学科分类号:
0812 ;
摘要:
Over the last decade, the vertex-centric programming model has attracted significant attention in the world of graph processing, resulting in the emergence of a number of vertex-centric frameworks. Its simple programming interface, where computation is expressed from a vertex point of view, offers both ease of programming to the user and inherent parallelism for the underlying framework to leverage. However, vertex-centric programs represent an extreme form of irregularity, both inter and intra core. This is because they exhibit a variety of challenges from a workload that may greatly vary across supersteps, through fine-grain synchronisations, to memory accesses that are unpredictable both in terms of quantity and location. In this paper, we explore three optimisations which address these irregular challenges; a hybrid combiner carefully coupling lock-free and lock-based combinations, the partial externalisation of vertex structures to improve locality and the shift to an edge-centric representation of the workload. The optimisations were integrated into the iPregel vertex-centric framework, enabling the evaluation of each optimisation in the context of graph processing across three general purpose benchmarks common in the vertex-centric community, each run on four publicly available graphs covering all orders of magnitude from a million to a billion edges. The result of this work is a set of techniques which we believe not only provide a significant performance improvement in vertex-centric graph processing, but are also applicable more generally to irregular applications.
引用
收藏
页码:45 / 50
页数:6
相关论文