A Low Communication Overhead Breadth-First Search Based on Global Bitmap

被引:1
|
作者
Peng, Ziwei [1 ,2 ]
Lu, Yutong [1 ,2 ,3 ]
Cheng, Zhiguang [1 ,2 ,3 ]
Du, Yunfei [2 ,3 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha 410073, Peoples R China
[2] Natl Supercomp Ctr Guangzhou, Guangzhou 510006, Peoples R China
[3] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou 510006, Peoples R China
基金
国家重点研发计划;
关键词
Graph500; Breadth-First Search; Global bitmap; Hybrid approach;
D O I
10.1007/978-3-030-05054-2_9
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Breadth-First Search (BFS) is the underlying kernel algorithm for many graph applications such as social networks, medical informatics, transport systems, etc. Therefore, it has been absorbed as a core of Graph500, used to evaluate the capability of supercomputers in terms of big data processing. In this paper, we introduce into a global bitmap which is used to accelerate two approaches: the top-down and bottom-up. Specifically, the new top-down approach uses the global bitmap to indicate whether the vertices are visited or not, while the new bottom-up approach changes the frontier queue to the global bitmap to indicate whether the vertices are on the frontier. With the help of the global bitmap, the total number of communication messages produced by the BFS will be reduced significantly, and consequentially the BFS is accelerated. Meanwhile, our algorithm is optimized for storage on Knights Landing (KNL). We evaluate our proposal on both the KNL platform and the Tianhe-2 supercomputer. Experimental results demonstrate that the communication was time reduced to roughly 1/4 of the original. We obtain speedups of 2.2-3.1 compared to the top-down approach.
引用
收藏
页码:114 / 129
页数:16
相关论文
共 50 条
  • [41] Breadth-First Search with A Multi-Core Computer
    Belova, Maryia
    Ouyang, Ming
    2017 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2017, : 579 - 587
  • [42] Distributed breadth-first search LTL model checking
    Jiří Barnat
    Ivana Černá
    Formal Methods in System Design, 2006, 29 : 117 - 134
  • [43] Temporal resolution using a breadth-first search algorithm
    Clare Dixon
    Annals of Mathematics and Artificial Intelligence, 1998, 22 : 87 - 115
  • [44] On dynamic breadth-first search in external-memory
    Meyer, Ulrich
    STACS 2008: PROCEEDINGS OF THE 25TH INTERNATIONAL SYMPOSIUM ON THEORETICAL ASPECTS OF COMPUTER SCIENCE, 2008, : 551 - 560
  • [45] Fast Breadth-First Search in Still Less Space
    Hagerup, Torben
    GRAPH-THEORETIC CONCEPTS IN COMPUTER SCIENCE (WG 2019), 2019, 11789 : 93 - 105
  • [46] Breadth-first search and the Andrews-Curtis conjecture
    Havas, G
    Ramsay, C
    INTERNATIONAL JOURNAL OF ALGEBRA AND COMPUTATION, 2003, 13 (01) : 61 - 68
  • [47] An adaptive breadth-first search algorithm on integrated architectures
    Feng Zhang
    Heng Lin
    Jidong Zhai
    Jie Cheng
    Dingyi Xiang
    Jizhong Li
    Yunpeng Chai
    Xiaoyong Du
    The Journal of Supercomputing, 2018, 74 : 6135 - 6155
  • [48] Load-Balanced Breadth-First Search on GPUs
    Zhu, Zhe
    Li, Jianjun
    Li, Guohui
    WEB-AGE INFORMATION MANAGEMENT, WAIM 2014, 2014, 8485 : 435 - 447
  • [49] SlimSell: A Vectorizable Graph Representation for Breadth-First Search
    Besta, Maciej
    Marending, Florian
    Solomonik, Edgar
    Hoefler, Torsten
    2017 31ST IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2017, : 32 - 41
  • [50] Temporal resolution using a breadth-first search algorithm
    Dixon, C
    ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE, 1998, 22 (1-2) : 87 - 115