A Low Communication Overhead Breadth-First Search Based on Global Bitmap

被引:1
|
作者
Peng, Ziwei [1 ,2 ]
Lu, Yutong [1 ,2 ,3 ]
Cheng, Zhiguang [1 ,2 ,3 ]
Du, Yunfei [2 ,3 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha 410073, Peoples R China
[2] Natl Supercomp Ctr Guangzhou, Guangzhou 510006, Peoples R China
[3] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou 510006, Peoples R China
基金
国家重点研发计划;
关键词
Graph500; Breadth-First Search; Global bitmap; Hybrid approach;
D O I
10.1007/978-3-030-05054-2_9
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Breadth-First Search (BFS) is the underlying kernel algorithm for many graph applications such as social networks, medical informatics, transport systems, etc. Therefore, it has been absorbed as a core of Graph500, used to evaluate the capability of supercomputers in terms of big data processing. In this paper, we introduce into a global bitmap which is used to accelerate two approaches: the top-down and bottom-up. Specifically, the new top-down approach uses the global bitmap to indicate whether the vertices are visited or not, while the new bottom-up approach changes the frontier queue to the global bitmap to indicate whether the vertices are on the frontier. With the help of the global bitmap, the total number of communication messages produced by the BFS will be reduced significantly, and consequentially the BFS is accelerated. Meanwhile, our algorithm is optimized for storage on Knights Landing (KNL). We evaluate our proposal on both the KNL platform and the Tianhe-2 supercomputer. Experimental results demonstrate that the communication was time reduced to roughly 1/4 of the original. We obtain speedups of 2.2-3.1 compared to the top-down approach.
引用
收藏
页码:114 / 129
页数:16
相关论文
共 50 条
  • [31] Research of FTP File Traversal Method based on Breadth-First Search
    Yan, Lei
    Ma, Hong-lin
    Kang, Li
    INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2012), 2013, 8768
  • [32] A method of characterizing network topology based on the breadth-first search tree
    Zhou, Bin
    He, Zhe
    Wang, Nianxin
    Wang, Bing-Hong
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2016, 450 : 682 - 686
  • [33] A Communication-Efficient Self-stabilizing Algorithm for Breadth-First Search Trees
    Datta, Ajoy K.
    Larmore, Lawrence L.
    Masuzawa, Toshimitsu
    PRINCIPLES OF DISTRIBUTED SYSTEMS, OPODIS 2014, 2014, 8878 : 293 - 306
  • [34] Evaluation and Optimization of Breadth-First Search on NUMA Cluster
    Cui, Zehan
    Chen, Licheng
    Chen, Mingyu
    Bao, Yungang
    Huang, Yongbing
    Lv, Huiwei
    2012 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2012, : 438 - 448
  • [35] Distributed breadth-first search LTL model checking
    Barnat, Jiri
    Cerna, Ivana
    FORMAL METHODS IN SYSTEM DESIGN, 2006, 29 (02) : 117 - 134
  • [36] Optimal Algebraic Breadth-First Search for Sparse Graphs
    Burkhardt, Paul
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2021, 15 (05)
  • [37] A breadth-first search applied to the minimization of the open stacks
    Moreira de Carvalho, Marco Antonio
    Soma, Nei Yoshihiro
    JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2015, 66 (06) : 936 - 946
  • [38] Implementing Breadth-First Search on a compact supercomputer Suiren
    Mitsuishi, Takuji
    Kaneda, Takahiro
    Torii, Sunao
    Amano, Hideharu
    2016 FOURTH INTERNATIONAL SYMPOSIUM ON COMPUTING AND NETWORKING (CANDAR), 2016, : 395 - 401
  • [39] Semi-dynamic breadth-first search in digraphs
    Franciosa, PG
    Frigioni, D
    Giaccio, R
    THEORETICAL COMPUTER SCIENCE, 2001, 250 (1-2) : 201 - 217
  • [40] CyGraph: A Reconfigurable Architecture for Parallel Breadth-First Search
    Attia, Osama G.
    Johnson, Tyler
    Townsend, Kevin
    Jones, Philip
    Zambreno, Joseph
    PROCEEDINGS OF 2014 IEEE INTERNATIONAL PARALLEL & DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2014, : 228 - 235