A Low Communication Overhead Breadth-First Search Based on Global Bitmap

被引:1
|
作者
Peng, Ziwei [1 ,2 ]
Lu, Yutong [1 ,2 ,3 ]
Cheng, Zhiguang [1 ,2 ,3 ]
Du, Yunfei [2 ,3 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha 410073, Peoples R China
[2] Natl Supercomp Ctr Guangzhou, Guangzhou 510006, Peoples R China
[3] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou 510006, Peoples R China
基金
国家重点研发计划;
关键词
Graph500; Breadth-First Search; Global bitmap; Hybrid approach;
D O I
10.1007/978-3-030-05054-2_9
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Breadth-First Search (BFS) is the underlying kernel algorithm for many graph applications such as social networks, medical informatics, transport systems, etc. Therefore, it has been absorbed as a core of Graph500, used to evaluate the capability of supercomputers in terms of big data processing. In this paper, we introduce into a global bitmap which is used to accelerate two approaches: the top-down and bottom-up. Specifically, the new top-down approach uses the global bitmap to indicate whether the vertices are visited or not, while the new bottom-up approach changes the frontier queue to the global bitmap to indicate whether the vertices are on the frontier. With the help of the global bitmap, the total number of communication messages produced by the BFS will be reduced significantly, and consequentially the BFS is accelerated. Meanwhile, our algorithm is optimized for storage on Knights Landing (KNL). We evaluate our proposal on both the KNL platform and the Tianhe-2 supercomputer. Experimental results demonstrate that the communication was time reduced to roughly 1/4 of the original. We obtain speedups of 2.2-3.1 compared to the top-down approach.
引用
收藏
页码:114 / 129
页数:16
相关论文
共 50 条
  • [1] Breadth-first search
    Swaine, M
    DR DOBBS JOURNAL, 2000, 25 (06): : 100 - +
  • [2] Breadth-first heuristic search
    Zhou, R
    Hansen, EA
    ARTIFICIAL INTELLIGENCE, 2006, 170 (4-5) : 385 - 408
  • [3] Efficient Breadth-First Reduct Search
    Boonjing, Veera
    Chanvarasuth, Pisit
    MATHEMATICS, 2020, 8 (05)
  • [4] A compressed breadth-first search for satisfiability
    Motter, DRB
    Markov, IL
    ALGORITHM ENGINEERING AND EXPERIMENTS, 2002, 2409 : 29 - 42
  • [5] Reducing Communication in Parallel Breadth-First Search on Distributed Memory Systems
    Lu, Huiwei
    Tan, Guangming
    Chen, Mingyu
    Sun, Ninghui
    2014 IEEE 17TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE), 2014, : 1261 - 1268
  • [6] Orthopedic disease classification based on breadth-first search algorithm
    Elshewey, Ahmed M.
    Osman, Ahmed M.
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [7] Virtual network embedding algorithm based on breadth-first search
    Peng, Limin
    Sichuan Daxue Xuebao (Gongcheng Kexue Ban)/Journal of Sichuan University (Engineering Science Edition), 2015, 47 (02): : 117 - 122
  • [8] Grid breadth-first search algorithm based on asynchronous automation
    Bu, Guan-Ying
    Xu, Zhi-Wei
    2002, Science Press (39):
  • [9] Research on the Search Strategy of Complex Network Based on Breadth-first
    Cheng Bo
    MECHATRONICS ENGINEERING, COMPUTING AND INFORMATION TECHNOLOGY, 2014, 556-562 : 5348 - 5351
  • [10] Measuring the Search Effectiveness of a Breadth-First Crawl
    Fetterly, Dennis
    Craswell, Nick
    Vinay, Vishwa
    ADVANCES IN INFORMATION RETRIEVAL, PROCEEDINGS, 2009, 5478 : 388 - +