An efficient algorithm for density-balanced partitioning in distributed PageRank

被引:0
|
作者
Sangamuang, Sumalee [1 ]
Boonma, Pruet [1 ]
Natwichai, Juggapong [1 ]
机构
[1] Chiang Mai Univ, Dept Comp Engn, Data Engn & Network Technol Lab, Chiang Mai 50200, Thailand
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Google's PageRank is the most notable approach for web search ranking. In general, web pages are represented by web-link graph; a web-page is represented by a node, and a link between two pages is represented by an edge. In particular, it is not efficient to perform PageRank of a large web-link graph in a single computer. Distributed systems, such as P2P, are viable choices to address such limitation. In P2P-based PageRank, each computational peer contains a partial web-link graph, i.e., a sub-graph of the global web-link graph, and its PageRank is computed locally. The convergence time of a PageRank calculation is affected by the web-link graph density, i.e., the ratio of the number of edges to the number of nodes, such that if a web-link graph has high density, it will take longer time to converge. As the execution time to compute the P2P-based web ranking is influenced by the execution time of the slowest peer to compute the local ranking, the density-balanced local web-link graph partitioning can be highly desirable. This paper addresses a density-balanced partitioning problem and proposes an efficient algorithm for the problem. The experiment results show that the proposed algorithm can effectively partition graph into density-balanced subgraph with an acceptable cost.
引用
收藏
页码:118 / 123
页数:6
相关论文
共 50 条
  • [41] BRGP: a balanced RDF graph partitioning algorithm for cloud storage
    Leng, Yonglin
    Chen Zhikui
    Zhong, Fangming
    Li, Xiongjiu
    Hu, Yueming
    Yang, Chao
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (14):
  • [42] A multilevel tabu search algorithm for balanced partitioning of unstructured grids
    Mehrdoost, Zahra
    Bahrainian, Seyed Saied
    INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2016, 105 (09) : 678 - 692
  • [43] HEPart: A balanced hypergraph partitioning algorithm for big data applications
    Yang, Wenyin
    Wang, Guojun
    Choo, Kim-Kwang Raymond
    Chen, Shuhong
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 83 : 250 - 268
  • [44] An efficient algorithm for distributed density-based outlier detection on big data
    Bai, Mei
    Wang, Xite
    Xin, Junchang
    Wang, Guoren
    NEUROCOMPUTING, 2016, 181 : 19 - 28
  • [45] An efficient density-based clustering algorithm for vertically partitioned distributed datasets
    Department of Computer Science and Engineering, Southeastern University, Nanjing 210096, China
    不详
    Jisuanji Yanjiu yu Fazhan, 2007, 9 (1612-1617):
  • [46] Design of an efficient load balancing algorithm on distributed networks by employing symmetric balanced incomplete block design
    Lee, O
    Anshel, M
    Chung, I
    IEE PROCEEDINGS-COMMUNICATIONS, 2004, 151 (06): : 535 - 538
  • [47] Hybrid Partitioning-Density Algorithm for K-Means Clustering of Distributed Data Utilizing OPTICS
    Markiewicz, Mikolaj
    Koperwas, Jakub
    INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2019, 15 (04) : 1 - 20
  • [48] AN EFFICIENT DISTRIBUTED THINNING ALGORITHM
    NEUSIUS, C
    OLSZEWSKI, J
    SCHEERER, D
    PARALLEL COMPUTING, 1992, 18 (01) : 47 - 55
  • [49] AN EFFICIENT DISTRIBUTED ORIENTATION ALGORITHM
    VISHKIN, U
    IEEE TRANSACTIONS ON INFORMATION THEORY, 1983, 29 (04) : 624 - 629
  • [50] A load-balanced distributed parallel mining algorithm
    Yu, Kun-Ming
    Zhou, Jiayi
    Hong, Tzung-Pei
    Zhou, Jia-Ling
    EXPERT SYSTEMS WITH APPLICATIONS, 2010, 37 (03) : 2459 - 2464