Graph Computing System and Application Based on Large-Scale Information Network

被引:0
|
作者
Xu, Jingbo [1 ,2 ]
Li, Zhao [2 ]
Zeng, Weibin [2 ]
Huang, Jiaming [2 ]
机构
[1] Peking Univ, Beijing, Peoples R China
[2] Alibaba Grp, Hangzhou, Peoples R China
来源
关键词
Graph computing; Distributed system; Incremental evaluation; Information network;
D O I
10.1007/978-981-16-1967-0_12
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
Graph computing is more and more widely used in various fields such as spatial information network and social network. However, the existing graph computing systems have some problems like complex programming and steep learning curve. This paper introduces GRAPE, a distributed large-scale GRAPh Engine, which has the unique features of solid theoretical guarantee, ease of use, auto-parallelization and high performance. The paper also introduces several typical scenarios of graph computing, including entity resolution, link prediction, community detection and graph mining of spatial information network. In these scenarios, various problems have been encountered in the existing systems, such as failure to compute over large-scale data due to the high computation complexity, loss of accuracy due to the cropping of original data and too long execution time. In the face of these challenges, GRAPE is easy to support these computing scenarios with a series of technical improvements. With the deployment of GRAPE in Alibaba, both effectiveness and efficiency of graph computing have been greatly improved.
引用
收藏
页码:158 / 178
页数:21
相关论文
共 50 条
  • [1] A Probabilistic Computing Approach of Attack Graph-Based Nodes in Large-scale Network
    Ye Yun
    Xu Xi-shan
    Qi Zhi-chang
    [J]. 2011 3RD INTERNATIONAL CONFERENCE ON ENVIRONMENTAL SCIENCE AND INFORMATION APPLICATION TECHNOLOGY ESIAT 2011, VOL 10, PT A, 2011, 10 : 3 - 8
  • [2] A reconfigurable monitoring system for large-scale network computing
    Subramanyan, R
    Miguel-Alonso, J
    Fortes, JAB
    [J]. EURO-PAR 2003 PARALLEL PROCESSING, PROCEEDINGS, 2003, 2790 : 98 - 108
  • [3] CNS: Application of Distributed Indexing Based on Large-Scale Graph Data in Legal Protection of Network Personal Information
    Han, Peiqing
    [J]. INTERNATIONAL JOURNAL OF COOPERATIVE INFORMATION SYSTEMS, 2021, 30 (1-4)
  • [4] Petascale computing for large-scale graph problems
    Bader, David A.
    [J]. PARALLEL PROCESSING AND APPLIED MATHEMATICS, 2008, 4967 : 166 - 169
  • [5] Large-Scale Dynamic Graph Updating Algorithm in Distributed Computing System
    Rong Xuanyu
    Cui Huanqing
    [J]. PROCEEDINGS OF 2019 2ND INTERNATIONAL CONFERENCE ON BIG DATA TECHNOLOGIES (ICBDT 2019), 2019, : 248 - 251
  • [6] Petascale computing for large-scale graph problems
    Bader, David A.
    [J]. CISIS 2008: THE SECOND INTERNATIONAL CONFERENCE ON COMPLEX, INTELLIGENT AND SOFTWARE INTENSIVE SYSTEMS, PROCEEDINGS, 2008, : 779 - 779
  • [7] Attack graph generation algorithm for large-scale network system
    [J]. Ye, Y. (yeyun1234@tom.com), 1600, Science Press (50):
  • [8] Prediction of New Media Information Dissemination Speed and Scale Effect Based on Large-Scale Graph Neural Network
    Chen, Qiumeng
    Shen, Yu
    [J]. SCIENTIFIC PROGRAMMING, 2022, 2022
  • [9] GRAPH NEURAL NETWORK FOR LARGE-SCALE NETWORK LOCALIZATION
    Yan, Wenzhong
    Jin, Di
    Lin, Zhidi
    Yin, Feng
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 5250 - 5254
  • [10] Concept of Parallel Graph Processing System for Large-Scale Network Science
    Chernoskutov, Mikhail
    [J]. 2017 INTERNATIONAL MULTI-CONFERENCE ON ENGINEERING, COMPUTER AND INFORMATION SCIENCES (SIBIRCON), 2017, : 206 - 208