Graph Computing System and Application Based on Large-Scale Information Network

被引:0
|
作者
Xu, Jingbo [1 ,2 ]
Li, Zhao [2 ]
Zeng, Weibin [2 ]
Huang, Jiaming [2 ]
机构
[1] Peking Univ, Beijing, Peoples R China
[2] Alibaba Grp, Hangzhou, Peoples R China
来源
关键词
Graph computing; Distributed system; Incremental evaluation; Information network;
D O I
10.1007/978-981-16-1967-0_12
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
Graph computing is more and more widely used in various fields such as spatial information network and social network. However, the existing graph computing systems have some problems like complex programming and steep learning curve. This paper introduces GRAPE, a distributed large-scale GRAPh Engine, which has the unique features of solid theoretical guarantee, ease of use, auto-parallelization and high performance. The paper also introduces several typical scenarios of graph computing, including entity resolution, link prediction, community detection and graph mining of spatial information network. In these scenarios, various problems have been encountered in the existing systems, such as failure to compute over large-scale data due to the high computation complexity, loss of accuracy due to the cropping of original data and too long execution time. In the face of these challenges, GRAPE is easy to support these computing scenarios with a series of technical improvements. With the deployment of GRAPE in Alibaba, both effectiveness and efficiency of graph computing have been greatly improved.
引用
收藏
页码:158 / 178
页数:21
相关论文
共 50 条
  • [41] Traffic Flow Prediction Model for Large-Scale Road Network Based on Cloud Computing
    Yang, Zhaosheng
    Mei, Duo
    Yang, Qingfang
    Zhou, Huxing
    Li, Xiaowen
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2014, 2014
  • [42] Based on the Part of Routing Information Congestion Modeling Research with the Large-Scale Network
    An Shuzhao
    Wang Zhaohui
    [J]. INTERNATIONAL JOURNAL OF FUTURE GENERATION COMMUNICATION AND NETWORKING, 2014, 7 (02): : 173 - 182
  • [43] Large-scale Prediction of Drug-Protein Interactions Based on Network Information
    Li, Xinsheng
    Ma, Daichuan
    Ren, Yan
    Luo, Jiesi
    Li, Yizhou
    [J]. CURRENT COMPUTER-AIDED DRUG DESIGN, 2022, 18 (01) : 64 - 72
  • [44] A large-scale graph search algorithms Based LRU
    Xiao Li
    Xiao Jing-Zhong
    [J]. 2011 INTERNATIONAL CONFERENCE ON FUTURE COMPUTER SCIENCE AND APPLICATION (FCSA 2011), VOL 3, 2011, : 72 - 75
  • [45] Complexity measurement of large-scale software system based on complex network
    [J]. Li, D. (lidali001@163.com), 1600, Academy Publisher (09):
  • [46] TIGER: Training Inductive Graph Neural Network for Large-scale Knowledge Graph Reasoning
    Wang, Kai
    Xu, Yuwei
    Luo, Siqiang
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2024, 17 (10): : 2459 - 2472
  • [47] Analyses toward a prediction system for a large-scale volunteer computing system
    Sekma, Nahla Chabbah
    Dridi, Najoua
    Elleuch, Ahmed
    [J]. 2015 WORLD CONGRESS ON INFORMATION TECHNOLOGY AND COMPUTER APPLICATIONS (WCITCA), 2015,
  • [48] A graph-powered large-scale fraud detection system
    Zhao Li
    Biao Wang
    Jiaming Huang
    Yilun Jin
    Zenghui Xu
    Ji Zhang
    Jianliang Gao
    [J]. International Journal of Machine Learning and Cybernetics, 2024, 15 : 115 - 128
  • [49] LWCS: A Large-scale Web Page Classification System Based on Anchor Graph Hashing
    Zheng, Yi
    Sun, Chengcheng
    Zhu, Chengzhang
    Lan, Xv
    Fu, Xiang
    Han, Weihong
    [J]. PROCEEDINGS OF 2015 6TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE, 2015, : 90 - 94
  • [50] A graph-powered large-scale fraud detection system
    Li, Zhao
    Wang, Biao
    Huang, Jiaming
    Jin, Yilun
    Xu, Zenghui
    Zhang, Ji
    Gao, Jianliang
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (01) : 115 - 128