SCALABLE ALGORITHMS FOR LARGE AND DYNAMIC NETWORKS: REDUCING BIG DATA FOR SMALL COMPUTATIONS

被引:0
|
作者
Saniee, Iraj [1 ]
机构
[1] Bell Labs, Alcatel Lucent, Math Networks & Syst Res Dept, Murray Hill, NJ 07974 USA
关键词
D O I
10.15325/BLTJ.2015.2437465
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we summarize recent research regarding a novel characterization of large-scale real-life informational networks which can be leveraged to speed computations for network analytics purposes by orders of magnitude. First, using publicly available data, we show that informational networks not only satisfy well-known principles such as the small-world property and variants of the power law degree distribution, but that they also exhibit the geometric property of large-scale negative curvature, also referred to as hyperbolicity. We then provide examples of large-scale physical networks that universally lack this property, thus showing that hyperbolicity is not an ever-present feature of real-life networks in general. We document how hyperbolicity leads to unusually high centrality in informational networks. We then describe an approximation of hyperbolic networks that leverages the observed property of high centrality. We provide evidence that the fidelity of the proposed approximation is not only high for applications such as distance approximation, but that it can speed computation by a factor of 1000X or more. Finally, we discuss two applications of our proposed linear-time distance approximation for informational networks: one for personalized ranking and the other for clustering. These and many more algorithms yet to be developed take full advantage of our proposed tree-approximation of hyperbolic networks and further demonstrate its power and utility. © 2015 Alcatel-Lucent.
引用
收藏
页码:23 / 33
页数:11
相关论文
共 50 条
  • [1] Scalable Clustering Algorithms for Big Data: A Review
    Mahdi, Mahmoud A.
    Hosny, Khalid M.
    Elhenawy, Ibrahim
    [J]. IEEE ACCESS, 2021, 9 : 80015 - 80027
  • [2] Scalable Classification for Large Dynamic Networks
    Yao, Yibo
    Holder, Lawrence B.
    [J]. PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 609 - 618
  • [3] Scalable Algorithms for Large Competing Risks Data
    Kawaguchi, Eric S.
    Shen, Jenny, I
    Suchard, Marc A.
    Li, Gang
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2021, 30 (03) : 685 - 693
  • [4] Scalable big earth observation data mining algorithms: a review
    Sisodiya, Neha
    Dube, Nitant
    Prakash, Om
    Thakkar, Priyank
    [J]. EARTH SCIENCE INFORMATICS, 2023, 16 (3) : 1993 - 2016
  • [5] Scalable big earth observation data mining algorithms: a review
    Neha Sisodiya
    Nitant Dube
    Om Prakash
    Priyank Thakkar
    [J]. Earth Science Informatics, 2023, 16 : 1993 - 2016
  • [6] Tweaking gossip algorithms for computations In large-scale networks
    Dulman, Stefan
    Pauwels, Eric
    [J]. 2015 IEEE TENTH INTERNATIONAL CONFERENCE ON INTELLIGENT SENSORS, SENSOR NETWORKS AND INFORMATION PROCESSING (ISSNIP), 2015,
  • [7] Handling Vertex Deletions in Memory Scalable Anytime Anywhere Algorithms for Large and Dynamic Social Networks
    Santos, Eunice E.
    Korah, John
    Murugappan, Vairavan
    [J]. 2018 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2018), 2018, : 1153 - 1162
  • [8] Fast Scalable Selection Algorithms for Large Scale Data
    Thompson, Lee Parnell
    Xu, Weijia
    Miranker, Daniel P.
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2013,
  • [9] Big Data and Location Based Dynamic Power Control for Small Cell Networks
    Li, Yi
    Yang, Yucang
    Fan, Xingyu
    Lu, Jun
    Chen, Weiwei
    [J]. SIGNAL AND INFORMATION PROCESSING, NETWORKING AND COMPUTERS, 2018, 473 : 468 - 474
  • [10] Parallel and Distributed Machine Learning Algorithms for Scalable Big Data Analytics
    Bal, Henri
    Pal, Arindam
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 108 : 1159 - 1161