Shared-Nothing Distributed Enumeration of 2-Plexes

被引:2
|
作者
Conte, Alessio [1 ]
Firmani, Donatella [2 ]
Patrignani, Maurizio [2 ]
Torlone, Riccardo [2 ]
机构
[1] Univ Pisa, Pisa, Italy
[2] Roma Tre Univ, Rome, Italy
关键词
Community detection; Shared Nothing; 2-Plexes; pseudocliques; CLIQUES;
D O I
10.1145/3357384.3358083
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We present a novel approach for the detection of 2-plexes, a popular relaxation of cliques used for modeling network communities. Specifically, with the purpose of identifying theoretically sound methods for community detection on a large scale, we introduce the first shared-nothing distributed algorithm for this problem. This result opens a new research direction for scalable community detection. Our proposal has three main ingredients: (i) we reduce the problem of finding 2-plexes to that of finding cliques; (ii) we leverage known algorithms for fast computation of cliques; (iii) we exploit a decomposition technique for a distributed shared-nothing computation. Preliminary experiments on a 10-nodes cluster running Spark confirm the effectiveness of our approach.
引用
收藏
页码:2469 / 2472
页数:4
相关论文
共 50 条
  • [1] Performance issues in distributed shared-nothing information-retrieval systems
    Tomasic, Anthony
    Garcia-Molina, Hector
    [J]. Information Processing and Management, 1996, 32 (06): : 647 - 665
  • [2] On the Use of Shared Storage in Shared-Nothing Environments
    Krish, K. R.
    Khasymski, Aleksandr
    Wang, Guanying
    Butt, Ali R.
    Makkar, Gaurav
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2013,
  • [3] Caching and database scaling in distributed shared-nothing information retrieval systems
    Tomasic, Anthony
    Garcia-Molina, Hector
    [J]. SIGMOD Record, 1993, 22 (02) : 129 - 138
  • [4] Performance issues in distributed shared-nothing information-retrieval systems
    Tomasic, A
    GarciaMolina, H
    [J]. INFORMATION PROCESSING & MANAGEMENT, 1996, 32 (06) : 647 - 665
  • [5] ACTDP: An Adaptive Chunk Tool for Database Partition in Shared-nothing Distributed Database
    Huang, Xiaoming
    Shen, Zhen
    [J]. PROCEEDINGS OF 2018 IEEE 9TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS), 2018, : 903 - 906
  • [6] TriAD: A Distributed Shared-Nothing RDF Engine based on Asynchronous Message Passing
    Gurajada, Sairam
    Seufert, Stephan
    Miliaraki, Iris
    Theobald, Martin
    [J]. SIGMOD'14: PROCEEDINGS OF THE 2014 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2014, : 289 - 300
  • [7] Composite Key Generation on a Shared-Nothing Architecture
    Hoffmann, Marie
    Alexandrov, Alexander
    Andritsos, Periklis
    Soto, Juan
    Markl, Volker
    [J]. PERFORMANCE CHARACTERIZATION AND BENCHMARKING: TRADITIONAL TO BIG DATA, 2015, 8904 : 188 - 203
  • [8] Nearest Neighbor Queries in Shared-Nothing Environments
    Papadopoulos A.
    Manolopoulos Y.
    [J]. GeoInformatica, 1997, 1 (4) : 369 - 392
  • [9] Osprey: Implementing MapReduce-Style Fault Tolerance in a Shared-Nothing Distributed Database
    Yang, Christopher
    Yen, Christine
    Tan, Ceryen
    Madden, Samuel R.
    [J]. 26TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING ICDE 2010, 2010, : 657 - 668
  • [10] Parallelizing Query Optimization on Shared-Nothing Architectures
    Trummer, Immanuel
    Koch, Christoph
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2016, 9 (09): : 660 - 671