Distributed frequent subgraph mining on evolving graph using SPARK

被引:3
|
作者
Senthilselvan, N. [1 ]
Subramaniyaswamy, V. [1 ]
Vijayakumar, V. [2 ]
Karimi, Hamid Reza [3 ]
Aswin, N. [1 ]
Ravi, Logesh [4 ]
机构
[1] SASTRA Deemed Univ, Sch Comp, Thanjavur, India
[2] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW, Australia
[3] Politecn Milan, Dept Mech Engn, Milan, Italy
[4] Sri Ramachandra Inst Higher Educ & Res, Sri Ramachandra Fac Engn & Technol, Chennai, Tamil Nadu, India
关键词
ALGORITHM; PATTERNS;
D O I
10.3233/IDA-194601
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Within the graph mining context, frequent subgraph identification plays a key role in retrieving required information or patterns from the huge amount of data in a short period. The problem of finding frequent items in traditional mining changed to the innovation of subgraphs that recurrently occurs in graph datasets containing a single huge graph. Majority of the existing methods target static graphs, and the distributed solution for dynamic graphs has not been explored. But, in modern applications like Facebook, robotics utilizes large evolving graphs. The goal is to design a method to find recurrent subgraphs from a single large evolving graph. In this research paper, a novel approach is proposed called DFSME, which uses SPARK to discover frequent subgraphs from an evolving graph in a distributed environment. DFSME maintains a set of subgraphs between frequent and infrequent subgraphs, which is used to decrease the search space. Our experiments with synthetic and real-world datasets authorize the effectiveness of DFSME for mining of recurrent subgraphs from huge evolving graph datasets. © 2020 - IOS Press and the authors. All rights reserved.
引用
收藏
页码:495 / 513
页数:19
相关论文
共 50 条
  • [1] A Parallel Approach for Frequent Subgraph Mining in a Single Large Graph Using Spark
    Qiao, Fengcai
    Zhang, Xin
    Li, Pei
    Ding, Zhaoyun
    Jia, Shanshan
    Wang, Hui
    [J]. APPLIED SCIENCES-BASEL, 2018, 8 (02):
  • [2] FSMBUS: A frequent subgraph mining algorithm in single large-scale graph using spark
    Yan, Yuliang
    Dong, Yihong
    He, Xianmang
    Wang, Wei
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2015, 52 (08): : 1768 - 1783
  • [3] Distributed Frequent Subgraph Mining Using Gaston and MapReduce
    Rao, Jagannadha D. B.
    [J]. INTERNATIONAL JOURNAL ON SEMANTIC WEB AND INFORMATION SYSTEMS, 2021, 17 (02) : 41 - 58
  • [4] Online Structural Graph Clustering Using Frequent Subgraph Mining
    Seeland, Madeleine
    Girschick, Tobias
    Buchwald, Fabian
    Kramer, Stefan
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT III, 2010, 6323 : 213 - 228
  • [5] A novel temporal frequent subgraph based mining algorithm using spark
    Ali, Aamir
    Asim, Muhammad
    [J]. INTELLIGENT DECISION TECHNOLOGIES-NETHERLANDS, 2021, 15 (04): : 599 - 608
  • [6] Incremental Frequent Subgraph Mining on Large Evolving Graphs
    Abdelhamid, Ehab
    Canim, Mustafa
    Sadoghi, Mohammad
    Bhattacharjee, Bishwaranjan
    Chang, Yuan-Chi
    Kalnis, Panos
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2017, 29 (12) : 2710 - 2723
  • [7] A Distributed Approach to Weighted Frequent Subgraph Mining
    Babu, Nisha
    John, Ansamma
    [J]. IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGICAL TRENDS IN COMPUTING, COMMUNICATIONS AND ELECTRICAL ENGINEERING (ICETT), 2016,
  • [8] SparkFSM: A Highly Scalable Frequent Subgraph Mining Approach using Apache Spark
    Jena, Bismita S.
    Khan, Cynthia
    Sunderraman, Rajshekhar
    [J]. 2018 18TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2018, : 990 - 997
  • [9] Weighted Frequent Subgraph Mining using Affinity Weighing in Distributed Environment
    Kumar, Vipul
    Gupta, Daya
    [J]. 2017 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND DATA SCIENCE (MLDS 2017), 2017, : 136 - 140
  • [10] Large Graph Sampling Algorithm for Frequent Subgraph Mining
    Zheng, Tianyu
    Li Wang
    [J]. IEEE ACCESS, 2021, 9 : 88970 - 88980