Research on Parallel Design of DBSCAN Clustering Algorithm in Spatial Data Mining

被引:0
|
作者
Zhou, Gong-jian [1 ]
机构
[1] Xiamen Univ, Tan Kah Kee Coll, Zhangzhou, Fujian, Peoples R China
关键词
Distributed computing; DBSCAN algorithm; Spark; MapReduce; Data segmentation;
D O I
暂无
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
DBSCAN clustering algorithm uses fixed Eps and Minpts. When density distribution is uneven, the effect of clustering is not ideal, and the time complexity of the algorithm is O (n(2)). To solve the above problems, this paper proposes a parallel grid clustering algorithm and two cluster merging strategies of DBSCAN based on Spark platform, will find the Eps neighborhood to narrow the scope of the eight adjacent cells within the data object, and the parallel execution of the local clustering data with fast global clustering. The experiment shows that the improved DBSCAN parallel algorithm has better acceleration ratio and extensibility.
引用
收藏
页码:343 / 348
页数:6
相关论文
共 50 条
  • [41] Privacy preserving DBSCAN algorithm for clustering
    Anil Kumar, K.
    Pandu Rangan, C.
    [J]. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2007, 4632 : 57 - 68
  • [42] Application of Improved DBSCAN Clustering Algorithm on Industrial Fault Text Data
    Wang, Xiaohan
    Zhang, Lin
    Zhang, Xuesong
    Xie, Kunyu
    [J]. 2020 IEEE 18TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), VOL 1, 2020, : 461 - 468
  • [43] Web Usage Data Clustering using Dbscan algorithm and Set similarities
    Santhisree, K.
    Damodaram, A.
    Appaji, S.
    NagarjunaDevi, D.
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON DATA STORAGE AND DATA ENGINEERING (DSDE 2010), 2010, : 220 - 224
  • [44] Fuzzy extensions of the DBScan clustering algorithm
    Dino Ienco
    Gloria Bordogna
    [J]. Soft Computing, 2018, 22 : 1719 - 1730
  • [45] A Clustering Algorithm Based on FDP and DBSCAN
    Wang, Zhihe
    Huang, Mengying
    Du, Hui
    Qin, Hongwu
    [J]. 2018 14TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2018, : 145 - 149
  • [46] Privacy preserving DBSCAN algorithm for clustering
    Kumar, K. Anil
    Rangan, C. Pandu
    [J]. ADVANCED DATA MINING AND APPLICATIONS, PROCEEDINGS, 2007, 4632 : 57 - +
  • [47] Fuzzy Core DBScan Clustering Algorithm
    Bordogna, Gloria
    Ienco, Dino
    [J]. INFORMATION PROCESSING AND MANAGEMENT OF UNCERTAINTY IN KNOWLEDGE-BASED SYSTEMS, PT III, 2014, 444 : 100 - 109
  • [48] Parallel DBSCAN Algorithm Using a Data Partitioning Strategy with Spark Implementation
    Han, Dianwei
    Agrawal, Ankit
    Liao, Wei-keng
    Choudhary, Alok
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 305 - 312
  • [49] Mining lidar data with spatial clustering algorithms
    Ghosh, Suddhasheel
    Lohani, Bharat
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2013, 34 (14) : 5119 - 5135
  • [50] Clustering Centroid Finding Algorithm (CCFA) using Spatial Temporal Data Mining Concept
    Baboo, S. Santhosh
    Tajudin, K.
    [J]. 2013 INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, INFORMATICS AND MEDICAL ENGINEERING (PRIME), 2013,