An Improved Fuzzy C-Means Algorithm Based on MapReduce

被引:0
|
作者
Yu, Qing [1 ]
Ding, Zhimin [1 ]
机构
[1] Tianjin Univ Technol, Tianjin Key Lab Intelligence Comp & Network Secur, Tianjin, Peoples R China
关键词
Clustering; The Fuzzy C-means algorithm; a Max-min Principle; The Canopy algorithm; MapReduce;
D O I
暂无
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
In order to solve the problem that the Fuzzy C-Means algorithm is sensitive to the initial clustering center, we use the Canopy algorithm to carry out the quick and rough clustering. At the same time, to avoid the blindness of the Canopy algorithm, we put forward an improved Canopy-FCM algorithm based on a max-min principle. In allusion to the problem that the FCM algorithm has high time complexity, this article use the parallel computing frame of MapReduce to design and realize the improved Canopy-FCM algorithm. Experimental results show: the improved Canopy-FCM algorithm based on MapReduce has better clustering quality and running speed than the Canopy-FCM and the FCM algorithm based on MapReduce, and the improved Canopy-FCM algorithm based on Hadoop has better speed-up ratio than the Canopy-FCM based on the Standalone mode.
引用
收藏
页码:634 / 638
页数:5
相关论文
共 50 条
  • [1] MapReduce-based Fuzzy C-means Algorithm for Distributed Document Clustering
    Sardar T.H.
    Ansari Z.
    [J]. Journal of The Institution of Engineers (India): Series B, 2022, 103 (01): : 131 - 142
  • [2] MapReduce-based fuzzy c-means clustering algorithm: implementation and scalability
    Ludwig, Simone A.
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2015, 6 (06) : 923 - 934
  • [3] MapReduce-based fuzzy c-means clustering algorithm: implementation and scalability
    Simone A. Ludwig
    [J]. International Journal of Machine Learning and Cybernetics, 2015, 6 : 923 - 934
  • [4] Improved fuzzy C-means algorithm based on density peak
    Xiang-yi Liu
    Jian-cong Fan
    Zi-wen Chen
    [J]. International Journal of Machine Learning and Cybernetics, 2020, 11 : 545 - 552
  • [5] An Improved Fuzzy C-means Clustering Algorithm
    Duan, Lingzi
    Yu, Fusheng
    Zhan, Li
    [J]. 2016 12TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2016, : 1199 - 1204
  • [6] Intrusion Detection Based on Improved Fuzzy C-means Algorithm
    Jiang, Wei
    Yao, Min
    Yan, Jun
    [J]. ISISE 2008: INTERNATIONAL SYMPOSIUM ON INFORMATION SCIENCE AND ENGINEERING, VOL 2, 2008, : 326 - +
  • [7] Improved fuzzy C-means algorithm based on density peak
    Liu, Xiang-yi
    Fan, Jian-cong
    Chen, Zi-wen
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2020, 11 (03) : 545 - 552
  • [8] An Improved Fuzzy C-means Clustering Algorithm Based on Simulated Annealing
    Liu, Peiyu
    Duan, Linshan
    Chi, Xuezhi
    Zhu, Zhenfang
    [J]. 2013 10TH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (FSKD), 2013, : 39 - 43
  • [9] An Improved Generalized Fuzzy C-Means Clustering Algorithm Based on GA
    Ma, Wenping
    Ge, Xiaohua
    Jiao, Licheng
    [J]. INTELLIGENT SCIENCE AND INTELLIGENT DATA ENGINEERING, ISCIDE 2011, 2012, 7202 : 599 - 606
  • [10] Improved Fuzzy C-Means Clustering Algorithm Based on Particle Swarm Optimization Algorithm
    Hu, Quan
    Zheng, Kai
    Wang, Zheng
    [J]. INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2016, 2016, 9937 : 617 - 623