A Parallel Algorithm of Association Rules Based on Cloud Computing

被引:0
|
作者
Wang Yong [1 ]
Zhang Zhe [1 ]
Wang Fang [2 ]
机构
[1] Guilin Univ Elect Technol, Dept Comp Sci & Engn, Guilin, Peoples R China
[2] Guilin Univ Elect Technol, Sch Informat & Commun, Guilin, Peoples R China
关键词
FP-growth; Parallel Computing; Cloud Computing; MapReduce; Association Rules;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In view of the traditional parallel FP-growth algorithm (PFP) that suffers from two major limitations, namely, multiple database scans requirement (i.e., high I/O cost) and high inter-processor communications cost, therefore we design and implement a parallel association rules mining method based on cloud computing. The algorithm adopts the separation strategy to simply visit a local database only once, thus, the inter-processor communication I/O overhead is reduced. What's more, the MapReduce model is used to solve the problem of huge amounts of data mining, as well as the calculated execution taking place in the local data storage node, which can avoid large amounts of data on the network transmission and reduce the communication overhead. By using ordinary PC structures, Hadoop cluster experimental results verify that the proposed algorithm based on cloud computing offers higher efficiency and has a good speedup.
引用
收藏
页码:415 / 419
页数:5
相关论文
共 50 条
  • [1] Fast Mining Algorithm of Association Rules Base on Cloud Computing
    He, Bo
    [J]. PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON ELECTRONIC & MECHANICAL ENGINEERING AND INFORMATION TECHNOLOGY (EMEIT-2012), 2012, 23
  • [2] Association rules mining in parallel conditional tree based on grid computing inspired partition algorithm
    Wang, Chunzhi
    Bian, Wenshuo
    Wang, Ruoxi
    Chen, Hongwei
    Ye, Zhiwei
    Yan, Lingyu
    [J]. INTERNATIONAL JOURNAL OF WEB AND GRID SERVICES, 2020, 16 (03) : 321 - 339
  • [3] An Algorithm of Mining Association Rules Based on Granular Computing
    Cao, Xiaojun
    [J]. 2012 INTERNATIONAL CONFERENCE ON MEDICAL PHYSICS AND BIOMEDICAL ENGINEERING (ICMPBE2012), 2012, 33 : 1248 - 1253
  • [4] A Improved Attribute Anonymity Algorithm Based on Association Rules and Support Vector Machines in Cloud Computing Environment
    Fan, Liqiang
    Li, Wensheng
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2019, 124 : 285 - 286
  • [5] Parallel Collaborative Filtering Recommendation Algorithm based on Cloud Computing
    Zhang, Guohua
    Bao, Feng
    Bai, Sheng
    [J]. INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 2016, 9 (07): : 169 - 176
  • [6] Implementation of a Parallel Algorithm Based on a Spark Cloud Computing Platform
    Wang, Longhui
    Wang, Yong
    Xie, Yudong
    [J]. ALGORITHMS, 2015, 8 (03): : 407 - 414
  • [7] A Parallel Domain Decomposition FDTD Algorithm Based on Cloud Computing
    Lin, Haiming
    Liu, Xiaohu
    Jia, Kangyu
    Fu, Wei
    [J]. PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CLOUD COMPUTING COMPANION (ISCC-C), 2014, : 252 - 259
  • [8] Toward the association rules of meteorological data mining based on cloud computing
    Liu, Limin
    Lv, Jie
    Ma, Zhiqiang
    Wan, Jianxiong
    Jingjing, Ma
    [J]. Lecture Notes in Electrical Engineering, 2015, 334 : 1051 - 1059
  • [9] Parallel Analysis on Clustering Algorithm Based on Hadoop Cloud Computing Platform
    OuYang, Baicheng
    [J]. 2016 ISSGBM INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATION AND SOCIAL SCIENCES (ISSGBM-ICS 2016), PT 3, 2016, 68 : 499 - 502
  • [10] Parallel algorithm of multiobjective optimization harmony search based on cloud computing
    Li W.
    Du W.
    Tang W.
    Pan Y.
    Zhou J.
    Lin Z.
    [J]. Li, Wenjing (liwjgood@126.com), 2017, SAGE Publications Inc. (11): : 301 - 313