The Study of Improved FP-Growth Algorithm in MapReduce

被引:0
|
作者
Sun, Hong [1 ]
Zhang, Huaxuan [1 ]
Chen, Shiping [2 ]
Hu, Chunyan [2 ]
机构
[1] Shanghai Univ Sci & Technol, Shanghai Key Lab Modern Opt Syst, Shanghai 201800, Peoples R China
[2] Shanghai Univ Sci & Technol, Shanghai 201800, Peoples R China
基金
中国国家自然科学基金;
关键词
FP-Growth; IFP algorithm; MapReduce Introduction;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As FP-Growth algorithm generates a great deal of conditional pattern bases and conditional pattern trees, leading to low efficiency, propose an improved FP-Growth(IFP) algorithm which firstly combine the same patterns based on the situation whether the support of the transaction is greater than the minimum support(min_sup) to mine the frequent patterns. Thus the IFP cuts down on the space and improves the efficiency. It also makes it easy to be paralleled. Further more, combine the IFP algorithm with the MapReduce computing model, named MR-IFP(MapReduce-Improved FP), to improve the capability to deal with the mass data.
引用
收藏
页码:250 / 253
页数:4
相关论文
共 50 条
  • [1] AN OPTIMISED FP-GROWTH ALGORITHM USING MAPREDUCE PARADIGMS
    Wu, Xiuguo
    [J]. JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2021, 22 (10) : 2127 - 2137
  • [2] FP-growth algorithm based on Boolean matrix and MapReduce
    College of Computer, Sichuan University, Chengdu 610065, Sichuan, China
    [J]. Huanan Ligong Daxue Xuebao, 1 (135-141):
  • [3] A heuristic approach for load balancing the FP-growth algorithm on MapReduce
    Bagui, Sikha
    Devulapalli, Keerthi
    Coffey, John
    [J]. Bagui, Sikha (bagui@uwf.edu), 1600, Elsevier B.V. (07):
  • [4] FP-Growth算法MapReduce化研究
    吕雪骥
    李龙澍
    [J]. 计算机技术与发展, 2012, 22 (11) : 123 - 126
  • [5] An Improved FP-Growth Algorithm Based on SOM Partition
    Jia, Kuikui
    Liu, Haibin
    [J]. DATA SCIENCE, PT 1, 2017, 727 : 166 - 178
  • [6] Parallelization of FP-growth Algorithm for Mining Probabilistic Numerical Data based on MapReduce
    Pei, Bin
    Wang, Xiuzhen
    Wang, Fenmei
    [J]. PROCEEDINGS OF 2016 9TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 2, 2016, : 223 - 226
  • [7] Correlation Failure Analysis Based on the Improved FP-Growth Algorithm
    Wang, Yanhui
    Wang, Shujun
    Lin, Shuai
    [J]. PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON ELECTRICAL AND INFORMATION TECHNOLOGIES FOR RAIL TRANSPORTATION: TRANSPORTATION, 2016, 378 : 135 - 145
  • [8] Research of Improved FP-Growth Algorithm in Association Rules Mining
    Zeng, Yi
    Yin, Shiqun
    Liu, Jiangyue
    Zhang, Miao
    [J]. SCIENTIFIC PROGRAMMING, 2015, 2015
  • [9] An Improved FP-growth Algorithm Based on Compound Single Linked List
    Ding Zhenguo
    Wei Qinqin
    Ding Xianhua
    [J]. ICIC 2009: SECOND INTERNATIONAL CONFERENCE ON INFORMATION AND COMPUTING SCIENCE, VOL 1, PROCEEDINGS: COMPUTING SCIENCE AND ITS APPLICATION, 2009, : 351 - 353
  • [10] Data Analysis of Tyre Quality Based on Improved FP-Growth Algorithm
    Li, Minbo
    Ding, Duo
    Yi, Yong
    [J]. Zhongguo Jixie Gongcheng/China Mechanical Engineering, 2019, 30 (02): : 244 - 251