An Efficient Load Balancing Multi-core Frequent Patterns Mining Algorithm

被引:12
|
作者
Yu, Kun-Ming [1 ]
Wu, Shu-Hao [1 ]
机构
[1] Chung Hua Univ, Dept Comp Sci & Informat Engn, Hsinchu, Taiwan
关键词
multi-core; frequent pattern mining; load balancing; association rules;
D O I
10.1109/TrustCom.2011.192
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Mining frequent pattern from transactional database is an important problem in data mining. Many methods have been proposed to solve this problem. However, the computation time still increase significantly while the data size grows. Therefore, parallel computing is a good strategy to solve this problem. Researchers have proposed various parallel and distributed algorithms on cluster system, grid system. However, the construction and maintenance cost is pretty high. In this paper, a multi-core load balancing frequent pattern mining algorithm is presented. The main goal of the proposed algorithm is to reduce the massive duplicated candidates generated in previous method. In order to verify the performance, we also implemented the proposed algorithm as well as previous methods for comparison. The experimental results showed that our method could reduce the computation time dramatically with more threads. Moreover, we could observe that the workload was equally dispatched to each computing unit.
引用
收藏
页码:1408 / 1412
页数:5
相关论文
共 50 条
  • [1] An Efficient Mining Algorithm of Closed Frequent Itemsets on Multi-core Processor
    Phan, Huan
    [J]. ADVANCED DATA MINING AND APPLICATIONS, ADMA 2019, 2019, 11888 : 107 - 118
  • [2] An efficient method for mining frequent sequential patterns using multi-Core processors
    Bao Huynh
    Bay Vo
    Vaclav Snasel
    [J]. Applied Intelligence, 2017, 46 : 703 - 716
  • [3] An efficient method for mining frequent sequential patterns using multi-Core processors
    Huynh, Bao
    Vo, Bay
    Snasel, Vaclav
    [J]. APPLIED INTELLIGENCE, 2017, 46 (03) : 703 - 716
  • [4] An Efficient Parallel Algorithm for Mining Both Frequent Closed and Generator Sequences on Multi-core Processors
    Hai Duong
    Tin Truong
    Bac Le
    [J]. PROCEEDINGS OF 2018 5TH NAFOSTED CONFERENCE ON INFORMATION AND COMPUTER SCIENCE (NICS 2018), 2018, : 154 - 159
  • [5] A novel multi-core algorithm for frequent itemsets mining in data streams
    Bustio-Martinez, Lazaro
    Munoz-Briseno, Alfredo
    Cumplido, Rene
    Hernandez-Leon, Raudel
    Feregrino-Uribe, Claudia A.
    [J]. PATTERN RECOGNITION LETTERS, 2019, 125 : 241 - 248
  • [6] Dynamic Load Balancing Algorithm for Heterogeneous Multi-Core Processors Cluster
    Sharma, Rajkumar
    Kanungo, Priyesh
    [J]. 2014 FOURTH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT), 2014, : 288 - 292
  • [7] Adaptive Load Balancing on Multi-core IPsec Gateway
    Li, Wei
    Hu, Shengjie
    Sun, Guanchao
    Li, Yunchun
    [J]. ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2018, PT I, 2018, 11334 : 215 - 228
  • [8] A load-balancing algorithm for cluster-based multi-core web servers
    You, Guohua
    Zhao, Ying
    [J]. Journal of Computational Information Systems, 2011, 7 (13): : 4740 - 4747
  • [9] A topology-aware load balancing algorithm for clustered hierarchical multi-core machines
    Pilla, Laercio L.
    Ribeiro, Christiane P.
    Coucheney, Pierre
    Broquedis, Francois
    Gaujal, Bruno
    Navaux, Philippe O. A.
    Mehaut, Jean-Francois
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2014, 30 : 191 - 201
  • [10] Parallel Optimization of Frequent Algorithm on Multi-core Processors
    Zhang, Yu
    Zhang, Jianzhong
    Xu, Jingdong
    Wu, Ying
    [J]. 2012 INTERNATIONAL CONFERENCE ON CONTROL ENGINEERING AND COMMUNICATION TECHNOLOGY (ICCECT 2012), 2012, : 295 - 299