A MapReduce-based Fuzzy Associative Classifier for Big Data

被引:0
|
作者
Ducange, Pietro [1 ]
Marcelloni, Francesco [2 ]
Segatori, Armando [2 ]
机构
[1] ECampus Univ, Fac Ingn, I-22060 Novedrate, Italy
[2] Univ Pisa, Dip Ingn Informaz, I-56122 Pisa, Italy
关键词
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose an efficient distributed fuzzy associative classification model based on the MapReduce paradigm. The learning algorithm first mines a set of fuzzy association classification rules by employing a distributed version of a fuzzy extension of the well-known FP-Growth algorithm. Then, it prunes this set by using three purposely adapted types of pruning. We implemented the distributed fuzzy associative classifier using the Hadoop framework. We show the scalability of our approach by carrying out a number of experiments on a real-world big dataset. In particular, we evaluate the achievable speedup on a small computer cluster, highlighting that the proposed approach allows handling big datasets even with modest hardware support.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Research on MapReduce-based fuzzy associative classifier for big probabilistic numerical data
    Pei, Bin
    Wang, Fenmei
    Wang, Xiuzhen
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON INTERNET OF THINGS (ITHINGS) AND IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) AND IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) AND IEEE SMART DATA (SMARTDATA), 2016, : 903 - 906
  • [2] Knowledge process of health big data using MapReduce-based associative mining
    Choi, So-Young
    Chung, Kyungyong
    [J]. PERSONAL AND UBIQUITOUS COMPUTING, 2020, 24 (05) : 571 - 581
  • [3] Knowledge process of health big data using MapReduce-based associative mining
    So-Young Choi
    Kyungyong Chung
    [J]. Personal and Ubiquitous Computing, 2020, 24 : 571 - 581
  • [4] A MapReduce-Based ELM for Regression in Big Data
    Wu, B.
    Yan, T. H.
    Xu, X. S.
    He, B.
    Li, W. H.
    [J]. INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2016, 2016, 9937 : 164 - 173
  • [5] Atrak: a MapReduce-based data warehouse for big data
    Barkhordari, Mohammadhossein
    Niamanesh, Mahdi
    [J]. JOURNAL OF SUPERCOMPUTING, 2017, 73 (10): : 4596 - 4610
  • [6] Atrak: a MapReduce-based data warehouse for big data
    Mohammadhossein Barkhordari
    Mahdi Niamanesh
    [J]. The Journal of Supercomputing, 2017, 73 : 4596 - 4610
  • [7] A Distributed Fuzzy Associative Classifier for Big Data
    Segatori, Armando
    Bechini, Alessio
    Ducange, Pietro
    Marcelloni, Francesco
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (09) : 2656 - 2669
  • [8] FUZZY ASSOCIATIVE CLASSIFIER FOR BIG DATA APPLICATIONS
    Cabezas, Eduardo Francisco Garcia
    Alulema, Julio Cesar Moyano
    Ramos, Jhonny Marcelo Orozco
    Lozano, Angel Geovanni Guaman
    Martinez, Juan Carlos Cayan
    [J]. RUSSIAN LAW JOURNAL, 2023, 11 (06) : 683 - 692
  • [9] Verifying Properties of MapReduce-Based Big Data Processing
    Zhang, Nan
    Wang, Meng
    Duan, Zhenhua
    Tian, Cong
    [J]. IEEE TRANSACTIONS ON RELIABILITY, 2022, 71 (01) : 321 - 338
  • [10] Distributed Big Data Clustering using MapReduce-based Fuzzy C-Medoids
    Sardar T.H.
    Ansari Z.
    [J]. Journal of The Institution of Engineers (India): Series B, 2022, 103 (01): : 73 - 82