Mining the Associated Patterns in Big Data Using Hadoop Cluster

被引:0
|
作者
Asha, P. [1 ]
Jacob, T. Prem [1 ]
Pravin, A. [1 ]
Asbern, A. [2 ]
机构
[1] Sathyabama Inst Sci & Technol, Dept Comp Sci & Engn, Chennai, Tamil Nadu, India
[2] Global Knowledge Network India Private Ltd, Chennai, Tamil Nadu, India
关键词
Big data; Hadoop; Data mining; Frequent item sets; Cluster; Associations;
D O I
10.1007/978-3-030-03146-6_147
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
The level of data usage goes on increasing day by day in every aspect of life, the notion of data mining and Big data lies in the fact that, how the related (associated) pattern or the information is maintained and reused. This doesn't mean it can only be implemented in the huge volume of data. It can be applied to all fields of data collection, but the relative need is the association existing between the data sets. There exists n number of methods to find the associations between the data, but comforting them to scale up with the big data seems really challenging. The paper aims at retrieving the recurrent patterns with respect to big datasets. Apriori algorithm is used to fetch the associated patterns and their performance enhancements over various data sets were evaluated.
引用
收藏
页码:1255 / 1263
页数:9
相关论文
共 50 条
  • [1] Big Data Analysis Using Hadoop Cluster
    Saldhi, Ankita
    Goel, Abhinav
    Yadav, Dipesh
    Saldhi, Ankur
    Saksena, Dhruv
    Indu, S.
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMPUTING RESEARCH (IEEE ICCIC), 2014, : 572 - 575
  • [2] A Big Data Framework for Mining Sensor Data Using Hadoop
    El-Shafeiy, Engy A.
    El-Desouky, Ali I.
    [J]. STUDIES IN INFORMATICS AND CONTROL, 2017, 26 (03): : 365 - 376
  • [3] Performance Evaluation Of Association Mining In Hadoop Single Node Cluster With Big Data
    Asbern, A.
    Asha, P.
    [J]. 2015 INTERNATIONAL CONFERENCED ON CIRCUITS, POWER AND COMPUTING TECHNOLOGIES (ICCPCT-2015), 2015,
  • [4] Inverted Indexing In Big Data Using Hadoop Multiple Node Cluster
    Velusamy, Kaushik
    Vijayaraju, Nivetha
    Venkitaramanan, Deepthi
    Suresh, Greeshma
    Madhu, Divya
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2013, 4 (11) : 156 - 161
  • [5] Big Data Mining: In-Database Oracle Data Mining over Hadoop
    Kovacheva, Zlatinka
    Naydenova, Ina
    Kaloyanova, Kalinka
    Markov, Krasimir
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON NUMERICAL ANALYSIS AND APPLIED MATHEMATICS 2016 (ICNAAM-2016), 2017, 1863
  • [6] Big Data: Mining of Log File through Hadoop
    Kotiyal, Bina
    Kumar, Ankit
    Pant, Bhaskar
    Goudar, R. H.
    [J]. 2013 INTERNATIONAL CONFERENCE ON HUMAN COMPUTER INTERACTIONS (ICHCI), 2013,
  • [7] Text Mining For Educational Literature On Big Data With Hadoop
    Wang, Haoge
    Wang, Quanyu
    Wang, Wenming
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD), 2018, : 166 - 170
  • [8] Hadoop Based Scalable Cluster Deduplication for Big Data
    Liu, Qing
    Fu, Yinjin
    Ni, Guiqiang
    Hou, Rui
    [J]. 2016 IEEE 36TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW 2016), 2016, : 98 - 105
  • [9] Mining Algorithm for Association Rules in Big Data Based on Hadoop
    Fu, Chunhua
    Wang, Xiaojing
    Zhang, Lijun
    Qiao, Liying
    [J]. ADVANCES IN MATERIALS, MACHINERY, ELECTRONICS II, 2018, 1955
  • [10] Security framework using Hadoop for Big Data
    Johri, Prashant
    Kumar, Arun
    Das, Sanjoy
    Arora, Sanchita
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND AUTOMATION (ICCCA), 2017, : 268 - 272