Efficient Implementation of Apriori Algorithm on HDFS using GPU

被引:0
|
作者
Tiwary, Mayank [1 ]
Sahoo, Abhaya Kumar [1 ]
Misra, Rachita [1 ]
机构
[1] CV Raman Coll Engn, Dept Informat Technol, Bhubaneswar, Orissa, India
关键词
Hadoop; Map-reduce; CUDA; GPU; Apriori;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A very efficient distributed processing framework is provided by Hadoop. For processing big data, Hadoop uses map-reduce programming model. The proposed technique uses parallel apriori map-reduce algorithm using high performance GPU. The computationally intensive operations of mapping phase are offloaded to GPU. Apriori is a very basic data mining algorithm which is used to determine the frequent item sets in the transactional database. In Hadoop, big transactional database are stored in structured form. When the size of transactional database is big, very fast apriori technique is required to solve the problem. Past researches show a clear view of solving data mining operations in heterogeneous environment which increase the performance with a very high rate than older serial execution techniques. This paper introduces integration of GPU in map-reduce programming model to solve the apriori data mining technique in a very time efficient manner. For our experimental implementation, we use NVIDIA's GPU and for the integration process, we use JCUDA and JNI.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] GPU-Accelerated Apriori Algorithm
    Jiang, Hao
    Xu, Chen-Wei
    Liu, Zhi-Yong
    Yu, Li-Yan
    4TH ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND APPLICATIONS (ITA 2017), 2017, 12
  • [2] A multi-GPU implementation of apriori algorithm for mining association rules in medical data
    School of Computer Science, Dalian University of Technology, No 2 Linggong Road, Dalian, China
    不详
    ICIC Express Lett., 5 (1303-1310):
  • [3] Efficient Implementation of the Bellman-Ford Algorithm on GPU
    Nazarifard, Marjan
    Bahrepour, Davoud
    2017 IEEE 4TH INTERNATIONAL CONFERENCE ON KNOWLEDGE-BASED ENGINEERING AND INNOVATION (KBEI), 2017, : 773 - 778
  • [4] Grid implementation of the Apriori algorithm
    Aflori, Cristian
    Craus, Mitica
    ADVANCES IN ENGINEERING SOFTWARE, 2007, 38 (05) : 295 - 300
  • [5] AN IMPLEMENTATION OF IMPROVED APRIORI ALGORITHM
    Yang, Gang
    Zhao, Hong
    Wang, Lei
    Liu, Ying
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 1565 - +
  • [6] EFFICIENT IMPLEMENTATION OF OPTICAL FLOW ALGORITHM BASED ON DIRECTIONAL FILTERS ON A GPU USING CUDA
    Hegner, Robert
    Austvoll, Ivar
    Ryen, Tom
    Schuster, Guido M.
    19TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO-2011), 2011, : 1529 - 1533
  • [7] Efficient GPU implementation of the multivariate empirical mode decomposition algorithm
    Wang, Zeyu
    Juhasz, Zoltan
    JOURNAL OF COMPUTATIONAL SCIENCE, 2023, 74
  • [8] IMPLEMENTATION OF IMPROVED APRIORI ALGORITHM IN INTERNAL
    Kumar, Vijay
    Gopal, Veni Devi
    IIOAB JOURNAL, 2016, 7 (09) : 97 - 105
  • [9] Design and Implementation of HDFS Data Encryption Scheme using ARIA Algorithm on Hadoop
    Song, Youngho
    Shin, Young-Sung
    Jang, Miyoung
    Chang, Jae-Woo
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2017, : 84 - 90
  • [10] EFFICIENT DICTIONARY LEARNING IMPLEMENTATION ON THE GPU USING OPENCL
    Irofti, Paul
    UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN SERIES C-ELECTRICAL ENGINEERING AND COMPUTER SCIENCE, 2016, 78 (03): : 39 - 50