Efficient Implementation of Apriori Algorithm on HDFS using GPU

被引:0
|
作者
Tiwary, Mayank [1 ]
Sahoo, Abhaya Kumar [1 ]
Misra, Rachita [1 ]
机构
[1] CV Raman Coll Engn, Dept Informat Technol, Bhubaneswar, Orissa, India
关键词
Hadoop; Map-reduce; CUDA; GPU; Apriori;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A very efficient distributed processing framework is provided by Hadoop. For processing big data, Hadoop uses map-reduce programming model. The proposed technique uses parallel apriori map-reduce algorithm using high performance GPU. The computationally intensive operations of mapping phase are offloaded to GPU. Apriori is a very basic data mining algorithm which is used to determine the frequent item sets in the transactional database. In Hadoop, big transactional database are stored in structured form. When the size of transactional database is big, very fast apriori technique is required to solve the problem. Past researches show a clear view of solving data mining operations in heterogeneous environment which increase the performance with a very high rate than older serial execution techniques. This paper introduces integration of GPU in map-reduce programming model to solve the apriori data mining technique in a very time efficient manner. For our experimental implementation, we use NVIDIA's GPU and for the integration process, we use JCUDA and JNI.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] AN EFFICIENT IMPLEMENTATION OF SMITH WATERMAN ALGORITHM ON GPU USING CUDA, FOR MASSIVELY PARALLEL SCANNING OF SEQUENCE DATABASES
    Ligowski, Lukasz
    Rudnicki, Witold
    2009 IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL & DISTRIBUTED PROCESSING, VOLS 1-5, 2009, : 1602 - +
  • [22] Parallel implementation of Apriori algorithm based on MapReduce
    Li N.
    Zeng L.
    He Q.
    Shi Z.
    International Journal of Networked and Distributed Computing, 2013, 1 (2) : 89 - 96
  • [23] Parallel Implementation of Apriori Algorithm Based on MapReduce
    Li, Ning
    Zeng, Li
    He, Qing
    Shi, Zhongzhi
    INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2013, 1 (02) : 89 - 96
  • [24] High Performance Implementation of APSO Algorithm using GPU Platform
    Ziyabari, Seyyedeh Hamideh Sojoudi
    Shahbahrami, Asadollah
    2015 INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND SIGNAL PROCESSING (AISP), 2015, : 196 - 200
  • [25] An Efficient Implementation of Fuzzy Edge Detection using GPU in MATLAB
    Hoseini, Farnaz
    Shahbahrami, Asadollah
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS 2015), 2015, : 605 - 610
  • [26] An efficient quantum circuit implementation of Shor's algorithm for GPU accelerated simulation
    Tan, XinJian
    Gao, Peng
    AIP ADVANCES, 2024, 14 (02)
  • [27] A RIGOROUS AND EFFICIENT GPU IMPLEMENTATION OF LEVEL-SET SPARSE FIELD ALGORITHM
    Galluzzo, Francesca
    Speciale, Nicolo
    Bernard, Olivier
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 1705 - 1708
  • [28] An Efficient Transaction-based GPU Implementation of Minimum Spanning Forest Algorithm
    Manoochehri, Shayan
    Goodarzi, Bahareh
    Goswami, Dhrubajyoti
    2017 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2017, : 643 - 650
  • [29] EFFICIENT IMPLEMENTATION OF INSAR TIME-CONSUMING ALGORITHM KERNELS ON GPU ENVIRONMENT
    Guerriero, Andrea
    Anelli, Vito Walter
    Pagliara, Alessandro
    Nutricato, Raffaele
    Nitti, Davide Oscar
    2015 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2015, : 4264 - 4267
  • [30] A Memory-Access-Efficient Implementation of the Approximate String Matching Algorithm on GPU
    Nunes, Lucas S. N.
    Bordim, J. L.
    Nakano, K.
    Ito, Y.
    2016 FOURTH INTERNATIONAL SYMPOSIUM ON COMPUTING AND NETWORKING (CANDAR), 2016, : 483 - 489