Performance analysis of MapReduce Programs on Hadoop cluster

被引：0

作者：

Maurya, Mahesh ^{[1
]}

Mahajan, Sunita ^{[2
]}

机构：

[1] JJT Univ, MPSTME, Bombay, Maharashtra, India

[2] MET, Mumbai, Maharashtra, India

来源：

PROCEEDINGS OF THE 2012 WORLD CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGIES | 2012年

关键词：

Hadoop; MapReduce; HDFS; wordcount; grep;

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

This paper discusses various MapReduce applications like pi, wordcount, grep, Terasort. We have shown experimental results of these applications on a Hadoop cluster. In this paper, performance of above application has been shown with respect to execution time and number of nodes. We find that as the number of nodes increases the execution time decreases. This paper is basically a research study of above MapReduce applications.

引用

页码：505 / 510

页数：6

共 50 条

[1] Performance Analysis of MapReduce on OpenStack-based Hadoop Virtual Cluster
Ahmad, Nazrul M.
Yaacob, Asrul Hadi
Amin, Anang Hudaya Muhamad
Kannan, Subarmaniam
[J]. 2014 IEEE 2ND INTERNATIONAL SYMPOSIUM ON TELECOMMUNICATION TECHNOLOGIES (ISTT), 2014, : 132 - 137
[2] Performance Modelling and Analysis of MapReduce/Hadoop Workloads
Yu, Xiaolong
Li, Wei
[J]. 2015 IEEE 21ST INTERNATIONAL WORKSHOP ON LOCAL & METROPOLITAN AREA NETWORKS (LANMAN), 2015,
[3] Performance Analysis of Coupling Scheduler for MapReduce/Hadoop
Tan, Jian
Meng, Xiaoqiao
Zhang, Li
[J]. 2012 PROCEEDINGS IEEE INFOCOM, 2012, : 2586 - 2590
[4] A MapReduce Optimization Method on Hadoop Cluster
Wu, Xiaodong
[J]. 2015 INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS - COMPUTING TECHNOLOGY, INTELLIGENT TECHNOLOGY, INDUSTRIAL INFORMATION INTEGRATION (ICIICII), 2015, : 18 - 21
[5] A Performance Comparison of Apache Tez and MapReduce with Data Compression on Hadoop Cluster
Rattanaopas, Kritwara
[J]. PROCEEDINGS OF 2017 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (JCSSE), 2017,
[6] Performance optimization of MapReduce-based Apriori algorithm on Hadoop cluster
Singh, Sudhakar
Garg, Rakhi
Mishra, P. K.
[J]. COMPUTERS & ELECTRICAL ENGINEERING, 2018, 67 : 348 - 364
[7] Observations on Factors Affecting Performance of MapReduce based Apriori on Hadoop Cluster
Singh, Sudhakar
Garg, Rakhi
Mishra, P. K.
[J]. 2016 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND AUTOMATION (ICCCA), 2016, : 87 - 94
[8] Analyzing performance of Apache Tez and MapReduce with hadoop multinode cluster on Amazon cloud
Singh R.
Kaur P.J.
[J]. Journal of Big Data, 3 (1)
[9] Performance Improvement of MapReduce Framework by Identifying Slow TaskTrackers in Heterogeneous Hadoop Cluster
Naik, Nenavath Srinivas
Negi, Atul
Sastry, V. N.
[J]. PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING, NETWORKING AND INFORMATICS, ICACNI 2015, VOL 2, 2016, 44 : 465 - 473
[10] A Hadoop MapReduce Performance Prediction Method
Song, Ge
Meng, Zide
Huet, Fabrice
Magoules, Frederic
Yu, Lei
Lin, Xuelian
[J]. 2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 820 - 825

← 1 2 3 4 5 →